Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Safeguards Enforcement Analyst, Account Takeover & Credential Abuse

$245k - $285k

Doist

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. About the role As a Safeguards Enforcement Analyst on the account abuse team, you will build and execute enforcement workflows that keep our products safe, focusing on detecting and mitigating potential harm. Your initial focus will be on account compromise, distinguishing customers whose accounts have been compromised from actors abusing the platform. You will own the problem end‑to‑end: detection, revocation, user notification, remediation, and criteria for restoring access. This position may expand into broader areas of enforcement over time. Key responsibilities Investigate credential‑compromise incidents across first‑party and third‑party platforms, tracing actor behavior across accounts and surfaces. Design and operate remediation workflows for compromised accounts: revocation, customer notification, and standards for restoring access. Partner with Engineering and Data Science teams to improve separation of compromised‑customer traffic from willful abuse. Enforce usage policies with a focus on detecting and mitigating potentially harmful use of AI systems. Work with threat intelligence on emerging credential‑abuse patterns and the actors behind them. Support the Safeguards policy design team by providing detailed feedback on policy gaps based on real enforcement scenarios. Keep up to date with emerging AI policy enforcement best practices and use these to inform decision‑making and workflows. Write the policy framework for compromise scenarios, including cases where Anthropic can’t independently verify a customer’s security posture. Act as the enforcement SME when account compromise intersects with active abuse investigations. Minimum qualifications Experience in trust and safety, fraud investigation, security operations, or a related field. Subject‑matter expertise in one or more of: account takeover, credential abuse, session security, or incident response. Experience designing or operating enforcement, remediation, or customer‑recovery flows – not just detection. Comfort using data (SQL or similar tools) to trace actor behavior across accounts and measure what's working. A thoughtful perspective on the tension between protecting the platform and restoring access for legitimate compromised customers. Strong written communication skills, with experience producing clear briefs about messy incidents for technical and non‑technical stakeholders. Excellent judgment and the ability to collaborate with team members while navigating rapidly evolving priorities and workstreams. Preferred qualifications Familiarity with credential‑theft ecosystems or threat intelligence tooling. Experience working with fraud/risk vendors (e.g., device or network intelligence platforms). Experience with API platform abuse specifically, not just consumer‑account ATO. A deep interest in AI safety and responsible technology development. Experience writing effective prompts for generative AI systems in a content review or enforcement context. Compensation Annual Salary: $245,000— $285,000USD Logistics Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience. Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience. Minimum years of experience: Correlates with the internal job level requirements for the position. Location‑based hybrid policy: Expect all staff to be in one of our offices at least 25% of the time; some roles may require more time in our offices. Visa sponsorship: We sponsor visas and will make every reasonable effort to obtain one if you receive an offer. #J-18808-Ljbffr Doist

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Safeguards Enforcement Analyst, Account Takeover & Credential Abuse in San Francisco, CA vacancy
  • Anthropic is seeking a Safeguards Enforcement Analyst to build and run enforcement workflows...  ...criteria for compromised accounts. Responsibilities include investigating credential‑compromise incidents,...  ...separate compromised traffic from abuse. #J-18808-Ljbffr Doist
    Accounts

    Doist

    San Francisco, CA
    2 days ago
  • Doist is seeking a Safeguards Enforcement Analyst on the account abuse team to build and execute enforcement workflows that keep our products safe, focusing on detecting and mitigating potential harm. You will drive enforcement areas including access controls and identity... 
    Accounts

    Doist

    San Francisco, CA
    2 days ago
  • $245k - $285k

    Position Overview As a Safeguards Enforcement Analyst on the account abuse team, you will build and execute enforcement workflows that keep our products safe, focusing on detecting and mitigating potential harm. Your initial focus will be recidivism: ensuring banned actors... 
    Accounts
    For contractors
    Work at office
    Visa sponsorship

    Doist

    San Francisco, CA
    2 days ago
  • $285k - $330k

    About the role As a Safeguards Enforcement Analyst on the account abuse team, you will build and execute enforcement workflows that keep our products safe, focusing on detecting and mitigating potential harm. You will drive enforcement areas including access controls and... 
    Accounts
    For contractors
    Work at office
    Visa sponsorship

    Doist

    San Francisco, CA
    2 days ago
  • $245k - $285k

    Role Overview An Anthropic Safeguards Enforcement Analyst on the user well‑being team is responsible for building and executing enforcement workflows...  ...age‑gating flows, age estimation signals, underage account detection, or appeals workflows. Experience advising or partnering... 
    Accounts
    Work at office
    Visa sponsorship
    Flexible hours

    Doist

    San Francisco, CA
    1 day ago
  • $285k - $330k

    Safeguards Enforcement Analyst, Cyber Harm Remote-Friendly, United States; San Francisco, CA | New York City...  ...Review flagged content and accounts to make accurate, well-documented enforcement...  ...performing content review, abuse investigations, or policy enforcement... 
    Accounts
    Work at office
    Remote work
    Visa sponsorship
    Flexible hours
    Weekend work

    Anthropic

    San Francisco, CA
    9 hours ago
  • Doist is seeking a Safeguards Enforcement Analyst on the account abuse team to build enforcement workflows that detect and mitigate harm, with an initial focus on recidivism and preventing re-registration by banned actors. You will own detection of returning actors, link... 
    Accounts

    Doist

    San Francisco, CA
    2 days ago
  • $285k - $330k

    Safeguards Enforcement Analyst, Integrity & Authenticity Remote-Friendly, United States; San Francisco, CA | New York City, NY | Washington, DC About...  ...influence operations and disinformation campaigns, the abuse of AI to interfere with electoral processes, and the use of... 
    Remote work
    Visa sponsorship
    Weekend work

    Anthropic

    San Francisco, CA
    1 day ago
  • $245k - $285k

    Safeguards Enforcement Analyst Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial...  ...processes we use to detect and respond to child sexual abuse material (CSAM) and child sexual exploitation material (... 
    Work at office
    Visa sponsorship
    Flexible hours

    Colorwave Inc

    San Francisco, CA
    1 day ago
  • $230k - $270k

     ...Safeguards Enforcement Analyst, Safety Evaluations Remote-Friendly (Travel-Required) | San Francisco, CA | Washington, DC; San Francisco, CA | New York City, NY About Anthropic Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want... 
    Work at office
    Remote work
    Visa sponsorship
    Flexible hours
    Shift work

    Anthropic

    San Francisco, CA
    4 days ago
  • Anthropic is seeking a Safeguards Enforcement Analyst in San Francisco to ensure our models meet safety standards. This role is remote-friendly but requires occasional travel. You will collaborate with various teams to manage evaluations and drive improvements. The ideal... 
    Remote work

    Anthropic

    San Francisco, CA
    2 days ago
  • $245k - $285k

    Safeguards Enforcement Analyst, Chem & Explosives Harms Remote-Friendly, United States; San Francisco, CA | New York City, NY | Washington, DC About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and... 
    Remote work
    Visa sponsorship

    Anthropic

    San Francisco, CA
    9 hours ago
  • $245k - $285k

    Safeguards Enforcement Analyst, Radiological & Nuclear Harms Remote-Friendly, United States; San Francisco, CA | New York City, NY | Washington, DC About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe... 
    Remote work
    Visa sponsorship

    Anthropic

    San Francisco, CA
    9 hours ago
  • Anthropic is seeking a Safeguards Enforcement Analyst to design scalable enforcement workflows and partner with engineering and data science teams to improve policy enforcement against AI-enabled influence operations and disinformation. The role involves reviewing content... 
    Remote work

    Anthropic

    San Francisco, CA
    1 day ago
  • Anthropic is seeking an Enforcement Analyst focused on Radiological & Nuclear Harms to protect against AI misuse in sensitive domains. You...  ...Policies, investigate potential violations, and strengthen safeguards across cross-functional teams including Policy, Threat Intelligence... 
    Work at office
    Remote work

    Anthropic

    San Francisco, CA
    9 hours ago
  • $245k - $285k

    Enforcement Analyst Focused on Bio Harms An Enforcement Analyst focused on bio harms will play a critical role in protecting against the misuse...  ...potential violations, and help continuously strengthen our safeguards. The work sits at the intersection of biosecurity threat... 
    Work at office
    Visa sponsorship
    Flexible hours

    Colorwave Inc

    San Francisco, CA
    1 day ago
  • $126k - $181k

    Enforcement Detection Analyst, YouTube, Trust and Safety Location: San Bruno, CA, USA Level: Mid - Experience...  ...deliverables. Experience in anti-abuse operations at scale. Preferred...  ...the abuse (why), methods to acquire accounts, gaps in our enforcement (how), etc.... 
    Accounts
    Full time
    Worldwide
    Weekend work

    Google

    San Bruno, CA
    1 day ago
  • $64k - $103k

     ...an excellent opportunity for a Conflicts Analyst II. This position could be based in any of...  ...and compliance matters. Employ and enforce risk management processes and procedures....  ...parental leave benefits, health savings account contributions (w/applicable medical plan)... 
    Accounts
    Temporary work
    Work at office
    Remote work
    Flexible hours

    Orrick Herrington & Suttcliffe

    San Francisco, CA
    9 hours ago
  •  ...Under direction of the Supervisor I, the Analyst II reviews and analyzes all formal...  ...encouraged to apply through your CalCareer Account at Electronic applications submitted...  ...application deadline. Foreign education credential evaluation services can be found at... 
    Accounts
    Permanent employment
    Full time
    Temporary work
    Work at office
    Remote work
    Monday to Friday
    2 days per week

    California Correctional Health Care Services

    San Francisco, CA
    3 days ago
  •  ...About This Job The Revenue Operations Analyst will be responsible for assisting our customer...  ...Provide direction and training to Account Executives, Customer Success Managers, and...  ...everything deal related Implement, document, enforce processes, and tools that will maintain... 
    Accounts
    Contract work

    Net2Source (N2S)

    San Francisco, CA
    2 days ago
  • $8.77k - $10.97k

    Customer Generation Analyst (JC-500388) Energy Division/ Customer Generation and Demand...  ...encouraged to apply through your CalCareer Account at Electronic applications submitted...  ...application deadline. Foreign education credential evaluation services can be found at Employment... 
    Accounts
    Full time
    Temporary work
    Local area
    Remote work

    California Public Utilities Commission

    San Francisco, CA
    9 hours ago
  • $65.8k - $106k

     ...processes and procedures* Technology: Salesforce, Portfolio Accounting Software, DocuSign, Microsoft Suite, Planning & Investment Software...  ...' degree in related field and working towards obtaining CFP credentials* Typically, 0-3 years’ experience**Competencies** -... 
    Accounts
    Permanent employment
    Temporary work
    Work at office
    Flexible hours

    Corient Private Wealth LLC.

    San Francisco, CA
    9 hours ago
  •  ...performing deep-dive troubleshooting on integrated systems, and enforcing robust data governance and security protocols. This role...  ...none specified) AllSTEM Representative Contact Info Account Executive: Nichols Branch Phone: (90... 
    Accounts
    Temporary work

    AllSTEM Connections

    San Francisco, CA
    4 days ago
  •  ...A state government agency is seeking a Paralegal - Health Quality Enforcement Senior Legal Analyst in San Francisco. This full-time role involves high-level legal work in state and federal court litigation, case management, and document analysis. The ideal candidate is... 
    Full time
    Flexible hours

    California Department of Justice

    San Francisco, CA
    1 day ago
  • $160k - $180k

     ...and detail-oriented Sales Compensation Analyst to own the administration and reconciliation...  ...audits of CRM opportunity stages and account ownership to ensure the commission system...  ...deliver 100% accuracy while confidently enforcing established plan policies. Proven... 
    Accounts
    Contract work
    Work at office
    Flexible hours
    3 days per week

    Postman

    San Francisco, CA
    2 days ago
  • $245k - $285k

     ...systems. About the Role As a Safeguards Policy Analyst focused on Fraud & Scams,...  ..., building, and executing enforcement workflows that detect and...  ...policies for fraud or abuse prevention at scale Threat...  ...butchering, advance fee fraud, account takeover facilitation) and how they... 
    Accounts
    Remote job
    Visa sponsorship
    Shift work

    Anthropic

    San Francisco, CA
    3 days ago
  • Anthropic is seeking an Enforcement Analyst focused on chem & explosives harms to help protect against misuse of AI systems. You will enforce...  ...policies, investigate potential violations, and strengthen safeguards across cross-functional teams in a remote-friendly US... 
    Remote job

    Anthropic

    San Francisco, CA
    9 hours ago
  • $132k - $190k

    Enforcement Detection Analyst, YouTube, Trust and Safety Bachelor's degree or equivalent practical experience. 2 years of experience in data analysis...  ...) to automate the detection and mitigation of platform abuse, including spam, phishing, or violative content.... 
    Worldwide

    Google Inc.

    San Bruno, CA
    4 days ago
  • Google Inc. is seeking an Enforcement Detection Analyst for YouTube's Trust & Safety team. You will analyze data to detect abuse, define strategies, and implement scalable policy enforcement with ML assistance. You will collaborate with engineers, product, and policy teams... 

    Google Inc.

    San Bruno, CA
    9 hours ago
  • Anthropic is seeking a Safeguards Analyst focusing on Integrity & Authenticity to build enforcement workflows for our AI products, detecting coordinated inauthentic behavior, election manipulation, targeting, tracking, and surveillance. The role may require weekend responses... 
    Visa sponsorship
    Weekend work

    Doist

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Safeguards Enforcement Analyst, Account Takeover & Credential Abuse. Be the first to apply!