Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Safeguards Enforcement Lead, User Well-Being

EngineersOfAI

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role As a Safeguards Enforcement Lead on the User Well-Being team, you will be responsible for managing our child safety, mental health, abuse and exploitation, and age assurance enforcement workflows. This will include managing the team responsible for scaling, maintaining, and continuously improving the systems and processes we use to detect and respond to these harms. This is a management role. You will serve as the central point of contact for those who conduct content review, managing day-to-day workflows, quality assurance, and escalation processes. You will also work closely with internal Engineering, Policy, and Legal teams to scale detection systems and close enforcement gaps as the threat landscape evolves. Important context for this role: In this position you will regularly be exposed to and engage with explicit content of a sexual nature involving minors, as well as content that may be violent or psychologically disturbing. Anthropic takes the wellbeing of team members working in this area seriously and provides access to wellness resources and support. Candidates should carefully consider this aspect of the role before applying. Key responsibilities Manage a team of individual contributors across multiple policy areas under the User Well-Being banner Serve as the primary point of contact for review partners conducting content review, including onboarding, training, quality assurance, and ongoing relationship management Design and improve enforcement workflows to scale effectively as volume grows, while maintaining high accuracy and consistency across review decisions Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for User Well-Being policies Develop and maintain internal documentation, decision trees, and review guidelines that enable accurate and consistent enforcement at scale Keep up to date with emerging AI policy enforcement best practices, evolving legal frameworks, and developments in technology, and use these to inform our workflows Identify and report trends in misuse patterns to internal stakeholders, including Policy, Legal, and Trust & Safety leadership Coordinate reporting obligations to relevant external bodies (e.g., NCMEC) in accordance with applicable law and Anthropic policy Minimum qualifications Experience managing teams in the User Well-Being space Experience in trust & safety, content moderation operations, or policy enforcement with direct exposure to child safety, mental health, abuse and exploitation, and age assurance harm areas Experience managing or coordinating content review operations, including quality assurance and workflow management Experience standing up and scaling policy enforcement or content review workflows Proficiency in SQL and/or other data analysis tools to monitor workflow health, review queue metrics, and surface enforcement trends Experience identifying emerging risks and communicating findings to cross-functional stakeholders, such as Product, Policy, Engineering, and Legal teams Understanding of the challenges involved in implementing product policies at scale in the content moderation space Preferred qualifications Deep subject matter expertise in child safety, child sexual exploitation and abuse (CSEA), online child protection, mental wellness, and age assurance Experience working with or reporting to NCMEC, IWF, or equivalent child safety reporting bodies Familiarity with relevant legal and regulatory frameworks, including CSAM reporting obligations, KOSA, COPPA, or e #J-18808-Ljbffr EngineersOfAI

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Safeguards Enforcement Lead, User Well-Being in San Francisco, CA vacancy
  • $285k - $330k

     ...steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team...  ...systems. About the role Anthropic's Safeguards organization builds the policies, evaluations, and detection and enforcement systems that define and hold the... 
    Suggested
    Work at office
    Visa sponsorship
    Flexible hours
    Shift work
    Night shift
    Weekend work

    Candidate

    San Francisco, CA
    2 days ago
  • Russell Tobin is supporting a leading AI technology company to hire a CBRNE Safeguards & Enforcement Operations Specialist. The role focuses on strengthening CBRNE controls across trusted-access and enterprise environments in a high-stakes setting. Ideal candidates bring... 
    Suggested

    Russell Tobin

    San Francisco, CA
    2 days ago
  • $265k - $295k

     ...AI systems. We want AI to be safe and beneficial for our users and for society as a whole...  ...messaging for Anthropic’s Safeguards (Trust & Safety) work, with...  ...how one of the world's leading AI companies communicates...  ...areas like child safety, well-being, and mental health... 
    Suggested
    For contractors
    Work at office
    Visa sponsorship
    Flexible hours

    anthropic

    San Francisco, CA
    5 days ago
  •  ...systems. We want AI to be safe and beneficial for our users and for society as a...  ...not misused. The Safeguards team is at the forefront...  ...of powerful AIs as well as ethical,...  ...collaborate with policy, enforcement, research engineering...  ...determined adversaries. Lead the development of... 
    Suggested

    Anthropic

    San Francisco, CA
    2 days ago
  • $385k

     ...Product Manager, Safeguards (Account Integrity & Abuse...  .... We want AI to be safe and beneficial for our users and for society as a...  ...of powerful AIs as well as ethical, technical...  ...collaborate with policy, enforcement, research,...  ...determined adversaries. Lead the development of... 
    Suggested
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic Limited

    San Francisco, CA
    1 day ago
  • $257k

     ...Program Manager, AI Safety & Safeguards | OpenAI Careers...  ...Program Managers lead complex, high‑stakes initiatives...  ...responsibly and cannot be used to cause serious...  ...improve detection and enforcement systems, create...  ...ambiguity, advocating for users and developers, balancing... 
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our...  ...systems. About the role Anthropic’s Safeguards Enforcement team detects and mitigates misuse...  .... You’ll partner with Enforcement leads to turn shifting priorities into capacity... 
    Full time
    For contractors
    Shift work

    EngineersOfAI

    San Francisco, CA
    2 days ago
  •  ...Anthropic is seeking a Policy Program Manager for Safeguards Regulatory in San Francisco, NY, or DC. You will translate evolving AI safety laws into program controls, coordinating with Legal, Engineering and Product teams to safeguard model deployments. The role demands... 

    Jobleads-US

    San Francisco, CA
    2 days ago
  •  ...Anthropic is seeking a strategic communications professional in San Francisco to lead messaging for Safeguards, translating complex AI safety topics into accessible narratives for media, policymakers, researchers, and the public. The role requires proactive storytelling... 

    Jobleads-US

    San Francisco, CA
    5 days ago
  • $245k - $285k

     ...Policy Program Manager, Safeguards Regulatory San Francisco...  ...AI systems. We want AI to be safe and beneficial for our users and for society as a whole...  ...safeguards used to address them, well enough to engage...  ...the EU AI Act Experience leading incident response programs... 
    For contractors
    Work at office
    Visa sponsorship
    Flexible hours

    anthropic

    San Francisco, CA
    1 day ago
  •  ...Limited is seeking a Product Manager for Safeguards (Account Integrity & Abuse) to own...  ...mitigate deployment risks. You will lead prioritization, define requirements for...  ...and futures states, and work with policy, enforcement, and engineering to advance safe, reliable... 

    Jobleads-US

    San Francisco, CA
    2 days ago
  •  ...Anthropic is seeking a Product Manager for the Safeguards team to own ideation, design, development and deployment of protections for...  ...mitigation tools. You will partner with policy, engineering and enforcement teams to prioritize and ship robust safeguards features while... 

    Jobleads-US

    San Francisco, CA
    2 days ago
  •  ...will help define product strategy, collect and synthesize customer feedback, and contribute to delivering measurable outcomes for our users. Ideal candidates bring strong product judgment, communication skills, and the ability to translate business goals into clear... 

    Snow, Robinson and Taylor

    San Francisco, CA
    5 days ago
  •  ...Anthropic is seeking a Product Policy Manager for Product Risk to lead safety assessments for new features, collaborating with product, legal, policy, and engineering teams. The role involves evaluating potential misuses and crafting policies that balance innovation with... 

    Jobleads-US

    San Francisco, CA
    2 days ago
  •  ...Operations, Point of Care, will lead day‑to‑day operations,...  ...market teams, practice, and end user go‑to‑market efforts for all Risk...  ...verbal communication skills, as well as the ability to build strong...  ...Occasional walking and lifting may be required. Who We Are: Aledade... 
    Work at office
    Remote work
    Flexible hours

    Logoslabs

    San Francisco, CA
    1 day ago
  • Anthropic seeks a Program Manager for Safeguards Workforce Operations to own onboarding, offboarding, device provisioning and access provisioning for contractor, vendor and BPO reviewers in San Francisco. You will partner with IT, Security and vendor teams to translate... 
    For contractors

    EngineersOfAI

    San Francisco, CA
    2 days ago
  • $108k - $208.8k

     ...In this role, you will be part of a global Trust...  ...organization, helping lead our efforts to ensure that...  ...the safety of our users while balancing free expression...  ..., product teams, enforcement and operations partners...  ...so our candidates are well informed before joining... 
    Temporary work
    Local area

    TikTok

    San Francisco, CA
    4 days ago
  • $245k - $285k

     ...AI systems. We want AI to be safe and beneficial for our users and for society as a...  ...risk framework into clear, enforceable policies, ensuring policy...  ...psychologically disturbing nature, as well as detailed descriptions...  ..., develop and improve safeguards with cross-functional... 
    Work at office
    Visa sponsorship
    Flexible hours

    Candidate

    San Francisco, CA
    5 days ago
  • $300k - $375k

     ...data centers and take pride in being at the forefront of...  ...Infrastructure Integrated Planning leads end-to-end capacity and Sales...  ...CLM) to minimize cycle times, enforce buying policy, and ensure purchasing...  ...accurate data flow and seamless user adoption while championing... 
    Full time
    Contract work
    Temporary work
    Work at office
    Remote work

    Iris Energy

    San Francisco, CA
    1 day ago
  • $163.4k - $322.1k

     ...you’ll find courageous and inspiring people who are committed to driving transformation, advancing access to healthcare, and leading a well-being revolution. Where you find innovators committed to sustainable progress, you’ll find Deloitte’s Life Sciences & Health Care... 
    Local area
    Flexible hours

    Deloitte

    San Francisco, CA
    3 days ago
  •  ...OpenAI is seeking a Technical Program Manager for AI Safety & Safeguards in San Francisco, hybrid 3 days in the office. You will drive complex product, platform, and safety initiatives across ChatGPT, API, and enterprise deployments. You will partner with engineers... 
    Work at office

    Jobleads-US

    San Francisco, CA
    2 days ago
  • $245k - $285k

     ...steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our...  ...role in setting and executing the Safeguards team’s approach to assessing product...  ...Safeguards team to leverage deep policy, enforcement, and engineering expertise... 
    Contract work
    For contractors
    For subcontractor
    Work at office
    Remote work
    Visa sponsorship
    Flexible hours

    Anthropic Limited

    San Francisco, CA
    1 day ago
  • $245k - $285k

     ...steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our...  ...role in setting and executing the Safeguards team’s approach to assessing product...  ...Safeguards team to leverage deep policy, enforcement, and engineering expertise... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    1 day ago
  • $230k - $287k

     ...we are committed to advancing financial well-being through smarter, technology-driven financial...  ...VP of Collections & Recoveries, you will lead and empower high-performing analytics...  ...leads to longevity Simplicity guides our user experience Accountability at all levels drives... 
    Full time
    Work at office
    Local area
    Remote work
    Flexible hours
    2 days per week

    Prosper

    San Francisco, CA
    2 days ago
  • $134.6k - $256.45k

     ...strategic decisions, such as its well-publicized transition to cloud,...  ...growth. In this role, there be an outstanding opportunity to support...  ...of proven track record of leading transformational change with increasing...  ...accessible to any and all users. If you have a disability or... 
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Francisco, CA
    3 days ago
  • $206k - $285k

     ...you can expect toIdentify and lead high-impact strategic initiatives...  .... Full-time employees may also be eligible for bonus(es),...  ...helpful, easy, and free. Through our user-friendly tools and intuitive platforms...  ...of your choiceð Annual wellness stipend to use towards eligible... 
    Full time
    Work at office
    Local area
    Remote work

    Chime

    San Francisco, CA
    3 days ago
  • $220k - $250k

     ...scorecards, KPIs, SLAs, and performance standards.Lead quarterly business reviews and executive...  ....Monitor travel program performance and user experience.Resolve complex travel-related...  ...recognition and reward programsEmployee wellness and assistance programsEmployee discounts... 
    Full time
    Contract work
    Work at office
    Local area

    Goodwin Procter

    San Francisco, CA
    2 days ago
  • $190k - $257k

     ...optimizing business decision-making through our leading AI-infused scenario planning and analysis...  ....Supported by operating principles of being strategy-led, values-based and...  ...verticals, use cases / outcomes, business users, etc.) in order to activate sales execution... 

    Anaplan

    San Francisco, CA
    4 days ago
  •  ...About Lyra Health Lyra Health is a leading provider of evidence-based mental health care...  ...health outcomes. Team Resilience & Well-being: Maintain sustainable workloads, protect...  ...marketing strategies that drive measurable user outcomes in high-stakes environments. ~... 
    Shift work

    Logoslabs

    San Francisco, CA
    17 hours ago
  • $216.8k - $315.04k

     ...resources to properly invest in these tools, leading to a lot of old, clunky internal software...  ...connects to your real business data, enforces enterprise policies automatically, and lets...  ...the ground up. In this role, you\'ll be a highly motivated individual contributor... 

    Retool, Inc.

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Safeguards Enforcement Lead, User Well-Being. Be the first to apply!