Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Safeguards Enforcement Lead, Cyber HarmsNew

Full-time

Anthropic

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

About the role

As an Enforcement Lead, you will be responsible for managing and executing enforcement actions across our products and services, with a focus on detecting and mitigating attempts to misuse Anthropic's AI systems for malicious cyber operations. Your work will center on developing strategic enforcement frameworks for flagged activity related to cyberattacks, malware development, and offensive exploitation. Additionally, you will manage a team of Cyber Enforcement Analysts and contractors implementing this enforcement strategy. Safety is core to our mission, and you'll help uphold policy enforcement so that our users can safely interact with and build on top of our products in a harmless, helpful, and honest way. Important context for this role: In this position you may be exposed to and engage with explicit content spanning a range of topics, including those of a violent, technical, or psychologically disturbing nature. This role may require responding to escalations during weekends and holidays.

Key responsibilities

  • Manage a team of Cyber Enforcement Analysts and contractors, overseeing the vision of Cyber Enforcement strategy
  • Create strategies to detect and mitigate potential misuse of AI systems to facilitate cyberattacks, malware creation, exploitation tooling, and related harmful cyber operations
  • Collaborate with stakeholders regarding novel, ambiguous, or high-severity cases
  • Collaborate with the Safeguards Policy Design Team on policy gaps surfaced through real enforcement scenarios
  • Partner with Engineering and Data Science teams to ensure tooling and measurement support enforcement operations.
  • Keep up to date with emerging AI policy enforcement best practices, threat actor tactics, and the evolving cyber threat landscape, using these to inform enforcement decisions

Minimum qualifications

  • Experience as a people manager
  • Experience in cybersecurity, including knowledge of offensive techniques, exploit development, malware analysis, or vulnerability research
  • Experience performing content review, abuse investigations, or policy enforcement at volume
  • Proficiency in SQL and/or Python for data analysis and threat detection
  • Experience identifying emerging risks and communicating findings to a diverse set of stakeholders, such as Product, Policy, Engineering, and Legal teams
  • Experience working with generative AI products, including writing effective prompts for content review and enforcement

Preferred qualifications

  • Experience in trust & safety, abuse investigations, cybersecurity investigations, or threat intelligence in a technology or AI company
  • Experience with large language models and an understanding of how AI technology could be misused for cyber operations
  • Experience operating within abuse monitoring programs or enforcement review systems
  • Understanding of the challenges involved in implementing product policies at scale, including in the content moderation space
  • Experience working with government agencies, regulated environments, or information sharing communities

Logistics

Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices. Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this. We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team. Your safety matters to us. To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit [anthropic.com/careers](anthropic.com/careers) directly for confirmed position openings.

How we're different

We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills. The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.

Come work with us!

Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage: Learn about [our policy]( for using AI in our application process.

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file. As set forth in Anthropic’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law. [Race & Ethnicity Definitions]( greenhouse job boards/pdfs/000/000/690/original/EEO Addendum - Race and Ethnicity.pdf?1674251322) If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows: A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability. A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service. An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense. An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Voluntary Self-Identification of Disability

Form CC-305 Page 1 of 1 OMB Control Number 1250-0005 Expires 07/31/2029 Why are you being asked to complete this form?We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years. Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at [ How do you know if you have a disability?A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:
  • Alcohol or other substance use disorder (not currently using drugs illegally)
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
  • Blind or low vision
  • Cancer (past or present)
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or serious difficulty hearing
  • Diabetes
  • Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
  • Epilepsy or other seizure disorder
  • Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
  • Intellectual or developmental disability
  • Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
  • Missing limbs or partially missing limbs
  • Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
  • Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
  • Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
  • Partial or complete paralysis (any cause)
  • Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
  • Short stature (dwarfism)
  • Traumatic brain injury
PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Safeguards Enforcement Lead, Cyber HarmsNew in San Francisco, CA vacancy
  •  ...engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role As a Safeguards Enforcement Lead on the User Well-Being team, you will be responsible for managing our child safety, mental health, abuse and exploitation... 
    Suggested
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    3 days ago
  • $265k - $295k

     ...team and drive messaging for Anthropic’s Safeguards (Trust & Safety) work, with a focus on...  ...to shape how one of the world's leading AI companies communicates about safety...  ...agree that any issues pertaining to the enforceability, application or validity of this agreement... 
    Suggested
    For contractors
    Work at office
    Relocation
    Visa sponsorship
    Work visa
    Flexible hours

    Anthropic Limited

    San Francisco, CA
    3 days ago
  • $245k - $285k

     ...Policy Program Manager, Safeguards Regulatory San Francisco, CA | New York City, NY |...  ...regulation, such as the EU AI Act Experience leading incident response programs, including...  ...that any issues pertaining to the enforceability, application or validity of this... 
    Suggested
    For contractors
    Work at office
    Relocation
    Visa sponsorship
    Work visa
    Flexible hours

    Jobleads-US

    San Francisco, CA
    3 days ago
  • $305k - $385k

     ...need to ensure they are not misused. The Safeguards team is at the forefront of protecting...  ...state. Align & collaborate with policy, enforcement, research, engineering and cross...  ...powerful models and determined adversaries. Lead the development of metrics to understand... 
    Suggested
    Full time
    For contractors
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    3 days ago
  •  ...business leaders working together to build beneficial AI systems. About the role Anthropic's Safeguards organization builds the policies, evaluations, and detection and enforcement systems that define and hold the limits on how Claude can be used. Within Safeguards, our... 
    Suggested
    Full time
    Work at office
    Visa sponsorship
    Flexible hours
    Shift work
    Night shift
    Weekend work

    Anthropic

    San Francisco, CA
    3 days ago
  • $183.6k - $270k

     ...Corporate Counsel, Cybersecurity & Enforcement United States - Remote About the Team DoorDash's Legal Team has built a reputation...  ...incidents, and evolving legal and regulatory requirements. Lead the legal response to cybersecurity incidents and... 
    Hourly pay
    Work at office
    Local area
    Immediate start
    Remote work
    Flexible hours

    DoorDash USA

    San Francisco, CA
    1 day ago
  •  ...Special Agents play a critical role in safeguarding the financial integrity of the United States...  ...crimes, including counterfeiting, cyber fraud, and other threats to the financial...  ...or prior service in federal law enforcement positions covered by special retirement... 
    Cyber
    Overseas
    Trial period

    The United States Secret Service

    San Francisco, CA
    12 days ago
  •  ...Privacy & Cybersecurity Practice Group . The firm represents leading global clients across industries in data privacy , cybersecurity...  ...Handle complex litigation and regulatory enforcement matters related to data privacy and cybersecurity. Provide... 
    Cyber

    Direct Counsel

    San Francisco, CA
    22 days ago
  • $320k - $400k

     ...incident response. As Field Marketing Lead, Cybersecurity, you will lead Anthropic'...  ...enablement, and work with them to turn cyber use cases into the programs and campaigns...  ...agree that any issues pertaining to the enforceability, application or validity of this... 
    Cyber
    For contractors
    Work at office
    Local area
    Worldwide
    Visa sponsorship
    Flexible hours

    anthropic

    San Francisco, CA
    3 days ago
  •  ...Information Technology & Services Cyber Security Identity Management Privacy...  ...seeking a General Counsel to establish and lead its legal function, with a strong focus on...  ...also be instrumental in interfacing with enforcement bodies and advocating for consumer data privacy... 
    Cyber

    Confidential

    San Francisco, CA
    2 days ago
  •  ...critical infrastructure that powers breakthrough AI models at leading research labs and enterprises. Since 2018, we’ve been pioneering...  ...strengthening CI/CD security by integrating automated checks that enforce secure development practices early in the lifecycle. Help... 
    Cyber
    Hourly pay
    Internship
    Flexible hours

    EngineersOfAI

    San Francisco, CA
    1 day ago
  • $180k - $250k

     ...party risk management, board reporting, and cyber insurance underwriting; making all...  ...design system. Actively build, maintain, and enforce a consistent component library that accelerates...  ...who make the whole team better. You lead with humility. You’re confident in your... 
    Cyber

    Remote Services Inc.

    San Francisco, CA
    20 hours ago
  •  ...and reputation across all our markets. Our Cyber Defense team within Security proactively...  ...Director, Global Cyber Defense will lead DoorDash’s Cyber Defense organization, including...  ...within DoorDash, as well as external law enforcement, Identify and investigate insider... 
    Cyber

    Jobleads-US

    San Francisco, CA
    1 day ago
  • $310k - $390k

     ...Job Description Job Description Cyber/Data/Privacy Associate Attorney – Midlevel...  ...experience in litigation and/or regulatory enforcement investigations involving privacy and data...  ...~ Engage directly with clients and lead significant projects . Qualifications... 
    Cyber
    Fixed term contract

    Direct Counsel

    San Francisco, CA
    18 days ago
  • $260k

     ...Los Angeles or San Francisco Responsibilities Create risk-mitigated , global , scalable , and flexible privacy and cyber programs and data strategies for innovative data products, services, and uses Assist clients in protecting data in alignment with... 
    Cyber
    Flexible hours

    Cybersecurity Jobs

    San Francisco, CA
    1 day ago
  • $257k

     ...Technical Program Manager, AI Safety & Safeguards | OpenAI Careers Technical Program...  ...partners. Our Technical Program Managers lead complex, high‑stakes initiatives that...  ...other serious harms, improve detection and enforcement systems, create platform solutions for... 
    Work at office
    Relocation package

    Jobleads-US

    San Francisco, CA
    2 days ago
  •  ...User Safety & Risk Operations and builds enforcement systems for the most severe user-safety risks...  ..., fast, defensible, and scalable. The Cyber vertical turns policy into reviewer...  ...accountable a high-performing team. You’ll also lead through influence across FTEs, BPO... 
    Cyber
    Work at office
    Relocation package

    Jobleads-US

    San Francisco, CA
    4 days ago
  •  ...and society as a whole. As an Enforcement Analyst focused on Agentic...  ...teams, within and outside of Safeguards, including: Policy, Threat Intel...  ...agentic cases, translating leads from detection outputs and investigations...  ...each decision Assess cyber-related agentic activity,... 
    Cyber
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    3 days ago
  •  ...Operations AnalystCogent is building autonomous cyber defense with AI agents that help security...  ...out workflows that improve fill rates, enforce required fields, flag stale or low-...  ..., deal inspection views, forecast notes, lead-to-SQL reports, rep follow-up trackers, and... 
    Cyber

    Cogent Security, Inc.

    San Francisco, CA
    3 days ago
  •  ...blockchain intelligence stablecoin compliance cyber threat intelligence law enforcement threat intelligence digital forensics and public...  ...responsible for owning the global pipeline generation strategy, leading the customer journey from awareness to sales-accepted... 
    Cyber

    Confidential

    San Francisco, CA
    4 days ago
  •  ...solutions Industry Computer & Network Security Type Privately Held Employees 11-50 Specialties threat intelligence cyber risk intelligence cybersecurity third party threat detection & response third party risk management and cybercrime... 
    Cyber
    Contract work

    Confidential

    San Francisco, CA
    4 days ago
  •  ...their business go.We are seeking an Account Executive that has successfully sold a SaaS application into the CISO / InfoSec and/or Cyber GRC business line(s.) for an early stage startup company. While this is early – you'll be amongst our first sales hires – we have a... 
    Cyber
    Full time
    Remote work

    Cypago

    San Francisco, CA
    3 days ago
  •  ...connectors, it centralizes access visibility, enforces fine-grained controls, enables just-in-...  ...and personas Prioritize different lead sources and prospecting priorities for efficient...  ...(and/or have a lot of curiosity about) cyber security ConductorOne, Inc. is an... 
    Cyber
    Work experience placement
    Work at office

    C1

    San Francisco, CA
    4 days ago
  •  ...regulatory compliance wallet screening entity due diligence blockchain intelligence stablecoin compliance cyber threat intelligence law enforcement threat intelligence digital forensics and public-private crime disruption About the Role The Company... 
    Cyber

    Confidential

    San Francisco, CA
    3 days ago
  • $125 - $175 per hour

     ...job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...four weeks. Discuss the tools and processes used in enterprise cyber defense work. Evaluate how AI assistance currently impacts... 
    Cyber
    Hourly pay
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    17 days ago
  •  ...About Alaris Security Alaris Security is building the core technology stack for intelligent cyber security. Designed for enterprise and defense organizations, our platform unifies security data through our proprietary graph database and automates critical tasks using... 
    Cyber

    Alaris Security, Inc.

    San Francisco, CA
    4 days ago
  •  ...Consulting & Professional Services Security Specialties cyber defense cyber response cyber security cybersecurity...  ...Company is seeking a Vice President of Solution Architecture to lead and grow a global team responsible for technical solution design... 
    Cyber

    Confidential

    San Francisco, CA
    4 days ago
  •  ...About Cyble Cyble is an AI-native cybersecurity company building the next generation of autonomous cyber defense. Our products combine threat intelligence, endpoint security, exposure management, and AI-powered detection and response to protect enterprises and governments... 
    Cyber

    King River

    San Francisco, CA
    20 hours ago
  •  ...technology services and consulting company focuses on AI-led engineering, the agentic AI ecosystem, cloud and digital transformation, cyber security, and platform operations. Role Overview We are seeking a senior sales leader to drive growth for Interactive business... 
    Cyber

    CONFISA INTERNATIONAL GROUP

    San Francisco, CA
    2 days ago
  • $124k - $329.2k

     ...About GitHub GitHub is the world's leading platform for agentic software development - powered by Copilot to build, scale, and deliver...  ...~7+ years experience in security analysis, security research, cyber security, security engineering, software engineering, or relevant... 
    Cyber
    Ongoing contract
    Remote work

    GitHub

    San Francisco, CA
    20 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Safeguards Enforcement Lead, Cyber HarmsNew. Be the first to apply!