Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Safeguards Policy Analyst, Cyber Harms

$190k - $285k

Anthropic

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.About the role We're looking for an analyst to support the team's cyber product policy work: the usage policy language, help-center and enforcement guidance, and launch policy notes that say what Anthropic permits and prohibits for cyber-relevant use, kept consistent with the constitution and our access tiers. You'll analyze the constitution and usage policies to check that enforcement matches them, work with the threat intelligence and enforcement teams to make sure our safety standards are met, and coordinate cyber policy inputs to model releases and regulatory requirements alongside the Senior Cyber Policy Lead. You'll also help maintain our controlled-access framework and help keep our cyber-related policy commitments current as standards shift. You don't need to write code in this role, but you should be comfortable engaging deeply with technical material — probes, classifiers, and trusted-access programs — and translating it into policy that holds up under scrutiny. Key responsibilities Contribute to the team's cyber product policy artifacts (usage policy language, help-center and enforcement guidance, launch policy notes) and help keep them consistent with the constitution and access tiers Analyze Anthropic's constitution and cyber-related usage policies, and check that enforcement decisions and safeguards match what they say; maintain a running gap log and propose text fixes Work with the threat intelligence and enforcement teams to ensure cyber safety standards are met; review a sample of enforcement decisions against policy text on a regular cadence and report drift Coordinate cyber policy inputs to model releases and to regulatory requirements: prepare the cyber policy section of launch/model-card reviews and regulator pre-briefs, in support of the Senior Cyber Policy Lead Support Anthropic's access-requirements policy and contribute to consolidation of the controlled-access framework across existing and emerging access programs Help keep Anthropic's cyber-related policy commitments current with shifting industry and regulatory standards, and ensure they map cleanly to our technical safeguards Draft inputs to reporting for partners and regulators Help translate technical evaluation and safeguard work into policy positions and internal guidance Engage closely with technical teams to understand the capabilities of probes and classifiers relevant to access policy Minimum qualifications Demonstrated ability to write clear policy analysis (professional or academic) Familiarity with how AI developers or platforms enforce usage policies, or with cybersecurity policy, standards, or regulatory frameworks (e.g., usage policies/AUPs, trust and safety enforcement, NIST CSF, CVD) Ability to read and interpret technical security material, such as vulnerability reports or threat assessments Ability to work across teams (threat intelligence, enforcement, engineering, policy) and communicate clearly in writing Preferred qualifications Experience in cybersecurity policy, including familiarity with coordinated vulnerability disclosure Exposure to government information-sharing and incident-notification frameworks Experience supporting engagement with government agencies, regulators, or standards bodies on cybersecurity or AI matters Experience with legal, technical, or policy aspects of vulnerabilities and disclosure Experience with model-release or product-launch review processes Familiarity with trust-and-safety or product-policy work at a platform (usage policies, enforcement appeals, policy communications) The annual compensation range for this role is listed below. For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.Annual Salary:$190,000—$285,000 USDLogistics Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices. Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this. We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.Your safety matters to us. To protect yourself from potential scams, remember that Anthropic recruiters only contact you from ****** email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit anthropic.com/careers directly for confirmed position openings. How we're different We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills. The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences. Come work with us! Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage: Learn about our policy for using AI in our application process.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Safeguards Policy Analyst, Cyber Harms in San Francisco, CA vacancy
  • $245k - $285k

     ...committed researchers, engineers, policy experts, and business...  ...systems. About the Role As a Safeguards Policy Analyst focused on Fraud & Scams, you...  ...fraud and scam-related harms on Anthropic's products. You...  ...law enforcement focused on cyber-enabled fraud Demonstrated ability... 
    Cyber
    Remote job
    Work at office
    Visa sponsorship
    Flexible hours
    Shift work

    Neura Market

    San Francisco, CA
    4 days ago
  • OpenAI is seeking a Cyber Operations Strategist to lead Critical Harm Operations from our San Francisco site. You will shape the operating model, design escalation...  ..., scalable cyber risk mitigation. You will work with policy, safety, security, and product teams to implement... 
    Cyber

    Triwill Group

    San Francisco, CA
    14 hours ago
  • $285k - $330k

     ...researchers, engineers, policy experts, and business...  ...As an Enforcement Analyst, you will be responsible...  ...systems for malicious cyber operations. Your initial...  ...exploitation tooling, and related harmful cyber operations...  ...detailed feedback to the Safeguards policy design team on... 
    Cyber
    Full time
    Work at office
    Visa sponsorship
    Flexible hours
    Weekend work

    Anthropic

    San Francisco, CA
    2 days ago
  • Anthropic is seeking a Safeguards Enforcement Analyst to build and optimize enforcement workflows focused on age-related safety across its consumer...  ...will collaborate with engineering, data science, legal, and policy teams to implement signals, verification paths, and... 
    Suggested

    Anthropic

    San Francisco, CA
    1 day ago
  •  ...About the Team Our Cyber team builds AI systems and products that help trusted defenders...  ..., model training, evaluations, safeguards, and deployment to make advanced cyber capabilities...  ...Action and Equal Employment Opportunity Policy Statement . Background checks for applicants... 
    Cyber
    Full time

    OpenAI

    San Francisco, CA
    14 hours ago
  •  ...end mitigation stack that reduces severe cyber misuse across OpenAI’s products. This role...  ...depth and close collaboration with risk, policy, product, and engineering teams to ensure...  ...effective. You will design model-enabled safeguards across various surfaces, evaluate trade-... 
    Cyber

    Triwill Group

    San Francisco, CA
    14 hours ago
  • $141.92k - $212.89k

     ...of dedicated professionals committed to safeguarding the financial system and empowering investors...  ...As a Senior Principal Risk Specialist, Cyber Engagements, you'll play a pivotal role...  ...and comply with the company’s policy on nepotism.Search Firm RepresentativesPlease... 
    Cyber
    Full time
    Temporary work
    For contractors
    For subcontractor
    Local area
    Immediate start

    Financial Industry Regulatory Authority

    San Francisco, CA
    3 days ago
  •  ...cybersecurity risks to design and implement an end-to-end mitigation stack mitigating severe cyber misuse across our products. You will collaborate with cross-functional teams to ensure safeguards are robust, scalable, and effective as models and attacker tactics evolve. Ideal... 
    Cyber

    Neura Market

    San Francisco, CA
    4 days ago
  •  ...investigations and protection. Special Agents play a critical role in safeguarding the financial integrity of the United States and protecting...  ...into financial crimes, including counterfeiting, cyber fraud, and other threats to the financial infrastructure of the... 
    Cyber

    United States Secret Service

    San Francisco, CA
    1 day ago
  •  ...group of committed researchers, engineers, policy experts, and business leaders working...  ...wild, inform how Claude is trained and safeguarded in order to favor defenders, and engage...  ...Building demonstrations of frontier AI cyber capabilities for policy stakeholders Compensation... 
    Cyber
    Permanent employment
    Visa sponsorship

    Anthropic

    San Francisco, CA
    1 day ago
  • $252k - $280k

    ABOUT THE TEAM Critical Harm Operations sits within User Safety & Risk Operations and builds enforcement systems for Frontier...  ...are accurate, fast, defensible, and built to scale. The Cyber vertical turns policy into reviewer standards, calibrated judgment, quality systems... 
    Cyber

    OpenAI

    San Francisco, CA
    4 days ago
  • $230k - $290k

    A technology company based in San Francisco is seeking a Technical Cyber Threat Investigator to safeguard AI systems from cyber threats. As part of the Threat Intelligence team, you will investigate misuse, develop detection techniques, and engage with external partners... 
    Cyber

    Jobleads-US

    San Francisco, CA
    4 days ago
  • OpenAI is seeking a senior cybersecurity practitioner and operations strategist to elevate the Cyber Operations program. You will blend hands-on cyber judgment with systems-level design to resolve hard dual-use questions, refine SOPs, uplift reviewers, and create practical... 
    Cyber

    OpenAI

    San Francisco, CA
    4 days ago
  • $295k

     ...developed and deployed. We build evaluations, safeguards, and safety frameworks that help our...  ...to-end mitigation stack to reduce severe cyber misuse across OpenAI's products. This role...  ..., supervised fine-tuning, and policy optimization. Excel at working collaboratively... 
    Cyber

    Slope

    San Francisco, CA
    2 days ago
  •  ...we protect over 100,000 organizations worldwide from increasingly sophisticated cyber and AI-driven threats, securing their AI transformation.  Our prevention-first approach safeguards hybrid networks, cloud environments, digital workspaces, and AI systems, stopping... 
    Cyber
    Full time
    Remote work
    Worldwide

    Check Point Software Technologies

    San Francisco, CA
    27 days ago
  •  ...Network Security Administrator within its Information Technology department to safeguard UCSF's network infrastructure, ensure reliable connectivity, and protect data and systems from cyber threats and vulnerabilities. The role focuses on configuring and maintaining security... 
    Cyber

    University of California , San Francisco

    San Francisco, CA
    14 hours ago
  •  ...investigations and protection. Special Agents play a critical role in safeguarding the financial integrity of the United States and protecting...  ...into financial crimes, including counterfeiting, cyber fraud, and other threats to the financial infrastructure of the... 
    Cyber
    Overseas

    US Secret Service

    San Francisco, CA
    5 days ago
  • $134.5k - $265.1k

    Position Summary Our Deloitte Cyber team understands the unique challenges and opportunities...  ...within client environments, including policy modelling and decision-point/information-...  ...users, consumers, and patients from harm. Enables clients to provide consumer confidence... 
    Cyber
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    3 days ago
  • $82.6k - $162.8k

    Position Summary Our Deloitte Cyber team understands the unique challenges and opportunities businesses face in cybersecurity....  ...digital products, protecting users, consumers, and patients from harm. Enables clients to provide consumer confidence in knowing with... 
    Cyber
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    4 days ago
  • $293k - $405k

     ...AI systems. Mitigation. Keeping misuse safeguards, alignment tools, and security measures on...  ...internal work, they could become a dangerous cyber threat. People in this role will help...  ...Action and Equal Employment Opportunity Policy Statement. Background checks for applicants... 
    Cyber

    Slope

    San Francisco, CA
    4 days ago
  • $82.6k - $162.8k

    Position Summary Join our Deloitte Cyber team to deliver powerful solutions to help...  ...users, consumers, and patients from harm. Enables clients to provide consumer confidence...  ...certifications, lifecycle workflows, role management, policy configuration, and application... 
    Cyber
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    4 days ago
  • $97.61k - $188.38k

    Position Summary Our Deloitte Cyber team understands the unique challenges and opportunities businesses face in cybersecurity....  ...digital products, protecting users, consumers, and patients from harm. Enables clients to provide consumer confidence in knowing with... 
    Cyber
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    2 days ago
  • $134.5k - $265.1k

    Position Summary Cyber Digital Trust and Online Safety ManagerThe Digital Trust...  ...in developing, managing, and implementing policies, procedures, and strategies to ensure a safe...  ...inputs could be manipulated to generate harmful, misleading, or misaligned generative... 
    Cyber
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    1 day ago
  • $82.6k - $162.8k

     ...Strategy, Growth and Transformation on the Cyber team, you will be responsible for:...  ...technology risk consulting.Experience translating policies and regulatory expectations into...  ...hallucination measurement, toxicity scoring, harm scoring, and grounding effectiveness.Experience... 
    Cyber
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    4 days ago
  •  ...frontier AI systems. Mitigation. Keeping misuse safeguards, alignment tools, and security measures...  ...consequence domains like CBRN as well as cyber and other frontier-risk areas), and...  ...Action and Equal Employment Opportunity Policy Statement. Background checks for applicants... 
    Cyber
    Permanent employment
    Temporary work

    United States Digital Space LLC

    San Francisco, CA
    1 day ago
  • $320k

     ...group of committed researchers, engineers, policy experts, and business leaders working...  ...robustness) and drive hill-climbing on the hardest harm areas. Construct RL environments to...  ...real-world misuse across harm areas such as cyber attacks, bio weapons, and influence operations... 
    Cyber
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    2 days ago
  •  ...The City and County of San Francisco is offering a position for an Administrative Analyst, responsible for supporting initiatives through robust data analysis in various areas, including legislation and finance. This role requires collaboration with managers and departments... 
    Remote work
    Flexible hours

    City and County of San Francisco

    San Francisco, CA
    4 days ago
  • $120k - $150k

     ...provider designed from the ground up to help businesses tackle cyber risk head on. By combining industry-leading insurance with world...  ...security technology and skills gap — all through their cyber insurance policy — making them less likely to be hit with a ransomware attack. As... 
    Cyber

    At-Bay

    San Francisco, CA
    4 days ago
  •  ...Provide support for DCPP Palo Alto Fire Walls. Work with corporate on OS and hardware upgrades. Provide network support for DCPP Cyber Security to assist with requests for logs or other network device info. Thanks & Regards Bhanu Prakash DeltaSoft Solutions... 
    Cyber
    Remote work

    DELTASOFT SOLUTIONS

    San Francisco, CA
    3 days ago
  •  ...quality, and alignment of frontier AI models across complex policy-sensitive topics. You will assess AI-generated responses, apply...  ...involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains, and collaborate with... 
    Cyber

    Obsidian

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Safeguards Policy Analyst, Cyber Harms. Be the first to apply!