Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Safeguards Enforcement Analyst, Bio Harms

$245k - $285k

Colorwave Inc

Enforcement Analyst Focused on Bio Harms An Enforcement Analyst focused on bio harms will play a critical role in protecting against the misuse of AI systems for biological and related CBRNE harms. You will enforce our Usage Policy with a specific focus on detecting and mitigating bio risks, investigating potential violations, and help continuously strengthen our safeguards. The work sits at the intersection of biosecurity threat analysis and platform enforcement: you will read real model interactions and make fast, well-reasoned calls about whether activity is benign research or a credible attempt at harm. This role is a fit for someone who understands the dual-use nature of biology and enabling technologies well enough to separate the benign from the malicious. You will own and continuously improve the enforcement monitoring workflows for the bio-harms area, and you will work closely with Policy, Threat Intelligence, Data Science, and Engineering cross-functional partners to accomplish tasks at scale. Safety is core to our mission, and your work will directly protect individuals, communities, and critical systems. Important context for the role: In this position you may be exposed to and engage with explicit content spanning a range of topics, including material of a sexual, violent, or psychologically disturbing nature. The role also carries a shared on-call responsibility across the Policy and Enforcement teams. Key Responsibilities Enforce Usage Policies with a specific focus on detecting and mitigating potential bio risks and harmful use of AI systems. Take ownership of enforcement monitoring workflows for the bio-harms area, improving end-to-end detection, investigation, triage, and escalation processes. Monitor and analyze platform activity to identify emerging patterns related to biological (and adjacent chemical, radiological, nuclear, and explosive) threats that may require policy updates or enforcement action. Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy across a technically complex content surface. Conduct thorough investigations of potential violations, gathering and documenting evidence to support enforcement decisions. Proactively surface trends and propose improvements to detection methods and review workflows. Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for bio-related policy violations. Partner with Policy and Threat Intelligence groups to understand potential exploits and contribute to risk-assessment frameworks, and partner with engineers iterating on safety systems. Provide enforcement-grounded feedback on policy gaps, and handle escalations and time-sensitive situations related to potential bio-related Usage Policy violations. Minimum Qualifications Hold a degree in a bio-related field (e.g., microbiology, molecular biology, biochemistry, public health) and/or relevant professional experience in a related field. Possess experience in Trust & Safety, content moderation, or policy enforcement at platform scale, including working with generative AI tools to refine and optimize content review and enforcement workflows. Possess experience in utilizing AI tools to develop data dashboards for metrics collection in support of continuous improvement efforts. Can analyze complex, ambiguous situations and make well-reasoned, defensible decisions under time pressure. Are proactive and self-directed: you spot trends, dig in, and ship improvements on your own initiative. Communicate clearly in writing and can translate technical bio concepts for diverse audiences, including both technical and non-technical stakeholders. Preferred Qualifications Subject matter expertise in biodefense, biosecurity, WMD/CBRNE non-proliferation, or threat-intelligence. An understanding of where real-world biological risk actually lies — adversary intent, acquisition and weaponization pathways, and dual-use concerns, including familiarity with cross-platform threat analysis and open-source intelligence (OSINT) techniques relevant to weapons of mass destruction. Proficiency in SQL and/or other data analysis tools to draw insights from large datasets and monitor enforcement workflow health. Familiarity with dual-use research of concern (DURC), select agents, and relevant policy frameworks. The annual compensation range for this role is listed below. For sales roles, the range provided is the role's On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role. Annual Salary: $245,000 —$285,000 USD Logistics Minimum education: Bachelor's degree or an equivalent combination of education, training, and/or experience Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices. Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this. We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team. Your safety matters to us. To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit anthropic.com/careers directly for confirmed position openings. How We're Different We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills. The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences. Come Work With Us! Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage: Learn about our policy for using AI in our application process. Colorwave Inc

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Safeguards Enforcement Analyst, Bio Harms in San Francisco, CA vacancy
  • $245k - $285k

    Position Overview As a Safeguards Enforcement Analyst on the account abuse team, you will build and execute enforcement workflows that keep our products...  ...safe, focusing on detecting and mitigating potential harm. Your initial focus will be recidivism: ensuring banned actors... 
    Suggested
    For contractors
    Work at office
    Visa sponsorship

    Doist

    San Francisco, CA
    3 days ago
  • Anthropic is seeking an Enforcement Analyst focused on Radiological & Nuclear Harms to protect against AI misuse in sensitive domains. You will enforce Usage...  ...investigate potential violations, and strengthen safeguards across cross-functional teams including Policy, Threat... 
    Suggested
    Work at office
    Remote work

    Anthropic

    San Francisco, CA
    1 day ago
  • Doist is seeking a Safeguards Enforcement Analyst on the account abuse team to build and execute enforcement workflows that keep our products safe, focusing on detecting and mitigating potential harm. You will drive enforcement areas including access controls and identity... 
    Suggested

    Doist

    San Francisco, CA
    3 days ago
  • Anthropic is seeking a Safeguards Enforcement Analyst to build and run enforcement workflows that keep our products safe, focusing on detecting and mitigating potential harm. You will own detection, revocation, user notification, remediation, and restoration criteria for... 
    Suggested

    Doist

    San Francisco, CA
    3 days ago
  • $245k - $285k

    Safeguards Enforcement Analyst Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial...  ...'s mission. Child safety is one of our highest-priority harm areas, and the person in this role will have a direct and... 
    Suggested
    Work at office
    Visa sponsorship
    Flexible hours

    Colorwave Inc

    San Francisco, CA
    1 day ago
  • $230k - $270k

     ...Safeguards Enforcement Analyst, Safety Evaluations Remote-Friendly (Travel-Required) | San Francisco, CA | Washington, DC; San Francisco, CA | New York City, NY About Anthropic Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want... 
    Work at office
    Remote work
    Visa sponsorship
    Flexible hours
    Shift work

    Anthropic

    San Francisco, CA
    5 days ago
  •  ...A state government agency is seeking a Paralegal - Health Quality Enforcement Senior Legal Analyst in San Francisco. This full-time role involves high-level legal work in state and federal court litigation, case management, and document analysis. The ideal candidate is... 
    Full time
    Flexible hours

    California Department of Justice

    San Francisco, CA
    2 days ago
  • Anthropic is seeking a Safeguards Analyst focusing on Integrity & Authenticity to build enforcement workflows for our AI products, detecting coordinated inauthentic behavior, election manipulation, targeting, tracking, and surveillance. The role may require weekend responses... 
    Visa sponsorship
    Weekend work

    Doist

    San Francisco, CA
    2 days ago
  • $70.72k

     ...GSOC Analyst Specific Duties and Responsibilities Essential Job Functions: Conduct regular monitoring of open-source intelligence...  ...through our common purpose, we provide the security needed to safeguard our clients' assets and people. Our core values - Integrity,... 
    Weekly pay
    Full time
    Local area
    Worldwide
    Flexible hours

    Securitas

    San Francisco, CA
    1 day ago
  • $126k - $181k

    Enforcement Detection Analyst, YouTube, Trust and Safety Location: San Bruno, CA, USA Level: Mid - Experience driving progress, solving problems, and mentoring more junior team members; deeper expertise and applied knowledge within relevant area. Minimum qualifications... 
    Full time
    Worldwide
    Weekend work

    Google

    San Bruno, CA
    2 days ago
  • Google is seeking an Enforcement Detection Analyst for YouTube's Trust and Safety team in San Bruno, CA. This role involves ensuring disruptive content is quickly identified and removed. Candidates must possess strong analytical skills and experience in project management... 
    Full time

    Google

    San Bruno, CA
    4 days ago
  • Google Inc. is seeking an Enforcement Detection Analyst for YouTube's Trust & Safety team. You will analyze data to detect abuse, define strategies, and implement scalable policy enforcement with ML assistance. You will collaborate with engineers, product, and policy teams... 

    Google Inc.

    San Bruno, CA
    1 day ago
  • $82.7k - $129.8k

     ...environment where streamers and their communities thrive, while proactively reducing harm and ensuring support is accessible when needed. Our organization encompasses safety policy & enforcement, fraud prevention, and customer experience. Within Customer Trust, the Strategic... 
    Flexible hours

    Twitch

    San Francisco, CA
    5 days ago
  •  ...inclusive People policies, forecast finances, give legal counsel, safeguard systems, nurture new initiatives, and more. Every challenge...  ...Bring yours to Block. The Role We're seeking a Senior Credit Risk Analyst to join our Enterprise Risk Management team. This role sits at... 
    Local area

    Block Inc

    San Francisco, CA
    4 days ago
  • $34 per hour

    Eligible for 20% pay differential** Be a part of the nationwide law enforcement initiative that removes the tools of crime from criminal...  ...security. We currently have a vacancy for a Records Examiner/Analyst. In this role, you will be supporting the overall mission of the... 
    Hourly pay
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    FSA Federal

    San Francisco, CA
    7 days ago
  •  ...software, and the ability to serve as a critical point of contact for both internal teams and external stakeholders. What you’ll do: Enforce Lock Desk policy & procedures. Assist the company’s loan officers with rate lock maintenance, loan re-prices, and general Lock.... 
    Remote work

    Dormont Manufacturing Company

    San Francisco, CA
    3 days ago
  • $90k - $95k

     ...Overview An Analyst on Control Risks' Online Threat Intelligence (OTI) team will: Conduct and lead operational delivery of open-source...  ...measure the intent and capability of online threat actors to cause harm to our clients. Provide tactical level insights to our clients... 
    Permanent employment
    Work at office
    Remote work
    Flexible hours

    Control Risks

    San Francisco, CA
    4 days ago
  •  ...engagement in the community. Class 1823 Senior Administrative Analyst is the senior journey-level class of the series. The 1823 Assistant...  ...location monitoring cases (GPS/electronic), reviewing reports, enforcing court-ordered conditions, and conducting risk assessments; acts... 
    Full time
    Contract work
    For contractors
    Work experience placement
    Second job
    Work at office
    Local area
    Immediate start
    Trial period
    Shift work

    City and County of San Francisco

    San Francisco, CA
    3 days ago
  • $64k - $103k

     ...Orrick currently has an excellent opportunity for a Conflicts Analyst II. This position could be based in any of our U.S. West Coast...  ...interest and other risk and compliance matters. Employ and enforce risk management processes and procedures. Coordinate with department... 
    Temporary work
    Work at office
    Remote work
    Flexible hours

    Orrick Herrington & Suttcliffe

    San Francisco, CA
    1 day ago
  •  ...Business Analyst Job Duties Elicits, analyzes, specifies, and validates the business needs of stakeholders, be they customers or end...  ...tracks the status of requirements throughout the project lifecycle; enforces and redefines as necessary. Communicates changes, enhancements,... 

    TradeJobsWorkforce

    San Francisco, CA
    5 days ago
  • $92k - $115k

     ...seeking a sharp, action-oriented Workforce Management Real-Time Analyst to operate at the intersection of human judgment and AI-powered...  ...directed to incident response. This connects directly to our proactive harm remediation process and is the highest-leverage intervention... 
    Full time
    Local area
    Relocation package
    Flexible hours
    2 days per week
    3 days per week

    Flex

    San Francisco, CA
    1 day ago
  •  ...analytics. You will be responsible for building complex data models, performing deep-dive troubleshooting on integrated systems, and enforcing robust data governance and security protocols. This role requires a "builder" mentality. You will not only be responsible for... 
    Temporary work

    AllSTEM Connections

    San Francisco, CA
    5 days ago
  •  ...Risk Management Analyst Integrated Resources, Inc is a premier staffing firm recognized as one of the tri-states most well-respected...  ...few. The incumbent will guide physicians to reduce the risk of harm to patients by assisting them in the development of retrospective... 

    Careers Integrated Resources Inc

    San Francisco, CA
    5 days ago
  • A leading law enforcement support firm seeks a Records Examiner/Analyst in San Francisco, California. This role involves reviewing and evaluating data, ensuring accuracy, and managing case files in support of the FBI's mission. Candidates should have an undergraduate degree... 

    Phase2 Technology

    San Francisco, CA
    3 days ago
  •  ...Senior Business Data Analyst – San Francisco, CA As the market leader in providing financial services and expertise to the world's...  ...and Sales Training & Enablement) to document, communicate, and enforce policies and processes Collaborating with our control room to... 

    1872 Consulting

    San Francisco, CA
    5 days ago
  •  ...occasional on-site presence may be required. The ERP Data Migration Analyst plays a critical role in the successful migration of legacy...  ...to maintain project timelines. Compliance & Standards: Enforce master data management policies and standards to ensure long‑term... 
    Work experience placement
    Remote work

    University of California - San Francisco

    San Francisco, CA
    5 days ago
  • $80.5k - $174.3k

     ...requirements are met and followed. Ensure that developers are aware of any change management changes/best practices policies and are enforced. Ensure that all applications are deployed correctly and occasionally triage issues that arise with build and deployment.... 
    Work from home

    Delta Dental Ins.

    San Francisco, CA
    1 day ago
  •  ...About The Role We are seeking an experienced Data Governance Analyst for the Data Analytics team. In this role, you will be responsible...  ...for monitoring and assessment Oversee the development and enforcement of data security and privacy policies, including access controls... 
    Work at office
    Local area
    Flexible hours

    ŌURA

    San Francisco, CA
    1 day ago
  •  ...Familiarity with HTML, Postman, and Chrome Developer tools - An advantage. Mandatory - Proven track record working as OSINT Analyst for 5 years in Law enforcement or intelligence organizations. Mandatory - Proven experience in conducting open-source investigations and other... 
    Work experience placement
    Remote work

    CatchProbe Intelligence Technologies

    San Francisco, CA
    1 day ago
  •  ...; 3) Explaining relevant topics in a manner that differentiates disqualifying conduct from non‑pertinent transgressions by a law enforcement applicant; and, 4) Testifying in litigation as a sworn federal agent to any criminal confessions and/or admissions collected during... 
    Full time
    Part time
    Interim role
    Work at office
    Remote work
    Trial period
    Relocation package

    Drug Enforcement Administration

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Safeguards Enforcement Analyst, Bio Harms. Be the first to apply!