Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff+ Software Engineer, Safeguards Human Review Tooling

$320k

Anthropic

About Anthropic

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

About the role

The Safeguards team is responsible for ensuring our models and products are developed and deployed safely. We're looking for engineers for our Review Tooling team, which builds the systems that humans — and increasingly Claude — use to investigate potential harms and take enforcement actions across Anthropic's first-party products and third-party cloud platforms.

You'll own the tools our safety investigators rely on to understand what's happening on our platforms and act on it, as well as the platform underneath those tools. That platform includes data analysis capabilities, privacy-preserving primitives that keep review workflows compatible with our data retention commitments, and a sandbox environment where new review interfaces and workflows can be built and iterated quickly.

These are internal tools, but they are anything but low-stakes: the speed, clarity, and reliability of this tooling directly determines how quickly Anthropic can identify harmful behavior, make sound enforcement decisions, and feed signals back into model training and safety classifiers. You'll partner closely with policy, operations, data science, legal, and privacy teams to ensure our enforcement systems are effective, accurate, and trustworthy.

Key responsibilities

  • Build investigation, review, and enforcement tooling for both first-party and third-party platform surfaces — including case queues, investigation views, decision and audit logging, and account-actioning workflows
  • Develop the platform layer of reusable APIs, data storage, and backend services that lets new review workflows be stood up quickly and safely
  • Stand up and run deployments of this tooling across multiple clouds, including inside cloud-provider partner environments where data must stay in place. Keep the deployments consistent through shared deployment pipelines, smoke tests, observability, and alerting
  • Scale review through automation, including enabling reviewers to use Claude effectively and building toward Claude-assisted and Claude-driven review workflows
  • Partner with policy, operations, legal, privacy, and data science stakeholders to translate enforcement and investigation needs into reliable, well-designed systems that measurably reduce handling time and decision error
  • Instrument the tools you ship — surfacing metrics on queue health, reviewer throughput, and decision quality — and ensure tooling evolves alongside new privacy primitives and data retention commitments

Minimum qualifications

  • A technical background in full-stack or platform engineering, with the ability to engage deeply in architecture and design discussions
  • Experience shipping internal tools or platforms with demanding operational users, and a track record of improving their workflows measurably
  • Experience working cross-functionally with non-engineering partners such as operations, policy, or legal teams
  • Excellent communication skills, including the ability to explain technical tradeoffs to non-technical stakeholders
  • Care about the societal impacts of AI and want your work to make powerful systems safer

Preferred qualifications

  • 8+ years of industry software engineering experience 
  • Experience building data labeling, trust and safety, integrity, fraud, or abuse-prevention tooling, or other systems supporting human review at scale
  • Have built systems that handle sensitive or regulated data, with requirements around access control, auditability, retention, and data residency
  • Have worked across multiple cloud providers, or built infrastructure designed to be provider-agnostic
  • A product-minded approach to internal users: you work directly with the people using your tools, watch where they struggle, and fix it

The annual compensation range for this role is listed below. 

For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.

Annual Salary:

$320,000—$485,000 USD

Logistics

Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience

Required field of study:  A field relevant to the role as demonstrated through coursework, training, or professional experience

Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position

Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.

For roles performing work in California: We will consider for employment all qualified applicants, including those with arrest or conviction records or criminal histories, in a manner consistent with the requirements of applicable state and local laws, including the San Francisco Fair Chance Ordinance, the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act.

We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed.  Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.

Your safety matters to us. To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit directly for confirmed position openings.

How we're different

We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.

The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.

Come work with us!

Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage: Learn about  our policy for using AI in our application process.

Vacancy posted 23 hours ago
Similar jobs that could be interesting for youBased on the Staff+ Software Engineer, Safeguards Human Review Tooling in San Francisco, CA vacancy
  • $320k

     ...committed researchers, engineers, policy experts...  ...looking for software engineers to...  ...on the Safeguards team, you will...  ...analysts for manual review Build abuse...  ...custom internal tooling Deadline to...  ...we expect all staff to be in one of...  ...Learning from Human Preferences.... 
    Suggested
    Currently hiring
    Work at office
    Local area
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    23 hours ago
  • $207.6k - $339.6k

     ...transformation by building the tools and experiences that...  ..., and the entire software development lifecycle.Your work empowers engineers across Plaid to delegate...  ....Role Description:As a Staff Software Engineer on the...  ...@plaid.com.Please review our Candidate Privacy Notice... 
    Suggested
    Work experience placement
    Local area

    Plaid Financial

    San Francisco, CA
    1 day ago
  •  ...committed researchers, engineers, policy experts,...  ...is for Fullstack Software Engineers only....  ...engineer on the Safeguards team, you will...  ...build the internal review tools analysts use to...  ...interfaces where humans supervise agents:...  ...Currently, we expect all staff to be in one of... 
    Suggested
    Full time
    For contractors
    Internship
    Currently hiring
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    4 days ago
  •  ...committed researchers, engineers, policy experts...  ...looking for software engineers to...  ...on the Safeguards team, you will...  ...evaluation, and review systems are built...  ...build the internal tooling their work depends...  ...we expect all staff to be in one of...  ...Learning from Human Preferences.... 
    Suggested
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    4 days ago
  • $252k - $315k

    Software is eating the world, but AI is eating software. We live in unprecedented...  ...to exponentially augment human intelligence. Every person...  ...the Generative AI Data Engine, SGP, Donovan, and others that...  ...at Scale using AI development tools in addition to traditional practices... 
    Suggested
    Full time
    Live in
    Local area

    Scale AI

    San Francisco, CA
    5 days ago
  • $174.5k - $236k

     ...imagination, self-expression, and human connection.. In 2003, we...  ...you are building innovative tools or fostering a welcoming...  ...We're looking for a Staff Software Engineer to help shape the technical...  ...applicants. To learn more, please review our full notice detailing how... 
    Work at office
    Remote work
    Monday to Thursday

    Linden Lab

    San Francisco, CA
    a month ago
  • $320k

     ...committed researchers, engineers, policy experts...  ...misused. As a software engineer on...  ...enforcement tooling that keeps them...  ...with rigorous safeguards. Responsibilities...  ...we expect all staff to be in one of...  ...Learning from Human Preferences. Come...  ...judicial review of arbitration... 
    Full time
    For contractors
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    12 days ago
  • $141k - $242k

     ...autonomous fleet. As a Senior or Staff Software Engineer on our Mapping team, you...  ..., spatial databases, and tooling such as QGIS, GDAL, or...  ...the hiring process, such as reviewing applications, analyzing resumes...  ...team but do not replace human judgment. Final hiring decisions... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    more than 2 months ago
  •  ...We are looking for a Software Engineer – Backend Platforms and...  ...such as watchlist review, sanctions and PEP matching...  ...that support tool calling, structured outputs...  ...actor-based workflows, human review, and policy-controlled...  ...limits. Add safeguards against stale, contradictory... 
    Full time
    Temporary work

    socure

    San Francisco, CA
    3 days ago
  • $405k

     ...committed researchers, engineers, policy experts,...  ...the platforms and tooling that let engineers...  ...experience in a Software Engineer role,...  ...Applications will be reviewed on a rolling basis...  ...Currently, we expect all staff to be in one of...  ...and Learning from Human Preferences.... 
    Internship
    Work at office
    Local area
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    8 days ago
  •  ...impact You’ll lead the development of AI tools and applications used by Airwallex...  ...large-scale log pipelines. Partner with engineering teams to identify opportunities for...  ...related field. ~8+ years of experience as a software engineer. ~ Experience working with... 
    Full time
    Work at office
    3 days per week

    airwallex

    San Francisco, CA
    4 days ago
  • $405k

     ...committed researchers, engineers, policy experts,...  ...of disconnected tools — literature,...  ...workflows with built-in review for citation and...  ...Have 8+ years of software engineering experience...  ...2+ years at a Staff or equivalent technical...  ...and Learning from Human Preferences.... 
    Work at office
    Local area
    Immediate start
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    8 days ago
  • $405k

     ...committed researchers, engineers, policy experts,...  ...that benefit humanity. We have multiple...  ...data pipelines using tools like Spark, Airflow...  ...(e.g. postmortem review, incident response...  ...rapidly evolving software systems \*This is...  ...Currently, we expect all staff to be in one of... 
    Full time
    Currently hiring
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    12 days ago
  • $405k

     ...Staff Software Engineer, Code RL San Francisco, CA | New York City, NY | Seattle, WA...  ...regression detection, and triage tooling Help define engineering standards, review practices, and design patterns...  ...in AI Safety, and Learning from Human Preferences. Come work with us... 
    Full time
    Work at office
    Remote work
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    12 days ago
  •  ...Binti builds software for state and county government...  ...We're looking for a Staff Engineer who combines deep technical...  ...by applying modern AI tooling to accelerate both...  ...engineering org through code review, design critique, and...  ..., non-biological human relationships across the... 
    Work at office
    Flexible hours

    Binti Inc

    San Francisco, CA
    1 day ago
  • $160k - $220k

     ...Every Identity, from AI to Human Identity is the key to unlocking...  ...you are too, let's talk. Staff Software Engineer, Device Identity (Java)...  ...designing for scale, rigorous code reviews, automated testing, and an...  ...Employment Decision Tools (AEDT), as defined by New York... 
    Local area
    Worldwide

    Okta

    San Francisco, CA
    8 days ago
  • $160k - $280k

     ...the Role We're looking for a software engineer to build the Kubernetes-...  ...running and efficient without a human in the loop. Strong candidates...  ...typing, automated tests, code review, versioning, and CI/CD for...  ...durable workflow orchestration tools such as Temporal, Cadence, or... 
    Full time

    Together AI

    San Francisco, CA
    8 days ago
  • $320k

     ...committed researchers, engineers, policy experts, and business...  ...-turn conversations, tools, long context, user...  ...~8+ years of industry software engineering or ML engineering...  ..., we expect all staff to be in one of our offices...  ..., and Learning from Human Preferences. Come work... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    23 hours ago
  •  ...AI. Coding agents now ship software faster than any human team can review or secure it; 100+ pull requests per engineer per week is no longer an outlier...  ...a Member of the Technical Staff, you build the system that...  ...quality, review culture, tooling, and how we build with AI... 
    Full time

    Tolmo

    San Francisco, CA
    8 days ago
  • $320k - $405k

     ...committed researchers, engineers, policy experts,...  ...that operates as software engineers on top...  ...Lead architecture reviews for GTM systems that...  ...and common tooling, where the right answer...  ...Currently, we expect all staff to be in one of...  ...and Learning from Human Preferences.... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    8 days ago
  • $320k

     ...committed researchers, engineers, policy experts, and...  ...from coming back. As a software engineer on this team,...  ...maximize the impact of their human-review availability...  ...SQL, and data analysis tools. Strong communication...  ...Currently, we expect all staff to be in one of our... 
    Internship
    Work at office
    Local area
    Immediate start
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    8 days ago
  • $50 per hour

     ...payments. Trusted by 10,000+ software engineers worldwide MIN EXP REQUIRED...  ...their AI agents by providing human feedback. Do you want to...  ...integrating agents with live tools such as Supabase, Gmail, and...  ...offer incentive payments. Please review the payment terms for each... 
    Weekly pay
    Extra income
    Contract work
    Freelance
    Internship
    Remote work
    Worldwide

    Outlier

    San Francisco, CA
    3 days ago
  •  ...to reference any tools, platforms, or workflows...  ...us bring modern software to modern science....  ...AI & Data Engineering, a small autonomous...  ...access controls, and human-in-the-loop controls...  ...the bar in design reviews, and grow other...  ...engineers (analysts, ops staff, business power... 
    Full time
    Work at office
    Local area
    Flexible hours
    3 days per week

    Benchling

    San Francisco, CA
    8 days ago
  • $148.5k - $260.1k

     ...#1 AI CRM, where humans with agents drive...  ...that help Salesforce engineers adopt AI-assisted...  ...integrations with coding tools and engineering...  ...of Technical Staff, you will design,...  ...ideas into reliable software that thousands of...  ...through design and code reviews, coaching, pairing... 
    Full time

    Salesforce

    San Francisco, CA
    1 day ago
  • $148.5k - $223.9k

     ...the #1 AI CRM, where humans with agents drive customer...  ...within their everyday tools.We’re building...  ...development with the engineering foundations needed to...  ...quality through code review, automated testing, documentation...  ...…You have 6+ years of software engineering experience... 
    Full time

    Salesforce

    San Francisco, CA
    1 day ago
  •  ...the most productive place of an engineer’s career. The Code Review team builds the tools and processes that help Stripe engineers...  ...on the decisions that need human judgment.Our goal is to build an...  ...at Stripe.What you’ll doAs a Staff Software Engineer, you will take ownership... 

    Stripe

    San Francisco, CA
    2 days ago
  • $229k - $343k

     .... Snap contributes to human progress by empowering...  ...digital services.Snap Engineering teams build fun and technically...  ....We’re looking for a Staff Software Engineer to join Snap...  ..., lead design reviews, raise engineering standards...  ...teams.Utilize AI tools and high velocity engineering... 
    Full time
    Live in
    Work at office
    Local area

    Snap

    San Francisco, CA
    1 day ago
  • $240k - $270k

     ...Hence, we are growing the engineering team and looking for...  ...learn!)Experience building software capabilities for...  ...hiring process. Please review Sigma’s Candidate Privacy...  ...artificial intelligence tools to assist in candidate...  ...designed to complement, not replace, human decision-making.
    Full time
    Work at office

    Sigma Computing

    San Francisco, CA
    5 days ago
  • $163k - $279k

     ...make impactGrowth Engineering at Airwallex is building...  ...outcomes.As a Staff Backend Engineer,...  ...thoughtful design reviews, and hands-on...  ...years of professional software engineering experience...  ...LLM integration, tool orchestration,...  ...The work spans both human + AI and... 
    Temporary work
    Work at office
    Local area
    3 days per week

    Airwallex

    San Francisco, CA
    3 days ago
  • $197.6k - $264k

     ...into powerful motion-tracking tools, giving members real-time...  ...progress.We're looking for a Staff Software Engineer to serve as the technical leader...  ...through thoughtful code reviews, design discussions, and knowledge...  ...worldwide. Our AI-powered, human-centered care model spans... 
    Work at office
    Local area
    Remote work
    Worldwide
    3 days per week

    Hinge Health

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff+ Software Engineer, Safeguards Human Review Tooling. Be the first to apply!