Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Engineer (Safeguards Labs)

$350k

Anthropic

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems, aiming for safety and benefit to users and society. About the Team Safeguards Labs is a new team at the intersection of research and engineering, investigating safety methods to protect Claude and its users. We prototype approaches to safe models, usage safeguards, and production safety, testing ideas offline before deploying them to partner Safeguards teams. Our work overlaps closely with account abuse, model behavior safeguards, and other safeguard subteams. About the Role We are hiring research engineers to define and execute the Labs research agenda. You will scope projects, run experiments end‑to‑end, and decide when an idea is ready for handoff to a production team or when to pivot. Responsibilities Lead and contribute to research projects investigating new methods for detecting misuse of Claude, identifying malicious organizations and accounts, strengthening model safeguards, and addressing other safety needs. Design and run offline analyses over model usage data to surface abuse patterns, build classifiers and detection systems, and evaluate their effectiveness. Develop prototypes that could supply signals to the real‑time safeguards path, partnering with engineers on tech transfer. Contribute to a broader research portfolio on detecting abusive behavior in chat‑based or agentive workflows, and for training the model to robustly refrain from dangerous responses without over‑refusing. Build evaluations and methodologies for measuring whether safeguards work, including in agentic settings. Write up findings clearly so they inform decisions across Trust & Safety, research, and product teams. You may be a good fit if you: Have a track record of independently driving research projects from ambiguous problem statements to concrete results, ideally in AI, ML, security, integrity, or a related technical field. Are comfortable scoping your own work and switching between research, engineering, and analysis as a project demands. Have working familiarity with how large language models operate—sampling, prompting, training—even if LLMs aren’t your primary background. Are proficient in Python and comfortable working with large datasets. Care about the societal impacts of AI and want your work to directly reduce real‑world harm. Strong candidates may also have: Experience building and training machine learning models, including classifiers for abuse, fraud, integrity, or security applications. Knowledge of evaluation methodologies for language models and experience designing evals. Experience with agentic environments and evaluating model behavior in them. Background in trust and safety, integrity, fraud detection, threat intelligence, or adversarial ML. Experience with red teaming, jailbreak research, or interpretability methods like steering vectors. A history of taking research prototypes and transferring them into production systems. Compensation Annual compensation range: $350,000 – $850,000 USD. Logistics Minimum education: Bachelor’s degree or equivalent. Required field of study: A field relevant to the role. Minimum years of experience: Correlates with internal job level requirements. Location-based hybrid policy: All staff expected to be in one of our offices at least 25% of the time. Visa sponsorship: We sponsor visas where possible. As set forth in Anthropic’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law. #J-18808-Ljbffr Anthropic

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Research Engineer (Safeguards Labs) in San Francisco, CA vacancy
  •  ...drug discovery. We work with leading AI labs, human data companies, and frontier biotech...  ...DeepMind. About the Role As an RL Engineer at BioStack, you will help build the reinforcement...  ...decision-making, and biomedical research tasks. We’re looking for someone with strong... 
    Suggested
    Contract work

    BioStack

    San Francisco, CA
    1 day ago
  •  ...Description We are seeking a creative, hands‑on Senior Mechanical Research Engineer with significant vibration and dynamics experience to lead...  ...accelerometers, IMUs, force/strain transducers, and standard lab instrumentation (DAQ and related tools). Strong technical judgment... 
    Suggested

    Gridware

    San Francisco, CA
    1 day ago
  • Research Engineer - World Models - Onsite, Downtown San Francisco Hiring for a stealth frontier AI lab building real-time AI gaming companions. Think AI squadmates that can learn, plan, understand game worlds, and play side-by-side with humans. Looking for someone research... 
    Suggested

    Acceler8 Talent

    San Francisco, CA
    1 day ago
  • Research Engineer - Voice/Speech AI - Onsite, Downtown San Francisco Hiring for a Stealth frontier AI lab building real-time, full-duplex voice agents for gaming Think AI squadmates that can listen, interrupt naturally, understand live game states, and join the chaos... 
    Suggested

    Acceler8 Talent

    San Francisco, CA
    1 day ago
  • Acceler8 Talent is hiring a Research Engineer in San Francisco to develop innovative real-time AI gaming companions. The role focuses on creating...  ...will have experience implementing research from top AI labs and training models. This position emphasizes active research... 
    Suggested

    Acceler8 Talent

    San Francisco, CA
    1 day ago
  • $350k

    Thinking Machines Lab's mission is to empower humanity through advancing collaborative...  ...needs and goals. We are scientists, engineers, and builders who’ve created some of the...  ...Tinker is our fine‑tuning API that empowers researchers and developers to customize frontier AI... 
    Visa sponsorship
    Work visa
    Relocation package

    Thinking Machines Lab

    San Francisco, CA
    1 day ago
  •  ...most exciting startups; a well-funded AI Lab building the next generation of AI tools...  ...design are hiring for Formal Methods Researchers. Backed by an advisory board that includes...  ...team brings together researchers and engineers from leading orgs. like OpenAI, Anthropic... 

    Strativ Group

    San Francisco, CA
    1 day ago
  •  ...internet — and it’s still massively under-modeled. We’re an AI research lab building internet-scale video understanding systems used by...  ...top-tier investors, we’re scaling fast and hiring our next core engineer. What You’ll Do Build high-performance video understanding... 
    Immediate start

    Acceler8 Talent

    San Francisco, CA
    1 day ago
  • Acceler8 Talent is seeking a Research Engineer for their AI research lab in San Francisco, focusing on interpretability, alignment, and reinforcement learning. This position involves building experimental systems for interpretability research. Ideal candidates will have... 

    Acceler8 Talent

    San Francisco, CA
    1 day ago
  • $150k - $230k

    Triage is an applied research lab building adaptive security and safety alignment infrastructure for AI systems: defending against novel...  ...San Francisco About the Role We're hiring a Founding Research Engineer to drive the research agenda that makes our detection infrastructure... 
    Full time

    Triage

    San Francisco, CA
    1 day ago
  • About Liquid Labs Research has been core to Liquid AI from the beginning. Liquid Labs gives that work a formal home; an internal research...  ...intelligence through both fundamental research and practical engineering. We work hand-in-hand with Liquid’s core foundation model and... 
    Immediate start
    Work from home

    Liquid AI

    San Francisco, CA
    1 day ago
  • $350k

    Thinking Machines Lab is seeking a Software Engineer to build tools that accelerate research. This role focuses on creating systems like evaluation frameworks and RL training systems. Candidates should have a Bachelor's in a related field and strong software engineering... 

    Thinking Machines Lab

    San Francisco, CA
    1 day ago
  • $250k

     ...,000/year + benefits Description: Transluce is a non‑profit research lab building tools for scalable, end‑to‑end oversight of AI systems...  .... About the role: We are looking for strong scientists and engineers to help advance our vision of scalable end‑to‑end oversight... 
    Work at office
    Visa sponsorship

    Transluce

    San Francisco, CA
    1 day ago
  • $250k

    Transluce, a non-profit research lab in San Francisco, seeks scientists and engineers to advance AI oversight tools. You will help develop interpretable assistants and evaluate model behaviors, ensuring industry standards. Ideal candidates have experience in fine-tuning... 
    Visa sponsorship
    Work visa

    Transluce

    San Francisco, CA
    1 day ago
  • $350k

     ...as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to...  ...etc.) Background in building infrastructure for AI research labs or large-scale ML organizations Knowledge of GPU/TPU architectures... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    1 day ago
  • $300k

    Want to build the large-scale RL environments frontier labs use to train agents that can truly reason and act? This team are creating...  ...“good” looks like for intelligent behaviour. It’s open-ended, research-driven work where the task definition, data, and reward structure... 

    Techire Ai

    San Francisco, CA
    1 day ago
  • $150k - $350k

     ...superintelligence stack: the infrastructure frontier AI labs build internally, made available to every...  ...for long‑horizon tasks like autonomous research, and the full‑stack platform our own...  ...with researchers and infrastructure engineers to translate bottlenecks into concrete... 
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours

    Prime Intellect

    San Francisco, CA
    1 day ago
  • Research Engineer - Interpretability Systems An AI research lab working at the frontier of interpretability, alignment, and reinforcement learning is hiring Research Engineers focused on understanding what’s happening inside large language models This role is for engineers... 

    Acceler8 Talent

    San Francisco, CA
    1 day ago
  • Fundamental AI Research Institute Come join one of the only research institutions globally with resources to compete with top AI companies => 10s of 1000s of GPUs and Tier1 talent. This lab is a playground for state-of-the-art research in LLMs, Reinforcement Learning... 

    Storm3

    San Francisco, CA
    1 day ago
  • $350k

    Research Engineer, Knowledge Foundations About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We...  ...work in a research-heavy environment such as a frontier AI lab, quant research firm, or domain-focused AI startup Published... 
    Visa sponsorship

    Anthropic

    San Francisco, CA
    1 day ago
  • Black Forest Labs is recruiting a Member of Technical Staff - Research Engineer to own and optimize large-scale generative-model training systems in a hybrid SF/remote setting. You’ll work closely with researchers to push performance, memory footprint, and stability across... 
    Remote work

    BlackForestLabs

    San Francisco, CA
    2 days ago
  • We're hiring ML Researchers to work on some of the hardest problems in voice AI, including expressive TTS, omni-modal LLMs, neural audio codecs...  ...High ownership and visibility Less bureaucracy than large AI labs Opportunity to build a research organization from the ground... 

    Confidential

    San Francisco, CA
    1 day ago
  •  ...intelligence layer to help scientists and engineers move faster and solve core R&D problems....  ...What you’ll do: Translate cutting-edge AI research into production‑grade systems. Build...  ...0‑to‑1 products at a startup, applied AI lab, or other high‑growth environments before... 

    Altara Technologies, Inc.

    San Francisco, CA
    1 day ago
  • Black Forest Labs is seeking an expert specialized in training systems to enhance performance and stability for multimodal generative...  ...systems. The role involves direct collaboration with researchers to implement efficient training solutions. Candidates should possess... 
    Remote job

    Black Forest Labs

    San Francisco, CA
    3 days ago
  •  ...structuring web data. This isn't theoretical RL research. You'll build your own training infra,...  ...translate your work into language that engineers, product people, and leadership can...  ...that tend to do well: RL engineers at AI labs or applied ML teams who've shipped models... 

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    1 day ago
  • $250k - $350k

     ...Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises looking to...  ...environment types are listed here: Environments for Software Engineering / coding agents MCP-based Environments for general... 
    For contractors

    turing

    San Francisco, CA
    1 day ago
  • $250k - $350k

    At World Labs, we’re building Large World Models—AI systems that understand, reason about, and interact with the physical world...  ...real-world environments. We’re assembling a global team of researchers, engineers, and builders to push beyond today’s limitations in... 

    WORLD LABS

    San Francisco, CA
    1 day ago
  • Turing, based in San Francisco, seeks a Staff Research Engineer - Code to own end-to-end data pipelines, RL environments, and evaluations for...  ...datasets at scale. You will collaborate with frontier labs, interface with researchers, and drive research, sales enablement... 

    turing

    San Francisco, CA
    1 day ago
  • $250k - $350k

     ...Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises looking to...  ...advantage. The Role We are looking for a Principal Research Engineer - RL to own the end‑to‑end lifecycle of RL environment... 
    Flexible hours

    Turing

    San Francisco, CA
    1 day ago
  • $250k - $350k

     ...Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises looking to...  ...environment types are listed here: Environments for Software Engineering / coding agents MCP‑based Environments for general... 

    Turing

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Engineer (Safeguards Labs). Be the first to apply!