Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Engineer / Scientist, Alignment

$350k

anthropic

Research Engineer / Scientist, AlignmentSan Francisco, CAAbout AnthropicAnthropic's mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.About the RoleYou want to build and run elegant and thorough machine learning experiments to help us understand and steer the behavior of powerful AI systems. You care about making AI helpful, honest, and harmless, and are interested in the ways that this could be challenging in the context of human-level capabilities. You could describe yourself as both a scientist and an engineer. As a Research Engineer on Alignment Science, you'll contribute to exploratory experimental research on AI safety, with a focus on risks from powerful future systems (like those we would designate as ASL-3 or ASL-4 under our Responsible Scaling Policy), often in collaboration with other teams including Interpretability, Fine-Tuning, and the Frontier Red Team. Our current topics of focus include:Scalable Oversight: Developing techniques to keep highly capable models helpful and honest, even as they surpass human-level intelligence in various domains.AI Control: Creating methods to ensure advanced AI systems remain safe and harmless in unfamiliar or adversarial scenarios.Alignment Stress-testing: Creating model organisms of misalignment to improve our empirical understanding of how alignment failures might arise.Automated Alignment Research: Building and aligning a system that can speed up & improve alignment research.Alignment Assessments: Understanding and documenting the highest-stakes and most concerning emerging properties of models through pre-deployment alignment and welfare assessments (see our Claude 4 System Card), misalignment-risk safety cases, and coordination with third-party evaluators.Safeguards Research: Developing robust defenses against adversarial attacks, comprehensive evaluation frameworks for model safety, and automated systems to detect and mitigate potential risks before deployment.Model Welfare: Investigating and addressing potential model welfare, moral status, and related questions. See our program announcement and welfare assessment in the Claude 4 system card for more.Note: For this role, we conduct all interviews in Python and prefer candidates to be based in the Bay Area.Representative ProjectsTesting the robustness of our safety techniques by training language models to subvert our safety techniques, and seeing how effective they are at subverting our interventions.Run multi-agent reinforcement learning experiments to test out techniques like AI Debate.Build tooling to efficiently evaluate the effectiveness of novel LLM-generated jailbreaks.Write scripts and prompts to efficiently produce evaluation questions to test models' reasoning abilities in safety-relevant contexts.Contribute ideas, figures, and writing to research papers, blog posts, and talks.Run experiments that feed into key AI safety efforts at Anthropic, like the design and implementation of our Responsible Scaling Policy.You May Be a Good Fit If YouHave significant software, ML, or research engineering experienceHave some experience contributing to empirical AI research projectsHave some familiarity with technical AI safety researchPrefer fast-moving collaborative projects to extensive solo effortsPick up slack, even if it goes outside your job descriptionCare about the impacts of AIStrong Candidates May AlsoHave experience authoring research papers in machine learning, NLP, or AI safetyHave experience with LLMsHave experience with reinforcement learningHave experience with Kubernetes clusters and complex shared codebasesCandidates Need Not Have100% of the skills needed to perform the jobFormal certifications or education credentialsThe annual compensation range for this role is listed below. For sales roles, the range provided is the role's On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.Annual Salary: $350,000 - $500,000 USDLogisticsMinimum education: Bachelor's degree or an equivalent combination of education, training, and/or experienceRequired field of study: A field relevant to the role as demonstrated through coursework, training, or professional experienceMinimum years of experience: Years of experience required will correlate with the internal job level requirements for the positionLocation-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team. Your safety matters to us. To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit anthropic.com/careers directly for confirmed position openings.How We're DifferentWe believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.Come Work With Us!Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage: Learn about our policy for using AI in our application process.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Research Engineer / Scientist, Alignment in San Francisco, CA vacancy
  •  ...About the Team The Foundations Research team works on high-risk, high-reward ideas that...  ...for a Researcher to lead our safety and alignment research: building the systems that distinguish...  ...Search, partnering with researchers, engineers, and broader Safety and Integrity teams... 
    Suggested
    Full time

    openai

    San Francisco, CA
    5 days ago
  •  ...for long-horizon tasks like autonomous research, and the full-stack platform our own...  ...learning. We’re hiring research engineers and scientists across RL algorithms, scaling research...  ...0-350k, including equity incentives, aligning your success with the growth and impact... 
    Suggested
    Full time
    Work at office
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours

    PrimeIntellect

    San Francisco, CA
    5 days ago
  •  ...all daily U.S. X-rays. Our research team brings experience from...  ...for an exceptional Research Scientist to push the frontier of...  ...small team of researchers and engineers, with the freedom to pursue...  ...objectives, and vision-language alignment. Experience with large-... 
    Suggested
    Full time

    epsilon-health

    San Francisco, CA
    5 days ago
  • $259.2k - $324k

    Scale Labs, Research Scientist — AI Safety and AlignmentAs the leading data and evaluation partner for frontier AI companies, Scale plays a...  ...some of the hardest open problems in AI safety: assessing the alignment of frontier models, developing control protocols and... 
    Suggested
    Full time

    Scale AI

    San Francisco, CA
    2 days ago
  • About Us FAR.AI is a non-profit AI research institute working to ensure advanced AI is...  ...looking for an experienced research scientist/engineer to partner with the Research Lead of the...  ...a compelling candidate: Safety or alignment research at a frontier lab or a research... 
    Suggested
    Full time
    For contractors
    Work at office
    Remote work
    Visa sponsorship

    FAR.AI

    Berkeley, CA
    2 days ago
  •  ...team of neuroscientists, computational scientists, and engineers to build them (hardware, software,...  ...implantation, and headbar installation. Mentor research associates and technicians - and, at...  ...with two-photon systems: optical alignment, system characterization, and in vivo... 
    Day shift
    Afternoon shift

    Astera

    Emeryville, CA
    4 days ago
  • Research Engineer/Scientist, World Models. Our mission is to build a general-purpose AI for robots. We believe the path is to deploy robots early in real customer environments, learn from large-scale real-world experience, and steadily increase autonomy and performance... 
    Full time

    Tau Robotics, Inc.

    San Francisco, CA
    13 hours ago
  •  ...a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build...  ...mission is to ensure that transformative AI systems are aligned with human interests. We are seeking a Research Engineer to... 
    Full time

    Anthropic

    San Francisco, CA
    17 days ago
  •  ...harnessing, and deployment—and connect that research to the patients, clinicians, and real-...  ...excellence, velocity, ownership, and alignment with the mission are most important to us...  ...decisions. Work closely with researchers, engineers, clinicians, and product teams to bring... 
    Full time
    Work at office
    Relocation package

    openai

    San Francisco, CA
    5 days ago
  •  ...pushing the boundaries of reinforcement learning research, building next-generation generative models,...  ...at scale. About the Role As a Research Engineer/Research Scientist at OpenAI, you will advance the frontier of AI alignment and capabilities through cutting-edge RL... 
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    5 days ago
  •  ...a quickly growing group of committed researchers, engineers, policy experts, and business leaders...  ...the north star goal of building an AI scientist – a system capable of solving the long...  ...models that are both capable and well aligned Scale research ideas from prototype... 
    Full time
    For contractors
    Work experience placement
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    5 days ago
  •  ...a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build...  ...mission is to ensure that transformative AI systems are aligned with human interests. We are seeking a Research Engineer to... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    5 days ago
  •  ...Labs World Labs is a frontier AI research and product company advancing spatial...  ...’re looking for strong Robot Learning Engineer/Scientist to develop and advance state-of-the-art...  ...randomization, system identification, real-sim alignment. Collaborate with simulation and... 
    Full time
    Work at office
    Visa sponsorship
    Work visa
    Relocation package
    Flexible hours

    worldlabs

    San Francisco, CA
    5 days ago
  •  ...1% of all daily U.S. X-rays. Our research team brings experience from DeepMind...  ...looking for an exceptional Research Engineer or Research Scientist to push the frontier of vision foundation...  ..., or cross-modal representation alignment. Background in medical imaging,... 
    Full time

    epsilon-health

    San Francisco, CA
    5 days ago
  • $140k - $200k

     ...for AI Safety (CAIS) is a leading research and advocacy organization focused on...  ...policymakers. The Role As a Research Engineer (RE) or Research Scientist (RS) at CAIS, you'll lead and...  ...federal, state, and local laws. In alignment with the San Francisco Fair Chance... 
    Work at office
    Local area

    Center for AI Safety (CAIS)

    San Francisco, CA
    2 days ago
  •  ...makers of Devin, the first AI software engineer. Our team is extremely talent-dense....  ...human in the loop. Safety here is not a research paper; it is whether an agent behaves correctly...  ...that gate every release, develop alignment methods that shape how our models are trained... 
    Full time
    Local area

    cognition

    San Francisco, CA
    5 days ago
  •  ...Research Scientist, Research Engineer, AI Systems EngineerThe Recursive Self-Improvement (RSI) team works across research, engineering, product, and infrastructure to build AI systems that accelerate and ultimately conduct high-quality research at OpenAI. We work to automate... 

    OpenAI

    San Francisco, CA
    2 days ago
  • # Researcher, Alignment InterpretabilityOpenaionsitefull timeSan FranciscoApply## DescriptionAbout the Team The Interpretability team studies...  ...using representations to understand model behavior, and in engineering models to have more understandable representations. We are... 

    Rebash

    San Francisco, CA
    1 day ago
  • OpenAI is seeking a Researcher in Alignment Interpretability in San Francisco. You will develop and execute a research plan on mechanistic interpretability...  ...safe AGI. The role emphasizes publishing techniques, engineering scalable infrastructure to study model internals, and... 

    Rebash

    San Francisco, CA
    1 day ago
  •  ...human review rubrics, and partner with research, product and business colleagues so that...  ...on measuring what matters, with product engineers on instrumenting real usage, and with external...  ...a gamed metric while keeping the team aligned.High agency and a strong sense of... 
    Relocation

    Raydar Inc

    San Francisco, CA
    3 days ago
  •  ...prescriptions. Our team includes ex-founders and engineers who have built and scaled consumer apps...  ...Overview We are hiring a Founding Research Engineer to design, prototype, and ship...  ..., retrieval and tool use, safety and alignment, and putting breakthroughs into... 

    Lotus

    San Francisco, CA
    2 days ago
  • $275k

     ...Research EngineerMagic's mission is to build safe AGI that accelerates humanity's progress...  ...generation to improve models and solve alignment more reliably than humans can alone. Our...  ...compute to achieve this goal.As a Research Engineer, you'll work on training, evaluating,... 
    Relocation

    Magic Inc

    San Francisco, CA
    2 days ago
  • $9.7k - $19k

     ...Research Engineer InternThe Center for AI Safety (CAIS) is a leading research and advocacy organization focused on mitigating societal-scale...  ...projects in areas such as AI security, machine ethics, AI alignment, and benchmarking AI risks. We will assign you a dedicated mentor... 
    Full time
    Internship
    Local area

    Center for AI Safety

    San Francisco, CA
    3 days ago
  •  ...About Human Archive Human Archive is a research lab backed by Y Combinator focused on...  .... The Opportunity As a Research Engineer, you’ll work on multimodal sensing systems...  ..., calibration, fusion, and multimodal alignment Prototype quickly and iterate from real... 
    Shift work

    Human Archive

    San Francisco, CA
    1 day ago
  •  ...industry and lab partners to shorten the path from research to real products. About the Role As a Research Scientist on our material discovery team, you will help...  ..., and machine learning scientists and engineers, where the biggest impact comes from working together... 

    Logical Intelligence

    San Francisco, CA
    14 days ago
  •  ...Astera Neuro is a philanthropically funded research organization within the Astera Institute...  ...primate brain. You'll work alongside engineers, software developers, neuroscientists, veterinarians...  ...senior or principal level, more junior scientists and engineers; contribute to hiring,... 

    Astera

    Emeryville, CA
    4 days ago
  •  ...World Labs is a frontier AI research and product company advancing...  ...research science (RS) or research engineering (RE) background who has made...  ...a small team of research scientists and/or research engineers: providing...  ...cross-functional partners to align 3D modeling capabilities with... 
    Full time
    Work at office
    Visa sponsorship
    Work visa
    Relocation package
    Flexible hours

    worldlabs

    San Francisco, CA
    5 days ago
  •  ...About the Team The Foundations Research team works on high-risk, high-reward ideas that could shape the next decade of AI. Our goal...  ...retrieval and model reasoning. Partner with researchers and engineers to integrate structured knowledge into Search and use model performance... 
    Full time

    openai

    San Francisco, CA
    5 days ago
  •  ...systems at companies like 11x and Bilt Rewards , learning and improving every day. We’re assembling a world-class team of researchers and engineers to solve AI’s hardest problem: making machines that can reason, remember, and learn the way humans do. Note that this... 
    Full time

    letta

    San Francisco, CA
    5 days ago
  • $230k

     ...verifiable legal tasks. You’ll help set the research direction and carry ideas from...  ...join a small, high-bar team of hands-on engineers and researchers, where each person owns...  ...We’re looking for research engineers and scientists who have gotten training runs working at... 
    Remote job
    Full time

    harvey

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Engineer / Scientist, Alignment. Be the first to apply!