Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Scientist, AI Safety and Alignment

$259.2k - $324k

Scale AI

Scale Labs, Research Scientist — AI Safety and AlignmentAs the leading data and evaluation partner for frontier AI companies, Scale plays a central role in understanding and safeguarding AI systems. Building on this expertise, Scale Labs has launched a new team focused on technical AI safety and policy research, to bridge the gap between frontier AI research and policy, helping policymakers make informed, evidence-based decisions about AI capabilities and risks.Our research tackles some of the hardest open problems in AI safety: assessing the alignment of frontier models, developing control protocols and monitoring methods, preserving the monitorability, understanding failure modes in multi-agent systems and recursive self-improvement. We collaborate closely with partners across industry, the public sector, and academia and regularly publish our findings. We are looking for talented researchers to join us in shaping this vision.As a Research Scientist on this team, you will conduct research and build evaluations, tools, and datasets that help us understand and reduce risks from frontier AI systems. For example, you might do any or all of the following: Design and stress-test control protocols and monitoring systems that detect and limit unsafe behavior by AI models and agents in deployment;Build alignment evaluations that probe for deception, sabotage, scheming, reward hacking, and other misaligned behaviors;Study monitorability, including whether a model’s reasoning stays faithful and legible enough to supervise, and how training methods and deployment practices can preserve or erode it;Investigate risks that emerge when multiple AI agents interact, such as collusion, coordination failures and steerability;Develop threat models and evaluations for AI systems that automate AI research and development, to track progress toward recursive self-improvement and inform preparedness planning;Work with government agencies and other labs to scope and design evaluations that measure and mitigate risks from advanced AI;Publish research and evaluation methodologies, and write technical reports for policymakers.Ideally you’d have:Commitment to our mission of promoting safe, secure, and trustworthy AI as capabilities continue to advance.Practical experience conducting technical research collaboratively. You should be comfortable building and instrumenting ML pipelines, building evaluation harnesses, running experiments on frontier models and agents, and quickly turning new ideas from the research literature into working prototypes.Familiarity with current research in at least one of the areas above.A track record of published research in machine learning, particularly in AI safety and alignment.At least three years of experience working on sophisticated ML problems, in research or product development.Strong written and verbal communication skills, including the ability to explain technical findings to policymakers and work across functions.Nice to have:Experience designing evaluations and benchmarks, or building tools and pipelines to analyze model and agent trajectories at scale.Experience with red-teaming or adversarial testing of AI systems, including stress-testing safeguards such as monitors and control protocols.Familiarity with AI safety policy and governance frameworks (e.g., NIST AI RMF, EU AI Act, Korea AI Basic Act, frontier AI safety frameworks).Our research interviews are crafted to assess candidates' skills in practical ML prototyping and debugging, their grasp of research concepts, and their alignment with our organizational culture. We will not ask any LeetCode-style questions. If you’re excited about advancing AI safety and contributing to our mission, we encourage you to apply, even if your experience doesn’t perfectly align with every requirement.Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position and may be inclusive of several career levels at Scale; it will be determined during the interview process based on work location and additional factors, including job-related skills, experience, qualifications, interview performance, and relevant education or training. Scale employees in eligible roles are also granted equity based compensation, subject to Board of Director approval. Your recruiter can share more about the specific salary range for your preferred location during the hiring process, and confirm whether the hired role will be eligible for equity grant. You'll also receive benefits including, but not limited to: comprehensive health, dental and vision coverage, retirement benefits, a learning and development stipend, and generous PTO. Additionally, this role may be eligible for additional benefits such as a commuter stipend.Please reference the job posting's subtitle for where this position will be located. For pay transparency purposes, the base salary range for this full-time position in the locations of San Francisco, New York, Seattle is:$259,200—$324,000 USDPLEASE NOTE: Our policy requires a 90-day waiting period before reconsidering candidates for the same role. This allows us to ensure a fair and thorough evaluation of all applicants.About Us:At Scale, our mission is to develop reliable AI systems for the world's most important decisions. Our products provide the high-quality data and full-stack technologies that power the world's leading models, and help enterprises and governments build, deploy, and oversee AI applications that deliver real impact. We work closely with industry leaders like Meta, Ernst& Young, Mayo Clinic, Time Inc., the Government of Qatar, and U.S. government agencies including the Army and Air Force. We are expanding our team to accelerate the development of AI applications.We believe that everyone should be able to bring their whole selves to work, which is why we are proud to be an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity or Veteran status. We are committed to working with and providing reasonable accommodations to applicants with physical and mental disabilities. If you need assistance and/or a reasonable accommodation in the application or recruiting process due to a disability, please contact us at View email address on click.appcast.io. Please see the United States Department of Labor's Know Your Rights poster for additional information.We comply with the United States Department of Labor's Pay Transparency provision. PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of job opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with our internal policies and programs designed to protect personal data. Please see our privacy policy for additional information.

Vacancy posted 19 hours ago
Similar jobs that could be interesting for youBased on the Research Scientist, AI Safety and Alignment in San Francisco, CA vacancy
  • $350k

     ...Research Engineer / Scientist, AlignmentSan Francisco, CAAbout AnthropicAnthropic's...  ...interpretable, and steerable AI systems. We want AI to be...  ...As a Research Engineer on Alignment Science, you'll contribute...  ...experimental research on AI safety, with a focus on risks from... 
    Suggested
    Work at office
    Visa sponsorship
    Flexible hours

    anthropic

    San Francisco, CA
    2 days ago
  •  ...About the Team The Foundations Research team works on high-risk, high-reward ideas that could shape the next decade of AI. Our goal is to advance the science and data...  ...re looking for a Researcher to lead our safety and alignment research: building the systems that distinguish... 
    Suggested
    Full time

    openai

    San Francisco, CA
    3 days ago
  • $195k - $300k

     ...Project/Division: AI, Foundational Research Start date: As soon as possible...  ...is hiring a Senior Research Scientist to design and run the in vitro...  ...a member of the NIST US AI Safety Consortium and a partner to...  ...with discretion. Alignment with SecureBio's mission of... 
    Suggested
    Full time
    Work at office
    Immediate start
    Overseas
    Flexible hours
    Shift work

    securebio

    San Francisco, CA
    20 hours ago
  • $140k - $200k

     ...week) About The Center for AI Safety (CAIS) The Center for AI Safety (CAIS) is a leading research and advocacy organization focused...  ...Engineer (RE) or Research Scientist (RS) at CAIS, you'll lead and...  ..., state, and local laws. In alignment with the San Francisco Fair Chance... 
    Suggested
    Work at office
    Local area

    Center for AI Safety (CAIS)

    San Francisco, CA
    22 hours ago
  • $250k

     ...to count cells to accelerate cancer research, improve construction site safety, digitize floor plans, preserve coral...  ...business that is exploding as AI traverses the physical economy. What You'll Do As a Research Scientist at Roboflow Labs, you'll sit at the... 
    Suggested
    Work at office

    Roboflow

    San Francisco, CA
    1 day ago
  • $100k - $300k

     ...Research ScientistCogent Research is the applied AI lab at the heart of Cogent's mission. As a Research Scientist, you will drive foundational and applied research at the frontier of automated...  ...and drive them to completionMission Alignment: A genuine passion for Cogent's... 

    Cogent Security, Inc.

    San Francisco, CA
    5 days ago
  •  ...multi-year runway. About the Role We're looking for an AI Research Scientist to advance the methodological frontier of AI in healthcare....  .... You will develop and own a research agenda aligned with Sprinter's company strategy. Your work may include novel... 
    Temporary work
    Work at office
    Monday to Friday
    Monday to Thursday
    Flexible hours

    Sprinter Health

    San Francisco, CA
    5 days ago
  • $168k - $233k

    About WRITERWRITER is the AI platform built for the world’s most...  ...WRITER.com. About the roleAI research at WRITER isn't just about...  ...the world. As an AI research scientist, you'll be at the center of that...  ..., DPO, etc., and emerging alignment techniques, with a focus on improving... 
    Full time
    Local area

    Writer Corporation

    San Francisco, CA
    5 days ago
  •  ...Khosla Ventures-backed company building AI agents that reason about complex...  ...stealth mode. The Role We’re looking for research scientists who want to work at the intersection of...  ...lucky. Scalable oversight: Contributing to alignment and oversight research - figuring out how... 

    Xterra Ai

    San Francisco, CA
    4 days ago
  • $275k

     ...About Plato Plato is an applied research lab building the foundational...  ...to train specialized AI agents. We turn real-world...  ...Work with the frontier: Build safety environments and benchmarks that...  ...Safety & Security Resaercher or AI Alignment Engineer or Researcher Compensation... 
    Relocation

    Plato

    San Francisco, CA
    28 days ago
  •  ...auditing methods, and improving alignment. We were the first to show...  ...can be a practical additional safety mechanism, and today our...  ...monitoring, and frontier-risk research.We care most about monitorability...  ...about making increasingly capable AI systems more monitorable,... 
    Full time
    Work at office
    Relocation package

    openai

    San Francisco, CA
    3 days ago
  •  ...the infrastructure frontier AI labs build internally, made available...  ...tasks like autonomous research, and the full-stack platform...  ...hiring research engineers and scientists across RL algorithms, scaling...  ...including equity incentives, aligning your success with the growth... 
    Full time
    Work at office
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours

    PrimeIntellect

    San Francisco, CA
    4 days ago
  •  ...diagnostics by bringing frontier AI into clinical practice. We're...  ...daily U.S. X-rays. Our research team brings experience from...  ...for an exceptional Research Scientist to push the frontier of vision...  ...objectives, and vision-language alignment. Experience with large-... 
    Full time

    epsilon-health

    San Francisco, CA
    4 days ago
  •  ...About Us FAR.AI is a non-profit AI research institute working to ensure advanced...  ...facilitate breakthrough AI safety research, advance global understanding...  ...an experienced research scientist/engineer to partner with...  ...candidate: Safety or alignment research at a frontier lab... 
    Full time
    For contractors
    Work at office
    Remote work
    Visa sponsorship

    far.ai

    Berkeley, CA
    3 days ago
  •  ...harder — but more important — than ever, with AI enabling fraudsters to launch...  ...assurance and verification to comply with online safety regulations, protecting younger users...  ...never been harder or more important. You'll research how to detect fraud and verify identities... 
    Full time
    For contractors
    Internship

    Persona AI

    San Francisco, CA
    3 days ago
  • $285k - $380k

     ...People Research Scientist, RecruitingSan Francisco, CA | New York City, NY | Seattle, WAAbout AnthropicAnthropic...  ...reliable, interpretable, and steerable AI systems. We want AI to be safe and...  ...field of people science at a leading AI safety company.ResponsibilitiesResearch Design... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    5 days ago
  •  ...founding team, who are well known in the AI community for seminal research accomplishments at top AI labs, have...  ...a highly experienced AI Research Scientist to play a crucial role in the...  ...learning research projects, ensuring they align with business goals. Scale our... 

    Chai Discovery Inc.

    San Francisco, CA
    4 days ago
  • $117.2k - $313.7k

     ...About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive...  .... The Experience Salesforce AI Research is a global leader in Enterprise AI, driving...  ...are looking for entrepreneurial Research Scientists who want to build, ship, and scale the next... 
    Full time
    Worldwide

    Salesforce

    San Francisco, CA
    4 days ago
  • $160k - $250k

     ...Overview Research Scientist - Mountain View, CA at Granica. This range is provided by Granica. Your actual pay will be based on your skills and...  ...60,000.00/yr - $250,000.00/yr What Granica does Granica is an AI research and systems company building the infrastructure for a... 
    Flexible hours

    Granica

    San Francisco, CA
    5 days ago
  • $150k - $275k

     ...technological leadership and dominance in semiconductor fabrication. We're a team of world‑class scientists, engineers, and technical experts spanning many disciplines. Research Scientist, AI Location Employment Type Full time Location Type On-site Department... 
    Full time
    Local area

    Substrate Inc

    San Francisco, CA
    2 days ago
  •  ...About Us FAR.AI is a non-profit AI research institute dedicated to ensuring advanced...  ...breakthrough AI safety research, advance global understanding...  ..., such as the San Diego Alignment Workshop or the Guaranteed...  ...overlap between scientist and engineer roles. As a scientist... 
    Full time
    Remote work
    Visa sponsorship

    Aisafety

    Berkeley, CA
    5 days ago
  • $184k - $274.6k

     ...notice.Meet the TeamAt Foundation AI, we are leading frontier AI research across Cisco. Our mission is to advance...  ...frontier models on specific tasks aligned with Cisco's business priorities...  ...systems for security-focused use cases, safety, and robust machine learningWhy... 
    Full time
    Temporary work
    Local area
    Flexible hours

    CISCO Systems

    San Francisco, CA
    2 days ago
  • $100 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...model outputs . Review complex machine learning research for alignment with domain principles and methodologies. Provide clear, structured... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    17 hours ago
  •  ...Join our team to develop cutting-edge gesture recognition AI models and algorithms. We're looking for an AI Research Scientist to join our team working on bleeding-edge gesture recognition technology. You'll be responsible for developing and improving our core AI models... 

    Perdurable AI

    San Francisco, CA
    2 days ago
  • $188k - $215k

     ...About Collate Collate is an AI document generation platform...  ...and founder of Lever. Our AI researchers, engineers, and designers...  ...looking for an AI Research Scientist to push the boundaries of how...  ...evaluation frameworks to measure safety, reliability, and fairness.... 

    Collate

    San Francisco, CA
    1 day ago
  •  ...time; have a track record of exceptional research or engineering achievement; move...  ...should apply for this role! About P-1 AI: At P-1 AI, we are building an AI engineer...  ...We're seeking an exceptional AI Research Scientist to join our small team of elite... 
    Relocation package

    P-1 Ai

    San Francisco, CA
    3 days ago
  •  ...AI Research ScientistLocation: San Francisco or remote · Full-timeAbout UsHum's mission is...  ...unsolved problems.The RoleAs our AI Research Scientist, you'll own the model at the center of...  ...positive impact seriously, including safety and guardrails, and you'll help us get it... 
    Remote work

    Humai

    San Francisco, CA
    2 days ago
  •  ...Sygaldry Sygaldry Technologies is building quantum-accelerated AI servers to exponentially speed up training and inference for...  ...AI systems for this next era. We are looking for a Research Scientist who can help define Quantum AI: not just quantum machine learning... 
    Full time
    Casual work
    Visa sponsorship

    sygaldry-technologies

    San Francisco, CA
    4 days ago
  • $150k - $250k

     ...About Us FAR.AI is a non-profit AI research institute working to ensure advanced...  ...facilitate breakthrough AI safety research, advance global...  ...training dynamics to improve alignment. Black-box methods,...  ...the Role As a Research Scientist on the team, you will take... 
    Full time
    Work at office
    Remote work
    Work from home
    Relocation
    Visa sponsorship

    far.ai

    Berkeley, CA
    4 days ago
  • $180k - $298k

     ...re building a talent-dense, high-agency AI safety team at Lila that will engage all core teams...  ...safety systems to mitigate risks, and a research agenda that explores longer-term needs...  ...mechanisms. We welcome Research Scientists and Research Engineers; responsibilities... 
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    San Francisco, CA
    22 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Scientist, AI Safety and Alignment. Be the first to apply!