AI Safety Benchmark Research Engineer
Vals AI, Inc.
Vals AI, Inc. is building the standard for evaluating misalignment in frontier models and agents. We seek an exceptional researcher to design and build the next generation of AI benchmarks that detect reward hacking, scheming, deception, and multi‑agent safety issues.
Your work will directly influence how foundations models are evaluated. You will lead benchmark design and infrastructure, collaborate with major labs and enterprises, publish findings, and stay at the forefront of alignment
#J-18808-LjbffrVacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Safety Benchmark Research Engineer in San Francisco, CA vacancy
- ...HUD Research EngineerHUD is building infrastructure to create RL training data and evals for frontier AI agents, as well as a marketplace to sell these to frontier... ...roleWe're looking for Research Engineers to build high-quality benchmarks for evaluating frontier agents...SuggestedFull timeWork at officeRemote workRelocationVisa sponsorship
Hud (yc W25)
San Francisco, CA20 hours ago - ...Founding Research EngineerThis early-stage AI safety company is building technology to ensure AI agents follow... ...legal evaluation environments and benchmarks, developing training pipelines... ...at least 1 year of research or ML engineering experience, strong Python engineering...Suggested
Recruiting from Scratch
San Francisco, CA3 days ago $140k - $200k
...The RoleAs a Research Engineer (RE) or Research Scientist (RS) at CAIS, you'll lead... ...impact research that advances the safety and reliability of frontier AI systems. This is the general posting... ....Build and maintain datasets and benchmarks.Run distributed training and...SuggestedWork at officeLocal areaCenter for Ai Safety
San Francisco, CA3 days ago- ...Dynamo AI in San Francisco seeks a research‑driven ML engineer focused on LLM safety to own a dedicated vertical, exploring a specific safety domain or use case from defense... ...high‑quality synthetic data, train LLMs, benchmark rigorously, and deliver robust production...Suggested
Capitolis
San Francisco, CA4 days ago $180k - $298k
...Research Scientist / Research Engineer, Automated Safety Cambridge, MA USA; London, UK; San Francisco, CA USA We're... ...building a talent-dense, high-agency AI safety team at Lila that will... ...systematic investigation beyond fixed benchmarks. Build reproducible...SuggestedFull timeWork at officeLocal areaFlexible hoursLila Sciences, Inc.
San Francisco, CA2 days ago$200k - $275k
...Halluminate, a San Francisco-based applied AI and data company, seeks a lead researcher to head in-house post-training... ...models, publish findings, drive benchmarks, contribute to platform tooling,... ...help build a high-performance engineering culture from the ground up, with...RelocationHalluminate
San Francisco, CA3 days ago- ...Senior Experimental Research Engineer, Electromagnetics Senior Experimental Research Engineer, Electromagnetics... ...of the grid that affect reliability and safety. Gridware’s advanced Active Grid... ...directly into each article, started with the help of AI. #J-18808-Ljbffr...Full time
Gridware
San Francisco, CA4 days ago $174k - $252k
...Share Research Engineer, Frontier Safety Mitigations, DeepMind DeepMind Mountain View, CA, USA ~ Bachelor’s degree or equivalent practical experience... ...of tangibly dangerous model capabilities seriously as AI advances. Because of this, we believe that proactively researching...Google LLC
San Francisco, CA20 hours ago$350k
...Research Engineer / Scientist, AlignmentSan Francisco, CAAbout AnthropicAnthropic's mission is to... ...reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial... ...exploratory experimental research on AI safety, with a focus on risks from powerful...Work at officeVisa sponsorshipFlexible hoursAnthropic
San Francisco, CA20 hours ago$200k - $400k
...Decagon is the leading conversational AI platform empowering every brand to deliver... ...About the Team Read more about the research team's work here: The Research team... .... About the Role As a Research Engineer focused on Safety, you’ll be responsible for making...Full timeWork at officeLocal areaDecagon
San Francisco, CA4 days ago- ...Research Scientist/Engineer, Biological Safety Anthropic · San Francisco, CA · Full-time Anthropic is hiring for Research Scientist/Engineer, Biological Safety, a role relevant to AI policy, governance, and external stakeholder work. policy security risk safeguards...Full time
Aicompliance
San Francisco, CA2 days ago - ...Firecrawl is hiring a Research Engineer - Benchmarks to design, run and publish public benchmarks of data providers, measuring accuracy, coverage, freshness, speed and cost. You will own datasets, ground truth, scoring, and the weekly release, collaborating with marketing...
Firecrawl
San Francisco, CA2 days ago $168k - $255k
...counting cells to accelerate cancer research, improving construction site safety, digitizing floor plans, preserving... ...on all roles (not only product and engineering), so Roboflow employs developers... ...bias toward action. Masters / PhD in AI, machine learning, computer vision,...Remote workWork from homeHome officeRelocation package$150k - $250k
About Distyl AI Distyl is an applied AI technology company partnering... ...social organizations.We research and deploy technologies that... ...ForAt Distyl, Research Engineers build the bridge between frontier... ...changes, not just whether a benchmark improvesAI Systems Mindset: You...Work at office3 days per weekDistyl AI
San Francisco, CA8 days ago$207k - $300k
...classifiers and introspection probes.Collaborate with safety engineering to develop new capabilities based on adversarial research.Contribute to increasing Gemini’s capabilities... ...-reviewed conferences or journals.Passion for AI technology and all of its possibilities.At...Google
San Francisco, CA8 days ago$200k - $225k
...AlembicAlembic is where top engineers are solving marketing's hardest... ...advanced analyticsDocument research and implementation decisions... ...technology: Work with advanced AI/ML algorithms, composite AI solutions... ...earn at or above real-time benchmarks. Ownership: Our generous...Alembic
San Francisco, CA8 days ago- ...platform for customer-facing AI agents, working with many of... ...Google Workspace.Sierra’s Applied Research team advances the quality,... ...to applied ML research or benchmarks.Our valuesTrust: We build trust... ...TypeFull timeLocation TypeOn-siteDepartmentEngineeringPlatform EngineeringFull timeFlexible hours
Sierra
San Francisco, CA6 days ago $180k - $280k
...SuperAnnotate helps the world’s leading AI teams build responsible, next... ...Impact You’ll Make Our research team is expanding to keep... ...of the field. As a Research Engineer, you’ll take a research... ...– finding the right papers, benchmarks, and prior work, reimplementing...Full timeSuperAnnotate AI
San Francisco, CA3 days ago$175k - $250k
...Research Engineer About Scorecard We’re a small, nimble team backed by top-tier investors... ...engineers to help shape the future of AI development. This role is part of the... ...realistic simulations. We plan to publish a benchmark to quantify the fidelity of a grounded...Work at officeKindredventures
San Francisco, CA4 days ago- ...RL training data and evals for frontier AI agents, as well as a marketplace to... ...the role We’re looking for an Applied Research Engineer to own implementation. Our data buyers... ...environments Experience working on benchmarks and evals – you can reason about what makes...Full timeWork at officeRemote workRelocationVisa sponsorship
HUD
San Francisco, CA4 days ago - ...world's first autonomous data engine, allowing us to teach the next... ...alike. About the Role As a Research Engineer at Datacurve, you... ...researchers at the world's leading AI labs — not necessarily to... ...domain. You will produce the benchmarks, artifacts, and technical narratives...Shift work
Datacurve
San Francisco, CA3 days ago - ...$150K Equity • Up to $25K in relocation assistance Research Engineer Greptile is an AI code reviewer that catches bugs and anti-patterns in pull... ...from $0 to eight figures in ARR ~ Raised $30M from Benchmark, Y Combinator, Paul Graham, and Initialized Team...Work at officeRelocation package
Greptile
San Francisco, CA4 days ago - ...build the foundation for agent engineering in the real world, helping... ...prototypes to production-ready AI agents that teams can rely on... ...Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures... ...looking for an experienced research engineer to help make the...Work at officeFlexible hours
LangChain
San Francisco, CA4 days ago - ...continuous conversation for every patient. An AI agent that knows who you are, remembers... ...of care. About the Role As a Research Engineer, you’ll be responsible for building... ...Design evaluation protocols and benchmarks that measure model quality, generalization...Work at officeFlexible hours
Alt
San Francisco, CA4 days ago $250k
...Description: Transluce is a non‑profit research lab building tools for scalable, end‑to‑end oversight of AI systems. We build world‑class,... ...integrated with core agent benchmarks like SWE‑bench, while our... ...for strong scientists and engineers to help advance our vision of...Work at officeVisa sponsorshipTransluce
San Francisco, CA4 days ago- ...Join Lucidic AI as a Founding Applied Research Engineer to develop and deploy cutting-edge optimization algorithms for enterprise AI agents. You will... ...architectures and pain points Build evaluation frameworks and benchmarks to measure agent performance improvements...
Lucidic
San Francisco, CA20 hours ago $224k - $336k
...Staff / Principal Research Engineer, AI Safety Mitigations Cambridge, MA USA; London, UK; San Francisco, CA USA We're building a talent-dense, high-agency AI safety team at Lila that will engage all core teams within the organization (science, model training, lab...Full timeWork at officeLocal areaFlexible hoursShift workLila Sciences, Inc.
San Francisco, CA2 days ago- ...Research Engineer, Computer UseSan Francisco, CA | New York City, NY | Seattle... ..., and steerable AI systems. We want AI to be safe... ...about the societal impacts and safety of your workPreferred Qualifications... ...building evaluations or benchmarks for agentic...Work at officeVisa sponsorshipFlexible hours
anthropic
San Francisco, CA6 hours ago $165k - $310k
...Senior Research Engineer, LLM Training & Post-Training New York, New York, United States; Remote... ...States Who We Are Lightning AI is the company behind PyTorch Lightning... ...bottlenecks. Design evaluation methodologies, benchmark models, analyze failure modes, and...For contractorsFor subcontractorWork at officeRemote workWork from homeFlexible hours2 days per weekLightning AI
San Francisco, CA1 day ago- ...Refresh is seeking a Research Engineer focused on benchmarking, to build rigorous evaluations of real-world coding and computer-use capabilities. You will translate expert workflows into verifiable tests and run benchmarks against frontier models. In this role you’ll...
Refresh
San Francisco, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Safety Benchmark Research Engineer. Be the first to apply!
Related searches
- machine learning ai engineer San Francisco, CA
- ai developer San Francisco, CA
- ai engineer remote San Francisco, CA
- ai ml engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- ai research engineer San Francisco, CA
- ai engineer San Francisco, CA
- reliability and safety engineer San Francisco, CA
- senior safety engineer San Francisco, CA