AI Safety Researcher: Safety, Evaluation & Red-Teaming
Thinking Machines Lab Inc.
Thinking Machines Lab Inc. in San Francisco is seeking a safety researcher to bridge research and hands-on engineering, focusing on making models safe and trustworthy. You will explore how training shapes refusals and how to evaluate boundaries, designing experiments to inform model training and evaluation strategies. Join a team that values rigorous analysis, data-driven evaluation, and responsible AI practices, with opportunities to influence real-world deployments. #J-18808-Ljbffr Thinking Machines Lab Inc.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Safety Researcher: Safety, Evaluation & Red-Teaming in San Francisco, CA vacancy
- Mercor is assembling a panel of chemistry and chemical safety experts to red-team frontier AI models. The role centers on writing challenging single-... ...prompts across benign, dual-use, and adversarial levels, and evaluating the model responses against a defined policy standard....Suggested
- Mercor is assembling a panel of chemistry and chemical safety experts to red-team frontier AI models. You will write challenging prompts at three levels (benign, dual-use, adversarial) and evaluate model responses against a defined policy standard, providing a reference...Suggested
- Mercor is assembling a panel of chemistry and chemical safety experts to red-team frontier AI models. The role focuses on writing challenging prompts... ...across benign, dual-use, and adversarial categories, and evaluating model responses against a defined policy standard....Suggested
- Mercor is assembling a panel of chemistry and chemical safety experts to red-team frontier AI models. You will write challenging prompts across three levels and judge model responses against a policy standard. You will also craft the reference answer with technical reasoning...Suggested
- OpenAI is seeking a safety- and security-minded researcher or engineer in San Francisco to design... ...for increasingly capable AI agents. The role focuses on... ...Codex harness engineering team to productionize AI controls, conduct red-team evaluations, and iterate mitigations...Suggested
- Mercor is assembling a panel of chemistry and chemical safety experts to red-team frontier AI models. The role centers on writing challenging prompts in three levels and evaluating model responses against a defined policy standard. You will also write the reference answer...
- OpenAI is seeking researchers and engineers to advance frontier-model research with a focus on safety and alignment. You will train and evaluate models, identify misalignments, and develop scalable... ...working with cross-functional teams to deploy mitigations at scale. This...Relocation package
$148k - $208k
...building a talent-dense, high-agency AI safety team at Lila that will engage all... ...engagement, safety-focused evaluations, safety systems to mitigate risks, and a research agenda that explores longer-term... ...informative assessments, interpret red-team findings and test...Full timeWork at officeLocal areaFlexible hours- About the Team The Agent Safety team works to ensure that increasingly capable AI agents act safely, exercise sound... ...Measurements: Build evaluations and production metrics... ...&security minded researcher or engineer who can reason... ...the AI controls. Red-team end-to-end agentic...Work at officeRelocation package
$150k - $250k
About Distyl AI Distyl is an applied AI technology company partnering... ...social organizations.We research and deploy technologies that power... ...System Self-Construction team builds systems that can build... ...their own construction processes, evaluate them, and evolve. They draw...Work at office3 days per weekDistyl AI
San Francisco, CA3 days ago$380k
About the TeamThe Safety Systems team is responsible for various safety work... ..., driving our commitment to AI safety and fostering a culture... ...a breadth of new ML research to address the growing set of... ...highest safety standards.Actively evaluate and understand the safety of...Work at officeLocal areaFlexible hoursOpenAI
San Francisco, CA3 days ago$380k
About the TeamThe Safety Training research team aims to fundamentally advance our capabilities for precisely implementing safe behavior in AI models, and to leverage these advances to make OpenAI... ...seeking a researcher to train and evaluate models for U.S. government use,...Work at officeLocal areaRemote workFlexible hoursOpenAI
San Francisco, CA3 days ago- ...site in the specified location(s).As an AI Researcher within Schwab’s Artificial Intelligence... ...problem formulation through modeling, evaluation, deployment, and iteration, contributing... ...actively used by clients or internal teams.Strong grounding in data analysis (Python...Work at office
Forge Global
San Francisco, CA1 day ago $216.3k - $280.8k
Meet the TeamAt Foundation AI, we are leading frontier AI research across Cisco. Our mission... ...training algorithms, evaluation science, inference optimization... ...engineering and product team members, you will... ...security-focused use cases, safety, and robust machine learning...Full timeTemporary workLocal areaFlexible hoursCISCO Systems
San Francisco, CA1 day ago$184k - $274.6k
...until further notice. Meet the Team At Foundation AI, we are leading frontier AI research across Cisco. Our mission is to... ...methods, inference optimization, evaluation techniques, and data pipelines.... ...for security-focused use cases, safety, and robust machine learning Why...Full timeTemporary workLocal areaFlexible hoursCISCO Systems
San Francisco, CA3 days ago$275k
...Plato Plato is an applied research lab building the... ...infrastructure to train specialized AI agents. We turn real-... ...the frontier: Build safety environments and benchmarks that research teams at leading AI labs can... ...Help set Plato’s safety evaluation agenda, from the...Full timeRelocation- ...is building neurally informed AI between biology and software... ...infrastructure. We seek a Staff AI Researcher to shape the technical... ...founders, researchers, and product teams to push the frontier of... ...work across modeling, training, evaluation, and deployment, mentoring...
$170k - $300k
Our client is a Series B AI company training custom frontier models to solve prediction... ...for enterprise supply chains. The team has raised $60 million and is expanding its... ...business impact. Partner with customers during evaluations, pilots and implementations. Support...Full timeH1bVisa sponsorshipRelocation package$164.7k - $339.08k
...Possible.At Pinterest, AI isn't just a feature, it... ...- Trust and Safety + Content Quality, you... ..., Engineering, Design, Research, Product Analytics, Data... ...our product development teams while introducing greater... ...robust, scalable ML and evaluation frameworks—spanning statistical...Work at officeLocal areaRelocationRelocation packagePinterest
San Francisco, CA1 day ago$150k - $230k
...company conducting rigorous, independent evaluations of medical imaging AI systems — bridging the gap between... ...reliability. As a Medical AI Researcher, you'll work directly with medical imaging... ...with customers and cross-functional teams to inform go/no-go decisions and...Work at officeClera
San Francisco, CA20 days ago- About the Team: Our Safety Systems org ensures that OpenAI’s most capable... ...developed and deployed. We build evaluations, safeguards, and safety... ...the Role: We are seeking a Researcher in Privacy-Preserving Safety... ...safety systems for frontier AI models. This role sits at the...
$250k - $325k
...was first-to-market with: An AI agent that lives in MS Word and... ...: Why, What, and Who Why AI Researchers are the engine of innovation at... ...production alongside the engineering team. Advance the core AI platform... ...on legal- specific tasks. Evaluate emerging work in agentic...Contract workWork at officeImmediate startRemote work$380k
...safely.The Preparedness team is dedicated to... ...of frontier AI systems.Mitigation.... ...seeking exceptional researchers who can push the frontier of safety mitigations. You will... ...continuously refine) the evaluations that enable us to... ...design effective red-teaming pipelines to...Work at officeLocal areaFlexible hoursOpenAI
San Francisco, CA3 days ago- DescriptionAbout the RoleWe are looking for an AI Reseacher to join our growing AI team and help build intelligent, production-grade AI systems that solve... ...the eval before you build the model.You read current research and can tell the difference between a technique that...Full timeTemporary workInternshipImmediate start
Innovaccer
San Francisco, CA4 days ago $216k - $270k
Scale Labs, Research Scientist — Safety Post TrainingAs the leading data and evaluation partner for frontier AI companies, Scale plays an integral role... ...Scale Labs has launched a new team focused on policy research... ....Familiarity with red-teaming or adversarial evaluation...Full timeScale AI
San Francisco, CA4 days ago$145.75k - $300.07k
...love? It’s Possible.At Pinterest, AI isn't just a feature, it's a... ...looking for a Staff Qualitative researcher to play a crucial role in the Pinterest monetization team to scope, execute research and... ...workflows, prompt/prototype tools, evaluation/QA methods) and hands-on...Work at officeLocal areaImmediate startRemote workRelocationRelocation packagePinterest
San Francisco, CA20 hours ago$77 - $85 per hour
...Get AI-powered advice on this job and more exclusive features.... ...hr - $85.00/hr Job Title: Researcher/Ethnographer Pay Comments:... ...Ethnographer/Designer to join their team and revolutionize the way... ...equal‑opportunity employer. We evaluate qualified applicants without regard...Hourly payFull timeWork experience placementAquent Talent
San Francisco, CA4 days ago- ...3D first-person adventure game where an AI companion is the core of the game. Think... ...s leading generative AI studio—we're the team behind niji・journey . Our mission is... ...veteran behind Project Astra, and top-tier AI researchers. As an early member of this team, you...Work at officeVisa sponsorship
Spellbrush
San Francisco, CA2 days ago $204k - $300k
...than computer code. As a member of the Dolby team, you’ll see and hear the results of your... ...Advanced Technology Group (ATG) is the research division of the company. ATG’s mission is... ...science and electrical engineering, such as AI/ML, algorithms, digital signal processing,...Full timeLocal areaWorldwideFlexible hoursDolby
San Francisco, CA20 hours ago$250k
...cells to accelerate cancer research, improve construction site safety, digitize floor plans,... ...business that is exploding as AI traverses the physical... ...findings into dataset and evaluation specifications, and validating... ...the research agenda for a team whose work is grounded in...Work at officeRoboflow
San Francisco, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Safety Researcher: Safety, Evaluation & Red-Teaming. Be the first to apply!
Related searches
- criminal researcher San Francisco, CA
- academic researcher San Francisco, CA
- machine learning researcher San Francisco, CA
- survey researcher San Francisco, CA
- music researcher San Francisco, CA
- design researcher San Francisco, CA
- legal researcher San Francisco, CA
- online researcher San Francisco, CA
- field researcher San Francisco, CA
- qualitative researcher San Francisco, CA