Adversarial Model Research PM: Safety & Evaluation Lead
Jobleads-US
OpenAI seeks a Research Program Manager to lead initiatives that test the safety and robustness of its models through creative experimentation and structured evaluation. You will coordinate across research and engineering teams to transform ambiguous risks into concrete programs and influence model development and deployment.
Based in San Francisco, CA, the role offers a hybrid work model with 3 days in the office per week and relocation assistance for new hires.
#J-18808-Ljbffr Jobleads-USVacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Adversarial Model Research PM: Safety & Evaluation Lead in San Francisco, CA vacancy
- ...Reflection is building model evals and safety from the ground up, and this RPM will be at the center... ...of that effort. You will shape the evaluation frameworks, operational... ...safety ecosystem, coordinating across research and engineering to accelerate frontier...Suggested
$239k - $328k
...Research Program Manager – Adversarial Model Research Human Data - San Francisco About the Team... ...advanced AI systems by designing evaluations, surfacing vulnerabilities,... ...Research Program Manager, you will lead initiatives that test the safety and robustness of OpenAI’s...SuggestedWork at officeRelocation packageOpenAI
San Francisco, CA2 days ago$136.44k - $265.11k
...data, and run AI agents and models directly in their workflows.... ...here.You’ll build the datasets, evaluations, and systems that help close... ...against. You’ll partner with leading AI labs to understand where models... ..., scientists, and external research partners.Desire to work in a...SuggestedWork at officeLocal areaMonday to FridayShift workBenchling
San Francisco, CA2 days ago- ...startup, is hiring a founding Product Manager to own the Vals Smith roadmap and go-to-market for an enterprise product that evaluates which foundation model best fits a customer's use case. You will run customer discovery and POCs, scope technical evaluations, shape pricing...Suggested
$45 - $60 per hour
Mercor maintains a standing humanities pool for AI training and evaluation. This listing is not a single opening but a continuously open... ...experience, you can join. Work involves writing questions, grading model outputs, and flagging misinterpretations, with #J-18808-Ljbffr...SuggestedHourly pay- ...Mission Reflection is a research lab making intelligence... ...on. We build open models that let anyone control... ...building model evals and safety from the ground up, and... ...means defining the evaluation frameworks, building the... ...research and engineering leads across pre-training, mid...Work at officeVisa sponsorship
Sierra Ventures
San Francisco, CA5 days ago $1,000 per month
...performance optimization About micro1 micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute their diverse... ...layer for frontier AI. Role Title: Research Engineer - Code Generation & Model Evaluation...Part timeFor contractorsRemote workmicro1
San Francisco, CA21 days ago$192.2k - $260k
...learning and large language models.We leverage advanced robotics... ...candidate will contribute to research that bridges the gap between... ...source and internal research), evaluate them on representative tasks,... ...optimize them to meet robustness, safety, and performance needs. You...Local areaWorldwideFlexible hoursAmazon
San Francisco, CA4 days ago$58 - $70 per hour
Role Overview As a Research Intern in the Model Shaping team, you will work on one or more of the following... ...methods) Robust and reliable evaluation of foundation model capabilities The... ...efficient machine learning Publications at leading ML and NLP conferences (such as...Hourly payInternshipWork at office$380k
...Research Engineer/Research Scientist- Personal AGI, Model Experience | OpenAI Careers Research Engineer/Research Scientist... ...behavior through human data, evaluations, reward models, and post-... ...tool that must be created with safety and human needs at its core, and...Work at officeRelocation packageOpenAI
San Francisco, CA2 days ago- OpenAI is seeking a Safety Systems role focused on policy and model misalignment as AI models become more capable and autonomous. You will investigate real... ...home on Thursdays and Fridays. You will work with research, engineering, security, product, and policy teams to...Work at officeWork from homeRelocation package
- ...and Master's scientists to author AI evaluation tasks (Sci Code). You will author original, executable research problems that today's frontier models cannot solve. The role emphasizes material... ...and robust grading criteria against leading AI models. Engagement spans 6 weeks,...Part timeImmediate start
- Vals AI, Inc. is seeking engineers to own and expand our leaderboards, evaluating new LLM models against benchmarks across law, tax, coding, finance, and more. You will analyze error modes, compare strengths and weaknesses, and collaborate with a communications team to...Relocation
- Benchling is building an AI-powered platform for biotech R&D in San Francisco. You will design datasets, evaluate frontier AI models, and partner with scientists to translate complex biology into rigorous tasks that models can learn from. This role sits at the intersection...
- ...- Member Of Technical Staff (Language Model Evaluations) Location: San Francisco (preferred), Sydney... ...Analysis Artificial Analysis is the leading independent AI benchmarking company. We... ...models, working directly with their research teams; our commercial team owns client...
$213k - $263k
...initiate and foster collaborations with other research teams in Alphabet. AI Foundations areas that we... ..., learning from demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust evaluation. In this hybrid role, you will report to a Software...Full timeRemote work- Obsidian is seeking an independent contractor for a remote role focused on benchmark dataset projects that evaluate AI models on visual document understanding in the Energy/Utilities domain. The role requires authoring complex tasks and providing objective rubrics to assess...Remote jobFor contractorsFlexible hours
- ...Francisco, CA Work Model: Onsite Industry... ...Applied AI / AI research data Compensation... ...sold to the world's leading frontier AI labs.... ...As the AI Safety & Red Teaming Lead... ...will do hands-on adversarial work that directly... ...behavior, safety evaluation, and risk priorities...
TalentPluto, Inc.
San Francisco, CA4 days ago $195.74k - $402.99k
...Senior Staff Product Manager for Adversarial Actors, you'll own the end-to-... .... Support the Bots & ATO PM on pre-authentication roadmap.... ...including network-based detection, ML models, and heuristic-based rules.... ...deep expertise in trust & safety, account integrity, anti-abuse...Work at officeLocal areaRemote workRelocation packagePinterest
San Francisco, CA3 days ago$400 per month
About the Role Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. The work focuses on realistic data engineering workflows...- ...TalentPluto, Inc. is seeking an AI Safety & Red Teaming Lead in San Francisco to perform hands-on adversarial work that shapes how foundation models behave. You will design safety benchmarks... ...AI labs on model behavior, safety evaluation, and risk priorities. This IC-...
$245k - $310k
...Product Manager, Model Behavior San Francisco, CA... ...balancing user needs, safety considerations, and technical... ..., technically adept PM who thrives on solving... ...Partner closely with research, engineering, product design... ..., and processes for evaluating, tuning, and iterating...Work at officeRelocation packagekozmetickesluzby.vecnakraska.sk - Jobboard
San Francisco, CA2 days ago- About the Team Our Safety Systems team is at the forefront... ...Safety Systems, the Model Policy team works to... ...and develop the data, evaluations, monitoring, and... ...work connects alignment research with the practical challenges... ...fields, with the adversarial mindset needed to...Work at officeWork from homeRelocation packageShift work
- Company Overview Deepgram is the leading platform underpinning the... ...Deepgram’s voice-native foundation models are accessed through cloud... ...Software Engineer - Model Evaluation & AI Systems to join the team... ...and we partner closely with Research to turn model expectations into...
$174k - $252k
...Share Research Engineer, Frontier Safety Mitigations, DeepMind DeepMind Mountain View... ...Experience in Large Language Model (LLM) development, fine-tuning, or safety evaluation methodologies.... ...automated red‑teaming and adversarial robustness, leveraging multi...Google LLC
San Francisco, CA3 days ago$200k - $400k
...Decagon is the leading conversational AI... ...Read more about the research team's work here:... ...team develops the model and decision-making... ...orchestration, and evaluation in order to make our... ...focused on Safety, you’ll be responsible... ...commitments Build adversarial evaluations,...Full timeWork at officeLocal areaDecagon
San Francisco, CA2 days ago- Deepgram is seeking a Senior Software Engineer - Model Evaluation & AI Systems to join the team responsible for validating the quality of our... ..., and integrate quality gates into CI/CD, working with Research, training, inference, and product teams to protect the customer...
- TypeSafe in San Francisco seeks a safety researcher to build evals, investigate concerning model behavior, and contribute to rigorous safety discussions. You will document observations from project start to formal records and draft internal communications. You will work...
- We are hiring systems engineers, kernel hackers, world-model researchers, and roboticists to compile the next industrial paradigm. Layer 01: COMPUTE Remote / Global Full-time CUDA / Kernel Optimization Engineer Design and benchmark custom FlashAttention-3, TensorRT-LLM...Full timeRemote work
- ...with a frontier AI research company on a... ...weight foundation models with a mission to... ...some of the world's leading AI labs and technology... ...advanced AI systems are evaluated, stress-tested,... ...intersection of adversarial research, red... ...and build scalable safety evaluation frameworks...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Adversarial Model Research PM: Safety & Evaluation Lead. Be the first to apply!
Related searches
- safety lead San Francisco, CA
- historical research San Francisco, CA
- research pharmacist San Francisco, CA
- research assistantship San Francisco, CA
- research compliance officer San Francisco, CA
- neuroscience research San Francisco, CA
- research investigator San Francisco, CA
- research dietitian San Francisco, CA
- mental health research San Francisco, CA
- research and development San Francisco, CA