Researcher, Robustness & Safety Training
OpenAI
### About the Team The [Safety Systems team]( is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit the society and is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency. The Model Safety Research team aims to fundamentally advance our capabilities for precisely implementing robust, safe behavior in AI models, and to leverage these advances to make OpenAI’s deployed models safe and beneficial. This requires a breadth of new ML research to address the growing set of safety challenges as AI becomes more powerful and used in more settings. Key focus areas include how to enforce nuanced safety policies without trading off helpfulness and capabilities, how to make the model robust to adversaries, how to address privacy and security risks, and how to make the model trustworthy in safety-critical domains. We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely.
About the Role
OpenAI is seeking a senior researcher with passion for AI safety and experience in safety research. Your role will set directions for research to enable and empower safe AGI and work on research projects to make our AI systems safer, more aligned and more robust to adversarial or malicious use cases. You will play a critical role in shaping how a safe AI system should look like in the future at OpenAI, making a significant impact on our mission to build and deploy safe AGI.In this role, you will:
- Conduct state-of-the-art research on AI safety topics such as RLHF, adversarial training, robustness, and more.
- Implement new methods in OpenAI’s core model training and launch safety improvements in OpenAI’s products.
- Set the research directions and strategies to make our AI systems safer, more aligned and more robust.
- Coordinate and collaborate with cross-functional teams, including T&S, legal, policy and other research teams, to ensure that our products meet the highest safety standards.
- Actively evaluate and understand the safety of our models and systems, identifying areas of risk and proposing mitigation strategies.
You might thrive in this role if you:
- Are excited about [OpenAI’s mission]( of building safe, universally beneficial AGI and are aligned with [OpenAI’s charter](
- Demonstrate a passion for AI safety and making cutting-edge AI models safer for real-world use.
- Bring 4+ years of experience in the field of AI safety, especially in areas like RLHF, adversarial training, robustness, fairness & biases.
- Hold a Ph.D. or other degree in computer science, machine learning, or a related field.
- Possess experience in safety work for AI model deployment
- Have an in-depth understanding of deep learning research and/or strong engineering skills.
- Are a team player who enjoys collaborative work environments.
$380k
About the TeamSafety Research at OpenAI is responsible for ensuring our most capable models... ...safely deployed in the real world. The Safety Training team develops the research and... ...failures, policy adherence, jailbreak robustness, multimodal risks, agent behavior, and...TrainingWork at officeLocal areaFlexible hours- ...appropriately. The Chat and Multimodal Safety team is responsible for ensuring that... ...these experiences. We develop the research, training methods, and evaluations needed to make... ...failures, and translate findings into robust improvements. About OpenAI OpenAI...TrainingFull timeWork at officeRelocation package
- ...About the Team The Agent Safety team works to ensure that increasingly... ...work spans three areas: Training: Create training methods,... ...for a safety&security minded researcher or engineer who can reason rigorously... ...deployment. Can build robust experimental infrastructure...TrainingFull timeWork at officeRelocation package
$250k - $350k
...Research ScientistHelp us push the boundaries of what's possible in LLM post-training. If you love training models, exploring new architectures, running experiments, and turning... ...findings in production settingsCreate robust benchmarks and evaluation frameworks that ensure...TrainingWork at office- ...Space Models or SSMs, a new primitive for training efficient, large-scale foundation models... ...Your Impact Conduct groundbreaking research in neural network architecture design to... ...model trade-offs, including scalability, robustness, latency, and energy efficiency....TrainingWork at officeVisa sponsorshipFlexible hours
- # Researcher, Frontier Cybersecurity RisksSafety SystemsSan FranciscoFull... ...**Preparedness is a critical Safety Research team at OpenAI,... ...building protections that remain robust as products, model... ...Are familiar with methods for training and fine-tuning large language...Training
- ...how to [measure monitorability]( which training mechanisms affect monitorability, and speculative... ...can be a practical additional safety mechanism, and today our monitoring systems... ..., monitoring, and frontier-risk research.We care most about monitorability where...TrainingFull timeWork at officeRelocation package
- ...assessment , control measures , RSI-relevant training interventions, and turning one’s... ...are problematically misaligned, or their safety-relevant capabilities lag behind... ...between performing rigorous hypothesis-driven research and turning our insights into interventions...TrainingFull time
$150k - $250k
...goods, and global social organizations.We research and deploy technologies that power AI-... ...research org.Key ResponsibilitiesThe Post-Training team focuses on adapting foundation... ...and specialization, data efficiency and robustness, capability and controllability. Their work...TrainingWork at office3 days per week$216.3k - $280.8k
...Foundation AI, we are leading frontier AI research across Cisco. Our mission is to... ...learning, reasoning systems, scalable training algorithms, evaluation science, inference... ...systems for security-focused use cases, safety, and robust machine learning.Demonstrated...TrainingFull timeTemporary workLocal areaFlexible hours- ...About the Team The Agent Safety team works to ensure that increasingly capable AI agents... .... Our work spans three areas: Training: Create training methods, environments... ...and an understanding of frontier model research. You don’t need prior safety or alignment...TrainingFull timeWork at officeRelocation package
- ...About the Team OpenAIs Safety Research organization works to ensure that our most capable AI models can be deployed safely and responsibly... ...particularly in model evaluations AI safety alignment robustness or related areas. Have demonstrated the ability to lead technically...Full time
- ...Research emerging threats and develop realistic phishing simulations. Listed location: San Francisco, CA Listed type: Full-time... ...templates and scenarios Create technical documentation for security training modules Collaborate with product team to design effective...TrainingFull time
$139.6k - $225.78k
...a passionate and self-driven Sr. Staff Researcher to join our Cloud-Delivered Security Services... ...adversarial activities and implement robust, proactive protections.Building high-... ...TensorFlow, PyTorch, Scikit-Learn) - including training and testing workflows, and technologies....TrainingFull timeWork experience placementWork at officeVisa sponsorshipWork visa$150k - $300k
...Join to apply for the Applied Researcher role at Variant Overview Variant is hiring an applied researcher to join our team in San Francisco... ...with creativity and taste. This role involves designing, training, and evaluating deep neural networks and large language models...TrainingFull time- ...tackle the full problem space: integrating with customer workflows, training models to solve their dexterous tasks, and ensuring the on-site... ...use cases and observe robots in deployment contexts.Bridge research and operations: translate research advances into deployable...Training
- ...startup dedicated to improving patient safety in hospitals through advanced AI-powered... ...a founding member of the clinical AI research team at Pharos. As a Physician AI Researcher... ..., create annotation schemas, curate training datasets, and ensure data quality for model...TrainingFull timeWork at office
- ...spans the full model lifecycle, from preparing data and choosing training methods to validating results and getting finished models into... ...with software engineers, partnership colleagues and other researchers so research results reach users and shared code stays easy to...TrainingLocal areaRelocation
- ...Proximal is building the research systems needed to identify what models can't yet do, build the tasks required to teach them, measure... ...help them build evals, identify model weaknesses and curate post-training data to fix these weaknesses. This role is perfect for...Training
$189k - $260k
...Machine Learning Researcher Location: San Francisco Bay Area Compensation: $189,000 – 260,000 USD / year Job Tags: Software... ...independently conducting long-term projects. Execute model training at scale, either by managing multiple experiments concurrently...TrainingWork at officeLocal areaWork from homeFlexible hours$247k - $396k
...Computer Science, or Robotics (Top-tier research lab background) Deep expertise in Vision... ..., qualifications, relevant education or training, and market conditions. These ranges may... ...everything we do is our commitment to safety. Building best-in-class self-driving...TrainingWork at officeLocal area3 days per week- ...About the role Conduit is a frontier AI research company, training on a new modality of data: brain signals. Our first goal is to decode thought into text through a non-invasive headset. We're a team of about ten ML researchers and software engineers, working together...TrainingFull timeWork at office
- ...World-Class Team: You'll work directly with some of the best AI researchers and engineers in the world in a small, mighty, and fast-paced... ....You May Be A Good Fit If:You Have Hands-On Experience In Training Text-To-Motion Or Audio-To-Motion ModelsYou might have previously...TrainingWork at officeVisa sponsorship
- ...Security Researcher We believe that software is the foundation of modern civilization - yet vulnerabilities threaten its integrity,... ...detect and remediate critical software vulnerabilities. We are training and scaling security AI agents to discover zero-days vulnerabilities...TrainingFull timeWork at office
$140k - $250k
...from the brain, entirely non-invasively. We apply deep learning research to large scale EEG datasets collected on affordable hardware to... ....Key ResponsibilitiesResearch & Model Development: Develop, train, and refine state-of-the-art deep learning models for neural decoding...TrainingWork from home$350k
...Research Engineer / Scientist, AlignmentSan Francisco, CAAbout AnthropicAnthropic... ...experimental research on AI safety, with a focus on risks from... ...Research: Developing robust defenses against adversarial... ...of our safety techniques by training language models to subvert...TrainingWork at officeVisa sponsorshipFlexible hours$50 - $60 per hour
Mercor is seeking STEM researchers at MSc/PhD level to contribute remotely on a part-time basis (10-20 hours/week). You must own a MacBook... ...role involves literature reviews, data analysis, and creating training data for AI models. Immediate start preferred. This contract...TrainingRemote jobHourly payContract workPart timeImmediate startFlexible hours$60 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ..., and technical writing on your Mac . Create high-quality training data for advanced AI models . Conduct research workflows independently...TrainingRemote jobContract workSummer workImmediate startFlexible hours$100 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...clear, structured feedback to AI research teams to improve training data quality and downstream performance. Develop evaluation rubrics...TrainingRemote jobContract workSummer work- ...Space Models or SSMs, a new primitive for training efficient, large-scale foundation models... .... You’ll work at the intersection of research, product, and infrastructure to develop... ...implement new evaluation pipelines with robust statistical analysis and clear reporting...TrainingFull timeWork at officeVisa sponsorshipFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Researcher, Robustness & Safety Training. Be the first to apply!
- legal researcher San Francisco, CA
- senior researcher San Francisco, CA
- criminal researcher San Francisco, CA
- qualitative researcher San Francisco, CA
- vulnerability researcher San Francisco, CA
- remote researcher San Francisco, CA
- senior design researcher San Francisco, CA
- data collection researcher San Francisco, CA
- online researcher San Francisco, CA
- content researcher San Francisco, CA




