Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Researcher, Robustness & Safety Training

Full-time

OpenAI

### About the Team The [Safety Systems team]( is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit the society and is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency. The Model Safety Research team aims to fundamentally advance our capabilities for precisely implementing robust, safe behavior in AI models, and to leverage these advances to make OpenAI’s deployed models safe and beneficial. This requires a breadth of new ML research to address the growing set of safety challenges as AI becomes more powerful and used in more settings. Key focus areas include how to enforce nuanced safety policies without trading off helpfulness and capabilities, how to make the model robust to adversaries, how to address privacy and security risks, and how to make the model trustworthy in safety-critical domains. We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely.

About the Role

OpenAI is seeking a senior researcher with passion for AI safety and experience in safety research. Your role will set directions for research to enable and empower safe AGI and work on research projects to make our AI systems safer, more aligned and more robust to adversarial or malicious use cases. You will play a critical role in shaping how a safe AI system should look like in the future at OpenAI, making a significant impact on our mission to build and deploy safe AGI.

In this role, you will:

  • Conduct state-of-the-art research on AI safety topics such as RLHF, adversarial training, robustness, and more.
  • Implement new methods in OpenAI’s core model training and launch safety improvements in OpenAI’s products.
  • Set the research directions and strategies to make our AI systems safer, more aligned and more robust.
  • Coordinate and collaborate with cross-functional teams, including T&S, legal, policy and other research teams, to ensure that our products meet the highest safety standards.
  • Actively evaluate and understand the safety of our models and systems, identifying areas of risk and proposing mitigation strategies.

You might thrive in this role if you:

  • Are excited about [OpenAI’s mission]( of building safe, universally beneficial AGI and are aligned with [OpenAI’s charter](
  • Demonstrate a passion for AI safety and making cutting-edge AI models safer for real-world use.
  • Bring 4+ years of experience in the field of AI safety, especially in areas like RLHF, adversarial training, robustness, fairness & biases.
  • Hold a Ph.D. or other degree in computer science, machine learning, or a related field.
  • Possess experience in safety work for AI model deployment
  • Have an in-depth understanding of deep learning research and/or strong engineering skills.
  • Are a team player who enjoys collaborative work environments.
About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. For additional information, please see [OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement]( AA EEO Policy Statement.pdf). Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations. To notify OpenAI that you believe this job posting is non-compliant, please submit a report through [this form]( No response will be provided to inquiries unrelated to job posting compliance. We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this [link]( [OpenAI Global Applicant Privacy Policy]( Global Applicant Privacy Policy_2023.01.27.pdf) At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Researcher, Robustness & Safety Training in San Francisco, CA vacancy
  • $380k

    About the TeamSafety Research at OpenAI is responsible for ensuring our most capable models...  ...safely deployed in the real world. The Safety Training team develops the research and...  ...failures, policy adherence, jailbreak robustness, multimodal risks, agent behavior, and... 
    Training
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    2 days ago
  •  ...appropriately. The Chat and Multimodal Safety team is responsible for ensuring that...  ...these experiences. We develop the research, training methods, and evaluations needed to make...  ...failures, and translate findings into robust improvements. About OpenAI OpenAI... 
    Training
    Full time
    Work at office
    Relocation package

    openai

    San Francisco, CA
    1 day ago
  •  ...About the Team The Agent Safety team works to ensure that increasingly...  ...work spans three areas: Training: Create training methods,...  ...for a safety&security minded researcher or engineer who can reason rigorously...  ...deployment. Can build robust experimental infrastructure... 
    Training
    Full time
    Work at office
    Relocation package

    openai

    San Francisco, CA
    1 day ago
  • $250k - $350k

     ...Research ScientistHelp us push the boundaries of what's possible in LLM post-training. If you love training models, exploring new architectures, running experiments, and turning...  ...findings in production settingsCreate robust benchmarks and evaluation frameworks that ensure... 
    Training
    Work at office

    Inference

    San Francisco, CA
    4 days ago
  •  ...Space Models or SSMs, a new primitive for training efficient, large-scale foundation models...  ...Your Impact Conduct groundbreaking research in neural network architecture design to...  ...model trade-offs, including scalability, robustness, latency, and energy efficiency.... 
    Training
    Work at office
    Visa sponsorship
    Flexible hours

    Cartesia

    San Francisco, CA
    4 days ago
  • # Researcher, Frontier Cybersecurity RisksSafety SystemsSan FranciscoFull...  ...**Preparedness is a critical Safety Research team at OpenAI,...  ...building protections that remain robust as products, model...  ...Are familiar with methods for training and fine-tuning large language... 
    Training

    Applied Methods Ltd

    San Francisco, CA
    5 days ago
  •  ...how to [measure monitorability]( which training mechanisms affect monitorability, and speculative...  ...can be a practical additional safety mechanism, and today our monitoring systems...  ..., monitoring, and frontier-risk research.We care most about monitorability where... 
    Training
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...assessment , control measures , RSI-relevant training interventions, and turning one’s...  ...are problematically misaligned, or their safety-relevant capabilities lag behind...  ...between performing rigorous hypothesis-driven research and turning our insights into interventions... 
    Training
    Full time

    openai

    San Francisco, CA
    1 day ago
  • $150k - $250k

     ...goods, and global social organizations.We research and deploy technologies that power AI-...  ...research org.Key ResponsibilitiesThe Post-Training team focuses on adapting foundation...  ...and specialization, data efficiency and robustness, capability and controllability. Their work... 
    Training
    Work at office
    3 days per week

    Distyl AI

    San Francisco, CA
    2 days ago
  • $216.3k - $280.8k

     ...Foundation AI, we are leading frontier AI research across Cisco. Our mission is to...  ...learning, reasoning systems, scalable training algorithms, evaluation science, inference...  ...systems for security-focused use cases, safety, and robust machine learning.Demonstrated... 
    Training
    Full time
    Temporary work
    Local area
    Flexible hours

    CISCO Systems

    San Francisco, CA
    9 hours ago
  •  ...About the Team The Agent Safety team works to ensure that increasingly capable AI agents...  .... Our work spans three areas: Training: Create training methods, environments...  ...and an understanding of frontier model research. You don’t need prior safety or alignment... 
    Training
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...About the Team OpenAIs Safety Research organization works to ensure that our most capable AI models can be deployed safely and responsibly...  ...particularly in model evaluations AI safety alignment robustness or related areas. Have demonstrated the ability to lead technically... 
    Full time

    OpenAI

    San Francisco, CA
    21 days ago
  •  ...Research emerging threats and develop realistic phishing simulations. Listed location: San Francisco, CA Listed type: Full-time...  ...templates and scenarios Create technical documentation for security training modules Collaborate with product team to design effective... 
    Training
    Full time

    SecurityAwarenessTraining.com

    San Francisco, CA
    9 hours ago
  • $139.6k - $225.78k

     ...a passionate and self-driven Sr. Staff Researcher to join our Cloud-Delivered Security Services...  ...adversarial activities and implement robust, proactive protections.Building high-...  ...TensorFlow, PyTorch, Scikit-Learn) - including training and testing workflows, and technologies.... 
    Training
    Full time
    Work experience placement
    Work at office
    Visa sponsorship
    Work visa

    Palo Alto Networks

    San Francisco, CA
    1 day ago
  • $150k - $300k

     ...Join to apply for the Applied Researcher role at Variant Overview Variant is hiring an applied researcher to join our team in San Francisco...  ...with creativity and taste. This role involves designing, training, and evaluating deep neural networks and large language models... 
    Training
    Full time

    Variant

    San Francisco, CA
    3 days ago
  •  ...tackle the full problem space: integrating with customer workflows, training models to solve their dexterous tasks, and ensuring the on-site...  ...use cases and observe robots in deployment contexts.Bridge research and operations: translate research advances into deployable... 
    Training

    Physical Intelligence

    San Francisco, CA
    9 hours ago
  •  ...startup dedicated to improving patient safety in hospitals through advanced AI-powered...  ...a founding member of the clinical AI research team at Pharos. As a Physician AI Researcher...  ..., create annotation schemas, curate training datasets, and ensure data quality for model... 
    Training
    Full time
    Work at office

    Pharos

    San Francisco, CA
    1 day ago
  •  ...spans the full model lifecycle, from preparing data and choosing training methods to validating results and getting finished models into...  ...with software engineers, partnership colleagues and other researchers so research results reach users and shared code stays easy to... 
    Training
    Local area
    Relocation

    Raydar Inc

    San Francisco, CA
    2 days ago
  •  ...Proximal is building the research systems needed to identify what models can't yet do, build the tasks required to teach them, measure...  ...help them build evals, identify model weaknesses and curate post-training data to fix these weaknesses. This role is perfect for... 
    Training

    Proximal LLC

    San Francisco, CA
    3 days ago
  • $189k - $260k

     ...Machine Learning Researcher Location: San Francisco Bay Area Compensation: $189,000 – 260,000 USD / year Job Tags: Software...  ...independently conducting long-term projects. Execute model training at scale, either by managing multiple experiments concurrently... 
    Training
    Work at office
    Local area
    Work from home
    Flexible hours

    Lambda

    San Francisco, CA
    2 days ago
  • $247k - $396k

     ...Computer Science, or Robotics (Top-tier research lab background) Deep expertise in Vision...  ..., qualifications, relevant education or training, and market conditions. These ranges may...  ...everything we do is our commitment to safety. Building best-in-class self-driving... 
    Training
    Work at office
    Local area
    3 days per week

    Aurora CO

    San Francisco, CA
    4 days ago
  •  ...About the role Conduit is a frontier AI research company, training on a new modality of data: brain signals. Our first goal is to decode thought into text through a non-invasive headset. We're a team of about ten ML researchers and software engineers, working together... 
    Training
    Full time
    Work at office

    Conduit Intelligence

    San Francisco, CA
    5 days ago
  •  ...World-Class Team: You'll work directly with some of the best AI researchers and engineers in the world in a small, mighty, and fast-paced...  ....You May Be A Good Fit If:You Have Hands-On Experience In Training Text-To-Motion Or Audio-To-Motion ModelsYou might have previously... 
    Training
    Work at office
    Visa sponsorship

    Spellbrush

    San Francisco, CA
    2 days ago
  •  ...Security Researcher We believe that software is the foundation of modern civilization - yet vulnerabilities threaten its integrity,...  ...detect and remediate critical software vulnerabilities. We are training and scaling security AI agents to discover zero-days vulnerabilities... 
    Training
    Full time
    Work at office

    DepthFirst

    San Francisco, CA
    3 days ago
  • $140k - $250k

     ...from the brain, entirely non-invasively. We apply deep learning research to large scale EEG datasets collected on affordable hardware to...  ....Key ResponsibilitiesResearch & Model Development: Develop, train, and refine state-of-the-art deep learning models for neural decoding... 
    Training
    Work from home

    Alljoined

    San Francisco, CA
    1 day ago
  • $350k

     ...Research Engineer / Scientist, AlignmentSan Francisco, CAAbout AnthropicAnthropic...  ...experimental research on AI safety, with a focus on risks from...  ...Research: Developing robust defenses against adversarial...  ...of our safety techniques by training language models to subvert... 
    Training
    Work at office
    Visa sponsorship
    Flexible hours

    anthropic

    San Francisco, CA
    4 days ago
  • $50 - $60 per hour

    Mercor is seeking STEM researchers at MSc/PhD level to contribute remotely on a part-time basis (10-20 hours/week). You must own a MacBook...  ...role involves literature reviews, data analysis, and creating training data for AI models. Immediate start preferred. This contract... 
    Training
    Remote job
    Hourly pay
    Contract work
    Part time
    Immediate start
    Flexible hours

    Mercor Inc

    San Francisco, CA
    5 days ago
  • $60 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ..., and technical writing on your Mac . Create high-quality training data for advanced AI models . Conduct research workflows independently... 
    Training
    Remote job
    Contract work
    Summer work
    Immediate start
    Flexible hours

    Mercor

    San Francisco, CA
    5 days ago
  • $100 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...clear, structured feedback to AI research teams to improve training data quality and downstream performance. Develop evaluation rubrics... 
    Training
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    3 days ago
  •  ...Space Models or SSMs, a new primitive for training efficient, large-scale foundation models...  .... You’ll work at the intersection of research, product, and infrastructure to develop...  ...implement new evaluation pipelines with robust statistical analysis and clear reporting... 
    Training
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    cartesia

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Researcher, Robustness & Safety Training. Be the first to apply!