Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Engineer, Frontier Evals & Environments

OpenAI

About the team The Frontier Evals & Environments team builds north star model environments to drive progress towards safe AGI/ASI. This team builds ambitious environments to measure and steer our models, and creates self‑improvement loops to steer our training, safety, and launch decisions. Some of the team's open‑sourced evaluations include GDPval, SWE‑bench Verified, MLE‑bench, PaperBench, and SWE‑Lancer, and the team built and ran frontier evaluations for GPT4o, o1, o3, GPT 4.5, ChatGPT Agent, and GPT5. If you are interested in feeling firsthand the fast progress of our models, and steering them towards good, this is the team for you. About you We seek exceptional research engineers that can push the boundaries of our frontier models. Specifically, we are looking for those that will help us shape our empirical grasp of the whole spectrum of AI capabilities measurement and will own individual threads within this endeavor end‑to‑end. In this role, you'll: Create ambitious RL environments to push our models to their limits Work on measuring frontier model capabilities, skills, and behaviors Develop new methodologies for automatically exploring the behavior of these models Help steer training for our largest training runs, and see the future first Design scalable systems and processes to support continuous evaluation Build self‑improvement loops to automate model understanding We expect you to be: Passionate and knowledgeable about AGI/ASI measurement Strong engineering and statistical analysis skills Able to think outside the box and have a robust “red‑team‑ing mindset” Experienced in ML research engineering, stochastic systems, observability and monitoring, LLM‑enabled applications, and/or another technical domain applicable to AI evaluations Able to operate effectively in a dynamic and extremely fast‑paced research environment as well as scope and deliver projects end‑to‑end It would be great if you also have: First‑hand experience in red‑team‑ing systems—be it computer systems or otherwise An ability to work cross‑functionally Excellent communication skills About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general‑purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non‑public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations. To notify OpenAI that you believe this job posting is non‑compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance. We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link. OpenAI Global Applicant Privacy Policy At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology. #J-18808-Ljbffr OpenAI

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Research Engineer, Frontier Evals & Environments in San Francisco, CA vacancy
  • $205k - $380k

     ...Training team creates the frontier agents OpenAI ships to...  ...made. We build the data, environments, graders, training methods...  ...people use.About the RoleAs a researcher working on Frontier Evals & Environments, you will...  ...work with researchers, engineers, product teams,... 
    Suggested

    OpenAI

    San Francisco, CA
    1 day ago
  • $310k - $380k

     ...About the team The Frontier Evals team builds north star model evaluations to drive progress...  ...you We are seeking exceptional research engineers that can push the boundaries of our...  ...and extremely fast-paced research environment as well as scope and deliver projects... 
    Suggested
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    more than 2 months ago
  • $320k

     ...a quickly growing group of committed researchers, engineers, policy experts, and business leaders...  ...beneficial AI systems. About the Team The Frontier Red Team (FRT) is a small, focused...  ...AI systems to operate in security environments Translate technical findings into compelling... 
    Suggested
    Work at office
    Relocation
    Visa sponsorship
    Flexible hours

    job-boards.greenhouse.io- JobBoard

    San Francisco, CA
    2 days ago
  • Turing, based in San Francisco, seeks a Staff Research Engineer - Code to own end-to-end data pipelines, RL environments, and evaluations for coding agents and SWE tasks...  ...datasets at scale. You will collaborate with frontier labs, interface with researchers, and drive... 
    Suggested

    turing

    San Francisco, CA
    2 days ago
  • $174k - $253k

     ...Experience communicating technical concepts or research insights to technical stakeholders....  ...field. Experience in areas such as frontier risk assessment or mitigations, AI safety...  ...or leading applied research projects. Engineering experience with Large Language Model (LLM... 
    Suggested

    Google DeepMind

    San Francisco, CA
    2 days ago
  •  ...vast talent network trains frontier AI models in the same way teachers...  ...team. You’ll work alongside researchers, operators, and AI companies...  ...the Role As a Research Engineer at Mercor, you’ll work at the...  ...in real‑world production environments. You’ll shape rewards, run post... 
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • $350k

    Mirendil is seeking research engineers in San Francisco to build the post-training stack for frontier reasoning models. You will engage in designing experiments and iterating on reinforcement learning methodologies, focusing on scalable infrastructure for large-scale AI... 

    Mirendil

    San Francisco, CA
    4 days ago
  • $350k

     ...a qualified candidate to join their Domain Scaling team. This unique role involves refining AI model capabilities through applied research and data sourcing in various sectors such as finance and healthcare. The ideal candidate will have experience in fine-tuning large... 

    Anthropic

    San Francisco, CA
    2 days ago
  • A leading AI research organization is seeking a Research Engineer to develop the next generation of training environments for safe agentic AI. This role requires strong software engineering skills and the ability to balance research and implementation while working collaboratively... 

    Anthropic

    San Francisco, CA
    3 days ago
  • Anthropic is seeking a Research Engineer to build the next generation of training environments for safe and capable AI. This role blends research with engineering responsibilities, requiring you to implement novel approaches while contributing to research direction. You... 
    Remote job

    Anthropic

    San Francisco, CA
    2 days ago
  • $150k - $350k

     ...stack: the infrastructure frontier AI labs build...  ...Lab, unifies compute, environments, evaluations, secure sandboxes...  ...tasks like autonomous research, and the full‑stack...  ...environments, sandboxes, evals, and deployment....  ...researchers and infrastructure engineers to translate... 
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours

    Prime Intellect

    San Francisco, CA
    2 days ago
  • $250k - $350k

     ...Turing is the world’s leading research accelerator for frontier AI labs and a trusted...  ...learning (RL) environments that power post‑training...  ...Environments for Software Engineering / coding agents MCP‑based...  ...into environment goals. Evals & Post‑training: Demonstrate... 

    Turing

    San Francisco, CA
    2 days ago
  • $380k

     ...Team The Future of Computing Research team is an applied research team...  ...of computing. We work at the frontier of multimodal AI, helping...  ...work closely across research, engineering, design, product, and safety...  ...clean experiments, reliable evals, and decision‑useful metrics.... 
    Work at office
    Immediate start
    Relocation package

    OpenAI

    San Francisco, CA
    2 days ago
  • Anthropic is seeking an exceptional Research Engineer to enhance our Life Sciences team. This role involves developing evaluation frameworks...  ...biology, with a strong emphasis on scientific applications and problem-solving in evolving environments. #J-18808-Ljbffr Anthropic

    Anthropic

    San Francisco, CA
    2 days ago
  •  ...Opportunity Our Audio team is building frontier speech-language models that...  ...with infrastructure and research teams Support...  ...model training (data pipelines, evals, serving infrastructure) Proficiency...  ...in shared codebases with high engineering standards Nice‑to‑have: Direct... 
    Shift work

    Liquid AI

    San Francisco, CA
    4 days ago
  • About Liquid Labs Research has been core to Liquid AI from the beginning...  ...in resource-constrained environments. At Liquid Labs, we extend...  ...- pushing forward the frontier of efficient, adaptive intelligence...  ...research and practical engineering. We work hand-in-hand with Liquid... 
    Immediate start
    Work from home

    Liquid AI

    San Francisco, CA
    2 days ago
  •  ...a quickly growing group of committed researchers, engineers, policy experts, and business leaders...  ...closely with Anthropic's alignment and frontier red teams to ensure our systems are...  ...research and engineering. You'll design RL environments and coding tasks, build the reward... 

    Anthropic

    San Francisco, CA
    2 days ago
  • $250k

     ...Description: Transluce is a non‑profit research lab building tools for scalable, end‑to‑...  ...We are looking for strong scientists and engineers to help advance our vision of scalable end...  ...quickly, creating technology at the frontier of AI research and with high direct impact... 
    Work at office
    Visa sponsorship

    Transluce

    San Francisco, CA
    2 days ago
  • $150k - $230k

    Triage is an applied research lab building adaptive security and safety alignment infrastructure...  ...Role We're hiring a Founding Research Engineer to drive the research agenda that makes...  ...failures we characterize in frontier models become the basis for per‑tenant adapters... 
    Full time

    Triage

    San Francisco, CA
    2 days ago
  • $280k

     ...capabilities. You could describe yourself as both a scientist and an engineer. As a Research Engineer on Alignment Science, you'll contribute to...  ...teams including Interpretability, Fine‑Tuning, and the Frontier Red Team. These papers give a simple overview of the topics... 
    Work at office
    Home office
    Relocation package

    Anthropic

    San Francisco, CA
    2 days ago
  • Research Engineer - World Models - Onsite, Downtown San Francisco Hiring for a stealth frontier AI lab building real-time AI gaming companions. Think AI squadmates that can learn, plan, understand game worlds, and play side-by-side with humans. Looking for someone research... 

    Acceler8 Talent

    San Francisco, CA
    2 days ago
  •  ..., human data companies, and frontier biotech teams to source, structure...  .... About the Role As an RL Engineer at BioStack, you will help...  ...the data engine and RL environment layer for medical AI systems...  ...decision-making, and biomedical research tasks. We’re looking for... 
    Contract work

    BioStack

    San Francisco, CA
    2 days ago
  • $280k - $405k

    Overview Prompt engineering is the art of instructing large language models in a way that delivers...  ..., and iterative experimentation. As a research prompt engineer, your role would be to...  ...improve the performance and safety of frontier models. Given that this is a nascent field... 
    Work at office
    Home office
    Relocation package

    Anthropic

    San Francisco, CA
    2 days ago
  • $235k

     ...Alembic Alembic is where top engineers are solving marketing's...  ...works. If you're looking for frontier technical challenges at an applied...  ...analytics Document research and implementation decisions...  ...research code in production environments Strong mathematical background... 
    Full time

    Alembic

    San Francisco, CA
    2 days ago
  • $350k

     ...for their unique needs and goals. We are scientists, engineers, and builders who’ve created some of the most widely...  ...Tinker Tinker is our fine‑tuning API that empowers researchers and developers to customize frontier AI to their needs — opening access to capabilities... 
    Visa sponsorship
    Work visa
    Relocation package

    Thinking Machines Lab

    San Francisco, CA
    2 days ago
  •  ...chip design are hiring for Formal Methods Researchers. Backed by an advisory board that...  ...the team brings together researchers and engineers from leading orgs. like OpenAI, Anthropic...  ...in computing. The work combines frontier AI research, formal reasoning and hardware... 

    Strativ Group

    San Francisco, CA
    2 days ago
  • $350k

     ...legal. This unique role blends applied research with data sourcing to enhance our models...  ...process of creating reinforcement learning environments for new capabilities: identifying high‑...  ...ML systems. Experience designing evals or benchmarks for LLMs. Domain expertise... 
    Visa sponsorship

    Anthropic

    San Francisco, CA
    2 days ago
  •  ...intelligence layer to help scientists and engineers move faster and solve core R&D...  ...do: Translate cutting-edge AI research into production‑grade systems. Build evals and benchmarks to rigorously...  ...in fast‑paced, unstructured environments with evolving requirements. Already... 

    Altara Technologies, Inc.

    San Francisco, CA
    2 days ago
  •  ...scalable human feedback systems to shape frontier models. Our three integrated...  ...Collaborative Excellence: Join a team of top researchers and engineers passionate about ethical AI. Growth &...  ...grow your career in a high-caliber environment. Clear Ownership: Take initiative,... 
    Flexible hours

    Right Hire Consulting LLC

    San Francisco, CA
    5 days ago
  • $350k

     ...the Role We're seeking an exceptional Research Engineer to join our Life Sciences team at Anthropic...  ...and training strategies that push the frontier of what AI can achieve in biology. You...  ...in rapidly evolving research environments Strong written and verbal communication... 
    Work experience placement
    Visa sponsorship

    Anthropic

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Engineer, Frontier Evals & Environments. Be the first to apply!