Research Engineer, Frontier Evals & Environments
OpenAI
About the team The Frontier Evals & Environments team builds north star model environments to drive progress towards safe AGI/ASI. This team builds ambitious environments to measure and steer our models, and creates self‑improvement loops to steer our training, safety, and launch decisions. Some of the team's open‑sourced evaluations include GDPval, SWE‑bench Verified, MLE‑bench, PaperBench, and SWE‑Lancer, and the team built and ran frontier evaluations for GPT4o, o1, o3, GPT 4.5, ChatGPT Agent, and GPT5. If you are interested in feeling firsthand the fast progress of our models, and steering them towards good, this is the team for you. About you We seek exceptional research engineers that can push the boundaries of our frontier models. Specifically, we are looking for those that will help us shape our empirical grasp of the whole spectrum of AI capabilities measurement and will own individual threads within this endeavor end‑to‑end. In this role, you'll: Create ambitious RL environments to push our models to their limits Work on measuring frontier model capabilities, skills, and behaviors Develop new methodologies for automatically exploring the behavior of these models Help steer training for our largest training runs, and see the future first Design scalable systems and processes to support continuous evaluation Build self‑improvement loops to automate model understanding We expect you to be: Passionate and knowledgeable about AGI/ASI measurement Strong engineering and statistical analysis skills Able to think outside the box and have a robust “red‑team‑ing mindset” Experienced in ML research engineering, stochastic systems, observability and monitoring, LLM‑enabled applications, and/or another technical domain applicable to AI evaluations Able to operate effectively in a dynamic and extremely fast‑paced research environment as well as scope and deliver projects end‑to‑end It would be great if you also have: First‑hand experience in red‑team‑ing systems—be it computer systems or otherwise An ability to work cross‑functionally Excellent communication skills About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general‑purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non‑public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations. To notify OpenAI that you believe this job posting is non‑compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance. We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link. OpenAI Global Applicant Privacy Policy At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology. #J-18808-Ljbffr OpenAI
$205k - $380k
...Training team creates the frontier agents OpenAI ships to... ...made. We build the data, environments, graders, training methods... ...people use.About the RoleAs a researcher working on Frontier Evals & Environments, you will... ...work with researchers, engineers, product teams,...Suggested$310k - $380k
...About the team The Frontier Evals team builds north star model evaluations to drive progress... ...you We are seeking exceptional research engineers that can push the boundaries of our... ...and extremely fast-paced research environment as well as scope and deliver projects...SuggestedWork at officeLocal areaRelocation packageFlexible hours$320k
...a quickly growing group of committed researchers, engineers, policy experts, and business leaders... ...beneficial AI systems. About the Team The Frontier Red Team (FRT) is a small, focused... ...AI systems to operate in security environments Translate technical findings into compelling...SuggestedWork at officeRelocationVisa sponsorshipFlexible hours- Turing, based in San Francisco, seeks a Staff Research Engineer - Code to own end-to-end data pipelines, RL environments, and evaluations for coding agents and SWE tasks... ...datasets at scale. You will collaborate with frontier labs, interface with researchers, and drive...Suggested
$174k - $253k
...Experience communicating technical concepts or research insights to technical stakeholders.... ...field. Experience in areas such as frontier risk assessment or mitigations, AI safety... ...or leading applied research projects. Engineering experience with Large Language Model (LLM...Suggested- ...vast talent network trains frontier AI models in the same way teachers... ...team. You’ll work alongside researchers, operators, and AI companies... ...the Role As a Research Engineer at Mercor, you’ll work at the... ...in real‑world production environments. You’ll shape rewards, run post...Work at officeRemote work
$350k
Mirendil is seeking research engineers in San Francisco to build the post-training stack for frontier reasoning models. You will engage in designing experiments and iterating on reinforcement learning methodologies, focusing on scalable infrastructure for large-scale AI...$350k
...a qualified candidate to join their Domain Scaling team. This unique role involves refining AI model capabilities through applied research and data sourcing in various sectors such as finance and healthcare. The ideal candidate will have experience in fine-tuning large...- A leading AI research organization is seeking a Research Engineer to develop the next generation of training environments for safe agentic AI. This role requires strong software engineering skills and the ability to balance research and implementation while working collaboratively...
- Anthropic is seeking a Research Engineer to build the next generation of training environments for safe and capable AI. This role blends research with engineering responsibilities, requiring you to implement novel approaches while contributing to research direction. You...Remote job
$150k - $350k
...stack: the infrastructure frontier AI labs build... ...Lab, unifies compute, environments, evaluations, secure sandboxes... ...tasks like autonomous research, and the full‑stack... ...environments, sandboxes, evals, and deployment.... ...researchers and infrastructure engineers to translate...Remote workVisa sponsorshipRelocation packageFlexible hours$250k - $350k
...Turing is the world’s leading research accelerator for frontier AI labs and a trusted... ...learning (RL) environments that power post‑training... ...Environments for Software Engineering / coding agents MCP‑based... ...into environment goals. Evals & Post‑training: Demonstrate...$380k
...Team The Future of Computing Research team is an applied research team... ...of computing. We work at the frontier of multimodal AI, helping... ...work closely across research, engineering, design, product, and safety... ...clean experiments, reliable evals, and decision‑useful metrics....Work at officeImmediate startRelocation package- Anthropic is seeking an exceptional Research Engineer to enhance our Life Sciences team. This role involves developing evaluation frameworks... ...biology, with a strong emphasis on scientific applications and problem-solving in evolving environments. #J-18808-Ljbffr Anthropic
- ...Opportunity Our Audio team is building frontier speech-language models that... ...with infrastructure and research teams Support... ...model training (data pipelines, evals, serving infrastructure) Proficiency... ...in shared codebases with high engineering standards Nice‑to‑have: Direct...Shift work
- About Liquid Labs Research has been core to Liquid AI from the beginning... ...in resource-constrained environments. At Liquid Labs, we extend... ...- pushing forward the frontier of efficient, adaptive intelligence... ...research and practical engineering. We work hand-in-hand with Liquid...Immediate startWork from home
- ...a quickly growing group of committed researchers, engineers, policy experts, and business leaders... ...closely with Anthropic's alignment and frontier red teams to ensure our systems are... ...research and engineering. You'll design RL environments and coding tasks, build the reward...
$250k
...Description: Transluce is a non‑profit research lab building tools for scalable, end‑to‑... ...We are looking for strong scientists and engineers to help advance our vision of scalable end... ...quickly, creating technology at the frontier of AI research and with high direct impact...Work at officeVisa sponsorship$150k - $230k
Triage is an applied research lab building adaptive security and safety alignment infrastructure... ...Role We're hiring a Founding Research Engineer to drive the research agenda that makes... ...failures we characterize in frontier models become the basis for per‑tenant adapters...Full time$280k
...capabilities. You could describe yourself as both a scientist and an engineer. As a Research Engineer on Alignment Science, you'll contribute to... ...teams including Interpretability, Fine‑Tuning, and the Frontier Red Team. These papers give a simple overview of the topics...Work at officeHome officeRelocation package- Research Engineer - World Models - Onsite, Downtown San Francisco Hiring for a stealth frontier AI lab building real-time AI gaming companions. Think AI squadmates that can learn, plan, understand game worlds, and play side-by-side with humans. Looking for someone research...
- ..., human data companies, and frontier biotech teams to source, structure... .... About the Role As an RL Engineer at BioStack, you will help... ...the data engine and RL environment layer for medical AI systems... ...decision-making, and biomedical research tasks. We’re looking for...Contract work
$280k - $405k
Overview Prompt engineering is the art of instructing large language models in a way that delivers... ..., and iterative experimentation. As a research prompt engineer, your role would be to... ...improve the performance and safety of frontier models. Given that this is a nascent field...Work at officeHome officeRelocation package$235k
...Alembic Alembic is where top engineers are solving marketing's... ...works. If you're looking for frontier technical challenges at an applied... ...analytics Document research and implementation decisions... ...research code in production environments Strong mathematical background...Full time$350k
...for their unique needs and goals. We are scientists, engineers, and builders who’ve created some of the most widely... ...Tinker Tinker is our fine‑tuning API that empowers researchers and developers to customize frontier AI to their needs — opening access to capabilities...Visa sponsorshipWork visaRelocation package- ...chip design are hiring for Formal Methods Researchers. Backed by an advisory board that... ...the team brings together researchers and engineers from leading orgs. like OpenAI, Anthropic... ...in computing. The work combines frontier AI research, formal reasoning and hardware...
$350k
...legal. This unique role blends applied research with data sourcing to enhance our models... ...process of creating reinforcement learning environments for new capabilities: identifying high‑... ...ML systems. Experience designing evals or benchmarks for LLMs. Domain expertise...Visa sponsorship- ...intelligence layer to help scientists and engineers move faster and solve core R&D... ...do: Translate cutting-edge AI research into production‑grade systems. Build evals and benchmarks to rigorously... ...in fast‑paced, unstructured environments with evolving requirements. Already...
- ...scalable human feedback systems to shape frontier models. Our three integrated... ...Collaborative Excellence: Join a team of top researchers and engineers passionate about ethical AI. Growth &... ...grow your career in a high-caliber environment. Clear Ownership: Take initiative,...Flexible hours
$350k
...the Role We're seeking an exceptional Research Engineer to join our Life Sciences team at Anthropic... ...and training strategies that push the frontier of what AI can achieve in biology. You... ...in rapidly evolving research environments Strong written and verbal communication...Work experience placementVisa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Engineer, Frontier Evals & Environments. Be the first to apply!
- junior machine learning research engineer San Francisco, CA
- research programmer San Francisco, CA
- research engineer San Francisco, CA
- senior research engineer San Francisco, CA
- ai research engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- research software engineer San Francisco, CA
- deep learning research engineer San Francisco, CA
- historical research San Francisco, CA
- neuroscience research San Francisco, CA
