Frontier AI Evaluation Engineer: RL Environments
OpenAI
A leading AI research organization in San Francisco is seeking a Research Engineer focused on pushing the boundaries of frontier models and AGI/ASI measurement. Candidates should have strong engineering and statistical skills, a red-teaming mindset, and the ability to thrive in a fast-paced research environment. This role offers the opportunity to shape innovative AI measurements and build evaluation environments that drive progress. #J-18808-Ljbffr OpenAI
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Frontier AI Evaluation Engineer: RL Environments in San Francisco, CA vacancy
$260k - $290k
...Job Description Job Description Software Engineer - RL Environments Company: AfterQuery Location: San Francisco, CA (in... ...lab that curates the datasets, RL environments and evaluation infrastructure frontier AI labs use to build better models, working with leading...SuggestedFull timeH1bVisa sponsorshipTransparent Search Group
San Francisco, CA3 days ago- ...well-backed, early-stage AI company to hire a Member... ...Staff. This role blends frontier research (≈30%) with serious engineering (≈70%), building environments, datasets and production... ...tackle model reasoning, RL, alignment, and large-scale evaluations, while shaping training...Suggested
$130k - $220k
...the leading independent AI benchmarking and... ...insights company. They help engineers, enterprises,... ...benchmarks do not just measure frontier AI — they actively... ...best described as an AI Evaluation Engineer / Technical Generalist... ...a fast-moving startup environment. **Tech Stack** *...SuggestedFull timeWorldwideAurora Jobs ApS
San Francisco, CAmore than 2 months ago$200k
...builds the training data and evaluation infrastructure that frontier AI labs use to make their... ...The Role As a SWE (Environments), you will design the datasets... ...for/interned for any RL environment companies in... ...Former founders and early engineers at early stage startups are...SuggestedFull time$252k - $315k
...is to develop reliable AI systems for the world'... ...real impact.Scale Frontier Data is the organization... ...behind the training and evaluation data that frontier... ...Reinforcement learning environments are now the center of... ...ResponsibilitiesAs a Staff Software Engineer, RL Environments, you'll...SuggestedFull timeRemote work- HUD is seeking an Applied Research Engineer to own implementation, troubleshooting, and evaluation tasks for frontier AI collaborations. You will diagnose ambiguous problems, run evals, and clean data at scale. The right candidate is a strong generalist AI engineer who...
- ...Remote Industry: Applied AI / AI research data... ...quality reinforcement-learning environments and agents sold to the world... ...The Opportunity As an RL Environment Software Engineer, you will sit at the intersection... ...-quality environments the frontier will need next, then build...Remote work
talentpluto
San Francisco, CAa month ago $180k - $280k
...Title of Role: Applied AI Engineer Location: San... ...architectures for dynamic environments Develop fine-tuning... ...the stack Build evaluation frameworks and experimentation... ...systems Translate frontier AI research into... ...Experience building AI agents, RL systems, or adaptive...H1bWork at officeRemote workVisa sponsorshipRecruiting from Scratch
San Francisco, CA3 days ago- ...We are looking for Applied AI Engineers to build AI systems that use... ...understand how agents behave, evaluate them at scale, and improve them... ...real-world agent data, apply frontier methods in production, and see... ...working on agents, RL, or the infrastructure that supports...
Judgment Labs
San Francisco, CA2 days ago $245k - $300k
...virtuous cycle: human insight improves AI, and better AI expands what people can... ...into the data , evals , and RL environments frontier models learn from. We work with leading... ...it's running. You sit between Pareto's engineering team and the researchers at the labs we...Full time- Founding Ai Engineer The future will have more chips, in more... ..., reward models, and evaluation harnesses that will make... ...interact reliably with EDA environments and RTL artifacts... ...metrics Stay current with frontier research in LLM reasoning, RL for agents, and tool use...
$150k - $250k
...About Distyl AI Distyl is an applied AI technology... ...operations for the frontier of AI. Our customers... ...build AI systems using Evaluation-Driven Development —an... .... AI Evaluation Engineers focus on designing and... ...deployed in customer environments Define how system quality...Full timeWork at officeFlexible hours3 days per week- ...AI Research Engineer (Robot Learning) San Francisco AI &... ...Learning) you will drive frontier AI model development... ...training and model evaluation in the real world. As... ...experience Experience with RL fine-tuning of... ...and inclusive environment we encourage everyone...Full timeWork at officeImmediate start
Software Engineering, Data Science
San Francisco, CAmore than 2 months ago - ...layer for taste. Our goal is to end AI slop. To make AI feel right, not just be... ...seed co-led by Amplify and CRV, and most frontier labs are already customers. AI has nailed... ...: building the post-training data and RL environments that teach taste to frontier models, and...Full time
$240k - $280k
A leading software monitoring company is seeking a Senior Software Engineer on its AI/ML team to build evaluation infrastructure for measuring the performance of AI systems. This role involves designing datasets, creating benchmarks, and ensuring AI features behave reliably...- Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models, partnering with a leading AI lab. You will analyze AI-generated music across genres and rate it against detailed quality standards, working in Telugu and English. Responsibilities...
- ...Forward Deployed AI Engineer The opportunity We are looking for... ...bridge between Latent Labs’ frontier generative models and the customers... ...their unique technical environments and ensuring that our... ...unique data challenges and evaluation paradigms of biological modelling...Shift work
Latent Labs
San Francisco, CA2 days ago $180k - $300k
...About The Role You'll own the core AI systems that power Gamma: the models,... ...scale. Your job is to elevate quality, evaluate new frontier models, and push into new capabilities... ...our AI stack. You'll work closely with engineering and product to ship improvements that...Full timeWork at officeImmediate startWork from homeGamma
San Francisco, CA2 days ago$400 per month
...the Role Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models... ...The work focuses on realistic infrastructure engineering workflows and model evaluation. Spots are limited...Mercor Inc
San Francisco, CA2 days ago$184k - $259.44k
...Scale AI is seeking a highly skilled and motivated Software Engineer, Frontier AI Infrastructure to join our dynamic Public Sector... ...in compliant or restrictive environments. This requires designing... ...ensure a fair and thorough evaluation of all applicants. About...Full timeWork at office3 days per weekEarly shiftScale AI
San Francisco, CA1 day ago$180k - $215k
...Job Title: Applied AI Engineer Job ID: 85512 Location: Mountain View, California What... ...and guardrails. Operationalize LLM + RL research into production systems that deliver... ...outcomes, not token loss. Build evaluation suites simulating real customer change...TEEMA
San Francisco, CA21 hours ago$170k - $210k
...built in person and scaled remotely. AI-native engineering. We expect every engineer to be... ...and similar) and to actively push the frontier of how we build software. Low-ego... ...realities of healthcare-grade safety and evaluation. What You Will Do Design,...Full timeWork at officeImmediate startRemote workShift work2 days per week- ...The Post-Training Frontiers team creates the frontier... ...go into the final RL run and deciding... ...will work across engineering and infrastructure... ...data, RL systems, evaluation infrastructure,... ...by fast-moving environments where reliability,... ...OpenAI OpenAI is an AI research and...Full time
$350k
...AI is already changing how people work, learn, and access care... .... About the role Frontier AI can, and must, benefit all... ...are seeking an AI Deployment Engineer to advise Foundation grantees... ...architecture, workflow redesign, evaluation, safety, data handling, and change...Work at officeFlexible hoursOpenAI Foundation
San Francisco, CA21 hours ago$250k - $350k
...Francisco, Turing works with frontier AI labs to generate high... ...learning environments, and frontier research... ...capabilities in software engineering, enterprise knowledge... ...into better data, evaluations, and more capable models... ...learning (RL) environments that power...Full timeWork at office$214k - $285k
...About the Role Hex is an AI-powered platform for modern Data Science... ...workflows. AI Research Engineers at Hex partner with product teams... ...inquiry. Whether it's pushing the frontiers of SQL generation quality or using LLMs to evaluate agent threads, your job will be...Full timeWork at officeFlexible hoursHEX
San Francisco, CA2 days ago- ...Senior AI Application Engineer Working with Us Challenging. Meaningful.... ...and flexibility in our work environment. We offer a wide variety of... ...and a variety of approved frontier LLM models and APIs.... ...Infrastructure, Observability, and Evaluation Create and maintain...
Bristol-Myers Squibb Company
Brisbane, CA3 days ago - ...Job Description - Senior AI/ML Engineer Location: Melbourne (hybrid... ...are actively shaping the frontier. Our benchmarks and analysis... ...for benchmarking, model evaluation and data analysis •... ...independently in a fast-paced environment • Bachelor's or Master's...Work at office3 days per week
Artificial Analysis
San Francisco, CA4 days ago - ...re building an agentic AI caregiver advocate... ...needs over time. The AI engineering challenge: build an autonomous... ...-use frameworks, and evaluation infrastructure that... ...on problems at the frontier of agentic AI: multi-... ...Flexible remote-first work environment Work-from-anywhere 30...Immediate startRemote workFlexible hours
$180k - $300k
...States to help them hire. AI Engineer (Full-stack) Location: San... ...taste - enabling models to evaluate subjective quality across creative... ...and reinforcement learning environments that help foundation models... ...with backgrounds across frontier AI, search infrastructure, indexing...H1bWork at officeRemote workVisa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Frontier AI Evaluation Engineer: RL Environments. Be the first to apply!
Related searches
- ai engineer San Francisco, CA
- ai research engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- ai prompt engineer San Francisco, CA
- ai developer San Francisco, CA
- senior ai engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- project manager environment San Francisco, CA
- environment artist San Francisco, CA