Frontier AI Evaluation Engineer: RL Environments
OpenAI
A leading AI research organization in San Francisco is seeking a Research Engineer focused on pushing the boundaries of frontier models and AGI/ASI measurement. Candidates should have strong engineering and statistical skills, a red-teaming mindset, and the ability to thrive in a fast-paced research environment. This role offers the opportunity to shape innovative AI measurements and build evaluation environments that drive progress. #J-18808-Ljbffr OpenAI
Vacancy posted 21 hours ago
Similar jobs that could be interesting for youBased on the Frontier AI Evaluation Engineer: RL Environments in San Francisco, CA vacancy
$200k
...builds the training data and evaluation infrastructure that frontier AI labs use to make their... ...The Role As a SWE (Environments), you will design the datasets... ...for/interned for any RL environment companies in... ...Former founders and early engineers at early stage startups are...SuggestedFull timeAfterQuery
San Francisco, CA1 day ago$180k - $220k
...client builds the training data and evaluation infrastructure that frontier AI labs use to improve their models,... .../ ML The Role As a Software Engineer (Environments), you design the datasets and... ...Nice to Haves Experience at RL-environment companies A background...SuggestedFull timeVisa sponsorshipDavid Joseph & Company
San Francisco, CA21 days ago$350k
Mirendil is a tech-first company located in San Francisco, California, seeking a Research Engineer to develop evaluation infrastructure for AI models. You'll design frameworks that measure model capabilities, implement automated pipelines, and create workflows for inspecting...Suggested- ...AI/ML Engineer (RL & Physical Systems) FLUIX is building the AI Operating... ...twin and simulation environments to accelerate training, testing... ...series, and sensor data to evaluate model reliability, interpret... .... Push the frontier of physical-world AI, where...SuggestedWeekend work
Fluix AI
San Francisco, CA5 days ago $350k
Mirendil is seeking research engineers in San Francisco to build the post-training stack for frontier reasoning models. You will engage in designing experiments and iterating... ...on scalable infrastructure for large-scale AI research. The position offers a base salary of $...Suggested$150k - $250k
About Distyl AI Distyl is an applied AI technology... ...operations for the frontier of AI. Our customers include... ...AI systems using Evaluation-Driven Development—an... ...production.AI Evaluation Engineers focus on designing and... ...run in production environments. You treat evaluation...Work at office3 days per week$130k - $220k
...the leading independent AI benchmarking and... ...insights company. They help engineers, enterprises,... ...benchmarks do not just measure frontier AI — they actively... ...best described as an AI Evaluation Engineer / Technical Generalist... ...a fast-moving startup environment. **Tech Stack** *...Full timeWorldwideAurora Jobs ApS
San Francisco, CAa month ago- RippleMatch Inc. is seeking an innovative and motivated individual to design and refine reinforcement learning tasks in San Francisco. This role requires a strong command of Python and the ability to work independently with coding agents. Responsibilities include the full...
- ...Remote Industry: Applied AI / AI research data... ...quality reinforcement-learning environments and agents sold to the world... ...The Opportunity As an RL Environment Software Engineer, you will sit at the intersection... ...-quality environments the frontier will need next, then build...Remote work
talentpluto
San Francisco, CA9 days ago - ...The Post-Training Frontiers team creates the frontier... ...go into the final RL run and deciding... ...will work across engineering and infrastructure... ...data, RL systems, evaluation infrastructure,... ...by fast-moving environments where reliability,... ...OpenAI OpenAI is an AI research and...Full time
OpenAI
San Francisco, CA1 day ago - Notion is seeking a data-driven AI quality engineer to own the quality bar for Notion AI products. You’ll collaborate... ...team, focusing on context engineering, evaluation systems, and data analysis. You’ll partner with frontier labs to evaluate and launch new models and...
- techire ai is seeking researchers to build frontier reasoning models for scientific discovery in a well-funded, stealth AI startup environment. You will design training pipelines, reasoning datasets, and evaluation systems, focusing on models that reason across complex...
- OpenAI is seeking a researcher to advance frontier evaluations and environments for safe AGI/ASI. You will help design north star model environments... ...into real-world products. Collaborate with researchers, engineers, product and safety teams to decide what to measure,...
- Prime Intellect is building an open frontier AI platform unifying compute, environments, evaluations, and deployment for researchers and engineers worldwide. This generalist software engineering role focuses on the product surface of Prime Intellect—the developer-facing...Worldwide
$150k - $250k
...going by building AI agents that automate... ...As a Founding AI Engineer, you will own the core... ...reward models, and evaluation harnesses that will... ...reliably with EDA environments and RTL artifacts... ...Stay current with frontier research in LLM reasoning, RL for agents, and tool...Bronco
San Francisco, CA3 days ago- ...intelligence to power the AI economy. We partner with leading... ...talent network trains frontier AI models in the same way... ...As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at... ...synthetic data pipelines and environments that generate high-signal...Full timeWork at officeRelocation package
Mercor
San Francisco, CA1 day ago $240k - $280k
A leading software monitoring company is seeking a Senior Software Engineer on its AI/ML team to build evaluation infrastructure for measuring the performance of AI systems. This role involves designing datasets, creating benchmarks, and ensuring AI features behave reliably...- ...Team Our Cyber team builds AI systems and products that... ...and reliability of frontier models in security-sensitive... ...team works across product engineering, model training, evaluations, safeguards, and... ...role if you: Enjoy 0 - 1 environments, can navigate ambiguity,...Full time
OpenAI
San Francisco, CA1 day ago - ...a well-funded startup in the AI Healthtech space. They're building... ...learning pipeline. Set up the evaluation infrastructure that measures... ...feedback loop, and implement RL pipelines so that agent performance... ..., and build with the next engineer in mind. What you'll bring:...Full timeWork at officeRemote work
Drh Search Llc
San Francisco, CA1 day ago $180k - $300k
...About The Role You'll own the core AI systems that power Gamma: the models,... ...scale. Your job is to elevate quality, evaluate new frontier models, and push into new capabilities... ...our AI stack. You'll work closely with engineering and product to ship improvements that...Full timeWork at officeImmediate startWork from homeGamma
San Francisco, CA1 day ago$150k - $250k
...About Distyl AI Distyl is an applied AI technology... ...operations for the frontier of AI. Our customers... ...Are Looking For AI Engineers build and operate production... ...value inside customer environments. This role is for... ...improve systems through evaluation, feedback, integration...Full timeWork at officeFlexible hours3 days per weekDistyl Ai
San Francisco, CA1 day ago- ...Forward Deployed AI Engineer The opportunity We are looking for... ...bridge between Latent Labs’ frontier generative models and the customers... ...their unique technical environments and ensuring that our... ...unique data challenges and evaluation paradigms of biological modelling...Full timeShift work
Latent Labs
San Francisco, CA1 day ago $192k - $237.1k
...Drata is advancing the frontier of compliance... ...integrating intelligent AI capabilities into its... ...are seeking a Senior AI Engineer to help design, build,... ...systems in production environments. Optimize for latency... ...cost, reliability, and evaluation in real-world enterprise...Full timeWork at officeImmediate startWorldwideMonday to FridayFlexible hoursDrata
San Francisco, CA1 day ago- ...Francisco seeks a bio safety researcher to design and run capability evaluations for biology-focused models, build and curate datasets for safety classifiers, and iterate on those classifiers with ML engineers. You will work at the intersection of applied ML and biosecurity...
- Notion seeks a role focused on quality for Notion AI products. You will partner with product and engineering to define what quality means, measure progress, and... ...and data-driven improvements, with direct collaboration with frontier AI labs. #J-18808-Ljbffr MakeWithMohit
$176k - $253k
...seeking a Senior Member of Technical Staff, AI Quality, in San Francisco. Your main goal... ..., ensuring high standards through robust evaluation processes. You'll build capability... ...grading systems, and work directly with engineers to ensure our AI systems excel. Ideal candidates...$150k
Tzafon is seeking a skilled engineer to enhance their machine intelligence systems in San Francisco. As part of the team, you'll be responsible for building evaluation infrastructure, designing data pipelines, and implementing fine-tuning processes. Ideal candidates have...- ...management, design, and engineering together with the... ...You are an exceptional AI-native software engineer... ..., establish tests and evaluations, and review generated... ...specifications, tests, development environments, CI pipelines, and... ...A genuine interest in frontier AI and a consistent...Permanent employmentFull timeWork experience placementLive inWork at officeLocal area
$110.7k - $372.9k
...need. Deloitte has a new AI-first effort, backed... ...lab. As an Agentic AI Engineer, you will design,... ...right time. Reliability, evaluation & safety • Implement observability... ..., and sandboxed test environments — alongside retrieval-... ...outputs. We pair frontier AI research with...Local areaVisa sponsorship$166.6k - $218.7k
...deliberate, company-wide bet on AI. Frontier users are already pushing... ...interface for agents and engineers.Expand and operate our LLM... ...companyBuild and refine sandbox environments and tooling that let... ...holding.Build playgrounds and evaluation harnesses so internal AI...Shift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Frontier AI Evaluation Engineer: RL Environments. Be the first to apply!
Related searches
- ai engineer San Francisco, CA
- ai research engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- ai developer San Francisco, CA
- senior environment artist San Francisco, CA
- environment health safety San Francisco, CA