Research Engineer: RL Environments & Evaluation Systems
MaxIT Consulting - Max Corporate Group
MaxIT Consulting - Max Corporate Group in San Francisco seeks a Research Engineer to build agent environments, evaluation systems, and infrastructure used to train and assess long-horizon enterprise AI agents. You will design evaluation environments, define tasks and rewards, and develop production-grade infrastructure for rollouts and trajectory inspection, focusing on reliability and scalability in real-world enterprise settings. #J-18808-Ljbffr MaxIT Consulting - Max Corporate Group
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Research Engineer: RL Environments & Evaluation Systems in San Francisco, CA vacancy
- ...We are looking for a hybrid Systems Engineer and AI Researcher to lead the development of our agent evaluation framework and post-training... ...design sandboxed execution environments, high-throughput reinforcement... ...safely. Scale Post-Training & RL Pipelines: Implement high-...SuggestedWork at office
Hyphen Connect
San Francisco, CA10 days ago - ...Description San Francisco, California | Primarily On-site We are seeking an Research Engineer – RL Infrastructure & Agent Environments to build the environments, evaluation systems, and supporting infrastructure used to train and assess long-horizon enterprise AI...Suggested
MaxIT Consulting - Max Corporate Group
San Francisco, CA4 days ago - ...Investigate and develop systems to enhance frontier... ...the world’s leading research accelerator for frontier... ...learning environments that power post-training... ...enterprises. Our environments evaluate and improve AI models... ...: Software engineering environments for coding...SuggestedContract workPart timeFor contractors
Turing
San Francisco, CA6 days ago $250k - $350k
...to develop reliable AI systems for the world’s most important... ..., combining rigorous evaluation with full-stack... ...paired with applied ML research, design, and evaluation... ...Machine Learning Research Engineer, you will operate across... ..., online or offline RL — and validate them with...SuggestedFull timeScale AI
San Francisco, CA3 days ago- ...constrained, measurable decisions. You will define environment abstractions, evaluation contracts, and baselines to guide placement and... ...limits and failure cases, and collaborate with ML researchers, runtime engineers, data teams, and safety reviewers to ensure rigorous...Suggested
$136.44k - $265.11k
...You’ll build the datasets, evaluations, and systems that help close that gap.... ...intersection of software engineering, biology, and frontier AI:... ...into high-quality tasks and environments for LLMs.Analyze model... ...scientists, and external research partners.Desire to work in...Work at officeLocal areaMonday to FridayShift workBenchling
San Francisco, CA4 days ago- ...Improvement (RSI) team works across research, engineering, product, and infrastructure to build AI systems that accelerate and... ...and feedback loops, designing evaluations, and training models to... ...harnesses, synthetic data, RL environments, and model training. Build...
OpenAI
San Francisco, CA16 hours ago - Preference Model is building automated ML research engineering to advance RL environments and post-training for large language models. We seek machine learning... ...and shaping research directions. You will train and evaluate models on proprietary RL environments, architect...
$189.6k - $237k
...platform has been powering MLEs, researchers, data scientists and... ...and automatic training and evaluation of LLM's, as well as evaluation... ...have:Strong excitement about system optimizationExperience with... ...distributed ML systemsStrong software engineering skills, proficient in...Full timeScale AI
San Francisco, CA3 days ago$1,000 per month
...frontier models and evaluating AI agents. Experts contribute... ..., healthcare, STEM engineering, and more. micro1... ...that improve how AI systems learn, reason, and perform... ...AI. Role Title: Research Engineer - Code... ...remote, collaborative environment. Commitment to producing...Part timeFor contractorsRemote workmicro1
San Francisco, CA6 days ago$320k - $405k
...interpretable, and steerable AI systems. We want AI to be safe and... ...growing group of committed researchers, engineers, policy experts, and... ...horizons. At frontier scale, an RL run is a large distributed system... ...: training, sampling, and environment execution run concurrently across...Full timeWork at officeVisa sponsorshipFlexible hours$250k - $300k
Researcher or engineer? This role wants both, in one person. A profitable, seed... ...reinforcement learning environments and post-training data for... ...goes into them Long-horizon RL environments and tasks in many... ..., physics, chemistry or systems Artefacts people use: fast...Full time- ...Research Engineer New York - Hybrid; San Francisco Bay Area - Hybrid About... ...research organization, focused on evaluation methodology, benchmarks, and RL environments for frontier labs and... ...design, then ship the production system that runs it. This role doesn't...Full timeWork at officeLocal areaRemote work
Invisible Technologies Inc. Defunct
San Francisco, CA3 days ago $275k
...Research Engineer Magic's mission is to build safe AGI that accelerates... ...pre-training, domain-specific RL, ultra-long context, and... ...Engineer, you'll work on training, evaluating, and serving large AI models... ...with large distributed systems Ability to handle large ETL...RelocationVisa sponsorshipMagic Inc
San Francisco, CA2 days ago$155k - $269k
...part of a multidisciplinary team of Research Scientists and Engineers building the content backbone of a best... ...demands of training and closed-loop evaluation. Qualifications: ~ Shipping... ...not just prototypes. You have shipped systems that other engineers and researchers...Full timeWork at officeWork from homeFlexible hoursWaabi
San Francisco, CA23 days ago- ...Lab, unifies compute, environments, evaluations, secure sandboxes,... ...into one full-stack system for post-training at... ...scale - from SFT and RL to tool use, agent workflows... ...like autonomous research, and the full-stack platform... ...working with systems engineers on hardware-aware...Remote workVisa sponsorshipRelocation packageFlexible hours
$250k - $350k
...reinforcement learning environments, and frontier research benchmarks that... ...capabilities in software engineering, enterprise... ...-to-end agentic AI systems inside mission-critical... ...into better data, evaluations, and more capable... ...reinforcement learning (RL) environments that...$174k - $252k
Research Engineer, Gemini Information Retrieval, DeepMind Share Research Engineer,... ...developing Reinforcement Learning (RL) algorithms, automated evaluation systems, or LLM reflection and reasoning... ...into large-scale production environments (e.g., Search, Recommendation Systems...- ...AfterQuery is an applied research lab curating data... ...of how those systems improve. This is... ...to shape the engineering organization and... ...controlled SFT and RL - base post-training... ...for SFT, RL and evaluation workflows. Build... ...APIs, compute environments, and evaluation infrastructure...Local area
- Spectral Labs is building foundation models for engineering physical systems in San Francisco. We seek a research engineer who turns ideas into experiments and experiments into deployable models for real CAD data, using Python and PyTorch or JAX. Role is fully in-person...Work at office
- ...Workspace.Sierra’s Applied Research team advances the... ...into reliable production systems.What you’ll doTackle... ....Develop, fine-tune, evaluate, and deploy models that... ..., creating an environment that enables all of us... ...timeLocation TypeOn-siteDepartmentEngineeringPlatform EngineeringFull timeFlexible hours
Sierra
San Francisco, CA1 day ago $193.3k - $261.5k
...unstructured data across enterprise systems. As a key member of this team, you will lead research and development efforts in... ..., and deep collaboration with engineering teams to bring research into... ...pipelines, data collection/annotation/evaluation web applications.* Expedite...InternshipLocal areaFlexible hoursAmazonWebServices
San Francisco, CA2 days ago$150k - $250k
...social organizations.We research and deploy... ...into self-constructing systems, the development of the... ...ForAt Distyl, Research Engineers build the bridge between... ...inside real customer environments.Research Engineers... ...system behavior, build evaluation frameworks, and collaborate...Work at office3 days per weekDistyl AI
San Francisco, CA3 days ago$197.3k - $313.7k
...talented software and platform engineers to embed in our AI team... ...AI and Agentic Systems? Do you thrive in an environment where your engineering skills... ...enable world-class research and products used by millions... ...like APIs, UIs, agentic evaluators, and more.Roll out...Full timeSalesforce
San Francisco, CA2 days ago- ...the Role Factory is seeking innovative Research Engineers to design and integrate advanced AI... ...develop, and deploy AI-driven agentic systems that enhance Factory’s core AI capabilities... ...on retrieval systems, code generation evaluation, agentic user experience development,...Work at office
The San Francisco AI Factory
San Francisco, CA3 days ago - ...behind The Path's AI Therapist. Combine research, data science, and engineering to create models, orchestration, and evaluation systems that make therapy conversations deeply... ...strategies, training data curation, building RL environments, new model architectures and other AI...
The Path
San Francisco, CA3 days ago - ...Research Engineer Post-Training Data Location: San Fran... ...Generation Research Environments Frontier AI Profile... ...the ability to build systems that scale data generation... ...and domain-specific evaluation workflows for some of... ...to post-training RL long-horizon tasks or...Full time
NxT Level
San Francisco, CA8 days ago $68.25k - $88.75k
...provides expert land development engineering and environmental consulting... ..., corporations, healthcare systems, colleges/universities, and... ...and supportive work environment for all; prioritizes wellbeing... ...management, processing, and evaluation; and report preparation. In...Hourly payFull timeTemporary workWork experience placementFor subcontractorInternshipWork at officeLocal areaWorldwideFlexible hoursLangan
San Francisco, CA16 hours ago- ...Phonic is a product and research lab focused on... ...Role As a Research Engineer at Phonic, you'll sit... ...directly on the core systems that make Phonic's voice... ...high trust, in-person environment in our SF office to push... ...the training pipelines, evaluation frameworks, and tooling...Work at office
Phonic
San Francisco, CA1 day ago - ...Research Engineer Lotus Health is a groundbreaking primary care app that integrates your medical... ...ship the core reasoning and agentic systems that power Lotus. You will turn messy... ...dataset curation, model training and evaluation, retrieval and tool use, safety and...
Lotus Health
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Engineer: RL Environments & Evaluation Systems. Be the first to apply!
Related searches
- research software engineer San Francisco, CA
- deep learning research engineer San Francisco, CA
- ai research engineer San Francisco, CA
- senior research engineer San Francisco, CA
- research engineer San Francisco, CA
- research programmer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- data systems engineer San Francisco, CA
- director systems engineering San Francisco, CA
- senior windows systems engineer San Francisco, CA