Software Engineer - RL Environments
$260k - $290kTransparent Search Group
Job Description
Job Description
Software Engineer - RL Environments
Company: AfterQuery
Location: San Francisco, CA (in person)
Compensation: $260,000 - $290,000 base + profit share (around 150% of base, per the company) + competitive equity
Employment Type: Full-time
Visa Sponsorship: H-1B, O-1, OPT
AfterQuery is an applied research lab that curates the datasets, RL environments and evaluation infrastructure frontier AI labs use to build better models, working with leading AI labs and companies including Nvidia, Thinking Machines Lab and Legora.
Founded in 2025, AfterQuery reached a $100M+ revenue run rate within about a year and recently raised at a $3.2B valuation, making it the fastest unicorn in Y Combinator history.
The RoleAs a Software Engineer on Environments, you will design the datasets and evaluation rubrics that directly shape how frontier models learn. You will work hands-on with research teams at top AI labs, experiment with data-collection strategies, diagnose model failure modes and build metrics that show whether a model is actually improving, moving from hypothesis to live experiment quickly, with output feeding directly into training runs at scale.
What You Will Do- Design data slices that expose meaningful model failure modes across domains such as finance, code and enterprise workflows.
- Build and refine evaluation rubrics and reward signals for RLHF and RLVR pipelines.
- Model annotator behavior and run experiments to improve model capabilities.
- Develop quantitative frameworks for dataset quality, diversity and downstream impact on alignment and capability.
- Create and manage real-world and synthetic data pipelines.
- Translate lab research teams' training objectives into concrete data and evaluation specifications.
- 1-4 years of engineering experience
- Strong software engineering fundamentals and comfort running fast, hypothesis-driven experiments
- Interest in RL, evaluation and data for frontier model training
- Ability to work in person in San Francisco
Profit share (around 150% of base per the company), competitive equity, and direct work with the world's leading AI labs.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Software Engineer - RL Environments in San Francisco, CA vacancy
$245k - $300k
...platform that turns that judgment into the data , evals , and RL environments frontier models learn from. We work with leading frontier... ...keep it healthy once it's running. You sit between Pareto's engineering team and the researchers at the labs we work with, close...SuggestedFull timePareto B.v.
San Francisco, CAa month ago$200k
...and improve. The Role As a SWE (Environments), you will design the datasets and evaluation... ...if they've worked for/interned for any RL environment companies in the past or any... ...results ~ Former founders and early engineers at early stage startups are a plus. We...SuggestedFull timeAfterQuery
San Francisco, CAmore than 2 months ago- ...research lab that builds high-quality reinforcement-learning environments and agents sold to the world's leading AI labs. In under... ...expanding into new domains. The Opportunity As an RL Environment Software Engineer, you will sit at the intersection of research...SuggestedRemote work
talentpluto
San Francisco, CA28 days ago $252k - $315k
...agentic tool use, and domain expertise. Reinforcement learning environments are now the center of gravity for that work: the... ...signals it was trained against.ResponsibilitiesAs a Staff Software Engineer, RL Environments, you'll own the technical foundation for how...SuggestedFull timeRemote work- RippleMatch Inc. is seeking an innovative and motivated individual to design and refine reinforcement learning tasks in San Francisco. This role requires a strong command of Python and the ability to work independently with coding agents. Responsibilities include the full...Suggested
- ...integrations that should go into the final RL run and deciding what can make it in, (2... ..., and unblocked. You will work across engineering and infrastructure problems as they... ...system. - Are energized by fast-moving environments where reliability, speed, and judgment matter...Full time
OpenAI
San Francisco, CAmore than 2 months ago - ...Description We are looking for a hybrid Systems Engineer and AI Researcher to lead the... ...pipelines. You will design sandboxed execution environments, high-throughput reinforcement learning... ...safely. Scale Post-Training & RL Pipelines: Implement high-throughput post...Work at office
Hyphen Connect
San Francisco, CA14 days ago - ...| Primarily On-site We are seeking an Research Engineer – RL Infrastructure & Agent Environments to build the environments, evaluation systems, and... ...high-fidelity representations of complex enterprise software environments. Develop infrastructure for rollouts...
MaxIT Consulting - Max Corporate Group
San Francisco, CA8 days ago $144k - $198k
...join the adventure? Loft’s Onboard Software group provides the on-orbit software that... ...orbit. The Deployment & Runtime Environments team is where software meets the satellite... ...for someone scrappy — the kind of engineer who digs into an unfamiliar system, maps...Full timeTemporary workWork at officeRelocation packageFlexible hoursLoft Orbital Solutions
San Francisco, CAmore than 2 months ago- ...re turning that into something measurable, starting with design. We do it on two sides: building the post-training data and RL environments that teach taste to frontier models, and the context and verification tools agents need to produce work that's more creative, more...Full time
Taste Labs
San Francisco, CA13 days ago $405k
...growing group of committed researchers, engineers, policy experts, and business leaders working... .... About the role Anthropic's Environments organization builds and maintains the... ...Scope also includes keeping production RL runs healthy, maintainable, monitored, and...Full timeWork at officeRemote workVisa sponsorshipFlexible hoursAnthropic
San Francisco, CAmore than 2 months ago- ...is building infrastructure to create RL training data and evals for frontier AI... ...role We’re looking for a Full-Stack Software Engineer, Reinforcement Learning to build the product... ...product-facing tools for browsing environments, inspecting trajectories, reviewing task...Full timeWork at officeRemote workRelocationVisa sponsorship
Hud
San Francisco, CAa month ago - ...What we do Idler builds reinforcement learning environments that teach AI models to code like 0.01% engineers. Our training environments are based on real-world coding... ...Design and build scaleable systems that generate RL environments Create automated QA systems to...Full timeContract workRelocation package
Idler
San Francisco, CAmore than 2 months ago $320k
...growing group of committed researchers, engineers, policy experts, and business leaders... ...without engineering support Construct RL environments to improve Claude’s safety... ...qualifications ~6+ years of industry software engineering experience ~ Expertise in...Full timeWork at officeVisa sponsorshipFlexible hoursAnthropic
San Francisco, CAmore than 2 months ago$100k - $200k
...Full-Stack Software Engineer, Reinforcement Learning Compensation: $100K–$200K Location:... ...that power HUD’s reinforcement learning (RL) data engine. As a Full-Stack... ...You’ll Do Build tools for browsing environments, inspecting trajectories, reviewing task...Full timeRelocationVisa sponsorshipDreams 2 Reality Recruitment
San Francisco, CA5 days ago- ...Mechanize builds reinforcement learning environments that frontier AI labs use to train and... ...the complex, judgment-heavy parts of software engineering. We build the environments that expose... ...You'll design, build, and refine RL tasks. Each task is a self-contained software...
$40 - $50 per hour
...Summers , and Jack Dorsey . Position: Software Engineer Expert Type: Contract... ...Integrate web or desktop applications into RL Studio . Work with APIs , Docker , Linux environments , and service configuration. Implement populate...Full timeContract workSummer workLocal areaRemote workMercor
San Francisco, CAmore than 2 months ago- ...London offices. About the Role We're looking for a strong engineer who can build agentic products that scale. You will work with... ...We own Mercor’s evaluation system & annotation platform for RL environments and tasks. We build harnesses, agents, verifiers, and the end...Full timeWork at officeRelocation package
Mercor
San Francisco, CAmore than 2 months ago $250k
...We’re looking for an ML infrastructure engineer to design and build the core systems that... ...research team to run online, multi-reward RL at scale. Qualifications ~6+ years... ...operating in a startup or startup-like environment, i.e. a small, fast-moving team with high...Full timeEpsilon Labs, Inc.
San Francisco, CA13 days ago$350k
...Mechanize builds reinforcement learning environments that frontier AI labs use to train and... ...the complex, judgment-heavy parts of software engineering. We build the environments that expose... ...'ll design, build, and quality-assure RL tasks. Each task is a self-contained...Mechanize
San Francisco, CA1 day ago$400k
...Reinforcement Learning Engineer Mechanize builds reinforcement learning environments that frontier AI labs use to train and evaluate... ..., judgment-heavy parts of software engineering. We build the environments... ...'ll design, build, and refine RL tasks, owning the full lifecycle...Mechanize
San Francisco, CA1 day ago$125k - $195k
...building a small team of exceptional, hands-on engineers to make this happen. Mechanical,... ...0 years. About the Team The Tool Software team builds the software that makes our semiconductor... ...function tuning Experience with ML or RL frameworks applied to perception or...Full timeWork at officeVisa sponsorshipNight shiftAtomic Semi
San Francisco, CAmore than 2 months ago- ...the intersection of product engineering and AI infrastructure, building... ..., evaluate, and iterate on RL training data. Your work directly... ...model behavior and environment quality. What You'll Do... ...For ~3+ years of full-stack software engineering experience building...Full timeWork at officeRemote workVisa sponsorshipRelocation package
Clera
San Francisco, CA7 days ago - ...Software engineers at Mechanize create RL environments to sell to the leading AI labs. You might be a good fit if you have 2-5 years of experience as a software engineer and can code in python. xhyhwjd Candidates should take the time to read all the elements of this...
Mechanize
San Francisco, CA3 days ago - Founding Software Engineer As a Founding Software Engineer, you'll have end-to-end ownership over projects pushing the frontier of AI evaluation... ...isn't a narrow role. One week you might prototype a new RL environment from a research paper, the next you'll deploy distributed...Work at officeVisa sponsorship
$300k
...with a top AI training lab in San Francisco to hire a junior software engineer — and they pay like it's a senior role: $300K base + equity... .... About the company One-liner: Building high-fidelity RL environments used to train frontier AI models on real software‑engineering...$185k - $250k
...Global Links LLC is seeking a Founding Software Engineer to help build AI safety products that... ...Build legal evaluation systems and testing environments for AI agents. Develop and... ...systems. Work with evaluation harnesses, RL environments, training pipelines, or related...Work at officePremier Global Links
San Francisco, CA4 days ago$125k - $400k
...data research lab. We build the evals and environments that the world's leading frontier labs... ...work here: About the role As a Software Engineer at idler, you’ll build the systems and... ...build scaleable systems that generate RL environments Create agentic QA systems...Work at officeRelocation packageIdler
San Francisco, CA28 days ago$180k - $210k
...more secure. The Full-Stack Product Engineering team is responsible for building a comprehensive... ...who can build reliable and scalable software that will be used by all TRM customers.... ...collaboratively in a cross-functional environment with a diverse group of people at all...Full timeWork at officeImmediate startWorldwide3 days per weekTrm Labs
San Francisco, CA21 days ago$150k - $200k
...We design and ship category-defining software that enables Ryder and its 50,000+ customers... ...problems and creating impact for the engine of the American economy, you’ll love it... ...Software Engineer who excels in dynamic environments and is driven to develop applications that...Full timeWork at officeImmediate startRemote workMonday to FridayBaton
San Francisco, CA13 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer - RL Environments. Be the first to apply!
Related searches
- software developer fintech San Francisco, CA
- startup software engineer San Francisco, CA
- financial software developer San Francisco, CA
- junior software developer remote San Francisco, CA
- software engineer San Francisco, CA
- software data engineer San Francisco, CA
- freelance software developer San Francisco, CA
- software developer internship no experience San Francisco, CA
- part time software developer San Francisco, CA
- associate software developer San Francisco, CA