Software Engineer - RL Environments
$200kAfterQuery
About AfterQuery
AfterQuery builds the training data and evaluation infrastructure that frontier AI labs use to make their models better. We work with the world's leading labs to design high signal datasets and run rigorous evaluations that go beyond static benchmarks. We are a small, early team (post Series A) where individual contributors have a direct impact on how the next generation of models learn and improve.
The Role
As a SWE (Environments), you will design the datasets and evaluation rubrics that directly influence how frontier models learn. You'll work hands-on with research teams at top AI labs, experimenting with data collection strategies, diagnosing model failure modes, and developing the metrics that determine whether a model is actually improving. You'll go from hypothesis to live experiment quickly, and your output will feed directly into model training runs at scale.
Day to day, you will design data slices that expose meaningful failure modes across domains like finance, code, and enterprise workflows. You will build and refine reward signals for RLHF and RLVR pipelines. You will develop quantitative frameworks for measuring dataset quality, diversity, and downstream impact on alignment and capability. You will partner with lab research teams to translate their training objectives into concrete data and evaluation specifications.
What You'll Do
Design data slides and explore data shapes that expose meaningful model failure modes across domains like finance, code, and enterprise workflows
Build and refine evaluation rubrics and reward signals for RLHF and RLVR training pipelines
Model annotator behavior and run experiments to improve different model capabilities
Develop quantitative frameworks for measuring dataset quality, diversity, and downstream impact on model alignment and capability
Create and manage both real world & synthetic data pipelines
Partner with lab research teams to translate their training objectives into concrete data and evaluation specifications
What We're Looking For
1-4 YOE
Major plus if they've worked for/interned for any RL environment companies in the past or any AI safety or benchmarking orgs like METR, Artificial Analysis, etc..
Genuine obsession with how data structure, selection, and quality drive model behavior
Ability to design lightweight experiments, move fast, and extract actionable insights from messy results
Former founders and early engineers at early stage startups are a plus. We don't filter on pedigree. We want people who can demonstrate they work hard, learn fast, and care deeply about getting the details right.
Compensation Structure:
$200k base + profit share (around 150% of base) + competitive equity
$180k - $220k
...2025 · 11–50 people · Industry: AI / ML The Role As a Software Engineer (Environments), you design the datasets and evaluation rubrics that directly... ...technical depth Nice to Haves Experience at RL-environment companies A background in AI safety or benchmarking...SuggestedFull timeVisa sponsorship- ...research lab that builds high-quality reinforcement-learning environments and agents sold to the world's leading AI labs. In under... ...expanding into new domains. The Opportunity As an RL Environment Software Engineer, you will sit at the intersection of research...SuggestedRemote work
- RippleMatch Inc. is seeking an innovative and motivated individual to design and refine reinforcement learning tasks in San Francisco. This role requires a strong command of Python and the ability to work independently with coding agents. Responsibilities include the full...Suggested
- ...integrations that should go into the final RL run and deciding what can make it in, (2... ..., and unblocked. You will work across engineering and infrastructure problems as they... ...system. - Are energized by fast-moving environments where reliability, speed, and judgment matter...SuggestedFull time
$144k - $198k
...Francisco, CA / Golden, COSoftware - Onboard Software /Full time /On-siteWanna join the... ...low Earth orbit.The Deployment & Runtime Environments team is where software meets the... ...looking for someone scrappy — the kind of engineer who digs into an unfamiliar system, maps...SuggestedFull timeTemporary work- ...Minerals Mariana Minerals is a software-first, vertically integrated... ...Senior Full Stack Software Engineer to lead critical technical initiatives... ...production-ready ML, RL, and LLM-powered features,... ...working in ambiguous, fast-paced environments and bringing structure to...Full time
$225k
...frontier-scale pre-training, domain-specific RL, ultra-long context, and inference-time... ...this goal. About the role: As a Software Engineer on the product team, you’ll be... ...to use LTM in a cloud-based development environment and manage Magic account settings. Partnering...Full timeLocal areaRelocationVisa sponsorship- ...What we do Idler builds reinforcement learning environments that teach AI models to code like 0.01% engineers. Our training environments are based on real-world coding... ...Design and build scaleable systems that generate RL environments Create automated QA systems to...Full timeContract workRelocation package
$200k
...frontier-scale pre-training, domain-specific RL, ultra-long context, and inference-time... ...this goal. About the role As a Software Engineer at Magic, you will work on core systems... ...Pre-training Data , RL Research & Environments , or Product , depending on...Full timeRelocationVisa sponsorship$350k
...goals. We are scientists, engineers, and builders who’ve created... ...infrastructure — evaluation libraries, RL training libraries,... ...learning, or similar. Strong software engineering fundamentals with... ...in highly collaborative environments involving many different cross...Full timeLocal areaVisa sponsorshipWork visaRelocation package- ...manipulation, long-horizon reliability, safety and more. Combining rigorous research with high-quality engineering across evaluation, data, training, RL environments and shared infrastructures, we aim to create reliable and practical computer-using agents. About the...Full timeWork at officeRelocation package
- ...AI/ML Engineer (RL & Physical Systems) FLUIX is building the AI Operating System for data... ...and refine digital twin and simulation environments to accelerate training, testing, and... ...meet. Collaborate with controls, software, and field engineering teams to integrate...Weekend work
- ...and perform actions. We develop secure environments that allow AI models to write and execute... ...evolve complex infrastructure that powers RL training and advanced model use cases.... ...training at scale, identifying bottlenecks and engineering solutions to optimize system performance...Full timeWork at officeRelocation package
$300k
...Mechanize builds reinforcement learning environments that frontier AI labs use to train and... ...the complex, judgment-heavy parts of software engineering. We build the environments that expose... .... You'll design, build, and refine RL tasks. Each task is a self-contained...$350k
...Mechanize RL Task Designer Mechanize builds reinforcement learning environments that frontier AI labs use to train and evaluate their coding models. Learn more... ...at the complex, judgment-heavy parts of software engineering. We build the environments that expose those...- ...doctors and AI working together. Role: Engineer – AI-Native Mental Health Care (In-... ...product. Before that, I did deep learning + RL research. I’m obsessed with building AI... ...and are committed to creating an inclusive environment for all employees, contractors, and...Full timeFor contractorsLive inWork at officeImmediate startVisa sponsorshipFlexible hoursShift work
$400k
...Mechanize builds reinforcement learning environments that frontier AI labs use to train and... ...the complex, judgment-heavy parts of software engineering. We build the environments that expose... ...You'll design, build, and refine RL tasks, owning the full lifecycle from...- ...Software Engineer - Full Stack (Frontend Focus) Location Team What we're looking for... ...for our AI training, fine-tuning, and RL platforms. Collaborate with product,... ...A collaborative and inclusive work environment. Access to cutting-edge technology and...
- ...Founding Software Engineer As a Founding Software Engineer, you'll have end-to-end ownership over projects pushing the frontier of AI... ...This isn't a narrow role. One week you might prototype a new RL environment from a research paper, the next you'll deploy distributed...Work at officeVisa sponsorship
$160k - $210k
...A growing technology startup is hiring a Senior Full Stack Software Engineer to help build and scale its core product. This engineer will... ...ownership and influence over technical decisions in a fast-paced environment. This position is well-suited for an engineer who enjoys...Remote workFlexible hours$120k - $170k
...Wanna join the adventure? Loft Orbital is looking for a Software Engineer to join our Ground Software Solutions team. About the Team: The Ground Software Solutions Team develops and maintains custom ground software capabilities for our customers. We configure...Full timeTemporary workWork at officeRelocation packageFlexible hours$300k
...with a top AI training lab in San Francisco to hire a junior software engineer — and they pay like it's a senior role: $300K base + equity... .... About the company One-liner: Building high-fidelity RL environments used to train frontier AI models on real software‑engineering...- ...Role We’re looking for a Senior Backend or Full-Stack Software Engineer (5+ years experience) who wants to build the core systems... ...collaboration with product, data, ops, or design partners Built in environments where speed, reliability, and ambiguity coexist — startups,...Full timeTemporary workWork at officeFlexible hours
- ...Position Overview We are seeking a frontend-leaning engineer to help build and scale the user-facing web applications powering Knowtex... ...real-time voice AI workflows across enterprise healthcare environments. This role is ideal for an engineer who has experience operating...Full timeShift work
$192k - $240k
...spend management, bill pay, and travel software, Brex enables founders and finance teams... ...support you need to grow your career.Engineering at BrexEngineering at Brex is about building... ...architecture to deployment. It’s an environment where engineering is a craft, and...Work at officeRemote workWork from home- ...we scale up with more researchers and engineers joining OpenAI, we seek a pragmatic and... ...of how we should build, test and deploy software. You will drive the design of our continuous... ...around our build system. Our current environment relies heavily on Python, Rust, and C++...Full timeWork at officeRelocation package
$150k - $200k
...to address them. You’ll play a critical role in shaping our engineering and broader company culture and help make this the best place... ...Mathematics, or similar degree. You have 3+ years of experience in a Software Engineering position. You have experience with HTML, CSS,...Full time$143.64k - $197.64k
...ensure the quality and reliability of the codebase. Troubleshoot and resolve issues. Qualifications: ~2-4 years as a backend engineer. ~ Working knowledge of one or more programming languages such as Go, Python, Java, or Node.js. ~ Experience MySQL or other...Full timeWork experience placement- ...enterprise applications (building HR applications is a plus) UNIX/Linux systems proficiency Ability to work in a fast-paced environment and have a solid background working in an Agile/Scrumenvironment Excellent communication skills Preferred: Experience developing...Full time
- ...Flipkart, and Okta, our team includes engineers from premier tech companies and graduates... .... Who are you? We are seeking a Software Engineer to join the Ema team. You are... ...deploying software in multi-tenant SaaS environments. Knowledge of front-end technologies...Full timeWork experience placement
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer - RL Environments. Be the first to apply!
- agile software developer San Francisco, CA
- software developer internship no experience San Francisco, CA
- intermediate software engineer San Francisco, CA
- software engineer staff San Francisco, CA
- experienced software developer San Francisco, CA
- work from home software developer San Francisco, CA
- software developer no experience San Francisco, CA
- software developer fintech San Francisco, CA
- software data engineer San Francisco, CA
- financial software developer San Francisco, CA



