Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer - RL Environments

$200k
Full-time

AfterQuery

About AfterQuery

AfterQuery builds the training data and evaluation infrastructure that frontier AI labs use to make their models better. We work with the world's leading labs to design high signal datasets and run rigorous evaluations that go beyond static benchmarks. We are a small, early team (post Series A) where individual contributors have a direct impact on how the next generation of models learn and improve.

The Role

As a SWE (Environments), you will design the datasets and evaluation rubrics that directly influence how frontier models learn. You'll work hands-on with research teams at top AI labs, experimenting with data collection strategies, diagnosing model failure modes, and developing the metrics that determine whether a model is actually improving. You'll go from hypothesis to live experiment quickly, and your output will feed directly into model training runs at scale.

Day to day, you will design data slices that expose meaningful failure modes across domains like finance, code, and enterprise workflows. You will build and refine reward signals for RLHF and RLVR pipelines. You will develop quantitative frameworks for measuring dataset quality, diversity, and downstream impact on alignment and capability. You will partner with lab research teams to translate their training objectives into concrete data and evaluation specifications.

What You'll Do

  • Design data slides and explore data shapes that expose meaningful model failure modes across domains like finance, code, and enterprise workflows

  • Build and refine evaluation rubrics and reward signals for RLHF and RLVR training pipelines

  • Model annotator behavior and run experiments to improve different model capabilities

  • Develop quantitative frameworks for measuring dataset quality, diversity, and downstream impact on model alignment and capability

  • Create and manage both real world & synthetic data pipelines

  • Partner with lab research teams to translate their training objectives into concrete data and evaluation specifications

What We're Looking For

  • 1-4 YOE

  • Major plus if they've worked for/interned for any RL environment companies in the past or any AI safety or benchmarking orgs like METR, Artificial Analysis, etc..

  • Genuine obsession with how data structure, selection, and quality drive model behavior

  • Ability to design lightweight experiments, move fast, and extract actionable insights from messy results

  • Former founders and early engineers at early stage startups are a plus. We don't filter on pedigree. We want people who can demonstrate they work hard, learn fast, and care deeply about getting the details right.

Compensation Structure:

$200k base + profit share (around 150% of base) + competitive equity

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer - RL Environments in San Francisco, CA vacancy
  • $180k - $220k

     ...2025 · 11–50 people · Industry: AI / ML The Role As a Software Engineer (Environments), you design the datasets and evaluation rubrics that directly...  ...technical depth Nice to Haves Experience at RL-environment companies A background in AI safety or benchmarking... 
    Suggested
    Full time
    Visa sponsorship

    David Joseph & Company

    San Francisco, CA
    20 days ago
  •  ...research lab that builds high-quality reinforcement-learning environments and agents sold to the world's leading AI labs. In under...  ...expanding into new domains. The Opportunity As an RL Environment Software Engineer, you will sit at the intersection of research... 
    Suggested
    Remote work

    talentpluto

    San Francisco, CA
    8 days ago
  • RippleMatch Inc. is seeking an innovative and motivated individual to design and refine reinforcement learning tasks in San Francisco. This role requires a strong command of Python and the ability to work independently with coding agents. Responsibilities include the full...
    Suggested

    RippleMatch

    San Francisco, CA
    1 day ago
  •  ...integrations that should go into the final RL run and deciding what can make it in, (2...  ..., and unblocked. You will work across engineering and infrastructure problems as they...  ...system. - Are energized by fast-moving environments where reliability, speed, and judgment matter... 
    Suggested
    Full time

    OpenAI

    San Francisco, CA
    1 day ago
  • $144k - $198k

     ...Francisco, CA / Golden, COSoftware - Onboard Software /Full time /On-siteWanna join the...  ...low Earth orbit.The Deployment & Runtime Environments team is where software meets the...  ...looking for someone scrappy — the kind of engineer who digs into an unfamiliar system, maps... 
    Suggested
    Full time
    Temporary work

    Loft Orbital

    San Francisco, CA
    2 days ago
  •  ...Minerals Mariana Minerals is a software-first, vertically integrated...  ...Senior Full Stack Software Engineer to lead critical technical initiatives...  ...production-ready ML, RL, and LLM-powered features,...  ...working in ambiguous, fast-paced environments and bringing structure to... 
    Full time

    Mariana Minerals

    San Francisco, CA
    1 day ago
  • $200k

     ...frontier-scale pre-training, domain-specific RL, ultra-long context, and inference-time...  ...this goal. About the role As a Software Engineer at Magic, you will work on core systems...  ...Pre-training Data , RL Research & Environments , or Product , depending on... 
    Full time
    Relocation
    Visa sponsorship

    Magic

    San Francisco, CA
    1 day ago
  • $225k

     ...frontier-scale pre-training, domain-specific RL, ultra-long context, and inference-time...  ...this goal. About the role: As a Software Engineer on the product team, you’ll be...  ...to use LTM in a cloud-based development environment and manage Magic account settings. Partnering... 
    Full time
    Local area
    Relocation
    Visa sponsorship

    Magic Ai

    San Francisco, CA
    1 day ago
  •  ...What we do Idler builds reinforcement learning environments that teach AI models to code like 0.01% engineers. Our training environments are based on real-world coding...  ...Design and build scaleable systems that generate RL environments Create automated QA systems to... 
    Full time
    Contract work
    Relocation package

    Idler

    San Francisco, CA
    1 day ago
  • $350k

     ...goals.  We are scientists, engineers, and builders who’ve created...  ...infrastructure — evaluation libraries, RL training libraries,...  ...learning, or similar. Strong software engineering fundamentals with...  ...in highly collaborative environments involving many different cross... 
    Full time
    Visa sponsorship
    Work visa
    Relocation package

    Thinking Machines Lab

    San Francisco, CA
    1 day ago
  •  ...manipulation, long-horizon reliability, safety and more. Combining rigorous research with high-quality engineering across evaluation, data, training, RL environments and shared infrastructures, we aim to create reliable and practical computer-using agents. About the... 
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...AI/ML Engineer (RL & Physical Systems) FLUIX is building the AI Operating System for data...  ...and refine digital twin and simulation environments to accelerate training, testing, and...  ...meet. Collaborate with controls, software, and field engineering teams to integrate... 
    Weekend work

    Fluix AI

    San Francisco, CA
    4 days ago
  •  ...and perform actions. We develop secure environments that allow AI models to write and execute...  ...evolve complex infrastructure that powers RL training and advanced model use cases....  ...training at scale, identifying bottlenecks and engineering solutions to optimize system performance... 
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...About The Company Our company builds RL training data and task construction...  ...business. About The Role As a Software Engineer, you'll accelerate task creation for company...  ...higher quality, construct complex RL environments and tasks yourself, and contribute to custom... 
    Full time
    For contractors
    H1b
    Work at office
    Remote work
    Visa sponsorship

    Product Pulse

    San Francisco, CA
    7 days ago
  •  ...Founding Software Engineer As a Founding Software Engineer, you'll have end-to-end ownership over projects pushing the frontier of AI...  ...This isn't a narrow role. One week you might prototype a new RL environment from a research paper, the next you'll deploy distributed... 
    Work at office
    Visa sponsorship

    RainesDev

    San Francisco, CA
    5 days ago
  •  ...Software Engineer - Full Stack (Frontend Focus) Location Team What we're looking for...  ...for our AI training, fine-tuning, and RL platforms. Collaborate with product,...  ...A collaborative and inclusive work environment. Access to cutting-edge technology and... 

    Emissary

    San Francisco, CA
    2 days ago
  • $350k

     ...Mechanize RL Task Designer Mechanize builds reinforcement learning environments that frontier AI labs use to train and evaluate their coding models. Learn more...  ...at the complex, judgment-heavy parts of software engineering. We build the environments that expose those... 

    Mechanize

    San Francisco, CA
    4 days ago
  • $300k

     ...Mechanize builds reinforcement learning environments that frontier AI labs use to train and...  ...the complex, judgment-heavy parts of software engineering. We build the environments that expose...  .... You'll design, build, and refine RL tasks. Each task is a self-contained... 

    Mechanize

    San Francisco, CA
    4 days ago
  •  ...doctors and AI working together. Role: Engineer – AI-Native Mental Health Care (In-...  ...product. Before that, I did deep learning + RL research. I’m obsessed with building AI...  ...and are committed to creating an inclusive environment for all employees, contractors, and... 
    Full time
    For contractors
    Live in
    Work at office
    Immediate start
    Visa sponsorship
    Flexible hours
    Shift work

    Legion Health

    San Francisco, CA
    4 days ago
  • $400k

     ...Mechanize RL Engineer Mechanize builds reinforcement learning environments that frontier AI labs use to train and evaluate their coding models. Learn more at mechanize...  ...fail at the complex, judgment-heavy parts of software engineering. We build the environments that... 

    Mechanize

    San Francisco, CA
    4 days ago
  • $221.19k - $260k

     ...design, and develop computer and network software or specialized utility programs....  ...using C++ which span multiple editing environments (Schematic Capture, PCB Layout, Library...  ...Bachelor’s degree in Computer Science, Engineering or related field and 8 years of experience... 
    Full time
    For contractors
    Remote work

    Autodesk

    San Francisco, CA
    1 day ago
  •  ...Role Overview We're seeking a Software Engineer to build the ML infrastructure and data...  ...research team to run online, multi-reward RL at scale. Build high-throughput...  ...handle competing priorities in a fast-paced environment Preferred Qualifications... 
    Full time

    Epsilon Labs, Inc.

    San Francisco, CA
    12 days ago
  • $120k - $170k

     ...Wanna join the adventure?   Loft Orbital is looking for a Software Engineer to join our Ground Software Solutions team.   About the Team: The Ground Software Solutions Team develops and maintains custom ground software capabilities for our customers. We configure... 
    Full time
    Temporary work
    Work at office
    Relocation package
    Flexible hours

    Loft Orbital Solutions

    San Francisco, CA
    1 day ago
  •  ...Role   We’re looking for a Senior Backend or Full-Stack Software Engineer (5+ years experience) who wants to build the core systems...  ...collaboration with product, data, ops, or design partners Built in environments where speed, reliability, and ambiguity coexist — startups,... 
    Full time
    Temporary work
    Work at office
    Flexible hours

    Sprinter Health

    San Francisco, CA
    1 day ago
  • $192k - $240k

     ...spend management, bill pay, and travel software, Brex enables founders and finance teams...  ...support you need to grow your career.Engineering at BrexEngineering at Brex is about building...  ...architecture to deployment. It’s an environment where engineering is a craft, and... 
    Work at office
    Remote work
    Work from home

    Brex

    San Francisco, CA
    4 days ago
  •  ...Frontend Software Engineer About Pi Pi is building an agentic product security platform for teams that need to secure software at the...  ...detail. ~ Ability to work in a fast-moving startup environment with ownership, autonomy, and good judgment. Technologies... 
    Full time

    Pi Security

    San Francisco, CA
    1 day ago
  • $125k - $160k

     ...Role Overview We are seeking a versatile Full Stack Software Engineer to join our engineering team. Reporting to the Software Engineering...  ...Terraform and Docker , for managing containerized environments. Familiarity with the "AI Stack" beyond APIs—such as... 
    Full time
    Local area
    Visa sponsorship
    Work visa
    Shift work

    Cala Health

    San Francisco, CA
    1 day ago
  •  ...information understandable and actionable. This is an early and ambitious product area with a substantial roadmap. We are looking for engineers who want to shape both the first user experiences and the durable systems required to earn and keep users’ trust. About the... 
    Full time

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...Netic is the AI revenue engine for essential services who are the backbone of the American economy. With $43M in funding from Founders...  ...the impact is immediate and tangible. Netic's Full-Stack Software Engineers working on the product team build the features that... 
    Summer work
    Internship
    Immediate start
    Sleeping nights

    Netic

    San Francisco, CA
    1 day ago
  • $196k - $220.5k

     ...features, partnerships and game-related launches at Discord. Our engineering culture values collaboration, and this is exactly how this...  ...Should Have You have 5+ years of experience as a fullstack software engineer. You have experience with React/TS, Python or... 
    Full time

    Discord

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer - RL Environments. Be the first to apply!