Software Engineer - RL Environments
$260k - $290kFull-time
Transparent Search Group
Software Engineer - RL Environments
Company: AfterQuery
Location: San Francisco, CA (in person)
Compensation: $260,000 - $290,000 base + profit share (around 150% of base, per the company) + competitive equity
Employment Type: Full-time
Visa Sponsorship: H-1B, O-1, OPT
About AfterQuery
AfterQuery is an applied research lab that curates the datasets, RL environments and evaluation infrastructure frontier AI labs use to build better models, working with leading AI labs and companies including Nvidia, Thinking Machines Lab and Legora.
Founded in 2025, AfterQuery reached a $100M+ revenue run rate within about a year and recently raised at a $3.2B valuation, making it the fastest unicorn in Y Combinator history.
The Role
As a Software Engineer on Environments, you will design the datasets and evaluation rubrics that directly shape how frontier models learn. You will work hands-on with research teams at top AI labs, experiment with data-collection strategies, diagnose model failure modes and build metrics that show whether a model is actually improving, moving from hypothesis to live experiment quickly, with output feeding directly into training runs at scale.
What You Will Do
- Design data slices that expose meaningful model failure modes across domains such as finance, code and enterprise workflows.
- Build and refine evaluation rubrics and reward signals for RLHF and RLVR pipelines.
- Model annotator behavior and run experiments to improve model capabilities.
- Develop quantitative frameworks for dataset quality, diversity and downstream impact on alignment and capability.
- Create and manage real-world and synthetic data pipelines.
- Translate lab research teams' training objectives into concrete data and evaluation specifications.
What You Bring
- 1-4 years of engineering experience
- Strong software engineering fundamentals and comfort running fast, hypothesis-driven experiments
- Interest in RL, evaluation and data for frontier model training
- Ability to work in person in San Francisco
Benefits
Profit share (around 150% of base per the company), competitive equity, and direct work with the world's leading AI labs.
REVENUE: 16.5% of first-year salary. Est. fee per hire $43K-$48K; 3 seat(s) = up to $136K if all filled.
TARGET COMPANIES (suggested): Scale AI, Surge AI, Mercor, Snorkel AI, Jane Street, Citadel, Hudson River Trading. DO NOT SOURCE: OpenAI (client do-not-source rule).
BEST-FIT CANDIDATE: 1-4 yrs; strong SWE fundamentals; RL/evals/data interest; visa: H-1B, O-1, OPT; location: SF in person. Company prefers top-university, top-quant or founding-engineer signal; do-not-contact OpenAI employees (sister-role rule).
Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Software Engineer - RL Environments in San Francisco, CA vacancy
- RippleMatch Inc. is seeking an innovative and motivated individual to design and refine reinforcement learning tasks in San Francisco. This role requires a strong command of Python and the ability to work independently with coding agents. Responsibilities include the full...Suggested
$245k - $300k
...platform that turns that judgment into the data , evals , and RL environments frontier models learn from. We work with leading frontier... ...keep it healthy once it's running. You sit between Pareto's engineering team and the researchers at the labs we work with, close...SuggestedFull time$260k - $290k
...Job Description Job Description Software Engineer - RL Environments Company: AfterQuery Location: San Francisco, CA (in person) Compensation: $260,000 - $290,000 base + profit share (around 150% of base, per the company) + competitive equity Employment...SuggestedFull timeH1bVisa sponsorshipTransparent Search Group
San Francisco, CA6 days ago$200k
...and improve. The Role As a SWE (Environments), you will design the datasets and evaluation... ...if they've worked for/interned for any RL environment companies in the past or any... ...results ~ Former founders and early engineers at early stage startups are a plus. We...SuggestedFull time- ...research lab that builds high-quality reinforcement-learning environments and agents sold to the world's leading AI labs. In under... ...expanding into new domains. The Opportunity As an RL Environment Software Engineer, you will sit at the intersection of research...SuggestedRemote work
talentpluto
San Francisco, CAa month ago - ...Description We are looking for a hybrid Systems Engineer and AI Researcher to lead the... ...pipelines. You will design sandboxed execution environments, high-throughput reinforcement learning... ...safely. Scale Post-Training & RL Pipelines: Implement high-throughput post...Work at office
Hyphen Connect
San Francisco, CA19 days ago - ...| Primarily On-site We are seeking an Research Engineer – RL Infrastructure & Agent Environments to build the environments, evaluation systems, and... ...high-fidelity representations of complex enterprise software environments. Develop infrastructure for rollouts...
MaxIT Consulting - Max Corporate Group
San Francisco, CA13 days ago - ...integrations that should go into the final RL run and deciding what can make it in, (2... ..., and unblocked. You will work across engineering and infrastructure problems as they... ...system. - Are energized by fast-moving environments where reliability, speed, and judgment matter...Full time
- ...Mechanize builds reinforcement learning environments that frontier AI labs use to train and... ...the complex, judgment-heavy parts of software engineering. We build the environments that expose... ...You'll design, build, and refine RL tasks. Each task is a self-contained software...
- ...early team has built coding agents and RL infrastructure at companies like Cursor... ...Thinking Machines. About the role As a software engineer, you'll build the core infrastructure... ...-node software systems as training environments, with a means of snapshotting and restoring...
ApplyMint
San Francisco, CA9 hours ago $400k
...Mechanize builds reinforcement learning environments that frontier AI labs use to train and... ...the complex, judgment-heavy parts of software engineering. We build the environments that expose... ...You'll design, build, and refine RL tasks, owning the full lifecycle from...Mechanize, Inc.
San Francisco, CA3 days ago$100k - $200k
Full-Stack Software Engineer, Reinforcement Learning Compensation: $100K-$200K Location: San Francisco... ...power HUD’s reinforcement learning (RL) data engine. As a Full-Stack Software... ...You’ll Do Build tools for browsing environments, inspecting trajectories, reviewing...Full timeRelocationVisa sponsorship- ...growing group of committed researchers, engineers, policy experts, and business leaders working... ...the role Reinforcement learning (RL) is how Claude learns to reason, write... ...Work across the stack (orchestration, environments, training, inference, evaluation) wherever...Full timeWork at officeVisa sponsorshipFlexible hours
$300k
...with a top AI training lab in San Francisco to hire a junior software engineer — and they pay like it's a senior role: $300K base + equity... .... About the company One-liner: Building high-fidelity RL environments used to train frontier AI models on real software‑engineering...$350k
...Mechanize builds reinforcement learning environments that frontier AI labs use to train and... ...the complex, judgment-heavy parts of software engineering. We build the environments that expose... ...'ll design, build, and quality-assure RL tasks. Each task is a self-contained...- Founding Software Engineer As a Founding Software Engineer, you'll have end-to-end ownership over projects pushing the frontier of AI evaluation... ...isn't a narrow role. One week you might prototype a new RL environment from a research paper, the next you'll deploy distributed...Work at officeVisa sponsorship
$144k - $198k
...join the adventure? Loft’s Onboard Software group provides the on-orbit software that... ...orbit. The Deployment & Runtime Environments team is where software meets the satellite... ...for someone scrappy — the kind of engineer who digs into an unfamiliar system, maps...Full timeTemporary workWork at officeRelocation packageFlexible hours- .... Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build... ...reason, write code, and act autonomously over long horizons. The RL Scaling team works on how RL scales: what happens to throughput,...Full timeWork at officeVisa sponsorshipFlexible hours
- Platform Engineer HUD is building infrastructure to create RL training data and evals for frontier AI agents, as well... ...reliable CI/CD, release automation, environment management, and deployment... ...maintainable code and apply strong software engineering judgment across...Full timeWork at officeRemote workRelocationVisa sponsorship
$107k - $178k
...technical teams. The role requires strong project management skills, a solid understanding of mining and regulatory environments, and experience coordinating engineering, environmental, geotechnical, water, and permitting disciplines. This position offers the opportunity to...For subcontractorWork at officeFlexible hours3 days per weekGHD
San Francisco, CA1 day ago- ...group of committed researchers, engineers, policy experts, and business... .... At frontier scale, an RL run is an unusually demanding... ...system. Training, sampling, and environment execution run concurrently... ...qualifications Strong software engineering skills in Python...Full timeWork at officeVisa sponsorshipFlexible hoursShift work
$405k
...growing group of committed researchers, engineers, policy experts, and business leaders working... .... About the role Anthropic's Environments organization builds and maintains the... ...Scope also includes keeping production RL runs healthy, maintainable, monitored, and...Full timeWork at officeRemote workVisa sponsorshipFlexible hours- ...re turning that into something measurable, starting with design. We do it on two sides: building the post-training data and RL environments that teach taste to frontier models, and the context and verification tools agents need to produce work that's more creative, more...Full time
- ...We're looking for a product minded Full Stack Software Engineer who thrives at the intersection of product, engineering, and experimentation. We're a small talented team still in the early days of building, and your contributions will go beyond just code. You'll have the...
Satori Digital
San Francisco, CA3 days ago $150k - $180k
...The Role As a Full Stack Engineer, you'll work across our entire stack with our CTO Nikki and the rest of the engineering team — from the React frontend to the Node/TypeScript backend — to build the product surface where institutions interact with their data and AI...Work at officeStraia
San Francisco, CA8 hours ago- ...we? We’re people who: genuinely enjoy solving complex engineering problems learn quickly and do what it takes to deliver... ...engineer, you will build both consumer-facing and enterprise-grade software with a clear opportunity for growth. Problems that you could...Work at officeFlexible hours
Alex
San Francisco, CA3 days ago $200k - $250k
...Premier Global Links LLC is seeking a Senior Full Stack Software Engineer to build sophisticated web applications across frontend, backend... ...as products scale in users and complexity. Technology Environment TypeScript | React | Python | APIs | WebSockets | SSE | CRDTs...Work at officeVisa sponsorshipSocket
San Francisco, CA1 day ago- ...infrastructure. We work closely with model researchers, mobile engineers, frontend engineers, and platform teams to build intuitive... ...feedback to drive decision-making. Thrive in fast-moving environments where priorities evolve quickly and new opportunities emerge...Worldwide
openai
San Francisco, CA9 hours ago - ...and privacy requirements. LiveRamp is looking for a Senior Software Engineer to help shape the next generation of Data Marketplace capabilities... ...to launch. ~ Ability to work effectively in ambiguous environments and translate business problems into durable technical...Work from homeWorldwideFlexible hoursNight shift
C0035 LiveRamp, Inc.
San Francisco, CA3 days ago - ...at our waterfront office in San Francisco. We care about creativity: our team includes musicians, designers, visual artists, and engineers. What you'll do You'll work across the whole backend: the SvelteKit app and its Postgres, Redis, and ClickHouse data layer,...Full timeH1bWork at officeVisa sponsorshipFlexible hours
Krea
San Francisco, CA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer - RL Environments. Be the first to apply!
Related searches
- software engineer internship remote San Francisco, CA
- senior software engineer ruby on rails San Francisco, CA
- software developer positions San Francisco, CA
- intermediate software engineer San Francisco, CA
- agile software developer San Francisco, CA
- software engineer intern San Francisco, CA
- part time software developer San Francisco, CA
- rust software engineer San Francisco, CA
- software engineer no experience San Francisco, CA
- software engineer internship San Francisco, CA