Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff ML Engineer, Agent Training & Environments

$250k - $280k

Labelbox

Shape the Future of AI

At Labelbox, we're building the critical infrastructure that powers breakthrough AI models at leading research labs and enterprises. Since 2018, we've been pioneering data-centric approaches that are fundamental to AI development, and our work becomes even more essential as AI capabilities expand exponentially.

About Labelbox

We're the only company offering three integrated solutions for frontier AI development:

  1. Enterprise Platform & Tools : Advanced annotation tools, workflow automation, and quality control systems that enable teams to produce high-quality training data at scale
  2. Frontier Data Labeling Service : Specialized data labeling through Alignerr, leveraging subject matter experts for next-generation AI models
  3. Expert Marketplace : Connecting AI teams with highly skilled annotators and domain experts for flexible scaling

Why Join Us

  • High-Impact Environment : We operate like an early-stage startup, focusing on impact over process. You'll take on expanded responsibilities quickly, with career growth directly tied to your contributions.
  • Technical Excellence : Work at the cutting edge of AI development, collaborating with industry leaders and shaping the future of artificial intelligence.
  • Innovation at Speed : We celebrate those who take ownership, move fast, and deliver impact. Our environment rewards high agency and rapid execution.
  • Continuous Growth : Every role requires continuous learning and evolution. You'll be surrounded by curious minds solving complex problems at the frontier of AI.
  • Clear Ownership : You'll know exactly what you're responsible for and have the autonomy to execute. We empower people to drive results through clear ownership and metrics.

Role Overview

Labelbox is the RL data factory for advancing frontier agent capabilities. We build the data, environments, and evaluations that frontier labs use to train and judge their agents.

This role sits where training meets infrastructure. You will run the experiments and build the systems that run them: environments agents act in, verifiers that decide whether they succeeded, and the fine-tuning pipelines that turn that signal into a better model. We're looking for someone who does both halves — the engineering throughput of a strong platform engineer, and real depth in post-training agents.

The bar is high: engineers with strong judgment who set technical direction, turn prototypes into reliable systems fast, and are at the frontier of agent-first engineering practice.

 

What you'll work on

  • RL environments for agentic tasks: task definitions, tool surfaces, state and reset semantics, reward design — and the harness that runs thousands of them in parallel.
  • Verifiers and graders: programmatic checks, LLM judges, rubric pipelines, View email address on job-boards.greenhouse.io scoring. Deciding what "the agent succeeded" means, and making that judgment trustworthy at scale.
  • Fine-tuning pipelines that turn evaluation signals into measurable agent improvements — SFT and RL, from data collection through training to checkpoint evaluation.
  • Eval systems that run millions of agent trajectories to measure model and product quality.
  • Training and serving infrastructure that scales to the throughput frontier labs need: multi-launcher orchestration, long-running job fault tolerance, cost accounting.

What we're looking for

As an engineer

  • A 3+ year track record of shipping systems that customers and other engineers still rely on.
  • Exceptional throughput, without the quality tax. You ship a lot, you review a lot, and the v1 you ship becomes the foundation the rest of the team builds on.
  • Strong system and API design judgment. Hard architecture calls land with you: you make them, defend them under pressure, and update fast when someone else is right.
  • You ship production code with coding agents daily. You know where they break and what it takes to make them reliable, and you use that to move the whole team faster.
  • You build the substrate other people's work runs on — tooling, CI, harnesses, libraries — and you treat that as the job, not a distraction from it.
  • You move fast in ambiguous, startup-pace environments, with influence over authority.
  • Deep proficiency in Python, and comfort across the rest of the stack.

As an RL post-training practitioner

  • You have fine-tuned models for agentic tasks and made them measurably better. SFT plus at least one RL method (GRPO, PPO, DPO, or similar) in production.
  • You have built environments agents operate in, and you know why reward and task design is where most of the difficulty actually lives.
  • You have designed verifiers or graders for open-ended work, and you know how they get gamed.
  • You debug training runs forensically and methodically.
  • You reason about compute-economics. You know what an experiment costs, when a run is not worth finishing, and how to get the same signal for a tenth of the spend.
  • You write up what you learned so it changes what the team does next.

 

Nice to have

  • Experience with agent harnesses and coding agents as subjects of training and evaluation.
  • Multi-tenancy and isolation for untrusted agent execution: sandboxing, egress control, credential handling.
  • Background in production distributed systems, ML infrastructure, or data systems at scale.
  • Experience working directly with frontier labs or other highly technical customers.

 

Our Technology Stack

Our engineering team works with a modern tech stack designed for scalability, performance, and developer efficiency:

  • Frontend: React.js with Redux, TypeScript
  • Backend: Node.js, TypeScript, Python, some Java & Kotlin
  • APIs: GraphQL
  • Cloud & Infrastructure: Google Cloud Platform (GCP), Kubernetes
  • Databases: MySQL, Spanner, PostgreSQL
  • Queueing / Streaming: Kafka, PubSub

Labelbox strives to ensure pay parity across the organization and discuss compensation transparently.  The expected annual base salary range for United States-based candidates   is below. This range is not inclusive of any potential equity packages or additional benefits. Exact compensation varies based on a variety of factors, including skills and competencies, experience, and geographical location.

Annual base salary range

$250,000—$280,000 USD

Life at Labelbox

  • Environment : Fast-paced and high-intensity, perfect for ambitious individuals who thrive on ownership and quick decision-making
  • Growth : Career advancement opportunities directly tied to your impact
  • Vision : Be part of building the foundation for humanity's most transformative technology

Our Vision

We believe data will remain crucial in achieving artificial general intelligence. As AI models become more sophisticated, the need for high-quality, specialized training data will only grow. Join us in developing new products and services that enable the next generation of AI breakthroughs.

Labelbox is backed by leading investors including SoftBank, Andreessen Horowitz, B Capital, Gradient Ventures, Databricks Ventures, and Kleiner Perkins. Our customers include Fortune 500 enterprises and leading AI labs.

Your Personal Data Privacy : Any personal information you provide Labelbox as a part of your application will be processed in accordance with Labelbox’s Job Applicant Privacy notice .

Any emails from Labelbox team members will originate from a @labelbox.com email address. If you encounter anything that raises suspicions during your interactions, we encourage you to exercise caution and suspend or discontinue communications.

Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Staff ML Engineer, Agent Training & Environments in San Francisco, CA vacancy
  • $340k

     ...Staff Machine Learning Engineer, Agent Skills Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle,...  ...Claude models and prompts across the training and product lifecycle Work with our...  ...fit if you: Have 7+ years of ML and software engineering experience... 
    Training
    Full time
    Work at office
    Remote work
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    8 days ago
  • $290.4k - $363k

     ...capabilities.About the General Agents TeamThe General...  ...the RoleAs a Senior/Staff Machine Learning Engineer (MLE) on the General...  ...of real customer environments.You will:Design and...  ...deploying ML systems in cloud environments...  ...education or training. Scale employees in... 
    Training
    Full time

    Scale AI

    San Francisco, CA
    1 day ago
  • $184k - $272k

     ...will... Build standardized distributed training frameworks for research and production,...  .... Work with researchers and ML engineers on best-practices for optimal resource...  .... Experience in Bazel in a monorepo environment, and integrating third party packages into... 
    Training
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    9 days ago
  • $184k - $272k

     ...will.. Build and evolve our training infrastructure on Kubernetes...  ...the operators and workflow engines that keep long-running training...  ...observability across the ML stack — utilization, throughput...  ...that hold up in an IP-sensitive environment while staying self-serve.... 
    Training
    Full time
    Live in
    Work at office
    Local area
    Remote work
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    20 days ago
  • $267k

     .... We work closely with engineering, product and data science...  ...AI, Computer Vision, ML Optimization, Geospatial...  ...We are hiring a Senior Staff ML Engineer to define...  ...personalization, search, agents, automation, and...  ...PyTorch and distributed training.Proven ability to set the... 
    Training
    Full time
    Work at office
    Remote work

    Uber

    San Francisco, CA
    6 hours ago
  •  ...Perplexity is seeking experienced ML engineers to design, build, and optimize the recommendation...  ...Experience with large-scale ranking and training infrastructure (multi-stage retrieval...  ...something and hope. They must have armies of agents and workers who can constantly work in... 
    Training
    Full time

    Perplexity

    San Francisco, CA
    4 days ago
  • $265k - $331k

     ...build production AI agents that automate complex...  ...one of the hardest engineering challenges.As a Staff Frontier Agent Engineer...  ....Unlike traditional ML roles that focus on...  ...in high-stakes environments.Collaborate with infrastructure...  ...education or training. Scale employees in... 
    Training
    Full time

    Scale AI

    San Francisco, CA
    14 hours ago
  • $227.33k - $312.58k

    We’re looking for a Staff ML Data Engineer to join Procore’s AI & Frontier Models organization. In...  ...decisions spanning research environments and production systems.Identify gaps...  ...pipelines that support machine learning training, evaluation, or inference workflows.Solid... 
    Training
    Full time
    Work at office
    Local area
    Immediate start
    3 days per week

    Procore Technologies

    San Francisco, CA
    3 days ago
  • $227k - $300k

     ...looking for a great Senior Staff Machine Learning Engineer to join our seasoned AI team...  ...You will own the end-to-end ML pipeline—from data ingestion and model training to deployment on resource-constrained...  ...work in a fast-paced startup environment where your code will directly... 
    Training
    Work at office
    Worldwide
    Flexible hours
    Shift work
    3 days per week

    Sonatus

    San Francisco, CA
    2 days ago
  •  ..., starting with data centers. About the Role At Watney, ML engineers turn a live fleet of robots into world class modals. The fleet...  ...problems at the company. Our Machine Learning team members run training experiments, help curate and label the data behind them, and... 
    Training

    Watney

    San Francisco, CA
    a month ago
  • $298k - $368k

     ...platform-agnostic Ground Truth (GT) engine that powers the next...  ...offline using state-of-the-art ML Foundation Models, we generate...  ...data engineering. As a Senior Staff Machine Learning Engineer, you...  ...specifically in the context of post-training, fine-tuning, or inference-... 
    Training
    Full time
    Remote work

    Waymo

    San Francisco, CA
    4 days ago
  •  ...teams: a security-focused product where an agent registers as a governed identity in a...  ...evals against replicas of real customer environments rather than synthetic tasks, reliable enough...  ...get better real-task data into eval and training Company stage: Pre-seed. Work type:... 
    Training
    Full time
    Contract work
    H1b
    Visa sponsorship

    Thomas Talent Network

    San Francisco, CA
    27 days ago
  • $270k - $305k

     ...where you come in. As an AI/ML Engineer, you’ll join a growing team...  ...ML lifecycle: data curation, training, deployment, monitoringA track...  ...’ll build here)You've built agents that can plan, reason, and...  ...: We have an in-office work environment in all our offices in SF, NYC... 
    Training
    Full time
    Work at office

    Sigma Computing

    San Francisco, CA
    1 day ago
  • $200k - $300k

     ...focused product where an agent registers as a...  ...replicas of real customer environments rather than synthetic...  ...task data into eval and training Requirements Must-Have ~4+ years of engineering experience ~ Experience...  ...Level: Senior / Staff Experience: 4+ years... 
    Training
    Full time
    Contract work
    H1b
    Work at office
    Visa sponsorship
    Monday to Friday

    David Joseph & Company

    San Francisco, CA
    22 days ago
  • $200k - $300k

     ...Description Job Description Senior/Staff Applied AI Engineer, Agent Harness Company: Confidential —...  ...against replicas of real customer environments, reliable enough to gate a release....  ...real-task data into evaluation and training What You Bring ~4+ years of... 
    Training
    Full time
    Contract work
    H1b
    Work at office
    Visa sponsorship
    Monday to Friday

    Transparent Search Group

    San Francisco, CA
    22 days ago
  •  ...The Role: As a Staff Machine Learning Engineer at Ambience , you will...  ..., evaluation, post-training, and agentic systems...  ...research in LLMs, agents, post-training, NLP,...  ...years in production ML, research engineering...  ...-paced, early-stage environment. Takes broad ownership... 
    Training
    Full time
    Work at office
    Immediate start
    Remote work
    Flexible hours
    3 days per week

    ambiencehealthcare

    San Francisco, CA
    10 hours ago
  • $189.31k - $389.75k

     ...looking for an experienced Staff Machine Learning Engineer / Technical Lead who can...  ...leader who combines strong ML judgment with product intuition...  ...pipelines, distributed training, inference, evaluation,...  ...recognize that the ideal environment for work is situational and... 
    Training
    Work at office
    Local area
    Relocation package

    Pinterest

    San Francisco, CA
    4 days ago
  • $267k

     ...customer experiences by building AI/ML-powered intelligence and sophisticated...  ...global users.What you’ll do As a Senior Staff Machine Learning Engineer, you will shape the technical vision...  ...data and feature pipelines, model training, inference, and monitoring, with a high... 
    Training
    Full time
    Temporary work
    Work at office
    Remote work

    Uber

    San Francisco, CA
    6 hours ago
  • $212k - $260k

     ...Customer Service to Marketing we rely on ML to ensure that guests and hosts have the...  ...possible experience with Airbnb. The Assistance Engineering Machine Learning team is the core team...  ...is dependent upon many factors, such as: training, transferable skills, work experience,... 
    Training
    Work experience placement
    Casual work
    Live in
    Work at office
    Remote work

    Airbnb

    San Francisco, CA
    2 days ago
  • $227.87k

     ...landing page to learn more. Staff Machine Learning Engineer, Applied Science As part...  ...Contribute to cutting-edge AI/ML research that can be...  ...experience with LLM/VLM post-training is a plusTechnical...  ...recognize that the ideal environment for work is situational and... 
    Training
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package
    Flexible hours

    Pinterest

    San Francisco, CA
    4 days ago
  • $232k

     ...for billions of rides. Engineers on the team work on...  ...cutting-edge marketplace ML problems and real-time...  ...-scale production environments at top-tier ML companies...  ...architecturesProficiency in the development, training, productionization and...  ...with strategic agent behaviorDeep... 
    Training
    Full time
    Work at office
    Remote work
    Worldwide

    Uber

    San Francisco, CA
    6 hours ago
  • $190k - $285k

     ...Databricks Assistant, AI/BI Genie, and Agent Bricks working with product...  ...we are seeking multiple GenAI Engineers from junior levels to more...  ...domains.Design and implement ML pipelines for data...  ...preprocessing, feature engineering, model training, hyperparameter tuning, and... 
    Training
    Work at office
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    1 day ago
  • $216.2k - $324.8k

     ...team is looking for a Staff Machine Learning Engineer to build the systems that bring ML capabilities into...  ...extend that work into training, fine-tuning, data processing...  ..., and deployment environments.Minimum...  ...experience applying Python to agent workflows and tool integration... 
    Training
    Work experience placement
    Relocation

    Apple

    San Francisco, CA
    2 days ago
  • $135.1k - $231.6k

     ..., and we’re looking for a Staff Machine Learning Engineer on the Data Science Team....  ...translate them into scalable ML architectures. You will...  ...an open and collaborative environment, where team members bring...  ...platforms for distributed model training, ensuring low-latency and... 
    Training
    Full time

    Integral Ad Science

    San Francisco, CA
    6 hours ago
  •  ...As a Senior Machine Learning Engineer for On-Device & Mobile AI, you...  ...the inference stack — from a trained checkpoint leaving research,...  ...the integration between the ML runtime and the game engine:...  ...fostering an inclusive, innovative environment and celebrate our employees... 
    Training
    Full time
    Work at office
    Remote work
    Worldwide

    Unity Technologies

    San Francisco, CA
    2 days ago
  • $170k - $225k

     ...Taskrabbit, and we're looking for a Staff Machine Learning Engineer to join our team and lead the next phase...  ...engaged and loyalEnd-to-End ML Lifecycle: Own the complete lifecycle...  ...models—from feature engineering and training through evaluation, deployment, monitoring... 
    Training
    Work at office
    Immediate start
    Flexible hours

    Taskrabbit

    San Francisco, CA
    3 days ago
  • $172.5k - $306.63k

    Join Adobe Security Engineering and help build the ML and generative AI capabilities that...  ...'s largest datasets.As a Staff Machine Learning Engineer,...  ...agentic AI. You'll write code, train models, run experiments,...  ...vector databases, RAG, or multi-agent systems.Publications,... 
    Training
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Francisco, CA
    3 days ago
  • $180k - $320k

     ...teams build the data and environments behind high-performing frontier...  ...a Forward Deployed Engineer focused on Computer Use Agents to partner with leading...  ...for multimodal and agentic training and evaluation data...  ...production software, data, or ML systems ~ Hands-on... 
    Training
    Local area

    Snorkel AI

    San Francisco, CA
    9 hours ago
  •  ...Consulting - Max Corporate Group in San Francisco, CA seeks a Research Engineer to build environments, evaluation systems, and infrastructure for training and assessing long-horizon enterprise AI agents. You will tackle engineering and research problems behind realistic... 
    Training

    MaxIT Consulting - Max Corporate Group

    San Francisco, CA
    1 day ago
  •  ...them operate as independent social media agents. Role You'll build the machine...  ...platform and next-generation data engine. You'll train human preference models, build large-scale...  ...related field. Experience building ML systems. You've trained preference models... 
    Training
    Full time
    Relocation
    Visa sponsorship

    intelligence

    San Francisco, CA
    10 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff ML Engineer, Agent Training & Environments. Be the first to apply!