Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff ML Engineer, Agent Training & Environments

WeHireYou

Staff ML Engineer, Agent Training & Environments

Shape the Future of AI

At Labelbox, we're building the critical infrastructure that powers breakthrough AI models at leading research labs and enterprises. Since 2018, we've been pioneering data-centric approaches that are fundamental to AI development, and our work becomes even more essential as AI capabilities expand exponentially.

About Labelbox

We're the only company offering three integrated solutions for frontier AI development:

  • Enterprise Platform & Tools: Advanced annotation tools, workflow automation, and quality control systems that enable teams to produce high-quality training data at scale
  • Frontier Data Labeling Service: Specialized data labeling through Alignerr, leveraging subject matter experts for next-generation AI models
  • Expert Marketplace: Connecting AI teams with highly skilled annotators and domain experts for flexible scaling

Why Join Us

  • High-Impact Environment: We operate like an early-stage startup, focusing on impact over process. You'll take on expanded responsibilities quickly, with career growth directly tied to your contributions.
  • Technical Excellence: Work at the cutting edge of AI development, collaborating with industry leaders and shaping the future of artificial intelligence.
  • Innovation at Speed: We celebrate those who take ownership, move fast, and deliver impact. Our environment rewards high agency and rapid execution.
  • Continuous Growth: Every role requires continuous learning and evolution. You'll be surrounded by curious minds solving complex problems at the frontier of AI.
  • Clear Ownership: You'll know exactly what you're responsible for and have the autonomy to execute. We empower people to drive results through clear ownership and metrics.

Role Overview

Labelbox is the RL data factory for advancing frontier agent capabilities. We build the data, environments, and evaluations that frontier labs use to train and judge their agents.

This role sits where training meets infrastructure. You will run the experiments and build the systems that run them: environments agents act in, verifiers that decide whether they succeeded, and the fine‑tuning pipelines that turn that signal into a better model. We're looking for someone who does both halves — the engineering throughput of a strong platform engineer, and real depth in post‑training agents.

The bar is high: engineers with strong judgment who set technical direction, turn prototypes into reliable systems fast, and are at the frontier of agent‑first engineering practice.

What you'll work on

  • RL environments for agentic tasks: task definitions, tool surfaces, state and reset semantics, reward design — and the harness that runs thousands of them in parallel.
  • Verifiers and graders: programmatic checks, LLM judges, rubric pipelines, View email address on click.appcast.io scoring. Deciding what "the agent succeeded" means, and making that judgment trustworthy at scale.
  • Fine‑tuning pipelines that turn evaluation signals into measurable agent improvements — SFT and RL, from data collection through training to checkpoint evaluation.
  • Eval systems that run millions of agent trajectories to measure model and product quality.
  • Training and serving infrastructure that scales to the throughput frontier labs need: multi‑launcher orchestration, long‑running job fault tolerance, cost accounting.

What we're looking for

As an engineer

  • A 3+ year track record of shipping systems that customers and other engineers still rely on.
  • Exceptional throughput, without the quality tax. You ship a lot, you review a lot, and the v1 you ship becomes the foundation the rest of the team builds on.
  • Strong system and API design judgment. Hard architecture calls land with you: you make them, defend them under pressure, and update fast when someone else is right.
  • You ship production code with coding agents daily. You know where they break and what it takes to make them reliable, and you use that to move the whole team faster.
#J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff ML Engineer, Agent Training & Environments in San Francisco, CA vacancy
  • $290.4k - $363k

     ...capabilities.About the General Agents TeamThe General...  ...the RoleAs a Senior/Staff Machine Learning Engineer (MLE) on the General...  ...of real customer environments.You will:Design and...  ...deploying ML systems in cloud environments...  ...education or training. Scale employees in... 
    Training
    Full time

    Scale AI

    San Francisco, CA
    5 days ago
  • $265k - $331k

     ...build production AI agents that automate complex...  ...one of the hardest engineering challenges.As a Staff Frontier Agent Engineer...  ....Unlike traditional ML roles that focus on...  ...in high-stakes environments.Collaborate with infrastructure...  ...education or training. Scale employees in... 
    Training
    Full time

    Scale AI

    San Francisco, CA
    4 days ago
  • $227.33k - $312.58k

    We’re looking for a Staff ML Data Engineer to join Procore’s AI & Frontier Models organization. In...  ...decisions spanning research environments and production systems.Identify gaps...  ...pipelines that support machine learning training, evaluation, or inference workflows.Solid... 
    Training
    Full time
    Work at office
    Local area
    Immediate start
    3 days per week

    Procore Technologies

    San Francisco, CA
    2 days ago
  •  ...accelerate how the world engineers new hardware....  ...applications, and agents that accelerate...  ...data science and ML, distributed systems...  ...The Role: As a Staff Research Engineer...  ...agent evals & post-training, you'll define how...  ...including air-gapped environments. Set Nominal's... 
    Training
    Permanent employment

    Nominal

    San Francisco, CA
    2 days ago
  • $240k - $270k

     ...where you come in. As an AI/ML Engineer, you’ll join a growing team...  ...ML lifecycle: data curation, training, deployment, monitoringA track...  ...’ll build here)You've built agents that can plan, reason, and...  ...: We have an in-office work environment in all our offices in SF, NYC... 
    Training
    Full time
    Work at office

    Sigma Computing

    San Francisco, CA
    5 days ago
  • $270k - $305k

    This staff engineer will build the AI foundation for Sigma’s data analytics...  ...deployment, and AI/ML infrastructure.* Full-time* On...  ...and trainingData curationModel training and deploymentModel monitoringAWS...  ...ll build here)• You've built agents that can plan, reason, and use... 
    Training
    Full time
    Remote work
    Flexible hours

    We Love AI Jobs

    San Francisco, CA
    1 day ago
  • $246k - $340k

     ...their financial lives. We're hiring a Staff AI/ML Engineer on our Lending and Cashflow team to...  ...you can expect to Lead the design, training, and deployment of deep learning and...  ...to operate independently in ambiguous environments, influence technical direction beyond... 
    Training
    Full time
    Work at office
    Local area
    Remote work

    Royper Royco LLC

    San Francisco, CA
    4 days ago
  • $270k - $305k

     ...where you come in. As an AI/ML Engineer, you’ll join a growing team...  ...ML lifecycle: data curation, training, deployment, monitoring ~...  ...build here) You've built agents that can plan, reason, and use...  ...moving startup or high-growth environment Additional Job details... 
    Training
    Full time
    Work at office
    Flexible hours

    Sigma Computing

    San Francisco, CA
    2 days ago
  •  ...AIML - Staff ML Infrastructure Engineer, ML Platform & Technology - Pre-training Infrastructure San Francisco Bay Area, California, United States Machine Learning and AI Apple is where individual imaginations gather together, committing to the values that lead to... 
    Training

    Apple Inc.

    San Francisco, CA
    1 day ago
  •  ...BURNT Member of Technical Staff AI/ML Engineer (MLOps-Focused) Location On-site, San Francisco...  ...into forecasts, into an ontology our agents can reason over, and into models tuned...  ...time. You'll own the datasets, the training runs, and the evals that decide whether... 
    Training
    Seasonal work
    Live in

    Burnt Group

    San Francisco, CA
    1 day ago
  • $189.31k - $389.75k

     ...looking for an experienced Staff Machine Learning Engineer / Technical Lead who can...  ...leader who combines strong ML judgment with product intuition...  ...pipelines, distributed training, inference, evaluation,...  ...recognize that the ideal environment for work is situational and... 
    Training
    Work at office
    Local area
    Relocation package

    Pinterest

    San Francisco, CA
    2 days ago
  • $212k - $260k

     ...Customer Service to Marketing we rely on ML to ensure that guests and hosts have the...  ...possible experience with Airbnb. The Assistance Engineering Machine Learning team is the core team...  ...is dependent upon many factors, such as: training, transferable skills, work experience,... 
    Training
    Work experience placement
    Casual work
    Live in
    Work at office
    Remote work

    Airbnb

    San Francisco, CA
    1 day ago
  • $227.87k

     ...landing page to learn more. Staff Machine Learning Engineer, Applied Science As part...  ...Contribute to cutting-edge AI/ML research that can be...  ...experience with LLM/VLM post-training is a plusTechnical...  ...recognize that the ideal environment for work is situational and... 
    Training
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package
    Flexible hours

    Pinterest

    San Francisco, CA
    2 days ago
  • $170k - $225k

     ...Taskrabbit, and we're looking for a Staff Machine Learning Engineer to join our team and lead the next phase...  ...engaged and loyalEnd-to-End ML Lifecycle: Own the complete lifecycle...  ...models—from feature engineering and training through evaluation, deployment, monitoring... 
    Training
    Work at office
    Immediate start
    Flexible hours

    Taskrabbit

    San Francisco, CA
    2 days ago
  • $190k - $285k

     ...Databricks Assistant, AI/BI Genie, and Agent Bricks working with product...  ...we are seeking multiple GenAI Engineers from junior levels to more...  ...domains.Design and implement ML pipelines for data...  ...preprocessing, feature engineering, model training, hyperparameter tuning, and... 
    Training
    Work at office
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    5 days ago
  • $172.5k - $306.63k

    Join Adobe Security Engineering and help build the ML and generative AI capabilities that...  ...'s largest datasets.As a Staff Machine Learning Engineer,...  ...agentic AI. You'll write code, train models, run experiments,...  ...vector databases, RAG, or multi-agent systems.Publications,... 
    Training
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Francisco, CA
    2 days ago
  • $185.1k - $335.3k

     ...HD maps toward automated, ML-driven map reconstruction...  ...RoleWe are looking for a Staff Machine Learning Engineer to serve as a technical leader...  ...strategies, model training, evaluation, and production...  ...vision systems in production environments.Strong foundation in computer... 
    Training
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    San Francisco, CA
    2 days ago
  •  ...As a Senior Machine Learning Engineer for On-Device & Mobile AI, you...  ...the inference stack — from a trained checkpoint leaving research,...  ...the integration between the ML runtime and the game engine:...  ...fostering an inclusive, innovative environment and celebrate our employees... 
    Training
    Full time
    Work at office
    Remote work
    Worldwide

    Unity Technologies

    San Francisco, CA
    6 days ago
  •  .... Surfaces Moments is a ML team within the Personalization...  ...around the world. As a Staff Machine Learning Engineer, you will help shape the...  ...powered user experiences. Train, fine-tune, evaluate, and...  ...learning systems in production environments. You have deep expertise... 
    Training
    Immediate start

    Logoslabs

    San Francisco, CA
    1 day ago
  • $307k - $352k

     ...Role We are seeking a Staff Machine Learning Engineer to set the technical direction...  ...learning at Kikoff. ML sits at the center of our...  ...runs on: feature stores, training and evaluation pipelines,...  ...in a regulated financial environment, including fair lending considerations... 
    Training
    Local area
    Immediate start

    Kikoff

    San Francisco, CA
    1 day ago
  • $275k - $321k

     ...deploy them into real environments, operate them, learn from...  ...We are roboticists, engineers, operators, and...  ...the role As a Senior Staff Machine Learning Engineer...  ...spanning data, model design, training, evaluation, inference...  ..., autonomy, and ML infrastructure. Provide... 
    Training
    Full time
    Work at office
    Immediate start
    Flexible hours

    Atoms

    San Francisco, CA
    1 day ago
  • $273k - $321k

     ...deploy them into real environments, operate them, learn from...  ...We are roboticists, engineers, operators, and builders...  ...the role As a Senior Staff Machine Learning Engineer...  ...future states. Train and evaluate models using...  ...autonomy, simulation, and ML infrastructure.... 
    Training
    Full time
    For contractors
    Work at office
    Flexible hours

    Atoms

    San Francisco, CA
    1 day ago
  •  ...At Plenful, we build agents and models that do that...  ...matters. As a Staff Machine Learning Engineer, you set the technical...  ...direction for how we build, train and measure AI across...  ...Co‑own the 12‑month ML roadmap with...  ...Flexible Hybrid Work Environment — We're remote‑first... 
    Training
    Full time
    Work at office
    Remote work
    Flexible hours
    2 days per week

    Plenful

    San Francisco, CA
    12 hours ago
  •  ...helps scientists and engineers build structured data...  ...power everything our AI/ML team delivers—the APIs...  ...whether that's powering agent-based workflows,...  ...data access patterns for training and inference workloads...  ...computing or research environments Background in or curiosity... 
    Training
    Remote work
    Work from home

    Albert Invent Corp

    Oakland, CA
    3 days ago
  • $273k - $321k

     ...deploy them into real environments, operate them, learn from...  ...We are roboticists, engineers, operators, and...  ...the role As a Senior Staff Machine Learning Engineer...  ...autonomous systems. Develop training strategies that take...  ..., simulation, and ML infrastructure.... 
    Training
    Full time
    Work at office
    Flexible hours

    Atoms

    San Francisco, CA
    1 day ago
  •  ...a growing volume of automated agents: AI assistants, crawlers, and...  ...this traffic, combining in-house ML and vendor signals to decide...  ...security analysts, data platform engineers, and international...  ...dependent upon many factors, such as: training, transferable skills, work experience... 
    Training
    Work experience placement

    airbnb, Inc.

    San Francisco, CA
    1 day ago
  • $205k - $240k

     ...We're looking for a Senior Staff Machine Learning Engineer to lead the AI behind Altana...  ...build the models and AI agents that turn it into real-time...  ...traces to fine-tune and post-train models (SFT, DPO, RL with domain...  ...how we hire and level ML talent. Shape the product... 
    Training
    Full time
    Temporary work
    Work experience placement
    Remote work
    Flexible hours

    Altana

    San Francisco, CA
    1 day ago
  •  ...As a Senior Machine Learning Engineer for On-Device & Mobile AI, you...  ...the inference stack — from a trained checkpoint leaving research,...  ...the integration between the ML runtime and the game engine:...  ...fostering an inclusive, innovative environment and celebrate our employees... 
    Training
    Work at office
    Remote work
    Worldwide
    Relocation package

    Unity Enterprise

    San Francisco, CA
    1 day ago
  •  ...Staff Machine Learning Engineer Primer exists to make the world a safer place. We...  ...by what frontier models and agents make newly possible. You reach...  ...of shipping and operating ML-driven functionality. ~...  ...or LLM fine-tuning and post-training. A pull toward high-stakes... 
    Training
    Contract work
    Remote work
    Flexible hours

    Primer

    San Francisco, CA
    4 days ago
  •  ...The Role Reporting to the Head of Software Engineering, you will own the design, training, adaptation, and deployment of the AI/ML systems that give our robots their...  ...capabilities uniquely suited to construction environments. What You’ll Do LLM Adaptation & Proprietary... 
    Training
    Flexible hours

    Hardhat Robotics

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff ML Engineer, Agent Training & Environments. Be the first to apply!