Senior ML Engineer, Agent Oversight & Production Quality
Scale AI
Scale AI is seeking a Senior Machine Learning Engineer focused on Agent Oversight in New York. You will drive the end‑to‑end lifecycle to ensure production agents perform reliably, building observability, robust evaluation loops, and scalable improvements. Collaborate with engineers, PMs, and customers to translate requirements into platform capabilities. You will work across the ML loop, tackle drift detection, and design experiments to validate improvements before deployment, contributing to a #J-18808-Ljbffr Scale AI
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior ML Engineer, Agent Oversight & Production Quality in San Francisco, CA vacancy
- Scale is seeking a Machine Learning Engineer on the Agent Oversight team to own the end-to-end lifecycle of production agents, ensuring reliability and continual improvement. You will build observability, evaluation frameworks, and improvement loops while collaborating...Senior
$216k - $270k
Senior Machine Learning Engineer, Agent Oversight About Scale Scale’s mission is to develop reliable... ..., we provide the high‑quality data and full‑stack technologies... ...to bring AI into production that performs when it... ...production, paired with applied ML research, design, and...QualitySeniorFull time$218k - $273k
...and deploy reliable production AI applications. We... ...About The General Agents Team The General Agents... ...The Role As a Senior/Staff Machine Learning Engineer (MLE) on the General... ...writing production-quality, testable, and maintainable... ...deploying ML systems in cloud environments...QualitySeniorFull time$218k - $273k
...and deploy reliable production AI applications. We... ...About the General Agents Team The General Agents... ...About the Role As a Senior/Staff Machine Learning Engineer (MLE) on the General... ...writing production-quality, testable, and maintainable... ...deploying ML systems in cloud environments...QualitySeniorFull timeContract workFor contractorsFor subcontractorWork at office- A leading AI technology firm in New York seeks a Senior/Staff Machine Learning Engineer to design and deploy production-ready AI agents that address complex enterprise challenges. You'll work throughout the agent lifecycle, develop reliable systems, and collaborate with...Senior
$216k - $270k
Senior Software Engineer, Agent Oversight About Scale Scale’s mission is to develop reliable... ...foundry, we provide the high-quality data and full-stack... ...governments to bring AI into production that performs when it... ...production, paired with applied ML research, design, and...QualitySeniorFull time- ...and bleeding‑edge part of our engine. You'll be working on making AI... ...management You've written production PyTorch code that pushes performance... ...think the current state of ML deployment could be way better... ...thing that matters is the quality of your cultural fit and execution...QualitySenior
$96.8k - $306.4k
...Job Description The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands‑on technical leadership... ...and engineering direction for production‑grade agentic AI platforms,... ...Python and ability to contribute high‑quality production code, reviews, tests,...QualitySeniorTemporary workFlexible hoursOracle
San Francisco, CA4 days ago- Known in San Francisco is seeking an AI/ML Engineer to own the core matching and recommendation engines from zero to production scale. You will design and implement production... ...a small technical team while shipping high-quality features. #J-18808-Ljbffr Jack & JillQualitySenior
$200k - $275k
...more secure. The AI Engineering Team is chartered with... ...needed to make AI production-ready. We’re also deeply... ...tools in the LLM and agent space — including... ...than the market. As a Senior or Staff ML Systems Engineer - LLM... ...Looking For Write high-quality, maintainable...QualitySeniorRemote workWorldwide$175k - $230k
A leading AI solutions provider seeks a Field Engineer, Agent Builder to execute AI agent builds for strategic customers in San Francisco.... ...technical role involves implementing and scaling enterprise-quality agents by collaborating with internal teams and customers. The...QualitySenior$200k - $400k
...Douglas to deploy AI agents that power personalized... ...powers Decagon’s agents in production. This is the... ...experimental, frontier‑style engineering. The team continuously... ...quickly to improve quality, reliability, and capability... ...About the Role As a Senior Software Engineer on...QualitySeniorFull timeWork at officeLocal area$159.18k - $295.62k
...Senior Machine Learning Engineer – Data & Audience Platform (DAP) Senior, high‑ownership US‑based role... ...Engineer owns design and delivery of production ML systems end‑to‑end, drives... ...feature‑store strategy, implement data‑quality checks, model‑health dashboards, and...QualitySeniorTemporary workWarner Bros. Discovery
San Francisco, CA1 day ago$155.12k - $288.08k
Senior Machine Learning Engineer - Video AI (Vision & Creative Systems) Job Description What We Do... ...media content. We focus on taking ML from research to production, integrating models into real‑... ...goal is to build scalable, high-quality solutions that power both content...QualitySeniorTemporary workLocal area$152k - $228k
...Job Description Job Description Senior ML Engineer About Invoca Invoca is an AI-powered... ...tuning through inference optimization and production APIs. We move quickly, swarm on hard problems, and care deeply about code quality, reliability, and each other's growth....QualitySeniorCurrently hiringRemote workFlexible hours- ...food manufacturing. Food production faces one of the most severe... ...partnerships. Our team includes engineers and leaders from Google,... ...Food Foundation Model. As a Senior ML Engineer, Foundation Models,... ...reliable, production-quality training and evaluation infrastructure...QualitySeniorFlexible hours
- ...food manufacturing. Food production faces one of the most severe... ...partnerships. Our team includes engineers and leaders from Google,... ...preparation configurations. As a Senior ML Engineer, Manipulation, you... ...reliable, production-quality training and evaluation pipelines...QualitySeniorFlexible hours
$180k - $336k
Senior / Staff Machine Learning Engineer, Applied AI Cambridge, MA USA; San Francisco, CA USA We are growing... ...in LLM training, evaluation, and production-oriented ML systems. You’ll work on improving... ...workflows, improve model quality through experimentation, and ensure...QualitySeniorFull timeWork at officeLocal areaFlexible hours- ...is a well-funded AI startup building production-grade ML infrastructure used by enterprise customers. They are looking for a Senior AI/ML Engineer to own model training pipelines, evaluation... ...on ML best practices and code quality What we are looking for ~4+ years...QualitySeniorFull time
- Vectara in San Francisco is seeking an AI Systems Engineer to design and build AI systems, train ML models, and improve their AI Agents platform. The role requires a BS/MS in a relevant field and 8+ years of experience in machine learning, with strong skills in Python and...Senior
- Waymo is seeking a hands-on ML engineer on the Perception team to advance post-training techniques and scalable... ...and rollout major model evolutions, balancing quality, speed, and impact. This hybrid role reports to the Senior Director of Engineering, Perception, and offers...QualitySenior
- The Walt Disney Company is seeking a Senior Software Engineer for the Client Optimization team in Seattle. In this critical role, you will develop machine learning models to enhance video playback quality, collaborate with cross-functional teams, and participate in the...QualitySenior
- ...focused technology company in San Francisco is seeking a Senior Machine Learning Engineer to take ownership of the full ML lifecycle. You will design, build, and operate ML systems that directly impact the product, emphasizing reliability and cost-efficiency. Aimed at...Senior
$138k - $289k
Indeed is seeking an experienced Machine Learning Engineer located in San Francisco, California. The role involves delivering impactful ML and AI projects, developing and implementing machine learning solutions, and mentoring team members. This position offers a competitive...Senior$155.58k - $320.32k
Pinterest is seeking a talented engineer skilled in Python to write production code that powers real-time bidding and model training. Ideal candidates will have... ..., including the training and deployment of ML models that drive ad decisions. Located in San Francisco...Senior$181.4k - $235.8k
Gap Inc. is looking for a Senior Machine Learning Engineer in San Francisco, CA. The role requires over 10 years of experience in ML and software engineering, focusing on designing and scaling production-grade ML systems. Responsibilities include building ML pipelines,...Senior$180k - $336k
Lila Sciences in San Francisco, CA is looking for a Senior/Staff Machine Learning Engineer to enhance AI models tailored to specific customer scientific needs. This position will work closely with AI Researchers and Software teams to develop reliable workflows, ensuring...Senior- DoorDash is seeking a Senior Software Engineer, Machine Learning to enhance their data-driven solutions within the ad efficiency domain. This hybrid... ..., designing optimization algorithms, and extending the ML infrastructure. Candidates should have 5+ years of experience...Senior
- MrBeast is seeking a Senior Machine Learning Engineer to design, build, and operate ML systems for an engaging audience of 100M+ people. This role involves developing... ...or ML engineering, a deep understanding of production ML, and proven successes in deploying ML systems...SeniorFlexible hours
- Gravity Engineering Services Pvt Ltd. is seeking a Senior Machine Learning Engineer to leverage techniques in generative AI, computer vision, and reinforcement learning. You will enhance products and customer experiences by deploying advanced models in government systems...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Engineer, Agent Oversight & Production Quality. Be the first to apply!
Related searches
- graduate machine learning engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- data scientist machine learning engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- senior ml engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- computer vision machine learning engineer San Francisco, CA
- operations agent San Francisco, CA