Senior ML Engineer - Agent Oversight & Observability
Scale AI, Inc.
Scale is seeking a Machine Learning Engineer on the Agent Oversight team to own the end-to-end lifecycle of production agents, ensuring reliability and continual improvement. You will build observability, evaluation frameworks, and improvement loops while collaborating with platform and engineering teams. In this role you will run rigorous experiments, design scalable metrics, and translate enterprise requirements into robust capabilities. #J-18808-Ljbffr Scale AI, Inc.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior ML Engineer - Agent Oversight & Observability in San Francisco, CA vacancy
- Scale AI is seeking a Senior Machine Learning Engineer focused on Agent Oversight in New York. You will drive the end‑to‑end... ...agents perform reliably, building observability, robust evaluation loops, and... ...capabilities. You will work across the ML loop, tackle drift detection,...Senior
$216k - $270k
Senior Machine Learning Engineer, Agent Oversight About Scale Scale’s mission is to develop reliable AI systems for... ...production, paired with applied ML research, design, and evaluation... ...over time. This includes building observability tools, designing robust evaluation...SeniorFull time- Scale AI, Inc. is seeking a Software Engineer for Agent Oversight to build the platform infrastructure that enables production agents to be observed, evaluated, and improved at scale. You’... ...platform components, collaborating with ML engineers on production workflows and...Senior
- Scale AI is seeking a Senior Software Engineer for Agent Oversight in San Francisco. You will build the platform infrastructure to observe, evaluate, and improve production agents with strong... ...and scalable APIs. Collaborate with ML engineers to turn prototypes into reliable...Senior
$218k - $273k
...capabilities. About The General Agents Team The General Agents... .... About The Role As a Senior/Staff Machine Learning Engineer (MLE) on the General... ...patterns) into maintainable, observable systems. Own deployment, monitoring... .... Experience deploying ML systems in cloud...SeniorFull time$216k - $270k
Senior Software Engineer, Agent Oversight About Scale Scale’s mission is to develop reliable AI systems for the world... ...in production, paired with applied ML research, design, and evaluation to... ...that lets our production agents be observed, evaluated, and improved at scale. This...SeniorFull time$96.8k - $306.4k
...Job Description The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands‑on technical leadership role responsible for defining... ...expectation is to ship, scale, and operate reliable, secure, observable, and cost‑aware AI platform systems while raising...SeniorTemporary workFlexible hoursOracle
San Francisco, CA5 days ago- A leading AI technology firm in New York seeks a Senior/Staff Machine Learning Engineer to design and deploy production-ready AI agents that address complex enterprise challenges. You'll work throughout the agent lifecycle, develop reliable systems, and collaborate with...Senior
$218k - $273k
...capabilities. About the General Agents Team The General Agents... .... About the Role As a Senior/Staff Machine Learning Engineer (MLE) on the General... ...patterns) into maintainable, observable systems. Own deployment,... ...production. Experience deploying ML systems in cloud...SeniorFull timeContract workFor contractorsFor subcontractorWork at office- Watershed is seeking experienced software engineers to build the AI platform that... .... You will lead the design of the agent infrastructure, focusing on observability and reliable systems development.... ...of experience in backend or AI/ML engineering, with a strong emphasis...SeniorWork at office
- ...operations using a patented real‑time coaching platform. We provide dynamic, live guidance to every agent based on the best practices of the top performers. As an ML software engineer you will join a team of experts in frontend, backend, and ML/NLP. The team builds, evaluates...SeniorLocal area
- Senior AI Architect - Multi-Agent Systems & Platform Infrastructure Senior... .../ Head of Engineering Seniority: Senior-Level... ...implement distributed observability and tracing frameworks... ...with backend and ML engineers to... ...preferred), not just oversight • Strong architectural...SeniorFull timeWork at officeRemote work
- Affinity is seeking a Senior Machine Learning Engineer to join the AI Platform team in San Francisco, New... ...Remote. You will design and deploy ML-powered private capital relationship... ...engineering to model deployment and observability, focusing on information retrieval and...SeniorRemote job
- Responsibilities Design, deploy, and maintain large distributed ML training and inference clusters Develop efficient, scalable... ...deployment architectures Understanding of monitoring, logging, observability, and version control best practices for ML systems You don’t have...Senior
- ...integration into real-world systems, with the observability, manageability, and security required... ...Role We are looking for a visionary Senior ML Engineer who will bridge the gap between high-... ...enterprise integration for AI agents. As a key hire during our current growth...SeniorShift work
- Open CEDA is seeking experienced software engineers to join Watershed in San Francisco to... ...collaborate with product teams to enhance agent experiences. The role demands 6+ years of... ...experience, particularly in backend or AI/ML sectors. Candidates must be willing to work...SeniorWork at officeRemote work
$227.2k - $324.5k
...in San Francisco is seeking a Senior SRE Manager to spearhead the Site Reliability Engineering team. This role will focus on... ...driving the technical strategy for observability and automation while fostering... ...management, and financial oversight. This position offers a salary...Senior$200k - $275k
...safer and more secure. The AI Engineering Team is chartered with... ...level latency, and provide the observability and governance needed to... ...-edge tools in the LLM and agent space — including open-source... ...than the market. As a Senior or Staff ML Systems Engineer - LLM , you...SeniorRemote workWorldwide$150k - $250k
Garuda Ventures is looking for a Senior Software Engineer (IC) to develop cloud and on-prem systems that will power future factories. In this role, you will design backend systems, build observability into production environments, and ensure reliable data movement. Candidates...Senior$200k - $280k
...leading voice AI startup is seeking a Founding Senior Machine Learning Engineer to fine-tune and deploy human-like voice agents, handling millions of real-time calls. This... ...should have real-world experience in deploying ML models and work well in a fast-paced environment...SeniorRetell AI
San Francisco, CA2 days ago- MakerMaker in San Francisco is looking for a Senior ML Engineer to build and maintain ML systems and data pipelines. This role demands a... ...least one ML framework like PyTorch or JAX. You will design observability metrics, collaborate closely with researchers, and contribute...Senior
- ..., our AI-native coordination engine. Autonomous freight coordination... ...edge-case intelligence. As a Senior ML Engineer, you'll own both the... ...LLM-based dispatch agent, including reinforcement learning... ...engineering, model monitoring, and observability. Collaborate closely with...SeniorImmediate start
Oway
San Francisco, CA5 days ago - ...Senior Machine Learning Engineer Location: SF or Waterloo, with ability to travel Start Date: Flexible, ideally Q3 2025 About Hum.ai Hum.ai is building... ...on a mission to create positive impact through earth observation and AI. Founded at the University of Waterloo by a team...SeniorWork experience placementRemote workFlexible hours
Coastal Carbon
San Francisco, CA5 days ago $138k - $208k
...Responsibilities Autonomously deliver ML and AI projects, including... ..., including Machine Learning Engineers, Data Scientists, Software... ...and implement evaluation, observability, and production monitoring approaches... ...domains Familiarity with agent orchestration frameworks, LLM...SeniorIndeed
San Francisco, CA4 days ago- An innovative company is seeking a Distributed Systems/ML Engineer to enhance the training throughput of its internal framework. This role involves collaborating with researchers to develop efficient video models and applying cutting-edge techniques to optimize training...Senior
$160k - $235k
...actionable insights to customers. As a Senior Machine Learning Engineer , you will collaborate with data... ...will play a key role in advancing our ML Engineering capabilities,... ...model selection, deployment, and model observability and evaluation. Translate business needs...SeniorWork at officeRemote workWorldwideFlexible hours2 days per week3 days per weekAffinity
San Francisco, CA5 days ago- ...Valley, a small team of engineers is working on what... ...cloud" - intelligent agents capable of autonomously... ...wear many hats (building ML platforms, MLOps tools... ...environment. As a Senior ML Engineer, you will... ...production infrastructure and observability, and lead performance...SeniorWork at officeFlexible hours2 days per week3 days per week
Sailplane
San Francisco, CA2 days ago - An AI-focused technology company in San Francisco is seeking a Senior Machine Learning Engineer to take ownership of the full ML lifecycle. You will design, build, and operate ML systems that directly impact the product, emphasizing reliability and cost-efficiency. Aimed...Senior
$164k - $312k
A leading technology company in San Francisco seeks a Senior ML Engineer to drive advanced prediction models for ad ranking systems. You will design and implement efficient systems that optimize engagement predictions. The ideal candidate holds an advanced degree and has...Senior- ...legacy that inspires future generations. Senior Machine Learning Engineer Primary: Bay Area (San Francisco /... ...constraints, so you get to stand up ML systems the right way from day one.... ...deployment. Establish monitoring, observability, and model-performance tracking. Partner...SeniorWork at officeRelocation packageFlexible hours3 days per week
Mrbeastyoutube
San Francisco, CA5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Engineer - Agent Oversight & Observability. Be the first to apply!
Related searches
- graduate machine learning engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- data scientist machine learning engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- senior ml engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- computer vision machine learning engineer San Francisco, CA
- operations agent San Francisco, CA