Senior ML Systems Engineer - AI Evaluation Foundations
$144.7k - $261.3kGeneral Motors
About the Team The Evaluation Foundations team, part of Embodied AI's Scaling Foundations, solves critical evaluation challenges for autonomous vehicle development. We engineer high-performance tools that identify top-performing models and partner with data-intensive ML teams to drive rapid innovation. Why Join Us Develop introspection and evaluation tools capable of processing billions of examples to extract maximum value from our large-scale datasets. Join a high-impact team of engineers and machine learning scientists leveraging advanced AI to drive L2, L3, and L4 autonomous vehicle innovation. Directly influence the safety, reliability, and scalability of next-generation autonomous systems. About the Role As a Senior Engineer in the Embodied AI Scaling Foundations organization, you will be a key technical contributor on the team that measures and visualizes AV model performance. You will work across the stack to design, implement, and iterate on evaluation and introspection tools used by Embodied AI and adjacent GM AV teams. In this role you will Build and improve high-quality evaluation signal and introspection tools that help shorten the experimental path towards the best model. Develop and maintain visualization and metrics presentation within our model evaluation loop. Help teams introspect model behavior and reach actionable next steps with fewer manual steps. Participate in design and code reviews and work with Data, Infra, and validation teams to connect offline evaluation with real-world behavior. You will collaborate closely with modeling and data scaling teams working on our Compound AI driving models to design and implement evaluation workflows at scale with model-based metrics, end-to-end simulation, and tooling that connects evaluation signals back to data, training, and launch decisions. Your work contributes to a cohesive evaluation flywheel: better signal better data and training decisions better models better signal. Your Skills & Abilities (Required Qualifications) 3+ years of relevant industry experience Familiarity and experience with at least some of the following key technologies: Backend: Python, node.js, high-throughput data streaming. Frontend: React/TypeScript, WebGL/WebGPU (for 3D sensor visualization), Streamlit, Jupyter notebooks. Data/Infra: Spark for stream processing, BigQuery, Kubernetes. Strong communication skills and ability to collaborate effectively across engineering partners. Bachelor's degree in Computer Science or related field or equivalent experience What Will Give You A Competitive Edge (Preferred Qualifications) Previous experience in Robotics or Autonomous Driving 5+ years of relevant industry experience Master's or PhD degree in Computer Science or related field or equivalent experience Experience shipping production software and iterating quickly in a "startup within an enterprise" environment. Compensation Compensation: The compensation information is a good faith estimate only. It is based on what a successful applicant might be paid in accordance with applicable state laws. The compensation may not be representative for positions located outside of New York, Colorado, California, or Washington. The salary range for this role: is $144,700 to $261,300. The actual base salary a successful candidate will be offered within this range will vary based on factors relevant to the position. Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance. Benefits: GM offers a variety of health and wellbeing benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more. #GM-AV-1 This role is based remotely, but if the selected candidate lives within a specific mile radius of a GM hub, they will be expected to report to the location three times a week {or other frequency dictated by your manager}. The selected candidate will be required to travel About GM Our vision is a world with Zero Crashes, Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better, safer and more equitable for all. Why Join Us We believe we all must make a choice every day - individually and collectively - to drive meaningful change through our words, our deeds and our culture. Every day, we want every employee to feel they belong to one General Motors team. Benefits Overview From day one, we're looking out for your well-being-at work and at home-so you can focus on realizing your ambitions. Learn how GM supports a rewarding career that rewards you personally by visiting Total Rewards resources. Non-Discrimination and Equal Employment Opportunities (U.S.) General Motors is committed to being a workplace that is not only free of unlawful discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that providing an inclusive workplace creates an environment in which our employees can thrive and develop better products for our customers. All employment decisions are made on a non-discriminatory basis without regard to sex, race, color, national origin, citizenship status, religion, age, disability, pregnancy or maternity status, sexual orientation, gender identity, status as a veteran or protected veteran, or any other similarly protected status in accordance with federal, state and local laws. #J-18808-Ljbffr General Motors
$144.7k - $261.3k
...About the Team The Evaluation Foundations team, part of Embodied AI's Scaling... ...vehicle development. We engineer high-performance tools... ...with data-intensive ML teams to drive rapid... ...generation autonomous systems. About the Role As a Senior Engineer in the Embodied...SeniorFoundationFull timeLocal areaRemote workWork from homeFlexible hours- General Motors in the United States seeks a Senior Engineer on the Embodied AI Scaling Foundations team to measure and visualize autonomous vehicle model performance... ...the stack. You will design, implement, and iterate evaluation and introspection tools, collaborate with Data,...SeniorFoundationRemote jobRelocation package
$174.9k - $261.3k
...the world!The Data Labeling Engineering team designs, builds, and operates... ..., data engineering, and AI/ML, defining the strategies, tooling... ...training data solutions at foundation‑model scale. We partner... ...leadership, and direct impact on systems that unblock the next generation...SeniorFoundationFull timeLocal areaRemote workWork from homeRelocation packageFlexible hours- Apple Inc. seeks a senior hands-on Machine Learning Engineering Manager to lead a small team focused on evaluating foundation models and agentic systems, diagnosing failure modes, and driving automated improvements to prompts, contexts, tools, and data generation. You will...SeniorFoundation
- ...areMoveworks is the Agentic AI Assistant platform... ...of their business systems through natural... ...’ Reasoning Engine and natural... ...build cutting edge ML infrastructure for... ...models(LLM), model evaluation and monitoring framework... ...serve as a strong foundation for our hundreds...SeniorFoundationWork at officeRemote workFlexible hours
$184k - $287.5k
...boundless capabilities of AI to build the next era of... ..., and autonomous systems at scale. We seek a Senior ML Engineer to compose and deliver next... ...Cosmos, NVIDIA's world foundation model platform. Your main... ...-tuning techniques, and evaluation approaches.Experience working...SeniorFoundationFull time$90.1k - $191.8k
...The Data Labeling Engineering team designs, builds... ...engineering, and ML, defining labeling... ...to train and evaluate the models behind... ...labeling solutions at foundation‑model scale. We partner... ...work directly on systems that unblock the... ...goals.Champion AI‑assisted engineeringUse...FoundationFull timeWork experience placementLocal areaRemote workWork from homeRelocation packageFlexible hours$153.2k - $234.1k
...hardware and battery systems to intuitive design,... ...driving? Join the Embodied AI Infra Foundation team at General... ...every machine learning engineer working on our... ...driverless vehicles.As a Senior ML Infra Engineer, you will... ...model training and evaluation workflows across GM.Own...SeniorFoundationFull timeWork at officeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours- Rhoda AI is hiring a Senior/Staff-level Research Engineer to ensure our robot-learning pipeline is reliable from data collection through model training, inference, and real-robot evaluation. You will build validation systems, observability, and robust operating practices...Senior
$189.4k - $300.6k
...hardware and battery systems to intuitive design, intelligent... ...? Join the Embodied AI team at General Motors... ...-world scenarios.The Evaluation Foundations team—part of Embodied... ...development. We engineer high-performance tools... ...partner with data-intensive ML teams to drive rapid...FoundationFull timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours$182.4k - $250.6k
...hardware and battery systems to intuitive design,... ...? Join the Embodied AI team at General... ...world scenarios.As a Senior AI/ML Future Sensing Engineer in the Embodied AI organization... ...will develop and evaluate machine learning... ...and selection, and foundation modeling to solve problems...SeniorFoundationFull timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours- ...the da Vinci surgical system and Ion—have... ...worldwide.We’re a team of engineers, clinicians, and innovators... ...platforms. As a Senior AI/ML Research Engineer (Computer... ..., training, and evaluating models that extract anatomy... ...research stage.Solid foundations in linear algebra,...SeniorFoundationLocal areaWorldwideFlexible hours
$184k - $287.5k
...boundaries of innovation and engineering? At NVIDIA, we lead... ...—driving progress in AI, graphics, and high‑performance systems.As a Senior Hardware Systems... ...strengthen the hardware foundation for large‑scale AI. We... ...Experience in pathfinding, evaluating early designs and...SeniorFoundationFull time$237.6k - $401.7k
...Machine Learning Engineering Manager, Evaluation Cupertino, California... ...Learning and AI Apple's AIML Evaluation... ...team builds the systems and methodologies... ...the quality of foundation models and... ...are looking for a senior, hands‑on Machine... ...production‑quality ML pipelines, while...SeniorFoundationRelocation$174.72k - $295.68k
...integrating advanced AI and autonomous driving... ...mission is to build strong foundation for LLM deployment and... ...feasibility.Curate evaluation datasets and establish... ...and software engineering skills.Ability to work... ...effectively across research, systems, infrastructure, and product...SeniorFoundationFull time$230k - $265k
...deploy cutting-edge AI technology to... ...responsible for ML and work alongside... ...veteran scientists and engineers. As a Senior Machine Learning... ...optimize our ML systems—creating and... ...data pipelines, evaluation frameworks, and deployment... ...language or foundation models, with...SeniorFoundationPermanent employment$244.14k - $413.16k
...integrating advanced AI and autonomous... ...global driving. As a Senior Staff Machine Learning Engineer, you will architect... ...closed-loop training and evaluation.Policy Evolution: Apply... ...laws for driving foundation models, overseeing data... ...to support your ML model development/research...SeniorFoundationFull timeOverseas- ...areMoveworks: the Agentic AI Assistant platform... ...of their business systems through natural... ...’ Reasoning Engine and natural language... ...class LLMs, multimodal foundation models, and hybrid... ...infrastructure needed to tune, evaluate, and serve both... ...on the latest ML/LLM research and...SeniorFoundationWork at officeImmediate startRemote workFlexible hours
$174.72k - $295.68k
...integrating advanced AI and autonomous driving... ...time Machine Learning Engineer / Research Scientist to... ...Language-Action (VLA) Foundation Model — the core brain... ...end autonomous driving systems.You will work closely... ...systematic ablation, evaluation, and visualization of...SeniorFoundationFull time$174.72k - $295.68k
...integrating advanced AI and autonomous driving... ...seeking Machine Learning Engineers with strong expertise... ...-scale deep learning systems, along with solid software... ..., implement, and evaluate world models that learn... ...Experience with multimodal foundation models and video...SeniorFoundationFull time$224k - $356.5k
...seeking exceptional Senior Machine... ...and Simulation Engineers to join NVIDIA'... ...driving and Physics AI models. The... ...of productizing ML solutions for autonomous... ...multi-modal AV foundation models.Design,... ...training, AV systems, simulation,... ...& closed-loop evaluation of autonomous...SeniorFoundationFull time- General Motors’ Data Labeling Engineering team is building cutting‑... ...that power autonomous vehicle ML models. The role sits at the... ...on scalable labeling systems and foundations for foundation‑model scale.... ...labeling features and enable AI‑assisted engineering across...Foundation
$184.7k - $324.8k
...Machine Learning Engineer, Siri Speech Cupertino... ...Learning and AI Join the team redefining... ...in applied ML research and development... ...capabilities in systems like Siri. We are... ...learning training/evaluation Data-centric vision... ...and scaling foundation models At Apple, base...SeniorFoundationWorldwideRelocation- ...the next generation of generalist robotic systems in Mountain View, CA. We are seeking a senior or staff-level Research Engineer or ML Systems Engineer to make the robot-... ...model training, inference, and real-robot evaluation. This core research systems role emphasizes...Senior
- ...model teams. 3+ yrs distributed systems / ML infra. About Orbifold AI Orbifold AI is building the foundational infrastructure that the next... ...teams. Our work spans evaluation, model training, reinforcement... ...are hiring a Machine Learning Engineer to scale and optimize the ML...Foundation
- Rhoda AI in Mountain View is seeking a Staff / Principal ML Training Systems Engineer to lead the performance of large-scale multimodal training systems. This role involves improving training efficiency and collaborating closely with research teams to accelerate model iteration...Senior
- Google Cloud’s Gemini Enterprise team seeks a Senior Software/ML Engineer to shape enterprise AI at scale. You will design and implement GenAI features and... ...by millions of enterprise users. You will architect evaluation frameworks, optimize algorithms, and collaborate with...Senior
- Google Cloud’s Gemini Enterprise Senior Software ML Engineer in Sunnyvale, CA will help shape enterprise AI capabilities by building GenAI-powered systems and evaluation frameworks for scalable deployment. You’ll architect optimization algorithms, integrate with LLM infrastructure...Senior
- ServiceNow seeks a senior backend/infrastructure engineer to build and operate evaluation and observability tooling for its enterprise AI agent platform. You will design runtimes for multi-... ...tracing, and building non-deterministic systems that yield meaningful evaluation...Senior
$184k - $287.5k
NVIDIA is searching for a senior or principal engineer who specializes in robotics systems in the Generalist... ...initiative at building foundation models and full-stack... ...robot learning, embodied AI, and physics... ...algorithms;Deploy and evaluate neural network models...SeniorFoundationFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Systems Engineer - AI Evaluation Foundations. Be the first to apply!
- machine learning ai engineer Sunnyvale, CA
- computer vision machine learning engineer Sunnyvale, CA
- machine learning engineer Sunnyvale, CA
- ai ml engineer Sunnyvale, CA
- machine learning software engineer Sunnyvale, CA
- senior ml engineer Sunnyvale, CA
- system engineer remote Sunnyvale, CA
- senior windows systems engineer Sunnyvale, CA
- senior linux systems engineer Sunnyvale, CA
- ground systems engineer Sunnyvale, CA

