Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior ML Systems Engineer - AI Evaluation Foundations

$144.7k - $261.3k

General Motors

About the Team The Evaluation Foundations team, part of Embodied AI's Scaling Foundations, solves critical evaluation challenges for autonomous vehicle development. We engineer high-performance tools that identify top-performing models and partner with data-intensive ML teams to drive rapid innovation. Why Join Us Develop introspection and evaluation tools capable of processing billions of examples to extract maximum value from our large-scale datasets. Join a high-impact team of engineers and machine learning scientists leveraging advanced AI to drive L2, L3, and L4 autonomous vehicle innovation. Directly influence the safety, reliability, and scalability of next-generation autonomous systems. About the Role As a Senior Engineer in the Embodied AI Scaling Foundations organization, you will be a key technical contributor on the team that measures and visualizes AV model performance. You will work across the stack to design, implement, and iterate on evaluation and introspection tools used by Embodied AI and adjacent GM AV teams. In this role you will Build and improve high-quality evaluation signal and introspection tools that help shorten the experimental path towards the best model. Develop and maintain visualization and metrics presentation within our model evaluation loop. Help teams introspect model behavior and reach actionable next steps with fewer manual steps. Participate in design and code reviews and work with Data, Infra, and validation teams to connect offline evaluation with real-world behavior. You will collaborate closely with modeling and data scaling teams working on our Compound AI driving models to design and implement evaluation workflows at scale with model-based metrics, end-to-end simulation, and tooling that connects evaluation signals back to data, training, and launch decisions. Your work contributes to a cohesive evaluation flywheel: better signal better data and training decisions better models better signal. Your Skills & Abilities (Required Qualifications) 3+ years of relevant industry experience Familiarity and experience with at least some of the following key technologies: Backend: Python, node.js, high-throughput data streaming. Frontend: React/TypeScript, WebGL/WebGPU (for 3D sensor visualization), Streamlit, Jupyter notebooks. Data/Infra: Spark for stream processing, BigQuery, Kubernetes. Strong communication skills and ability to collaborate effectively across engineering partners. Bachelor's degree in Computer Science or related field or equivalent experience What Will Give You A Competitive Edge (Preferred Qualifications) Previous experience in Robotics or Autonomous Driving 5+ years of relevant industry experience Master's or PhD degree in Computer Science or related field or equivalent experience Experience shipping production software and iterating quickly in a "startup within an enterprise" environment. Compensation Compensation: The compensation information is a good faith estimate only. It is based on what a successful applicant might be paid in accordance with applicable state laws. The compensation may not be representative for positions located outside of New York, Colorado, California, or Washington. The salary range for this role: is $144,700 to $261,300. The actual base salary a successful candidate will be offered within this range will vary based on factors relevant to the position. Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance. Benefits: GM offers a variety of health and wellbeing benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more. #GM-AV-1 This role is based remotely, but if the selected candidate lives within a specific mile radius of a GM hub, they will be expected to report to the location three times a week {or other frequency dictated by your manager}. The selected candidate will be required to travel About GM Our vision is a world with Zero Crashes, Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better, safer and more equitable for all. Why Join Us We believe we all must make a choice every day - individually and collectively - to drive meaningful change through our words, our deeds and our culture. Every day, we want every employee to feel they belong to one General Motors team. Benefits Overview From day one, we're looking out for your well-being-at work and at home-so you can focus on realizing your ambitions. Learn how GM supports a rewarding career that rewards you personally by visiting Total Rewards resources. Non-Discrimination and Equal Employment Opportunities (U.S.) General Motors is committed to being a workplace that is not only free of unlawful discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that providing an inclusive workplace creates an environment in which our employees can thrive and develop better products for our customers. All employment decisions are made on a non-discriminatory basis without regard to sex, race, color, national origin, citizenship status, religion, age, disability, pregnancy or maternity status, sexual orientation, gender identity, status as a veteran or protected veteran, or any other similarly protected status in accordance with federal, state and local laws. #J-18808-Ljbffr General Motors

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior ML Systems Engineer - AI Evaluation Foundations in Sunnyvale, CA vacancy
  • $144.7k - $261.3k

     ...About the Team The Evaluation Foundations team, part of Embodied AI's Scaling...  ...vehicle development. We engineer high-performance tools...  ...with data-intensive ML teams to drive rapid...  ...generation autonomous systems. About the Role As a Senior Engineer in the Embodied... 
    Senior
    Foundation
    Full time
    Local area
    Remote work
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    6 days ago
  • General Motors in the United States seeks a Senior Engineer on the Embodied AI Scaling Foundations team to measure and visualize autonomous vehicle model performance...  ...the stack. You will design, implement, and iterate evaluation and introspection tools, collaborate with Data,... 
    Senior
    Foundation
    Remote job
    Relocation package

    General Motors

    Sunnyvale, CA
    2 days ago
  • $174.9k - $261.3k

     ...the world!The Data Labeling Engineering team designs, builds, and operates...  ..., data engineering, and AI/ML, defining the strategies, tooling...  ...training data solutions at foundation‑model scale. We partner...  ...leadership, and direct impact on systems that unblock the next generation... 
    Senior
    Foundation
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    3 days ago
  • Apple Inc. seeks a senior hands-on Machine Learning Engineering Manager to lead a small team focused on evaluating foundation models and agentic systems, diagnosing failure modes, and driving automated improvements to prompts, contexts, tools, and data generation. You will... 
    Senior
    Foundation

    Apple Inc.

    Cupertino, CA
    2 days ago
  •  ...areMoveworks is the Agentic AI Assistant platform...  ...of their business systems through natural...  ...’ Reasoning Engine and natural...  ...build cutting edge ML infrastructure for...  ...models(LLM), model evaluation and monitoring framework...  ...serve as a strong foundation for our hundreds... 
    Senior
    Foundation
    Work at office
    Remote work
    Flexible hours

    Moveworks

    Mountain View, CA
    20 hours ago
  • $184k - $287.5k

     ...boundless capabilities of AI to build the next era of...  ..., and autonomous systems at scale. We seek a Senior ML Engineer to compose and deliver next...  ...Cosmos, NVIDIA's world foundation model platform. Your main...  ...-tuning techniques, and evaluation approaches.Experience working... 
    Senior
    Foundation
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $90.1k - $191.8k

     ...The Data Labeling Engineering team designs, builds...  ...engineering, and ML, defining labeling...  ...to train and evaluate the models behind...  ...labeling solutions at foundation‑model scale. We partner...  ...work directly on systems that unblock the...  ...goals.Champion AI‑assisted engineeringUse... 
    Foundation
    Full time
    Work experience placement
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    3 days ago
  • $153.2k - $234.1k

     ...hardware and battery systems to intuitive design,...  ...driving? Join the Embodied AI Infra Foundation team at General...  ...every machine learning engineer working on our...  ...driverless vehicles.As a Senior ML Infra Engineer, you will...  ...model training and evaluation workflows across GM.Own... 
    Senior
    Foundation
    Full time
    Work at office
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    2 days ago
  • Rhoda AI is hiring a Senior/Staff-level Research Engineer to ensure our robot-learning pipeline is reliable from data collection through model training, inference, and real-robot evaluation. You will build validation systems, observability, and robust operating practices... 
    Senior

    Socket.dev

    Mountain View, CA
    4 days ago
  • $189.4k - $300.6k

     ...hardware and battery systems to intuitive design, intelligent...  ...? Join the Embodied AI team at General Motors...  ...-world scenarios.The Evaluation Foundations team—part of Embodied...  ...development. We engineer high-performance tools...  ...partner with data-intensive ML teams to drive rapid... 
    Foundation
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • $182.4k - $250.6k

     ...hardware and battery systems to intuitive design,...  ...? Join the Embodied AI team at General...  ...world scenarios.As a Senior AI/ML Future Sensing Engineer in the Embodied AI organization...  ...will develop and evaluate machine learning...  ...and selection, and foundation modeling to solve problems... 
    Senior
    Foundation
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    3 days ago
  •  ...the da Vinci surgical system and Ion—have...  ...worldwide.We’re a team of engineers, clinicians, and innovators...  ...platforms. As a Senior AI/ML Research Engineer (Computer...  ..., training, and evaluating models that extract anatomy...  ...research stage.Solid foundations in linear algebra,... 
    Senior
    Foundation
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    Sunnyvale, CA
    1 day ago
  • $184k - $287.5k

     ...boundaries of innovation and engineering? At NVIDIA, we lead...  ...—driving progress in AI, graphics, and high‑performance systems.As a Senior Hardware Systems...  ...strengthen the hardware foundation for large‑scale AI. We...  ...Experience in pathfinding, evaluating early designs and... 
    Senior
    Foundation
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $237.6k - $401.7k

     ...Machine Learning Engineering Manager, Evaluation Cupertino, California...  ...Learning and AI Apple's AIML Evaluation...  ...team builds the systems and methodologies...  ...the quality of foundation models and...  ...are looking for a senior, hands‑on Machine...  ...production‑quality ML pipelines, while... 
    Senior
    Foundation
    Relocation

    Apple Inc.

    Cupertino, CA
    2 days ago
  • $174.72k - $295.68k

     ...integrating advanced AI and autonomous driving...  ...mission is to build strong foundation for LLM deployment and...  ...feasibility.Curate evaluation datasets and establish...  ...and software engineering skills.Ability to work...  ...effectively across research, systems, infrastructure, and product... 
    Senior
    Foundation
    Full time

    XPENG Motors

    Santa Clara, CA
    2 days ago
  • $230k - $265k

     ...deploy cutting-edge AI technology to...  ...responsible for ML and work alongside...  ...veteran scientists and engineers. As a Senior Machine Learning...  ...optimize our ML systems—creating and...  ...data pipelines, evaluation frameworks, and deployment...  ...language or foundation models, with... 
    Senior
    Foundation
    Permanent employment

    Otter.ai

    Mountain View, CA
    3 days ago
  • $244.14k - $413.16k

     ...integrating advanced AI and autonomous...  ...global driving. As a Senior Staff Machine Learning Engineer, you will architect...  ...closed-loop training and evaluation.Policy Evolution: Apply...  ...laws for driving foundation models, overseeing data...  ...to support your ML model development/research... 
    Senior
    Foundation
    Full time
    Overseas

    XPENG Motors

    Santa Clara, CA
    3 days ago
  •  ...areMoveworks: the Agentic AI Assistant platform...  ...of their business systems through natural...  ...’ Reasoning Engine and natural language...  ...class LLMs, multimodal foundation models, and hybrid...  ...infrastructure needed to tune, evaluate, and serve both...  ...on the latest ML/LLM research and... 
    Senior
    Foundation
    Work at office
    Immediate start
    Remote work
    Flexible hours

    Moveworks

    Mountain View, CA
    20 hours ago
  • $174.72k - $295.68k

     ...integrating advanced AI and autonomous driving...  ...time Machine Learning Engineer / Research Scientist to...  ...Language-Action (VLA) Foundation Model — the core brain...  ...end autonomous driving systems.You will work closely...  ...systematic ablation, evaluation, and visualization of... 
    Senior
    Foundation
    Full time

    XPENG Motors

    Santa Clara, CA
    3 days ago
  • $174.72k - $295.68k

     ...integrating advanced AI and autonomous driving...  ...seeking Machine Learning Engineers with strong expertise...  ...-scale deep learning systems, along with solid software...  ..., implement, and evaluate world models that learn...  ...Experience with multimodal foundation models and video... 
    Senior
    Foundation
    Full time

    XPENG Motors

    Santa Clara, CA
    3 days ago
  • $224k - $356.5k

     ...seeking exceptional Senior Machine...  ...and Simulation Engineers to join NVIDIA'...  ...driving and Physics AI models. The...  ...of productizing ML solutions for autonomous...  ...multi-modal AV foundation models.Design,...  ...training, AV systems, simulation,...  ...& closed-loop evaluation of autonomous... 
    Senior
    Foundation
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • General Motors’ Data Labeling Engineering team is building cutting‑...  ...that power autonomous vehicle ML models. The role sits at the...  ...on scalable labeling systems and foundations for foundation‑model scale....  ...labeling features and enable AI‑assisted engineering across... 
    Foundation

    General Motors

    Mountain View, CA
    4 days ago
  • $184.7k - $324.8k

     ...Machine Learning Engineer, Siri Speech Cupertino...  ...Learning and AI Join the team redefining...  ...in applied ML research and development...  ...capabilities in systems like Siri. We are...  ...learning training/evaluation Data-centric vision...  ...and scaling foundation models At Apple, base... 
    Senior
    Foundation
    Worldwide
    Relocation

    Apple

    Cupertino, CA
    10 hours ago
  •  ...the next generation of generalist robotic systems in Mountain View, CA. We are seeking a senior or staff-level Research Engineer or ML Systems Engineer to make the robot-...  ...model training, inference, and real-robot evaluation. This core research systems role emphasizes... 
    Senior

    RHODA

    Mountain View, CA
    5 days ago
  •  ...model teams. 3+ yrs distributed systems / ML infra. About Orbifold AI Orbifold AI is building the foundational infrastructure that the next...  ...teams. Our work spans evaluation, model training, reinforcement...  ...are hiring a Machine Learning Engineer to scale and optimize the ML... 
    Foundation

    Orbifold AI

    Palo Alto, CA
    5 days ago
  • Rhoda AI in Mountain View is seeking a Staff / Principal ML Training Systems Engineer to lead the performance of large-scale multimodal training systems. This role involves improving training efficiency and collaborating closely with research teams to accelerate model iteration... 
    Senior

    Rhoda AI

    Mountain View, CA
    1 day ago
  • Google Cloud’s Gemini Enterprise team seeks a Senior Software/ML Engineer to shape enterprise AI at scale. You will design and implement GenAI features and...  ...by millions of enterprise users. You will architect evaluation frameworks, optimize algorithms, and collaborate with... 
    Senior

    Socket.dev

    Sunnyvale, CA
    4 days ago
  • Google Cloud’s Gemini Enterprise Senior Software ML Engineer in Sunnyvale, CA will help shape enterprise AI capabilities by building GenAI-powered systems and evaluation frameworks for scalable deployment. You’ll architect optimization algorithms, integrate with LLM infrastructure... 
    Senior

    Google

    Sunnyvale, CA
    4 days ago
  • ServiceNow seeks a senior backend/infrastructure engineer to build and operate evaluation and observability tooling for its enterprise AI agent platform. You will design runtimes for multi-...  ...tracing, and building non-deterministic systems that yield meaningful evaluation... 
    Senior

    Servicenow

    Mountain View, CA
    5 days ago
  • $184k - $287.5k

    NVIDIA is searching for a senior or principal engineer who specializes in robotics systems in the Generalist...  ...initiative at building foundation models and full-stack...  ...robot learning, embodied AI, and physics...  ...algorithms;Deploy and evaluate neural network models... 
    Senior
    Foundation
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior ML Systems Engineer - AI Evaluation Foundations. Be the first to apply!