Senior ML Systems Engineer - AI Evaluation Foundations
$144.7k - $261.3kGeneral Motors
About the Team The Evaluation Foundations team, part of Embodied AI's Scaling Foundations, solves critical evaluation challenges for autonomous vehicle development. We engineer high-performance tools that identify top-performing models and partner with data-intensive ML teams to drive rapid innovation. Job Description About the Team The Evaluation Foundations team, part of Embodied AI's Scaling Foundations, solves critical evaluation challenges for autonomous vehicle development. We engineer high-performance tools that identify top-performing models and partner with data-intensive ML teams to drive rapid innovation. Why Join Us? Develop introspection and evaluation tools capable of processing billions of examples to extract maximum value from our large-scale datasets. Join a high-impact team of engineers and machine learning scientists leveraging advanced AI to drive L2, L3, and L4 autonomous vehicle innovation. Directly influence the safety, reliability, and scalability of next-generation autonomous systems. About The Role As a Senior Engineer in the Embodied AI Scaling Foundations organization, you will be a key technical contributor on the team that measures and visualizes AV model performance. You will work across the stack to design, implement, and iterate on evaluation and introspection tools used by Embodied AI and adjacent GM AV teams In this role you will: Build and improve high-quality evaluation signal and introspection tools that help shorten the experimental path towards the best model. Develop and maintain visualization and metrics presentation within our model evaluation loop. Help teams introspect model behavior and reach actionable next steps with fewer manual steps. Participate in design and code reviews and work with Data, Infra, and validation teams to connect offline evaluation with real-world behavior. You will collaborate closely with modeling and data scaling teams working on our Compound AI driving models to design and implement evaluation workflows at scale with model-based metrics, end-to-end simulation, and tooling that connects evaluation signals back to data, training, and launch decisions. Your work contributes to a cohesive evaluation flywheel: better signal -> better data and training decisions -> better models -> better signal. Your Skills & Abilities (Required Qualifications) 3+ years of relevant industry experience Familiarity and experience with at least some of the following key technologies: Backend: Python, node.js, high-throughput data streaming. Frontend: React/TypeScript, WebGL/WebGPU (for 3D sensor visualization), Streamlit, Jupyter notebooks. Data/Infra: Spark for stream processing, BigQuery, Kubernetes. Strong communication skills and ability to collaborate effectively across engineering partners. Bachelor's degree in Computer Science or related field or equivalent experience What Will Give You A Competitive Edge (Preferred Qualifications) Previous experience in Robotics or Autonomous Driving 5+ years of relevant industry experience Master's or PhD degree in Computer Science or related field or equivalent experience Experience shipping production software and iterating quickly in a "startup within an enterprise" environment. Compensation The salary range for this role: is $144,700 to $261,300. The actual base salary a successful candidate will be offered within this range will vary based on factors relevant to the position. Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance. Benefits: GM offers a variety of health and wellbeing benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more.
#GM-AV-1
This role is based remotely, but if the selected candidate lives within a specific mile radius of a GM hub, they will be expected to report to the location three times a week {or other frequency dictated by your manager}. The selected candidate will be required to travel About GM Our vision is a world with Zero Crashes, Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better, safer and more equitable for all. Why Join Us We believe we all must make a choice every day - individually and collaboratively - to drive meaningful change through our words, our deeds and our culture. Every day, we want every employee to feel they belong to one General Motors team. Benefits Overview From day one, we're looking out for your well-being - at work and at home - so you can focus on realizing your ambitions. Learn how GM supports a rewarding career that rewards you personally by visiting Total Rewards resources . Non-Discrimination and Equal Employment Opportunities (U.S.) General Motors is committed to being a workplace that is not only free of unlawful discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that providing an inclusive workplace creates an environment in which our employees can thrive and develop better products for our customers. All employment decisions are made on a non-discriminatory basis without regard to sex, race, color, national origin, citizenship status, religion, age, disability, pregnancy or maternity status, sexual orientation, gender identity, status as a veteran or protected veteran, or any other similarly protected status in accordance with federal, state and local laws. We encourage interested candidates to review the key responsibilities and qualifications for each role and apply for any positions that match their skills and capabilities. Applicants in the recruitment process may be required, where applicable, to successfully complete a role-related assessment(s) and/or a pre-employment screening prior to beginning employment. To learn more, visit How we Hire . Accommodations General Motors offers opportunities to all job seekers including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, email us or call us at View phone number on click.appcast.io. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying. #J-18808-Ljbffr General Motors- General Motors is seeking a Senior Engineer for the Embodied AI Scaling Foundations team to measure and visualize AV model performance at scale. You will design and implement evaluation and introspection tools used by GM AV teams, collaborating across Data, Infra, and validation...SeniorFoundationRemote job
$184.7k - $324.8k
...Machine Learning and AI Join the team redefining... ...and Large-scale Evaluation) team at Apple and... ...evaluates Siri and AI/ML models at scale to delight... ...by large-scale systems, rigorous statistical... ...seeking a highly skilled Senior Machine Learning Engineer specializing in...SeniorRelocation- At Atlassian is seeking a Senior Machine Learning Engineer to join the Search & Intelligence... ...organization. You will build AI-native experiences, agentic systems, models, evaluation frameworks, and data... ...’s AI products. You will own ML projects end-to-end—from problem...Senior
$175k - $308.5k
...AIML - Senior ML Research Engineer, AFM Safety Seattle, Washington... ...Learning and AI Join us as we build... ...build safe and reliable foundation models for Apple's products... ...risks of agentic systems, including tool use,... ...build the data and evaluations needed to address...SeniorFoundationRelocation$176.76k - $232k
...The Enterprise Data & AI team is a strategic... ...trusted unified data foundation, advanced analytics capabilities... ...As a Senior AI/ML Engineer, you will lead the delivery... ..., implement rigorous evaluation frameworks, and design... ...to architectures and system design for serving AI...SeniorFoundationPermanent employmentFull timeContract workPart timeWork visa$185k - $235k
...powered by advanced AI, recommendation systems, and adtech.... ...every downstream ML model performs: better... ...for an experienced Senior Machine Learning Engineer to design and build... ..., offline/online evaluation, deployment, monitoring... ...).Strong foundation in machine learning...SeniorFoundationFull timeLocal areaWork from home$206.1k - $269.08k
...ten relevant results. AI agents need to understand... ..., LLMs, agentic systems, and large-scale distributed... ...a particular task. Evaluation & Learning — Develop offline... ...Experience building ML systems that operate at... ...scale. Strong software engineering fundamentals and the...SeniorWork at officeLocal area- ...Senior Machine Learning Engineer About Amperity—Why This, Why... ...across a dozen systems, half of it contradicts... ...; it’s the foundation everything else... ...Amperity as an AI-first company—not... ...At Amperity, ML Engineers work in... ...blameless post-mortems. Evaluate MLOps tooling...SeniorFoundation
$203k - $258.6k
...TeamThe Cisco AI Research team brings... ...learning engineers, data engineers... ...large-scale data systems, and networking... ...Your ImpactAs a Senior Machine... ...improve the data and ML systems that power... ...training and evaluation data at scale.... ...Strong technical foundation in distributed...SeniorFoundationFull timeTemporary workWork at officeLocal areaFlexible hoursShift work$175k - $308.5k
...Apple Services Engineering (ASE) builds experiences... ...-scale commerce systems, we are... ...ecosystem. The ASE AI/ML organization sits... ...We are seeking a Senior Machine Learning... ...influence and implement foundational intelligence... ...LLM fine‑tuning, evaluation, safety alignment...SeniorFoundationRelocation- DoorDash is seeking a Senior Machine Learning Engineer to advance agentic foundations for vertical agents in a Seattle-based hybrid role. You will lead eval-driven improvements for flagship agents, including the Ask grocery assistant, and expand to Merchants and Dashers...SeniorFoundation
- ...Inc. is seeking a Machine Learning Engineer to build and deploy ML models powering Snapchat and related... .... You will work on scalable, secure systems while upholding high standards of code... .... Applicants should have strong ML foundations and practical experience with major...SeniorFoundation
$142.3k - $263.3k
...Machine Learning Engineer, Human Centered AI - Evaluations & Insights Seattle, Washington, United... ...helping evaluate and optimize Foundation Models and generative AI systems. You will architect robust evaluation... .../DPO).This role blends deep ML engineering expertise with...FoundationRelocation- CoreWeave in the United States is seeking a strong ML researcher/engineer to join the CRAFT team. You will generate and evaluate research ideas to advance continuous learning... ..., CUDA kernels to dashboards, and help scale AI with a focus on practical reliability and fast...Senior
- ...are seeking an accomplished Senior Staff ML Engineer who will serve as a technical leader for Generative AI applications at GEICO. In this... ...design, develop, and deploy systems that ensure scalability,... ...search capabilities as their foundation. You bring a passion for providing...SeniorFoundationLocal area
$184.7k - $324.8k
...Machine Learning and AI Apple is where... ...Description As a Senior/Staff Engineer on the Foundation Model Compute Infrastructure... ..., fine-tuning, evaluation, and inference. You... ...large-scale distributed systems or cloud... ...Experience with distributed ML training or inference...SeniorFoundationRelocation- ...Join us!About the RoleWe’re looking for a Senior Design Systems Engineer II to shape and scale the visual and interaction foundations of Blink’s digital ecosystem. You’ll partner... ...modern front-end tooling.Expert use of modern AI-assisted tools (e.g., Cursor, GitHub...SeniorFoundation
$131.4k - $236k
...re investing deeply in AI/ML, LLMs, and Industrial... ...skilled and motivated Senior Applied Machine Learning... ...developers, scaling systems, and driving the roadmap... ...impact, shaping the foundation for MaintainX’s predictive... ...for experimentation, evaluation, and model lifecycle...SeniorFoundation- Flodesk, a remote-first email marketing company, seeks an experienced AI Systems professional to own prompts, agent instructions, quality definitions, and evaluation infrastructure. You’ll connect engineering, product, and language models to improve member experiences and...SeniorRemote work
$182.4k - $247k
A leading data and AI company in Bellevue is seeking a Software Engineer to join their Runtime team. You will build the... ...data storage and processing systems that outperform traditional SQL... ...Scala, or C++, along with a solid foundation in algorithms and distributed systems...SeniorFoundation$213.76k - $280.55k
...teamThe Enterprise Data & AI team is a strategic and operational... ...of a trusted unified data foundation, advanced analytics... ...core responsibilitiesAs a Senior Manager, AI/ML Engineering, you lead a team of AI/ML... ...production-grade AI/ML systems that drive measurable business...SeniorFoundationPermanent employmentFull timePart timeWork visa$130k - $160k
...perfect fit as a Sr. Systems Engineer at Brighton Jones.... ...#OneTeam. The Senior Systems Engineer will... ...modern infrastructure foundation that supports our growing... ...risk requirements. Evaluate emerging technologies, cloud services, and AI-enabled workplace capabilities...SeniorFoundationFull timeSummer workWork at officeLocal areaImmediate startRemote workFlexible hours- Xaira Therapeutics is seeking a Senior Software Engineer to join our Platform team to design, build, and deploy the AI infrastructure that powers our world-class research. You... ...GPUs for training and inference of biology foundation models in Seattle. This role covers MLOps...SeniorFoundation
$197.6k - $264.9k
Job Posting Title:Senior Manager, AI & Machine Learning... ...We are the Finance Engineering & AI team, and we... ...operates the core systems finance relies on... ...delivering the AI/ML layer, the intelligent data foundation, software workflows... ...enough to credibly evaluate trade-offs your...SeniorFoundationFull time$206.1k - $269.08k
Overview Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data... ...will own projects across the ML lifecycle, from problem definition...SeniorWork at officeLocal area- Veeda AI is building the next generation of multimodal foundation world models for Physical AI. We're a small, fast-moving team tackling challenging problems at... ...robotics, and embodied intelligence. We are seeking engineers to design and deploy tools for experiment...SeniorFoundation
$207.4k - $278.1k
...organization of engineers, product... ...technological foundation and consumer media... ...is to advance AI and machine learning... ...high impact AI/ML and data science... ...are seeking a Senior Manager Machine... ...of software and systems including... ..., fine-tuning, evaluating, and deploying...SeniorFoundation$161.7k - $284.9k
...generation tools for creators. As a Senior CV & ML Engineer, you will be working alongside... ...Photography, Multimodal-LLMs/Foundation models, Generative AI, Machine Learning or related areas... ...Proven track record in training, evaluating, and deploying multimodal large language...SeniorFoundationRelocation$175k - $308.5k
...Staff/Senior Machine Learning Engineer, Search & Knowledge Platform... ...are an Applied ML team pushing the... ...distributed systems engineers. As such... ...outstanding Search and AI engineers on... ...frameworks to evaluate individual components... ...working with foundation models and LLMs...SeniorFoundationWork experience placementRelocation- ...job is to support the following businesses with the most advanced AI technology:- Combat any kinds of risks/violations issues in E-... ...in a Linux environment, proficient in Python, Go, or C++- Solid foundation in data structures/algorithms, proficient in machine learning/deep...SeniorFoundationOverseas
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Systems Engineer - AI Evaluation Foundations. Be the first to apply!
- senior ml engineer Seattle, WA
- data scientist machine learning engineer Seattle, WA
- machine learning ai engineer Seattle, WA
- machine learning software engineer Seattle, WA
- ai ml engineer Seattle, WA
- machine learning engineer Seattle, WA
- graduate machine learning engineer Seattle, WA
- computer vision machine learning engineer Seattle, WA
- junior machine learning research engineer Seattle, WA
- systems engineering technician Seattle, WA



