Senior ML Systems Engineer - AI Evaluation Foundations
$144.7k - $261.3kGeneral Motors Proving Ground
Remote/Hybrid Sunnyvale, California, United States of America Remote - Washington Austin, Texas, United States of America Mountain View, California, United States of America Warren, Michigan, United States of America Full time
JR-202606259
Job Description About the Team The Evaluation Foundations team, part of Embodied AI's Scaling Foundations, solves critical evaluation challenges for autonomous vehicle development. We engineer high-performance tools that identify top-performing models and partner with data-intensive ML teams to drive rapid innovation. Why Join Us? Develop introspection and evaluation tools capable of processing billions of examples to extract maximum value from our large-scale datasets. Join a high-impact team of engineers and machine learning scientists leveraging advanced AI to drive L2, L3, and L4 autonomous vehicle innovation. Directly influence the safety, reliability, and scalability of next-generation autonomous systems. About the Role As a Senior Engineer in the Embodied AI Scaling Foundations organization, you will be a key technical contributor on the team that measures and visualizes AV model performance. You will work across the stack to design, implement, and iterate on evaluation and introspection tools used by Embodied AI and adjacent GM AV teams In this role you will: Build and improve high-quality evaluation signal and introspection tools that help shorten the experimental path towards the best model. Develop and maintain visualization and metrics presentation within our model evaluation loop. Help teams introspect model behavior and reach actionable next steps with fewer manual steps. Participate in design and code reviews and work with Data, Infra, and validation teams to connect offline evaluation with real-world behavior. You will collaborate closely with modeling and data scaling teams working on our Compound AI driving models to design and implement evaluation workflows at scale with model-based metrics, end-to-end simulation, and tooling that connects evaluation signals back to data, training, and launch decisions. Your work contributes to a cohesive evaluation flywheel: better signal ? better data and training decisions ? better models ? better signal. Your Skills & Abilities (Required Qualifications) 3+ years of relevant industry experience Familiarity and experience with at least some of the following key technologies: Backend: Python, node.js, high-throughput data streaming. Frontend: React/TypeScript, WebGL/WebGPU (for 3D sensor visualization), Streamlit, Jupyter notebooks. Data/Infra: Spark for stream processing, BigQuery, Kubernetes. Strong communication skills and ability to collaborate effectively across engineering partners. Bachelor's degree in Computer Science or related field or equivalent experience What Will Give You A Competitive Edge (Preferred Qualifications) Previous experience in Robotics or Autonomous Driving 5+ years of relevant industry experience Master's or PhD degree in Computer Science or related field or equivalent experience Experience shipping production software and iterating quickly in a "startup within an enterprise" environment. Compensation: The compensation information is a good faith estimate only. It is based on what a successful applicant might be paid in accordance with applicable state laws. The compensation may not be representative for positions located outside of New York, Colorado, California, or Washington.- The salary range for this role: is $144,700 to $261,300. The actual base salary a successful candidate will be offered within this range will vary based on factors relevant to the position.
- Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance.
- Benefits: GM offers a variety of health and wellbeing benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more.
#GM-AV-1
This role is based remotely, but if the selected candidate lives within a specific mile radius of a GM hub, they will be expected to report to the location three times a week {or other frequency dictated by your manager}. The selected candidate will be required to travel This job may be eligible for relocation benefits. About GM Our vision is a world with Zero Crashes, Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better, safer and more equitable for all. Why Join Us We believe we all must make a choice every day - individually and collectively - to drive meaningful change through our words, our deeds and our culture. Every day, we want every employee to feel they belong to one General Motors team. Benefits Overview From day one, we're looking out for your well-being-at work and at home-so you can focus on realizing your ambitions. Learn how GM supports a rewarding career that rewards you personally by visiting Total Rewards resources ( . Non-Discrimination and Equal Employment Opportunities (U.S.) General Motors is committed to being a workplace that is not only free of unlawful discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that providing an inclusive workplace creates an environment in which our employees can thrive and develop better products for our customers. All employment decisions are made on a non-discriminatory basis without regard to sex, race, color, national origin, citizenship status, religion, age, disability, pregnancy or maternity status, sexual orientation, gender identity, status as a veteran or protected veteran, or any other similarly protected status in accordance with federal, state and local laws. We encourage interested candidates to review the key responsibilities and qualifications for each role and apply for any positions that match their skills and capabilities. Applicants in the recruitment process may be required, where applicable, to successfully complete a role-related assessment(s) and/or a pre-employment screening prior to beginning employment. To learn more, visit How we Hire ( . Accommodations General Motors offers opportunities to all job seekers including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, email (View email address on click.appcast.io) us or call us at View phone number on click.appcast.io. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying. We are leading the change to make our world better, safer and more equitable for all through our actions and how we behave. Learn more about: Our Company ( Our Culture How we hire ( Our diverse team of employees bring their collective passion for engineering, technology and design to deliver on our vision of a world with Zero Crashes, Zero Emissions and Zero Congestion. We are looking for adventure-seekers and imaginative thought leaders to help us transform mobility. Explore our global locations ( We are determined to lead change for the world through technology, ingenuity and harnessing the creativity of our diverse team. Join us to help lead the change that will make our world better, safer and more equitable for all by becoming a member of GM's Talent Community (beamery.com) ( . As a part of our Talent Community, you will receive updates about GM, open roles, career insights and more. Please note that filling out the form below will not add you to our Talent Community automatically; you will need to use the link above. If you are seeking to apply to a specific role, we encourage you to click "Apply Now" on the job posting of interest. The policy of General Motors is to extend opportunities to qualified applicants and employees on an equal basis regardless of an individual's age, race, color, sex, religion, national origin, disability, sexual orientation, gender identity/expression or veteran status. Additionally, General Motors is committed to being an Equal Employment Opportunity Employer and offers opportunities to all job seekers including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, email us at View email address on click.appcast.io .In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying. General MotorsVacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior ML Systems Engineer - AI Evaluation Foundations in Austin, TX vacancy
$144.7k - $261.3k
About the Team The Evaluation Foundations team, part of Embodied AI's Scaling Foundations,... ...vehicle development. We engineer high-performance... ...with data-intensive ML teams to drive rapid... ...generation autonomous systems. About the Role As a Senior Engineer in the Embodied...SeniorFoundationLocal areaRemote workWork from homeFlexible hours- General Motors, through Embodied AI, seeks a Senior Engineer to measure and visualize AV model performance. You will design and implement evaluation workflows, collaborate across Data, Infra... ...of next‑generation autonomous systems and to contribute to a cohesive evaluation...SeniorRemote job
$174.9k - $261.3k
...world! The Data Labeling Engineering team designs, builds, and operates... ...data engineering , and AI/ML , defining the strategies,... ...training data solutions at foundation-model scale . We partner... ...leadership, and direct impact on systems that unblock the next...SeniorFoundationFull timeLocal areaRemote workWork from homeRelocation packageFlexible hours- Expedia Group is seeking a Senior AI/ML Data Engineer for Layla, our AI-native travel planning platform. You will design... ...data quality and observability, and build data foundations for experimentation and model evaluation. You will collaborate with Product, Analytics,...SeniorFoundation
$224k - $356.5k
...the unlimited potential of AI to define the next era of... .... NVIDIA is hiring a Senior Software Architect in the Agent Harness & Runtime Engineering team to build foundational systems for the next generation of... ...agent runtimes, inference, evaluation, and large-scale...SeniorFoundation- Senior AI / ML Data Engineer At Expedia Group, we help travelers explore the world... ..., you will build the data foundations that power Layla's AI-... ..., and experimentation and evaluation support that let the team ship and improve AI/ML systems in production with confidence...SeniorFoundation
- ...Senior Machine Learning Engineer Hybrid At Cloudflare, we... ...problem and the AI-native curiosity... ...large-scale data systems, own the company... ...our unified AI/ML platform, designing... ...reviews, evaluating build-vs-buy decisions... ...leveling up platform foundations. Experience...SeniorFoundationLocal area
$104k - $164k
...DO We're looking for a Senior Lead Systems Engineer who's passionate about building... ..., software engineering, AI, and intelligent integrations... ...and operate together. Evaluate architecture decisions with... ...their businesses. Built on a foundation of composable intelligence,...SeniorFoundationWork at officeLocal areaFlexible hours- Senior Applied Machine Learning Developer MaintainX... ...re investing deeply in AI/ML, LLMs, and Industrial... ...mentoring developers, scaling systems, and driving the... ...impact, shaping the foundation for MaintainX's predictive... ...for experimentation, evaluation, and model lifecycle...SeniorFoundation
- Cloudflare is seeking a senior engineer to own the GTM-facing software and data products, spanning data foundations, signals, and multi-team coordination. You will drive complex... ...the developer buying journey while applying AI to accelerate delivery and reliability in a...SeniorFoundation
$128.7k - $261.3k
...hardware and battery systems to intuitive design,... ...driving? Join the Embodied AI Infra Foundation team at General... ...every machine learning engineer working on our... ...driverless vehicles.As a Senior ML Infra Engineer, you will... ...model training and evaluation workflows across GM.Own...SeniorFoundationFull timeWork at officeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours- ...“normalized” problem and the AI-native curiosity to create a... ...worldwide. Working alongside AI/ML engineers, hardware partners, and... ...hard problems in distributed systems and high-performance computing... ...engineers who are energized by foundational infrastructure problems and want...SeniorFoundationLocal areaWorldwide
- ...“normalized” problem and the AI-native curiosity to create a... ...end. That includes the data foundation underneath it and the signals... ...ones that span many teams and systems. You’ll drive them to delivery... ...smoother. The work is a mix of data engineering, full-stack product, and...SeniorFoundationLocal area
- ...Senior Machine Learning Engineer We are seeking a Senior Machine Learning Engineer... ...optimizing production ready AI systems for secure and distributed... .... Engineer adaptive ML systems using LoRA, PEFT,... ...have put in place as the foundation on which we operate as a team...SeniorFoundationLive outWork at officeFlexible hours
- ...ML Engineer Austin, Texas, United States About the... ...service teams work. Their AI technology captures... ...world of intelligent systems. Location New York... ...teams to shape the foundations of the AI stack, improve... ...model training and evaluation. Familiarity with FastAPI...FoundationFull time
- ...Machine Learning Engineer, Applied AI As a Machine Learning Engineer you'll... ...work across the full applied ML stack - deploying models, building the evaluation systems that tell us whether they actually... ...Improve our MLOps foundations - versioning, observability,...FoundationWork at officeWork from homeHome office
- CSC Generation is the AI-native holding company re-engineering omnichannel retail. We acquire... ...building closed-loop decision systems that use machine learning... ..., update policies, evaluate challengers, and deploy within... ...challenger systems Production ML infrastructure, monitoring...SeniorWork at officeImmediate start
- ...Responsibilities As a senior Machine Learning Systems Engineer on the Search... ...to-end delivery of ML components from experimentation... ...monitoring and evaluation harnesses.Agentic... ...with Rovo and AI platform teams to... ...infrastructure as a foundational layer for AI agents...SeniorWork at officeLocal area
$112k - $269k
SummaryYelp engineering culture is driven by our values... ...Machine Learning (ML) and Artificial Intelligence (AI) to scale across a... ...to enhance our systems. You’ll be responsible... ...engineering and evaluation.A Bachelor’s Degree... ...and our product. The foundation of our diversity...SeniorFoundationWork experience placementLocal areaRemote work$132k - $165k
CreatorIQ is the operating system for creator‑led growth... .... Machine Learning Engineer, Applied AI As a MLE you’ll join... ...the full applied ML stack — deploying models, building evaluation systems, and making data... ...pipelines. Improve our MLOps foundations—versioning,...FoundationWork from homeHome office$124k - $242k
...reimagining how work gets done. Engineers define intent, author... ..., and orchestrate AI agents that execute at... ...by solving complex systems challenges, excited to... ...enterprise technology. Senior Principal Thermal Engineer... ...and cold platesStrong foundation in heat transfer, thermodynamics...SeniorFoundationRelocation package- A leading data platform company in Austin is seeking a Senior Systems Engineer to contribute to our growth in the AI era. The role involves assisting customers with evaluations and system installations while collaborating with R&D on product requirements. Ideal candidates...Senior
- ...harness the power of AI and shape the future of... ...team is building the foundation for AI-native enterprise... ...connected third-party systems. The work sits at... ...assembly, orchestration, evaluation, observability, secure... ...combining strong engineering standards, AI-native development...SeniorFoundationFull timeTemporary workCasual workWorldwideFlexible hours
- ...The Senior AI/ML Engineer will design, develop, and deploy scalable AI-enabled solutions that enhance and automate Statistical Programming... ..., prompt and model versioning, validation rules, automated evaluation, regression testing, and quality checks of AI-generated artifacts...Senior
- ...Neurophos The demand for new data centers and AI compute is rapidly outpacing the planet's... ...seeking an experienced machine learning engineer to develop advanced post-training... ...models (LLMs), diffusion models, and other ML applications for our revolutionary optical...SeniorFull time
- ...possible with today’s search systems and this role is intended... ...search and discovery for AI. You'll lead the search and ML architecture that powers... ...systems standards: model evaluation, shadow traffic testing,... ...and elevate senior engineers across Search Serving; raise...SeniorWork at officeLocal area
$95k - $105k
...world-class end-to-end engineering solutions by leveraging... ...with by utilizing Gen AI or other machine learning... ...AI Engineer/ ML Engineer with python or... ...rapidly build prototypes to evaluate architecture What You... ...delivering NLP or LLM-based systems, with knowledge of...SeniorTemporary work- ...in Austin is seeking a Senior Software Architect to lead... ...of scalable agentic AI systems, spanning runtimes, inference, evaluation, and orchestration. You... ...leadership across research, engineering, product and... ...related fields, a strong AI foundation, deep distributed-systems...SeniorFoundation
$178.42k - $230.5k
...Description About Us The AI Cloud and Developer... ...the tools and services engineers here at GM use every... ...We are looking for a Senior Engineer with an extensive... ...your software and systems engineering skills to contribute... ...s technical roadmap by evaluating new tools and...SeniorFull timeWork experience placementLocal areaWork from homeRelocation packageFlexible hours- ...Ml Engineer We are seeking an ML Engineer to join our team developing an Enterprise Generative AI SaaS solution on AWS. In this role, you will be responsible for fine-tuning foundation models, prompt engineering, and optimizing algorithms for our generative AI platform...Foundation
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Systems Engineer - AI Evaluation Foundations. Be the first to apply!
Related searches
- machine learning engineer Austin, TX
- senior ml engineer Austin, TX
- machine learning ai engineer Austin, TX
- machine learning software engineer Austin, TX
- ai ml engineer Austin, TX
- computer vision machine learning engineer Austin, TX
- application system engineer Austin, TX
- system test engineer Austin, TX
- sr systems engineer Austin, TX
- software system engineer Austin, TX


