Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior ML Systems Engineer - AI Evaluation Foundations

$144.7k - $261.3k
Full-time

General Motors Proving Ground

Austin, TX

Description

About the Team

The Evaluation Foundations team, part of Embodied AI's Scaling Foundations, solves critical evaluation challenges for autonomous vehicle development. We engineer high-performance tools that identify top-performing models and partner with data-intensive ML teams to drive rapid innovation.

Why Join Us?

Develop introspection and evaluation tools capable of processing billions of examples to extract maximum value from our large-scale datasets.

Join a high-impact team of engineers and machine learning scientists leveraging advanced AI to drive L2, L3, and L4 autonomous vehicle innovation.

Directly influence the safety, reliability, and scalability of next-generation autonomous systems.

About the Role

As a Senior Engineer in the Embodied AI Scaling Foundations organization, you will be a key technical contributor on the team that measures and visualizes AV model performance. You will work across the stack to design, implement, and iterate on evaluation and introspection tools used by Embodied AI and adjacent GM AV teams In this role you will:

Build and improve high-quality evaluation signal and introspection tools that help shorten the experimental path towards the best model.

Develop and maintain visualization and metrics presentation within our model evaluation loop.

Help teams introspect model behavior and reach actionable next steps with fewer manual steps.

Participate in design and code reviews and work with Data, Infra, and validation teams to connect offline evaluation with real-world behavior.

You will collaborate closely with modeling and data scaling teams working on our Compound AI driving models to design and implement evaluation workflows at scale with model-based metrics, end-to-end simulation, and tooling that connects evaluation signals back to data, training, and launch decisions.

Your work contributes to a cohesive evaluation flywheel: better signal → better data and training decisions → better models → better signal.

Your Skills & Abilities (Required Qualifications)

3+ years of relevant industry experience

Familiarity and experience with at least some of the following key technologies:

Backend: Python, node.js, high-throughput data streaming.

Frontend: React/TypeScript, WebGL/WebGPU (for 3D sensor visualization), Streamlit, Jupyter notebooks.

Data/Infra: Spark for stream processing, BigQuery, Kubernetes.

Strong communication skills and ability to collaborate effectively across engineering partners.

Bachelor's degree in Computer Science or related field or equivalent experience

What Will Give You A Competitive Edge (Preferred Qualifications) 

Previous experience in Robotics or Autonomous Driving

5+ years of relevant industry experience

Master's or PhD degree in Computer Science or related field or equivalent experience

Experience shipping production software and iterating quickly in a "startup within an enterprise" environment.

Compensation: The compensation information is a good faith estimate only. It is based on what a successful applicant might be paid in accordance with applicable state laws. The compensation may not be representative for positions located outside of New York, Colorado, California, or Washington.  

·   The salary range for this role: is $144,700 to $261,300. The actual base salary a successful candidate will be offered within this range will vary based on factors relevant to the position. 

·  Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance. 

·  Benefits: GM offers a variety of health and wellbeing benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more.

#GM-AV-1

This role is based remotely, but if the selected candidate lives within a specific mile radius of a GM hub, they will be expected to report to the location three times a week {or other frequency dictated by your manager}.

The selected candidate will be required to travel <25% for this role.

This job may be eligible for relocation benefits.

About GM

Our vision is a world with Zero Crashes, Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better, safer and more equitable for all.

Why Join Us 

We believe we all must make a choice every day – individually and collectively – to drive meaningful change through our words, our deeds and our culture. Every day, we want every employee to feel they belong to one General Motors team.

Total Rewards | Benefits Overview

From day one, we're looking out for your well-being–at work and at home–so you can focus on realizing your ambitions. Learn how GM supports a rewarding career that rewards you personally by visiting Total Rewards resources. 

Non-Discrimination and Equal Employment Opportunities (U.S.)

General Motors is committed to being a workplace that is not only free of unlawful discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that providing an inclusive workplace creates an environment in which our employees can thrive and develop better products for our customers.

All employment decisions are made on a non-discriminatory basis without regard to sex, race, color, national origin, citizenship status, religion, age, disability, pregnancy or maternity status, sexual orientation, gender identity, status as a veteran or protected veteran, or any other similarly protected status in accordance with federal, state and local laws. 

We encourage interested candidates to review the key responsibilities and qualifications for each role and apply for any positions that match their skills and capabilities. Applicants in the recruitment process may be required, where applicable, to successfully complete a role-related assessment(s) and/or a pre-employment screening prior to beginning employment. To learn more, visit How we Hire.

Accommodations

General Motors offers opportunities to all job seekers including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, email us or call us at Show phone number. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior ML Systems Engineer - AI Evaluation Foundations in Austin, TX vacancy
  •  ...Normalized" problem and the AI-native curiosity to...  ...We are looking for a Senior Systems Engineer to help build that...  ..., tests, harnesses, evaluation loops, operational...  ...Experience building AI/ML infrastructure, inference...  ....1.1 to help fix the foundation of the Internet by... 
    Senior
    Foundation
    Local area

    Worky

    Austin, TX
    12 hours ago
  •  ...Responsibilities As a senior Machine Learning Systems Engineer on the Search...  ...to-end delivery of ML components from experimentation...  ...monitoring and evaluation harnesses.Agentic...  ...with Rovo and AI platform teams to...  ...infrastructure as a foundational layer for AI agents... 
    Senior
    Work at office
    Local area

    Atlassian

    Austin, TX
    1 day ago
  • $112k - $269k

    SummaryYelp engineering culture is driven by our values...  ...Machine Learning (ML) and Artificial Intelligence (AI) to scale across a...  ...to enhance our systems. You’ll be responsible...  ...engineering and evaluation.A Bachelor’s Degree...  ...and our product. The foundation of our diversity... 
    Senior
    Foundation
    Work experience placement
    Local area
    Remote work

    Yelp

    Austin, TX
    3 days ago
  • $104k - $164k

     ...YOU'LL DOWe're looking for a Senior Lead Systems Engineer who's passionate about...  ...automation, software engineering, AI, and intelligent...  ...communicate and operate together. Evaluate architecture decisions with...  ...their businesses. Built on a foundation of composable intelligence,... 
    Senior
    Foundation
    Work at office
    Local area

    Braze

    Austin, TX
    3 days ago
  • Cloudflare is seeking a senior engineer to own the GTM-facing software and data products, spanning data foundations, signals, and multi-team coordination. You will drive complex...  ...the developer buying journey while applying AI to accelerate delivery and reliability in a... 
    Senior
    Foundation

    Cloudflare

    Austin, TX
    1 day ago
  •  ...the Role:We are seeking a Senior Machine Learning Engineer to support our Public Sector...  ...production ready AI systems for secure and distributed...  ...applications.Engineer adaptive ML systems using LoRA, PEFT,...  ...have put in place as the foundation on which we operate as a team... 
    Senior
    Foundation
    Full time
    Live out
    Work at office
    Local area

    webAI

    Austin, TX
    2 days ago
  •  ..."normalized" problem and the AI-native curiosity to create a...  ...worldwide. Working alongside AI/ML engineers, hardware partners, and...  ...hard problems in distributed systems and high-performance computing...  ...engineers who are energized by foundational infrastructure problems and want... 
    Senior
    Foundation
    Local area
    Worldwide

    Cloudflare

    Austin, TX
    3 days ago
  •  ...“normalized” problem and the AI-native curiosity to create a...  ...worldwide. Working alongside AI/ML engineers, hardware partners, and...  ...hard problems in distributed systems and high-performance computing...  ...engineers who are energized by foundational infrastructure problems and want... 
    Senior
    Foundation
    Local area
    Worldwide

    Webhosting

    Austin, TX
    1 day ago
  •  ...“normalized” problem and the AI-native curiosity to create a...  ...end. That includes the data foundation underneath it and the signals...  ...ones that span many teams and systems. You’ll drive them to delivery...  ...smoother. The work is a mix of data engineering, full-stack product, and... 
    Senior
    Foundation
    Local area

    Webhosting

    Austin, TX
    1 day ago
  •  ...service teams work. Their AI technology captures...  ...production‑grade ML systems with end‑to‑end ownership...  ...functional teams to shape the foundations of the AI stack,...  ...experience in ML engineering. Strong programming skills...  ...for model training and evaluation. Familiarity with... 
    Foundation
    Full time

    Catalyst Labs, LLC

    Austin, TX
    2 days ago
  • $77k - $202k

     ...for healthcare payers. As a Senior Associate, you will analyze...  ...years of experience in software engineering or data engineeringWhat Sets...  ...configuration- Designing AI agent systems for development workflows- Familiarity...  ...with team members. We evaluate these factors thoughtfully... 
    Senior
    Full time
    H1b

    PwC

    Austin, TX
    3 days ago
  • $132k - $165k

     ...CreatorIQ is the operating system for creator‑led growth...  .... Machine Learning Engineer, Applied AI As a MLE you’ll join...  ...across the full applied ML stack — deploying models, building evaluation systems, and making...  ...pipelines. Improve our MLOps foundations—versioning,... 
    Foundation
    Work from home
    Home office

    CreatorIQ

    Austin, TX
    1 day ago
  • $183k - $237k

     ...Job Description Senior Principal System Development Engineer Infrastructure Solutions...  ...specifications, and orchestrate AI agents that execute at...  ...• Prepare, review and evaluate the Diags, ONIE, BMC and...  ...Fluent in UEFI and EDKII foundation design and delivering generic... 
    Senior
    Foundation
    Flexible hours

    Dell

    Round Rock, TX
    2 days ago
  •  ...The Senior Data Engineer will be a core member of the team building...  ...warehouse first, AI-centric operating model...  ...this person will own system and technical...  ...architectural decisions, evaluating tradeoffs, and translating...  ...—or the technical foundation and curiosity to lead... 
    Senior
    Foundation

    H & A Resources, LLC

    Austin, TX
    1 day ago
  • AI/ML Engineer**** Please note: This role is not eligible...  ...NLP, Recommendation Systems, etc.* Stay updated on...  ...stakeholders.* Solid technical foundation, combined with...  ...with AI validation, evaluation, observability, and...  ...: $130,000-$159,000* Senior Consultant: $163,000-... 
    Foundation
    Temporary work
    Work at office
    Local area
    3 days per week

    Slalom

    Austin, TX
    2 days ago
  • $95k - $105k

     ...world-class end-to-end engineering solutions by leveraging...  ...with by utilizing Gen AI or other machine learning...  ...platformsAI Engineer/ ML Engineer with python or...  ...rapidly build prototypes to evaluate architectureWhat You...  ...NLP or LLM-based systems, with knowledge of multi... 
    Senior
    Temporary work

    Quest Global Services

    Austin, TX
    7 hours ago
  • $124k - $280k

     ...people in data and analytics engineering focus on leveraging advanced...  ...and implementing advanced AI and ML solutions to drive innovation...  ...optimising algorithms, models, and systems to enable intelligent...  ...closely with team members. We evaluate these factors thoughtfully... 
    Senior
    Full time
    H1b

    PwC

    Austin, TX
    4 days ago
  • $140.88k - $153.75k

    General Information Job Title Senior AI/ML Engineer Job ID 108807 Work Areas Technology...  ..., and rollback) and you build the evaluation harnesses, inference services, and...  ...set the standard for how production ML systems are built and mentor mid-level engineers... 
    Senior
    Permanent employment
    Full time
    Work at office
    Local area

    Bain & Company

    Austin, TX
    3 days ago
  • $178.42k - $230.5k

     ...DescriptionAbout UsThe AI Cloud and Developer Infrastructure...  ...the tools and services engineers here at GM use every...  ...are looking for a Senior Engineer with an...  ...Using your software and systems engineering skills to contribute...  ...s technical roadmap by evaluating new tools and... 
    Senior
    Full time
    Work experience placement
    Local area
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Austin, TX
    4 days ago
  • $178.42k - $230.5k

     ...Washington area.About UsThe AI Cloud and Developer...  ...the tools and services engineers here at GM use every...  ...RoleWe are looking for a Senior Engineer with an extensive...  ...’s technical roadmap Evaluate new tools and...  ...and operating production systems at scale in the cloud Bachelors... 
    Senior
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours
    3 days per week

    General Motors

    Austin, TX
    12 hours ago
  • Oracle in the United States is seeking a senior engineer to design, build, and scale bare-metal provisioning systems powering millions of servers worldwide. You will...  ...distributed systems challenges, and help deliver the foundation for OCI’s most performant compute services.... 
    Senior
    Foundation
    Worldwide

    Oracle

    Austin, TX
    1 day ago
  •  ...role serves as a senior analytics partner...  ...including Product, Engineering, Finance, Industry...  ...leadership.Cutting-Edge "AI-Enabled Analytics"...  ...will serve as a foundational anchor for a newly...  ...Data Engineering, ML Engineering, and...  ...tooling evolves: evaluate new AI... 
    Senior
    Foundation
    Work at office
    Local area

    Realtor.com

    Austin, TX
    2 days ago
  •  ...computing experiences—from AI and data centers, to...  ...gaming and embedded systems. Grounded in a...  ...ROLE: We are seeking a Senior Hardware Engineer to join the Data Center...  ...leader with a strong foundation in hardware design...  ...technology vendors to evaluate solutions, review designs... 
    Foundation

    AMD

    Austin, TX
    3 days ago
  • Drive Capital is looking for a Senior Systems Engineer in Austin, TX to support enterprise storage sales in large IT organizations. The role involves assisting customers with evaluations, working closely with R&D to define product requirements, and providing technical leadership... 
    Senior

    Drive Capital

    Austin, TX
    1 day ago
  •  ...performance computing, cloud, and AI. Whether you’re designing...  ...: AMD, Inc. is hiring SMTS Systems Design Engineer to Research, design,...  ...next generation initiatives. Evaluate all aspects of the process...  ...data center server systems foundations;Server system memory, storage... 
    Foundation

    AMD

    Austin, TX
    3 days ago
  • A leading data platform company in Austin is seeking a Senior Systems Engineer to contribute to our growth in the AI era. The role involves assisting customers with evaluations and system installations while collaborating with R&D on product requirements. Ideal candidates... 
    Senior

    VAST Data

    Austin, TX
    2 days ago
  •  ...solutions harness the power of AI and shape the future of...  ...software, and platform engineering, you'll help build scalable systems that support intelligent...  ...you want to shape the foundation of AI-powered...  ...TeamViewer products.Build evaluation and testing frameworks to... 
    Senior
    Foundation
    Temporary work
    Casual work
    Worldwide

    TeamViewer

    Austin, TX
    1 day ago
  • $198k - $247.5k

     ...Forward Deployed Engineering (FDE) at ClouderaCloudera...  ...the Applied AI organization, and...  ...a specialized AI/ML engineering team focused...  ...AI and agentic systems solve real...  ...toolingExperience with foundation models, context engineering...  ...including evaluation, observability, serving... 
    Senior
    Foundation
    Full time
    Remote work
    Work from home
    Relocation

    Cloudera

    Austin, TX
    4 days ago
  • $173.9k - $235.2k

     ...the future of Generative AI at AWS? Join the team building the foundation of the world’s most...  ...breakthrough innovation in AI/ML and HPC workloads. If...  ...opportunity to build the systems that define what’s next...  ...a diverse AWS Hardware Engineering team of software, hardware... 
    Senior
    Foundation
    Internship
    Local area
    Flexible hours

    Amazon

    Austin, TX
    3 days ago
  •  ...propelled by the top engineers in mixed-signal...  ...which was built on a foundation of inclusion and...  ...a focus on risk evaluation and implementation...  ...protect information systems, data, and...  ...stakeholders and senior leadership.Required...  ...· Experience with AI security and governance... 
    Senior
    Foundation
    Full time
    Work at office
    Remote work
    Work visa
    2 days per week

    Cirrus Logic

    Austin, TX
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior ML Systems Engineer - AI Evaluation Foundations. Be the first to apply!