Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior ML Systems Engineer - AI Evaluation Foundations

$144.7k - $261.3k

General Motors Proving Ground

Job DescriptionAbout the TeamThe Evaluation Foundations team, part of Embodied AI's Scaling Foundations, solves critical evaluation challenges for autonomous vehicle development. We engineer high-performance tools that identify top-performing models and partner with data-intensive ML teams to drive rapid innovation.Why Join Us?Develop introspection and evaluation tools capable of processing billions of examples to extract maximum value from our large-scale datasets.Join a high-impact team of engineers and machine learning scientists leveraging advanced AI to drive L2, L3, and L4 autonomous vehicle innovation.Directly influence the safety, reliability, and scalability of next-generation autonomous systems.About the RoleAs a Senior Engineer in the Embodied AI Scaling Foundations organization, you will be a key technical contributor on the team that measures and visualizes AV model performance. You will work across the stack to design, implement, and iterate on evaluation and introspection tools used by Embodied AI and adjacent GM AV teams In this role you will:Build and improve high-quality evaluation signal and introspection tools that help shorten the experimental path towards the best model.Develop and maintain visualization and metrics presentation within our model evaluation loop.Help teams introspect model behavior and reach actionable next steps with fewer manual steps.Participate in design and code reviews and work with Data, Infra, and validation teams to connect offline evaluation with real-world behavior.You will collaborate closely with modeling and data scaling teams working on our Compound AI driving models to design and implement evaluation workflows at scale with model-based metrics, end-to-end simulation, and tooling that connects evaluation signals back to data, training, and launch decisions.Your work contributes to a cohesive evaluation flywheel: better signal better data and training decisions better models better signal.Your Skills & Abilities (Required Qualifications)3+ years of relevant industry experienceFamiliarity and experience with at least some of the following key technologies:Backend: Python, node.js, high-throughput data streaming.Frontend: React/TypeScript, WebGL/WebGPU (for 3D sensor visualization), Streamlit, Jupyter notebooks.Data/Infra: Spark for stream processing, BigQuery, Kubernetes.Strong communication skills and ability to collaborate effectively across engineering partners.Bachelor's degree in Computer Science or related field or equivalent experienceWhat Will Give You A Competitive Edge (Preferred Qualifications) Previous experience in Robotics or Autonomous Driving5+ years of relevant industry experienceMaster's or PhD degree in Computer Science or related field or equivalent experienceExperience shipping production software and iterating quickly in a "startup within an enterprise" environment.Compensation: The compensation information is a good faith estimate only. It is based on what a successful applicant might be paid in accordance with applicable state laws. The compensation may not be representative for positions located outside of New York, Colorado, California, or Washington. · The salary range for this role: is $144,700 to $261,300. The actual base salary a successful candidate will be offered within this range will vary based on factors relevant to the position. · Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance. · Benefits: GM offers a variety of health and wellbeing benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more.#GM-AV-1 This role is based remotely, but if the selected candidate lives within a specific mile radius of a GM hub, they will be expected to report to the location three times a week {or other frequency dictated by your manager}. The selected candidate will be required to travel <25% for this role. This job may be eligible for relocation benefits. About GMOur vision is a world with Zero Crashes, Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better, safer and more equitable for all.Why Join UsWe believe we all must make a choice every day – individually and collectively – to drive meaningful change through our words, our deeds and our culture. Every day, we want every employee to feel they belong to one General Motors team.Benefits OverviewFrom day one, we're looking out for your well-being–at work and at home–so you can focus on realizing your ambitions. Learn how GM supports a rewarding career that rewards you personally by visiting Total Rewards resources.Non-Discrimination and Equal Employment Opportunities (U.S.)General Motors is committed to being a workplace that is not only free of unlawful discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that providing an inclusive workplace creates an environment in which our employees can thrive and develop better products for our customers.All employment decisions are made on a non-discriminatory basis without regard to sex, race, color, national origin, citizenship status, religion, age, disability, pregnancy or maternity status, sexual orientation, gender identity, status as a veteran or protected veteran, or any other similarly protected status in accordance with federal, state and local laws. We encourage interested candidates to review the key responsibilities and qualifications for each role and apply for any positions that match their skills and capabilities. Applicants in the recruitment process may be required, where applicable, to successfully complete a role-related assessment(s) and/or a pre-employment screening prior to beginning employment. To learn more, visit How we Hire.AccommodationsGeneral Motors offers opportunities to all job seekers including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, emailus or call us at View phone number on click.appcast.io. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.SummaryLocation: Sunnyvale, California, United States of America; Remote - Washington; Austin, Texas, United States of America; Mountain View, California, United States of America; Warren, Michigan, United States of AmericaType: Full time

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior ML Systems Engineer - AI Evaluation Foundations in Austin, TX vacancy
  • $174.9k - $261.3k

     ...the world! The Data Labeling Engineering team designs, builds, and...  ...engineering , data engineering , and AI/ML , defining the strategies,...  ...training data solutions at foundation-model scale . We partner closely...  ..., and direct impact on systems that unblock the next generation... 
    Senior
    Foundation
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Austin, TX
    2 days ago
  •  ...entity.About the Central AI OrgOur organization...  ...Conversational AI system that integrates seamlessly...  ....About the AI & ML Platform TeamOur team...  ...goal is to build the foundations to democratize AI and...  ...About This RoleAs a Senior ML System Engineer on the AI & ML Platform... 
    Senior
    Foundation
    Work at office
    Local area

    Atlassian

    Austin, TX
    3 days ago
  • $128.7k - $261.3k

     ...hardware and battery systems to intuitive design,...  ...driving? Join the Embodied AI Infra Foundation team at General...  ...every machine learning engineer working on our...  ...driverless vehicles.As a Senior ML Infra Engineer, you will...  ...model training and evaluation workflows across GM.Own... 
    Senior
    Foundation
    Full time
    Work at office
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Austin, TX
    4 days ago
  • $104k - $164k

     ...YOU'LL DOWe're looking for a Senior Lead Systems Engineer who's passionate about...  ...automation, software engineering, AI, and intelligent...  ...communicate and operate together. Evaluate architecture decisions with...  ...their businesses. Built on a foundation of composable intelligence,... 
    Senior
    Foundation
    Work at office
    Local area

    Braze

    Austin, TX
    2 days ago
  • $112k - $269k

    SummaryYelp engineering culture is driven by our values...  ...Machine Learning (ML) and Artificial Intelligence (AI) to scale across a...  ...to enhance our systems. You’ll be responsible...  ...engineering and evaluation.A Bachelor’s Degree...  ...and our product. The foundation of our diversity... 
    Senior
    Foundation
    Work experience placement
    Local area

    Yelp

    Austin, TX
    2 days ago
  • Senior Machine Learning Engineer Hybrid At Cloudflare, we are on...  ...problem and the AI-native curiosity...  ...large-scale data systems, own the company...  ...our unified AI/ML platform, designing...  ...reviews, evaluating build-vs-buy decisions...  ...up platform foundations. Experience mentoring... 
    Senior
    Foundation
    Local area

    Cloudflare Inc

    Austin, TX
    2 days ago
  •  ...the Role:We are seeking a Senior Machine Learning Engineer to support our Public Sector...  ...production ready AI systems for secure and distributed...  ...applications.Engineer adaptive ML systems using LoRA, PEFT,...  ...have put in place as the foundation on which we operate as a team... 
    Senior
    Foundation
    Full time
    Live out
    Work at office
    Local area

    webAI

    Austin, TX
    1 day ago
  • $170.6k - $261.3k

     ...next-generation mapping systems that move beyond...  ...automated, algorithmic and ML-assisted map...  ...systems form a critical foundation for localization, perception...  ...are looking for a Senior Software Engineer to design and build...  ...training or fine-tuning, evaluation, and deployment.... 
    Senior
    Foundation
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Austin, TX
    4 days ago
  •  ...“normalized” problem and the AI-native curiosity to create a...  ...worldwide. Working alongside AI/ML engineers, hardware partners, and...  ...hard problems in distributed systems and high-performance computing...  ...engineers who are energized by foundational infrastructure problems and want... 
    Senior
    Foundation
    Local area
    Worldwide

    Cloudflare

    Austin, TX
    3 days ago
  • $128.4k - $192.5k

     ...opportunity Our AI, Data & Engineering team helps apply...  .... As a Senior AI Engineer, you...  ...AI, and agentic systems that learn, reason...  ...responsibly engineered, evaluated, deployed, and maintained...  ...production AI/ML solutions on a...  ...# Proficient in foundation models,... 
    Senior
    Foundation
    Full time
    Work experience placement
    Immediate start

    EY

    Austin, TX
    1 day ago
  •  ...NVIDIA Corporation in Austin, TX is seeking a Senior Software Engineer to build accelerated PyTorch-based solutions for large-scale ML models. You will work on GNNs, TFMs, and ensemble models, advancing training and inference on GPU infrastructure. You will collaborate... 
    Senior

    Jobleads-US

    Austin, TX
    3 days ago
  •  ...'normalized' problem and the AI-native curiosity to create a...  ...end. That includes the data foundation underneath it and the signals...  ...ones that span many teams and systems. You'll drive them to delivery...  ...smoother. The work is a mix of data engineering, full‑stack product, and... 
    Senior
    Foundation
    Temporary work
    Local area
    Flexible hours

    Cloudflare

    Austin, TX
    5 days ago
  •  ...DescriptionThe RoleWe're looking for a Senior Design Engineer to help evolve and scale our enterprise design system for the web. In this role,...  ...needed to support AI-assisted design and development...  ...formats with Storybook as the foundation.Your Skills & AbilitiesA bachelor... 
    Senior
    Foundation
    Full time
    Work experience placement
    Local area
    Work from home
    Flexible hours

    General Motors

    Austin, TX
    2 days ago
  •  ...service teams work. Their AI technology captures...  ...production‑grade ML systems with end‑to‑end ownership...  ...functional teams to shape the foundations of the AI stack,...  ...experience in ML engineering. Strong programming skills...  ...model training and evaluation. Familiarity with FastAPI... 
    Foundation
    Full time

    Catalyst Labs

    Austin, TX
    2 days ago
  •  ...protect how people, data, and AI agents connect across...  ...execution and impactThe RoleAs a Senior Site Reliability Engineer at Proofpoint you will...  ..., and tuning in systems, networking, and cloud services...  ...Experience with industry-standard foundation technologies such as TCP/... 
    Senior
    Foundation
    Full time
    Flexible hours

    Proofpoint

    Austin, TX
    5 days ago
  • $124k - $280k

     ...people in data and analytics engineering focus on leveraging advanced...  ...and implementing advanced AI and ML solutions to drive innovation...  ...optimising algorithms, models, and systems to enable intelligent...  ...closely with team members. We evaluate these factors thoughtfully... 
    Senior
    Full time
    H1b

    PwC

    Austin, TX
    3 days ago
  • $127k - $249k

    The TeamPlatform Engineering sits within SRE and builds...  ...multi-cloud Kubernetes foundation to automated deployment...  ...seeking a talented Senior Site Reliability Engineer...  ..., distributed systems, and automation to ensure...  ...data platform for the AI era, enabling builders... 
    Senior
    Foundation
    Local area
    Remote work
    Worldwide
    Flexible hours

    MongoDB

    Austin, TX
    5 days ago
  • $178.42k - $230.5k

     ...DescriptionAbout UsThe AI Cloud and Developer Infrastructure...  ...the tools and services engineers here at GM use every...  ...are looking for a Senior Engineer with an...  ...Using your software and systems engineering skills to contribute...  ...s technical roadmap by evaluating new tools and... 
    Senior
    Full time
    Work experience placement
    Local area
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Austin, TX
    3 days ago
  •  ...role serves as a senior analytics partner...  ...including Product, Engineering, Finance, Industry...  ...leadership.Cutting-Edge "AI-Enabled Analytics"...  ...will serve as a foundational anchor for a newly...  ...Data Engineering, ML Engineering, and...  ...tooling evolves: evaluate new AI... 
    Senior
    Foundation
    Work at office
    Local area

    Realtor.com

    Austin, TX
    2 days ago
  • $135k - $162k

     ...InformationJob TitleSenior AI/ML Engineering ManagerJob ID108808Work AreasTechnology...  ...RAG and retrieval systems. You manage and develop a team...  ..., serving, retrieval, and evaluation workstreams; balance feature...  ...work with clear ownership.Grow senior engineers into technical... 
    Senior
    Full time
    Work at office
    Local area
    Immediate start

    Bain & Company

    Austin, TX
    2 days ago
  • $133.1k - $236.4k

    Senior Data Scientist, ML— Fraud Detection & EffectivenessThe...  ...experimentation, evaluation, and analytics to...  ....Partner across engineering, product, policy,...  ...ML models.Strong foundation in statistical and...  ...or human-review systems.Familiarity with LLMs and AI-assisted evaluation... 
    Senior
    Foundation
    Full time
    Temporary work
    Work at office
    Local area
    Worldwide
    3 days per week

    Adobe Systems

    Austin, TX
    2 days ago
  •  ...solutions harness the power of AI and shape the future of...  ...software, and platform engineering, you'll help build scalable systems that support intelligent...  ...you want to shape the foundation of AI-powered...  ...TeamViewer products.Build evaluation and testing frameworks to... 
    Senior
    Foundation
    Temporary work
    Casual work
    Worldwide

    TeamViewer

    Austin, TX
    5 days ago
  •  ...Principal Machine Learning Engineer in the Confluence AI organization, you...  ...product design and evaluation strategy to...  ...product instinct and systems thinking. Success in...  ...evolve production-grade ML systems, evaluation...  ...teams.Help build the foundations that allow Confluence... 
    Foundation
    Work at office
    Remote work

    Atlassian

    Austin, TX
    2 days ago
  • $198k - $247.5k

     ...Forward Deployed Engineering (FDE) function sits...  ...within the Applied AI organization, and...  ...a specialized AI/ML engineering team focused...  ...AI and agentic systems solve real...  ...toolingExperience with foundation models, context engineering...  ...including evaluation, observability, serving... 
    Senior
    Foundation
    Full time
    Remote work
    Work from home
    Relocation

    Cloudera

    Austin, TX
    2 days ago
  •  ...propelled by the top engineers in mixed-signal...  ...which was built on a foundation of inclusion and...  ...a focus on risk evaluation and implementation...  ...protect information systems, data, and...  ...stakeholders and senior leadership.Required...  ...· Experience with AI security and governance... 
    Senior
    Foundation
    Full time
    Work at office
    Remote work
    Work visa
    2 days per week

    Cirrus Logic

    Austin, TX
    5 days ago
  • $173.9k - $235.2k

     ...the future of Generative AI at AWS? Join the team building the foundation of the world’s most...  ...breakthrough innovation in AI/ML and HPC workloads. If...  ...opportunity to build the systems that define what’s next...  ...a diverse AWS Hardware Engineering team of software, hardware... 
    Senior
    Foundation
    Internship
    Local area
    Flexible hours

    Amazon

    Austin, TX
    2 days ago
  •  ...entity. We are looking for a Senior Machine Learning Engineer to join our Confluence Cloud AI team. The Confluence...  ...working alongside experienced ML engineers and full-stack...  ..., experimentation, evaluation, deployment, and iteration.Design system and model architectures that... 
    Senior
    Work at office
    Local area

    Atlassian

    Austin, TX
    5 days ago
  • Senior Machine Learning Engineer, Matching & RecommendationsAt Bumble, we’re building...  ...help build and evolve the ML systems that power how members discover...  ...— from modeling and evaluation through deployment, monitoring...  ..., and responsible AI.What you’ll doBuild and deploy... 
    Senior
    Live in

    Bumble

    Austin, TX
    5 days ago
  •  ...Full-timeDepartment: Engineering & ProductAs a Senior Machine Learning...  ...refined data or internal ML/AI models can improve...  ...’ll own building, evaluating, and deploying your...  ...solutions across systems and ensure your...  ...shelf solutions (and foundational models) so we don’t... 
    Senior
    Full time
    Work at office

    Steadily

    Austin, TX
    5 days ago
  •  ...the-box communication systems for satellites, UAVs,...  ...We are looking for a Senior Machine Learning Engineer II to contribute to...  ...and maintain robust ML applications that support...  ...data processing. Evaluate and curate relevant datasets...  ...intelligence (AI) tools to support parts... 
    Senior
    Permanent employment
    Full time
    Contract work
    Work experience placement
    Local area

    CesiumAstro

    Austin, TX
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior ML Systems Engineer - AI Evaluation Foundations. Be the first to apply!