Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior ML Systems Engineer - AI Evaluation Foundations

$144.7k - $261.3k

General Motors

About the Team The Evaluation Foundations team, part of Embodied AI's Scaling Foundations, solves critical evaluation challenges for autonomous vehicle development. We engineer high-performance tools that identify top-performing models and partner with data-intensive ML teams to drive rapid innovation. Job Description About the Team The Evaluation Foundations team, part of Embodied AI's Scaling Foundations, solves critical evaluation challenges for autonomous vehicle development. We engineer high-performance tools that identify top-performing models and partner with data-intensive ML teams to drive rapid innovation. Why Join Us? Develop introspection and evaluation tools capable of processing billions of examples to extract maximum value from our large-scale datasets. Join a high-impact team of engineers and machine learning scientists leveraging advanced AI to drive L2, L3, and L4 autonomous vehicle innovation. Directly influence the safety, reliability, and scalability of next-generation autonomous systems. About The Role As a Senior Engineer in the Embodied AI Scaling Foundations organization, you will be a key technical contributor on the team that measures and visualizes AV model performance. You will work across the stack to design, implement, and iterate on evaluation and introspection tools used by Embodied AI and adjacent GM AV teams In this role you will: Build and improve high-quality evaluation signal and introspection tools that help shorten the experimental path towards the best model. Develop and maintain visualization and metrics presentation within our model evaluation loop. Help teams introspect model behavior and reach actionable next steps with fewer manual steps. Participate in design and code reviews and work with Data, Infra, and validation teams to connect offline evaluation with real-world behavior. You will collaborate closely with modeling and data scaling teams working on our Compound AI driving models to design and implement evaluation workflows at scale with model-based metrics, end-to-end simulation, and tooling that connects evaluation signals back to data, training, and launch decisions. Your work contributes to a cohesive evaluation flywheel: better signal -> better data and training decisions -> better models -> better signal. Your Skills & Abilities (Required Qualifications) 3+ years of relevant industry experience Familiarity and experience with at least some of the following key technologies: Backend: Python, node.js, high-throughput data streaming. Frontend: React/TypeScript, WebGL/WebGPU (for 3D sensor visualization), Streamlit, Jupyter notebooks. Data/Infra: Spark for stream processing, BigQuery, Kubernetes. Strong communication skills and ability to collaborate effectively across engineering partners. Bachelor's degree in Computer Science or related field or equivalent experience What Will Give You A Competitive Edge (Preferred Qualifications) Previous experience in Robotics or Autonomous Driving 5+ years of relevant industry experience Master's or PhD degree in Computer Science or related field or equivalent experience Experience shipping production software and iterating quickly in a "startup within an enterprise" environment. Compensation The salary range for this role: is $144,700 to $261,300. The actual base salary a successful candidate will be offered within this range will vary based on factors relevant to the position. Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance. Benefits: GM offers a variety of health and wellbeing benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more.

#GM-AV-1

This role is based remotely, but if the selected candidate lives within a specific mile radius of a GM hub, they will be expected to report to the location three times a week {or other frequency dictated by your manager}. The selected candidate will be required to travel About GM Our vision is a world with Zero Crashes, Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better, safer and more equitable for all. Why Join Us We believe we all must make a choice every day - individually and collaboratively - to drive meaningful change through our words, our deeds and our culture. Every day, we want every employee to feel they belong to one General Motors team. Benefits Overview From day one, we're looking out for your well-being - at work and at home - so you can focus on realizing your ambitions. Learn how GM supports a rewarding career that rewards you personally by visiting Total Rewards resources . Non-Discrimination and Equal Employment Opportunities (U.S.) General Motors is committed to being a workplace that is not only free of unlawful discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that providing an inclusive workplace creates an environment in which our employees can thrive and develop better products for our customers. All employment decisions are made on a non-discriminatory basis without regard to sex, race, color, national origin, citizenship status, religion, age, disability, pregnancy or maternity status, sexual orientation, gender identity, status as a veteran or protected veteran, or any other similarly protected status in accordance with federal, state and local laws. We encourage interested candidates to review the key responsibilities and qualifications for each role and apply for any positions that match their skills and capabilities. Applicants in the recruitment process may be required, where applicable, to successfully complete a role-related assessment(s) and/or a pre-employment screening prior to beginning employment. To learn more, visit How we Hire . Accommodations General Motors offers opportunities to all job seekers including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, email us or call us at View phone number on click.appcast.io. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying. #J-18808-Ljbffr General Motors

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior ML Systems Engineer - AI Evaluation Foundations in Seattle, WA vacancy
  • $176.76k - $232k

     ...The Enterprise Data & AI team is a strategic...  ...trusted unified data foundation, advanced analytics capabilities...  ...As a Senior AI/ML Engineer, you will lead the delivery...  ..., implement rigorous evaluation frameworks, and design...  ...to architectures and system design for serving AI... 
    Senior
    Foundation
    Permanent employment
    Contract work
    Part time
    Work visa

    lululemon

    Seattle, WA
    1 day ago
  • Senior Field ML Engineer We're looking for our first Senior Field ML...  ..., train, and deploy AI models using Oumi's platform...  ...loves both building systems and helping others...  ..., fine-tune, and evaluate modern LLMs and other...  ...or fine-tuning modern foundation models (e.g., LLMs, diffusion... 
    Senior
    Foundation
    Remote work

    Oumi

    Bellevue, WA
    2 days ago
  • $185.6k - $255k

     ...across a dozen systems, half of it contradicts...  ...; it's the foundation everything else...  ...Amperity as an AI-first company-...  ...waiting on an engineering queue. The bet...  ...At Amperity, ML Engineers work...  ...accountable teams. As a Senior ML Engineer,...  ...post-mortems. Evaluate MLOps tooling... 
    Senior
    Foundation
    Work at office
    Local area
    Remote work

    Amperity

    Seattle, WA
    5 days ago
  • $175k - $308.5k

     ...at the forefront of ML infrastructure and generative AI, where data and...  ...services. We build robust systems that connect...  ...embeddings (generation, evaluation, ANN search,...  ...We’re looking for engineers and researchers passionate...  ..., including foundation models, multimodal... 
    Senior
    Foundation
    Relocation
    Flexible hours

    Apple

    Seattle, WA
    1 day ago
  • $185k - $235k

     ...powered by advanced AI, recommendation systems, and adtech....  ...every downstream ML model performs: better...  ...for an experienced Senior Machine Learning Engineer to design and...  ...training, offline/online evaluation, deployment,...  ...prototyping). ~ Strong foundation in machine... 
    Senior
    Foundation
    Full time
    Local area
    Work from home

    NewsBreak

    Bellevue, WA
    3 days ago
  • $160k - $220k

     ...be at the forefront of AI-driven advertising...  ...Cognitiv’s real-time bidding systems and be accountable for...  ...within a well-defined foundation, with meaningful...  ...working relationships with engineering teammates and cross-...  ...Performance is evaluated based on: Outcomes... 
    Senior
    Foundation
    Full time
    Work from home

    Cognitiv

    Bellevue, WA
    1 day ago
  • $175k - $200k

    Senior Machine Learning Engineer Truveta is the world’s first health provider...  ...wave of healthcare AI — developing adaptive agentic systems and fine-tuned foundation models that...  ...engineering. You’ll blend ML craftsmanship with...  .... Understand evaluation deeply — fluent in... 
    Senior
    Foundation
    For contractors
    Visa sponsorship
    Work visa
    Flexible hours

    Truveta

    Seattle, WA
    2 days ago
  •  ...VTI Aerospace builds AI-powered perception and...  ...WA, we are a team of engineers and technologists from...  ...The Role As a Senior Software Engineer – Evaluation, you will design and implement systems that measure and monitor...  ...and collaborate with ML engineers to improve training... 
    Senior

    VTI Aerospace

    Seattle, WA
    24 days ago
  • $213.76k - $280.55k

     ...The Enterprise Data & AI team is a strategic and operational...  ...of a trusted unified data foundation, advanced analytics...  ...responsibilities As a Senior Manager, AI/ML Engineering, you lead a team of AI/ML...  ...produces production-grade AI/ML systems that drive measurable... 
    Senior
    Foundation
    Permanent employment
    Part time
    Work visa

    lululemon

    Seattle, WA
    3 days ago
  •  ...Join us! About the Role We’re looking for a Senior Design Systems Engineer II to shape and scale the visual and interaction foundations of Blink’s digital ecosystem. You’ll...  .... Technical Expertise Expert use of modern AI-assisted tools (e.g., Cursor, GitHub Copilot... 
    Senior
    Foundation

    Blink Health LLc

    Seattle, WA
    6 days ago
  • $184.7k - $324.8k

     ...Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference Santa Clara,...  ...California, United States Machine Learning and AI We are the Foundation Model...  ...with the largest foundation models.Our systems serve billions of queries daily across... 
    Senior
    Foundation
    Worldwide
    Relocation

    Apple

    Seattle, WA
    1 day ago
  • $184.5k

     ...Team Layla is an AI-native travel-...  ...team is small and senior by design and operates...  ...As a Senior AI / ML Data Engineer, you will build the data foundations that power Layla’s...  ...and evaluation support that let the...  ...and improve AI/ML systems in production with... 
    Senior
    Foundation

    Expedia Group

    Seattle, WA
    1 day ago
  •  ...is where embodied AI meets real robots,...  ...reliable, field-ready AI systems that solve the...  ...rigorous engineering with learning systems...  ...are seeking a Staff ML Systems Engineer to...  ..., model training, evaluation, and post-processing...  ...lab. Our Field Foundational Models™ raise the... 
    Local area

    FieldAI

    Seattle, WA
    23 days ago
  • $182k - $242k

     ...The Essential Cloud for AI™. Built for pioneers by...  ...’re looking for strong engineers with great taste. The...  ...experience with modern ML frameworks such as PyTorch...  ...Experience developing, evaluating, and deploying machine...  ...scale model training systems Experience leading technically... 
    Senior
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Bellevue, WA
    1 day ago
  •  ...Own end-to-end systems and infrastructure...  ...scalable training, evaluation, inference, and serving...  ...direction, raise engineering standards, and...  ...experience across the ML lifecycle,...  ...search experience, foundation model serving, agentic...  ..., and responsible AI or privacy-preserving... 
    Senior
    Foundation
    Full time
    Work at office
    Remote work

    Axon

    Seattle, WA
    23 days ago
  • $168.1k - $227.4k

    Alexa AI is building the next generation of...  ...future is agentic: LLM systems that reason and act...  ..., the harness, the evaluation infrastructure, and...  ...We are looking for a Senior Machine Learning Engineer to build and own...  ...will take one of its foundational areas - agentic evaluation... 
    Senior
    Foundation
    Internship
    Flexible hours
    Day shift

    Amazon

    Bellevue, WA
    3 days ago
  • $203k - $258.6k

     ...TeamThe Cisco AI Research team brings...  ...learning engineers, data engineers...  ...large-scale data systems, and networking...  ...Your ImpactAs a Senior Machine...  ...improve the data and ML systems that power...  ...training and evaluation data at scale....  ...Strong technical foundation in distributed... 
    Senior
    Foundation
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours
    Shift work

    CISCO Systems

    Seattle, WA
    3 days ago
  •  .... Design and calibrate evaluation systems for model, prompt, and agent...  ...Apply physics-informed ML and enterprise AI expertise to client engagements...  ...practices, mentor engineers, and maintain architectural...  ...reliability engineering, or the seniority to build the practice from... 
    Senior
    Full time
    Remote work
    Flexible hours

    AZX

    Seattle, WA
    23 days ago
  •  ...passionate about Generative AI and excited to work on...  ...of Multimodal Foundation Models, Efficient and Scalable ML Infrastructure, and Personalized...  ...Experiences. As a senior machine learning engineer on our team, you will design software systems and algorithms that enable... 
    Senior
    Foundation
    Flexible hours

    Apple

    Seattle, WA
    4 days ago
  • $174k - $299k

     ...are looking for experienced and innovative ML engineers with an entrepreneurial mindset to be...  ...the technical team pioneering in advance AI engineering for e-commerce scenarios at Coupang...  ...and implement high-quality algorithms / systems independently Ability to dive deep into... 
    Senior
    Foundation
    Temporary work
    Flexible hours

    Coupang

    Seattle, WA
    4 days ago
  •  ...is where embodied AI meets real robots,...  ...reliable, field-ready AI systems that solve the...  ...rigorous engineering with learning systems...  ...This Role Modern ML systems improve through...  ...are retrained and evaluated, and the resulting...  ...lab. Our Field Foundational Models™ raise the... 
    Senior
    Local area

    FieldAI

    Seattle, WA
    3 days ago
  •  ...development of a multi-modality foundation model to drive the next...  ...of autonomous system intelligence. As a Machine...  ...System Optimization Engineer, you will orchestrate...  ..., you will optimize ML models, write custom CUDA...  ...-level programming for AI accelerators, specifically... 
    Senior
    Foundation
    Temporary work
    Relocation package

    Zoox

    Seattle, WA
    22 days ago
  • $135.2k - $306.4k

     ...Masters, or Ph.D. in Computer Science, AI/ML, Engineering, or a related discipline, or...  ...substantial ownership of production systems, or equivalent Senior Staff / Principal-level impact....  ...handling, RAG, memory, tool safety, and evaluation. We require strong programming ability... 
    Senior
    Full time
    Flexible hours

    Oracle

    Seattle, WA
    4 days ago
  • $182.4k - $247k

     ...A leading data and AI company in Bellevue is seeking a Software Engineer to join their Runtime team. You will build the...  ...data storage and processing systems that outperform traditional SQL...  ...Scala, or C++, along with a solid foundation in algorithms and distributed systems... 
    Senior
    Foundation

    Menlo Ventures

    Bellevue, WA
    2 days ago
  • $228.7k - $306.7k

    Senior Principal Machine Learning Engineer, Ad Platforms Technology is at the heart of...  ...the technological foundation and consumer media touch...  ...of software and systems including Machine Learning and AI patterns, platforms and...  ...unblock and guide our ML and Research teams to... 
    Senior
    Foundation
    Work experience placement

    Disney

    Seattle, WA
    4 days ago
  • Senior Data Scientist - Advanced Machine Learning & AI Location: Seattle, WA / Remote...  ...GCP, GenAI, ML, AI, VertexAI...  ...have a strong foundation in cutting-edge...  ...-making systems. Design end-to...  ...Collaborate with data engineers and product...  ...engineering, and model evaluation techniques.... 
    Senior
    Foundation
    H1b
    Remote work

    Kaav Inc.

    Seattle, WA
    4 days ago
  • $141.9k - $190.3k

     ...global organization of engineers, product developers...  ...the technological foundation and consumer media...  ...time. As a Senior Machine Learning Engineer...  ...software and apply ML solutions where...  ...across teams and systems. An understanding...  ...using automated tools (AI) while adhering to... 
    Senior
    Foundation
    Work experience placement
    Work at office

    Disney Entertainment and ESPN Product & Technology Careers

    Seattle, WA
    3 days ago
  • Rex.zone is hiring a Senior Data Annotator to produce and review high-quality training data for AI systems across NLP, computer vision, and multimodal evaluation. This is a Remote, full-time role focused on annotation guidelines compliance, content safety labeling, and... 
    Senior
    Remote job
    Full time

    Rex.zone

    Seattle, WA
    6 days ago
  • $146.83k - $192.72k

     ...The Enterprise Data & AI team is a strategic and...  ...trusted unified data foundation, advanced analytics capabilities...  ...As an AI/ML Engineer, you will contribute to...  ...implementation of AI/ML systems across the full model...  ...model training through evaluation, deployment, and production... 
    Foundation
    Permanent employment
    Part time
    Work visa

    lululemon

    Seattle, WA
    3 days ago
  • $172.5k - $260.1k

     ...Category Software Engineering Job Details...  ...Salesforce is the #1 AI CRM, where humans...  ...The Metrics Foundations team is part of Slack...  ...Experience As a Senior Data Engineer, you...  ...pipelines, and metric systems that provide...  ...recruiters assess and evaluate candidates’... 
    Senior
    Foundation

    Salesforce

    Seattle, WA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior ML Systems Engineer - AI Evaluation Foundations. Be the first to apply!