Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Systems Engineer - Distributed AI & GPU

NVIDIA Gruppe

NVIDIA is seeking a talented Machine Learning Engineer to drive end-to-end lifecycle management of AI-powered systems across distributed infrastructure. You will deploy and scale models, manage GPU orchestration, and build automated testing and CI/CD pipelines using GitLab.

The role demands strong Python engineering skills, experience with Kubernetes, Ray, Slurm, and ML frameworks, and a track record of delivering production-grade AI workflows at scale in a fast-paced environment.

#J-18808-Ljbffr
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the ML Systems Engineer - Distributed AI & GPU in Santa Clara, CA vacancy
  •  ...Annapurna Labs, part of AWS, seeks an experienced Software Development Engineer to build distributed AI/ML systems. You’ll work on collective operations across accelerators and servers, with a focus on C/C++, Linux, kernels, and high-performance code. Embedded experience... 
    Suggested

    Amazon

    Cupertino, CA
    2 days ago
  •  ...Cogniify, Inc. is seeking a Software Engineer, AI/ML Systems to build, evaluate and deploy AI-powered applications and services. This hands...  ...production Python development, AI model evaluation, distributed deployment and automated testing. We are looking for someone... 
    Suggested

    Cogniify, Inc.

    Santa Clara, CA
    4 days ago
  •  ...Annapurna Labs, a core AWS team, seeks an experienced engineer to advance distributed AI/ML systems with a focus on collective operations that scale across multiple accelerators and servers. The role emphasizes a strong C/C++ foundation, Linux kernel knowledge, and high... 
    Suggested

    Annapurna Labs

    Cupertino, CA
    22 hours ago
  • $150k - $350k

     ...verification with agentic AI workflows. Our platform...  ...AI to assist engineers in RTL design, simulation...  ...Overview We are seeking an ML Systems Engineer to optimize...  ...the systems level—from GPU kernel execution to memory...  ..., batching strategies, distributed inference, or... 
    Suggested

    ScOp Venture Capital LLC.

    San Jose, CA
    4 days ago
  • $272k - $431.25k

    We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware Infrastructure...  ...in AI/ML and HPC tasks and systems.Hands-on experience in using or...  ...supervising and improving substantial distributed training operations using PyTorch (... 
    Suggested
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  •  ...ML Systems Research EngineerAdvance your career. Advance...  ...discovery to powering AI and the technologies people...  ...ML Systems Research Engineers to build the reinforcement...  ...usage must be balanced.Distributed experimentation, job...  ...management.Familiarity with GPU systems, ROCm/HIP, CUDA... 

    Advanced Micro Devices , Inc.

    Santa Clara, CA
    2 days ago
  • $174.9k - $261.3k

     ...the world!The Data Labeling Engineering team designs, builds, and operates...  ..., data engineering, and AI/ML, defining the strategies, tooling...  ..., and direct impact on systems that unblock the next generation...  ...of experience building robust distributed platforms and applications.... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    4 days ago
  • $150k

     ...nurture the next generation of AI builders, and drive...  ...economy. The Role The GPU Kernel Engineer will play a role at the forefront...  ...develop new and cutting-edge systems. The ideal candidate will have...  ...and optimization. Distributed training experience is a plus... 

    Institute of Foundation Models

    Sunnyvale, CA
    2 days ago
  •  ...Silicon Valley Physical AI research team of...  ...role Build the systems that make ambitious...  .... As our ML Systems owner, you...  ...observability Performance engineering: profile compute, memory...  ...time Responsible distributed execution: support...  ...compiler optimization and GPU/TPU/heterogeneous... 

    Neolix

    Sunnyvale, CA
    4 days ago
  •  ...scientific discovery to powering AI and the technologies people...  ...We are looking for a talented engineer to join our team: developing heterogeneous...  ...in a dynamic, geographically distributed agile team, where partnership...  ...Design, develop, and optimize GPU/CPU software for computer... 

    AMD

    Santa Clara, CA
    7 days ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows...  ...; over 10 times faster than GPU-based hyperscale cloud...  ...inference.Cerebras is seeking a Distributed Systems Security Engineer to help build out the next generation... 

    Cerebras Systems

    Sunnyvale, CA
    9 days ago
  •  ...Mind Robotics is hiring a Model Systems Engineer in Palo Alto to build core systems enabling fast, reliable training of large ML models and scalable production deployment. You will design distributed training stacks, optimize memory and compute usage, and partner with... 

    Mind Robotics

    Palo Alto, CA
    4 days ago
  •  ...Advanced Micro Devices, Inc. in San Jose, CA is seeking an Open Source Software Engineer to build and optimize ML systems that run on AMD hardware. You will bridge open source AI software with GPU systems, design, implement, test, and upstream contributions, working close... 

    Advanced Micro Devices , Inc.

    San Jose, CA
    22 hours ago
  •  ...NVIDIA AI in Santa Clara, CA is seeking an experienced software engineer to design and implement optimized GPU algorithms for large-scale vector search and ML workloads. You will drive performance analysis and contribute to open-source libraries. The role requires a CS... 

    NVIDIA AI

    Santa Clara, CA
    3 days ago
  •  ...Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows...  ...; over 10 times faster than GPU-based hyperscale cloud...  ...inference. Cerebras is seeking a Distributed Systems Security Engineer to help build out the next generation... 

    CEREBRAS SYSTEMS INC.

    Sunnyvale, CA
    23 hours ago
  • $220k - $250k

     ...Principal ML Systems Engineer – AI for QuantumLocation: Milpitas, California, United StatesJob Type: Full...  ....Design, implement, and optimize GPU/CUDA/C++ kernels for high-performance model training and inference.Build distributed training pipelines for multi-node GPU clusters... 
    Full time
    Visa sponsorship

    Quantum Jobs USA

    Milpitas, CA
    2 days ago
  • $169k - $338k

     ...WalmartBusiness Segment: Home OfficeAI/ML & Agentic Systems Technical Leadership:...  ...develop advanced agentic AI systems that can...  ...handle complex reliability engineering workflows, predictive failure...  ...and analysis of large-scale distributed systems across Walmart's entire... 
    Full time
    Temporary work
    Part time

    Walmart

    Sunnyvale, CA
    5 days ago
  • $152k - $241.5k

     ...hiring experienced software engineers with Kubernetes...  ...experience to help scale up its AI Infrastructure. We...  ...and working with GPU resource scheduling. We...  ...responsible for production systems that enable large scalable...  ...automating large-scale distributed systems independent of... 
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  • $193.3k - $261.5k

     ...performance for AWS's custom ML accelerators....  ...boundary, our engineers craft high-performance...  ...what's possible in AI acceleration.The...  ...performance computing, and distributed architectures,...  ...machine learning systems, you'll bring expertise...  ...- Experience with GPU kernel optimization... 
    Internship
    Local area
    Work from home
    Flexible hours

    Amazon

    Cupertino, CA
    4 days ago
  • $137k - $156k

     ...passionate, and committed engineers, technologists, and business...  ...seeking an experienced Senior Systems Engineer / GPU Platforms to support the...  ...GPU server systems used for AI, HPC, enterprise computing,...  ...and geographically distributed engineering teams.Comfortable... 
    Worldwide

    Super Micro Computer

    San Jose, CA
    8 days ago
  • $184.7k - $324.8k

     ...United States Machine Learning and AI Join the team redefining...  ...that evaluates Siri and AI/ML models at scale to delight and...  ...you are excited by large-scale systems, rigorous statistical evaluation...  ...Senior Machine Learning Engineer specializing in Conversational... 
    Relocation

    Apple Inc.

    Cupertino, CA
    4 days ago
  • $150.4k - $277.6k

     ...Services Apple’s Compute Frameworks team in GPU, Graphics and Displays org provides a...  ...machine learning and GPU programming engineers who are passionate about providing robust...  ...maintenance, and optimization. ~ Experience with system level programming and computer... 
    Relocation

    Apple Inc.

    Cupertino, CA
    4 days ago
  •  ...Micro Devices in San Jose, CA seeks a senior GPU compiler engineer to advance the Triton backend with native distributed execution. You will implement GPU-initiated communication...  ...architecture, compiler tech, and distributed systems, plus experience with Triton, CUDA, ROCm, and... 

    Advanced Micro Devices , Inc.

    San Jose, CA
    3 days ago
  •  ...Amazon Annapurna Labs is seeking a Sr. Software Engineer for AI/ML distributed training to design and optimize large-scale ML training on Trainium instances. You will enhance distributed frameworks and optimize mixed-precision training, working closely with hardware and... 

    Amazon

    Cupertino, CA
    4 days ago
  •  ...Amazon’s Annapurna Labs team within AWS Neuron Training seeks a Software Engineer to optimize distributed training on Trainium, tackling throughput across the Neuron stack and collaborating with PyTorch and JAX integrations. You will own parallelism strategies and help... 

    Amazon

    Cupertino, CA
    22 hours ago
  • $180k

     ...mission is to create AI systems that can accurately understand...  ..., and focused on engineering excellence. This...  ...ABOUT THE ROLE: As an ML Infrastructure Engineer...  ...building, and scaling GPU compute infrastructure...  ...production environments, distributed systems, GPU... 
    Temporary work
    Work experience placement

    Maven Ventures

    Palo Alto, CA
    4 days ago
  •  ...investing deeply in Generative AI — pioneering advanced...  ...Machine Learning Systems Engineer (P60) to lead technical...  ...ll Doð Design and Build ML SystemsArchitect and...  ...Nice to HaveBackground in distributed systems, high-performance computing, or GPU optimization.... 
    Work at office
    Local area

    Atlassian

    Mountain View, CA
    6 days ago
  • $153.2k - $234.1k

     ...hardware and battery systems to intuitive design, intelligent...  ...? Join the Embodied AI team at General Motors...  .... As a Senior ML Infra Engineer, you will work on the...  ...working on large-scale distributed systems, applications,...  ...training across large GPU/CPU clusters or specialized... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    6 days ago
  •  ...DescriptionAxiado is an AI-enhanced security...  ...management of every digital system. The company was founded...  ...'re looking for an ML engineer who works across the full...  ...inference performance on GPU/AI-accelerator...  ...performance — GPU clusters, distributed training, inference-serving... 

    Axiado Corporation

    San Jose, CA
    4 days ago
  •  ...From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at...  ...2027 WHAT YOU WILL BE DOING: We are seeking highly motivated ML System Engineering co-op to join our team. In this role - We will give you your... 
    Full time
    Summer work
    Internship
    Summer internship
    Worldwide

    Advanced Micro Devices , Inc.

    Santa Clara, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Systems Engineer - Distributed AI & GPU. Be the first to apply!