Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Machine Learning Engineer — GPU Kernel

Full-time

ifm-us

About the Institute of Foundation Models

We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy.

As part of our team, you’ll have the opportunity to work on the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You will participate in the development of groundbreaking AI solutions that have the potential to reshape entire industries. Strategic and innovative problem-solving skills will be instrumental in establishing MBZUAI as a global hub for high-performance computing in deep learning, driving impactful discoveries that inspire the next generation of AI pioneers.

The Role

The GPU Kernel Engineer will play a role at the forefront of optimizing performance for the machine learning software stacks, especially at training and inference, and support the team to develop new and cutting-edge systems. The ideal candidate will have a strong background in parallel computing, and hands-on experience in system level coding, debug methodologies, and large-scale machine learning experience.

This role focuses on CUDA kernel development and optimization. Distributed training experience is a plus.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Machine Learning Engineer — GPU Kernel in Sunnyvale, CA vacancy
  • $150.4k - $277.6k

     ...s Compute Frameworks team in GPU, Graphics and Displays org provides...  ...algebra, image processing, machine learning, along with other projects of...  ...learning and GPU programming engineers who are passionate about...  ...years of experienceGPU compute kernel framework development,... 
    Suggested
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $193.3k - $261.5k

     ...used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia...  ....The Acceleration Kernel Library team is at the...  ...-software boundary, our engineers craft high-performance...  ...architectures- Experience with GPU kernel optimization and... 
    Suggested
    Internship
    Local area
    Work from home
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  • $184k - $287.5k

    We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance ceiling? Our LLM Inference Performance Analysis and Optimization team builds the answer from the ground up. We develop... 
    Suggested
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $184.7k - $324.8k

    Role Number: 200670239Team: Hardware, Machine Learning and AILocation: CupertinoPosted: 2026-...  ...all Apple products, and as a research engineer on our team, you will build the infrastructure...  ...custom ops in CUDA or low-level GPU kernel optimizationResearch experience in ML... 
    Suggested
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  •  ...speeds; over 10 times faster than GPU-based hyperscale cloud...  ...Core ML team develops novel machine learning algorithms that take advantage...  ...of the Cerebras Wafer-Scale Engine. Our work spans efficient LLM...  ...compilers, runtimes, and low-level kernels to implement new algorithmic... 
    Suggested

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $170.1k - $258.3k

     ...accessible mobility. For the AI Kernels & Compilers team, that mission...  ...development, and performance engineering so that every cycle on our...  ...team builds high‑performance GPU kernels and custom libraries that...  ...on realizing your ambitions. Learn how GM supports a rewarding career... 
    Full time
    Local area
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • $184k - $287.5k

     ...computing. An era where our GPU serves as the intelligence behind...  ...scale. We seek a Senior ML Engineer to compose and deliver next-...  ...proven experience in applied machine learning or AI research.Deep expertise...  ...CUDA, Triton, or low-level GPU kernel development for inference... 
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $17 - $98 per hour

     ...Interns Group > Interim Engineering Intern - SW General...  ...creativity, and continuous learning. Our programs provide...  ...Visibility" Role Overview As a Machine Learning / AI...  ...technologies, runtime systems, GPU acceleration, model...  ...architecture search, kernel optimization, Bayesian... 
    Hourly pay
    Interim role
    Summer work
    Internship
    Summer internship
    Work from home
    Relocation

    QUALCOMM, Inc.

    Santa Clara, CA
    2 days ago
  • $197.5k - $272k

     ...Edge. We are looking for a great Staff Machine Learning Engineer to join our seasoned AI team and lead...  ...process unstructured application logs, kernel traces, and multi-modalities.Integrate...  ...-grade models for execution on CPU/GPU-bound targets or embedded NPUs.Apply quantization... 
    Work at office
    Worldwide
    Flexible hours
    Shift work
    3 days per week

    Sonatus

    Sunnyvale, CA
    2 days ago
  • $244.14k - $413.16k

     ...through cutting-edge R&D in AI, machine learning, and smart connectivity....  ...Machine Learning Performance Engineer, you will own that speed: working...  ...— from the data path to kernels, parallelism and communication...  ...Hands-on experience optimizing GPU training or inference workloads... 
    Full time

    XPENG Motors

    Santa Clara, CA
    22 hours ago
  •  ...its fast-growing teams. We are seeking a highly skilled Machine Learning Engineer with deep expertise in developing Bird’s Eye View (BEV) fusion...  ...with distributed training, high-performance computing, or GPU acceleration. Your opportunities joining PlusAI Work,... 

    PlusAI

    Santa Clara, CA
    1 day ago
  • $272k - $431.25k

    We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware Infrastructure team. As an Engineer...  ...computing frameworks and paradigms.Dedication to ongoing learning and staying updated on new technologies and innovative... 
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $150k

     ..., data scientists, and engineers, tackling the most fundamental...  ...computing in deep learning, driving impactful...  ...across multi-node, multi-GPU clusters Own experiment...  ...with large-scale machine learning workloads (strong...  ...performance profiling, kernel fusion, or memory optimization... 
    Flexible hours

    Institute of Foundation Models

    Sunnyvale, CA
    10 days ago
  • $182k - $242k

     ...: CRWV) in March 2025. Learn more at  Our Team...  ...headaches of managing GPU infrastructure.  These...  ...'re looking for strong engineers with great taste. The most...  ...touch everything from CUDA kernels to high-performance LLM...  ...in Computer Science, Machine Learning, Robotics, or... 
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    a month ago
  • $184.7k - $324.8k

    Role Number: 200650849Team: Machine Learning and AILocation: CupertinoPosted: 2026-03-09SummaryAs...  ...for highly motivated, result-oriented engineers with a strong background in system...  ...years low-level programming2 years in GPU programmingExperience with open-source... 
    Worldwide
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $250k - $300k

     ...Senior Machine Learning Engineer Inference Job Summary For our client a fast-growing AI company building realtime voice and LLM technology...  ...how our clients models run in production inference engines GPU efficiency model acceleration and the distributed serving infrastructure... 
    Permanent employment
    Full time
    Contract work
    H1b
    Local area
    Remote work
    Relocation
    Relocation package

    AIDA Recruitment

    Mountain View, CA
    9 days ago
  •  ...THE ROLE: We are looking for a talented engineer to join our team: developing heterogeneous...  ...: Design, develop, and optimize GPU/CPU software for computer vision, image...  ...Experience in video codecs, image processing and machine learning frameworksFamiliarity with computer... 

    AMD

    Santa Clara, CA
    1 day ago
  • $175k - $308.5k

    Role Number: 200677962Team: Machine Learning and AILocation: Santa Clara;...  ...technical direction for the engineers around you.This role sits within...  ...stacks.Working knowledge of GPU or TPU programming concepts....  ...authoring custom CUDA kernels using CUDA C++ or OpenAI Triton... 
    Worldwide
    Relocation

    Apple

    Santa Clara, CA
    4 days ago
  • $216.2k - $324.8k

     ...The Product Marketing Customer Analytics team is seeking a Machine Learning Engineer with deep technical experience in predictive analytics and analytic...  ...and traditional ML solutions on high-volume datasets using GPU clusters or distributed CPU environments.Experiment with... 
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $224k - $356.5k

    Intelligent machines powered by Artificial Intelligence computers that can learn, reason and interact with people are no longer science fiction. GPU Deep Learning has provided the foundation for machines...  ...for an extraordinary Senior Engineer to develop and productize... 
    Odd job
    Full time
    Work experience placement

    Nvidia

    Santa Clara, CA
    5 days ago
  • $165.2k - $223.6k

     ...revolution? At Amazon our vision is to make deep learning pervasive for everyday developers and to...  ...workloads.This role is for a software engineer in the Compiler team for AWS Neuron. As...  ....- Experience in compiler design for CPU/GPU/Vector engines/ML-accelerators.-... 
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  •  ...patients worldwide.We’re a team of engineers, clinicians, and innovators...  ..., CA for a SeniorMachine Learning Engineer with focus on Computer...  ...computer vision and machine learning applications; or PhD...  ...Strong hands-on experience with GPU accelerated algorithms and implementations... 
    Local area
    Immediate start
    Worldwide
    Flexible hours

    Intuitive Surgical

    Sunnyvale, CA
    2 days ago
  • $171k - $231.5k

     ...Fintech Risk AI/ML credit risk team(Team Apollo) as a Senior Machine Learning Engineer. Team Apollo is responsible for detecting and preventing...  ...scalable software supporting millions or more usersExperience with GPU acceleration (i.e CUDA and cuDNN)Experience with integrating... 
    Worldwide
    Shift work

    Intuit

    Mountain View, CA
    2 days ago
  •  ...strong people from varied backgrounds who learn fast, thrive in ambiguity, and can show us...  ...Kubernetes, Ray, custom load balancing, multi-GPU/multi-node inference, and reliably...  ...open-source contributions to major inference engines, or deep-dive technical write-ups.Full-cycle... 
    Full time
    Work at office
    Relocation package

    Inworld AI

    Mountain View, CA
    1 day ago
  • $150.4k - $277.6k

     ...the customer front and center? The Video Engineering group at Apple is responsible for...  ...almost all Apple products and services.As a machine learning engineer, you’ll be developing machine...  ...distribute computational workloads across CPU, GPU, Apple Neural Engine, and other... 
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $224k - $356.5k

    NVIDIA is looking for a Machine Learning Engineer to join the GPU accelerated Apache Spark team.Apache Spark is the most popular data processing engine in data centers for running massive scale workloads for ETL, SQL, and ML/DL model training and inference pipelines, spanning... 
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $165.2k - $223.6k

    Amazon AI is looking for a machine learning engineer to be part of inference optimization team working on optimizing large language OSS models like...  ...Speculative decoding, Disaggregated Inference and CUDA kernel tuning.As part of the team, you will own price-performance... 
    Internship
    Local area
    Work from home
    Flexible hours

    Amazon

    Santa Clara, CA
    2 days ago
  • $150k - $230k

     ...information, visit About the RoleWe are looking for a hands-on Machine Learning Engineer to drive the post-training of our large language models,...  ...on tight timelines.Run large-scale training on mid-to-large GPU clusters, applying distributed-training techniques (data parallelism... 
    Full time
    Local area
    Work from home

    News Break

    Mountain View, CA
    2 days ago
  • $143k - $286k

     ...WalmartBusiness Segment: Home OfficeRole summary: The Senior Machine Learning Engineer will lead the design, development, and deployment of...  ...pipeline development.Familiarity with large language modeling and GPU optimization techniques. At Walmart, we offer competitive pay... 
    Full time
    Temporary work
    Part time
    Work experience placement

    Walmart

    Sunnyvale, CA
    2 days ago
  • $152k - $241.5k

     ...NVIDIA is hiring a Senior Compiler Engineer to join our team driving the next generation of GPU systems programming. We are...  ...memory-safe, high-performance GPU kernels in idiomatic Rust.What you’ll be...  ...to high-performance CUDA PTX and machine code.Build compiler IRs and... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Machine Learning Engineer — GPU Kernel. Be the first to apply!