ML Systems Engineer: Trainium Inference & Kernels

OpenAI

OpenAI in San Francisco seeks an experienced Software Engineer to help bring inference workloads to AWS Trainium and build the software stack to run frontier models efficiently on the platform. This deeply technical, cross‑stack role covers kernels, compilers, and model execution. You will develop high‑performance kernels, improve compiler support, and ensure scalable execution of the model forward pass on Trainium. #J-18808-Ljbffr

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the ML Systems Engineer: Trainium Inference & Kernels in San Francisco, CA vacancy

ML Research Engineer — Inference & GPU Kernels
...We're building a research cohort of senior domain experts in ML inference and GPU kernel engineering — spanning inference serving systems, kernel optimization, and large-model deployment infrastructure — to help evaluate how frontier AI models reason about hard, real-...
Suggested
Temporary work
AfterQuery
San Francisco, CA
11 days ago
Senior ML Inference Systems Engineer
At Atlassian, we are seeking an ML System Engineer to join the AI & ML Platform Inference team. You will design and optimize large-scale model serving systems from distributed infrastructure to low-level performance tuning, enabling reliable, scalable inference across production...
Suggested
Atlassian
San Francisco, CA
5 days ago
AI/ML Infra / Systems Engineer (Inference)
$204k - $216k
...Knowledge lives in silos, in legacy systems, in the heads of a few... ...scale. You build and run the inference infrastructure that turns the... ...applied AI, research, and platform engineering, and you make the difference... ...to get right. The AI/ML Infrastructure and Systems Engineer...
Suggested
Sapience AI Corporation
San Francisco, CA
23 days ago
ML Infra Engineer: Scalable Training & Inference
...Trajectory is seeking an ML Infrastructure Engineer to join our research-driven team in San Francisco... ...platform, spanning training, inference and kernels, and collaborate with researchers to... ...translate new algorithms into reliable systems. We value deep specialization in...
Suggested
Mixpeek
San Francisco, CA
3 days ago
Machine Learning System Engineer
...have a legal entity. Responsibilities As a ML System Engineer on the AI & ML Platform’s Inference team, you will design and optimize large-scale model... ...auto-scaling) to deep low-level optimizations (GPU kernels, quantization, speculative decoding).In this role,...
Suggested
Work at office
Local area
Atlassian
San Francisco, CA
5 days ago
ML Systems & Performance Engineer
...study your context at training time, the better we become at inference time. We’re already working with leaders in AI like... ...about yours. About this role You’ll be among the first ML Systems Engineer, joining a team of machine learning researchers and performance...
Work at office
Engram
San Francisco, CA
4 days ago
Senior ML Systems Engineer, Frameworks & Tooling
...enterprises who are building AI systems. We believe that our work is... ...Cohere is a team of researchers, engineers, designers, and more, who are... ...across the full stack of ML systems, this role gives you the... ...training libraries, or custom kernels/fused ops.Experience with multi...
Full time
Work at office
Local area
Remote work
Home office
Cohere
San Francisco, CA
4 days ago
Senior ML Systems Engineer - Distributed Training
...Anthropic is seeking a Senior ML Engineer to join the Core Systems team to optimize training and inference infrastructure for the Claude family of foundation models. You will design high-performance distributed pipelines and work with researchers to remove scaling bottlenecks...
AI Breaking Wire
San Francisco, CA
3 days ago
ML Compiler & System Engineering & Research Bay Area
...performance code should feel natural to write. Engineers write plain Python in a NumPy or PyTorch... ...with, and Quadrants rebuilds it into kernels that run as if an expert had hand‑tuned... ..., and the ability to keep the whole system coherent as it grows. The core tradeoff...
Genesis Healthcare, Inc.
San Francisco, CA
4 days ago
Machine Learning System Engineer
...Machine Learning System EngineerAs a ML System Engineer on the AI & ML Platform's Inference team, you will design and optimize large-scale model serving systems end-to... ...scaling) to deep low-level optimizations (GPU kernels, quantization, speculative decoding).In this role...
Trello
San Francisco, CA
4 days ago
Senior ML System Engineer
...Senior ML System EngineerAs a Senior ML System Engineer in the Rovo GenAI Platform team, you will build and maintain the core infrastructure to allow machine... ...-level with search platform, deep learning training/inference platform.Experience with Databricks.Experience with...
Trello
San Francisco, CA
4 days ago
ML Infra Engineer: Scale GPU Training & Inference
...Francisco, is hiring a Machine Learning Infra Engineer. This role involves building and maintaining the training and inference frameworks necessary for optimal performance.... ...strong Python skills, have a background in systems engineering, and experience with Kubernetes....
REDUCTO
San Francisco, CA
3 days ago
ML Inference & Compiler Engineer - HW/SW Codesign
...DeepMind is hiring engineers to build a next-generation compute platform for AI inference workloads, focusing on memory technologies, hardware acceleration, and SW/HW codesign. This coding role emphasizes ML compiler stack and inference infrastructure, joining a team...
DeepMind Technologies Limited
San Francisco, CA
3 days ago
Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud
...The Role: As a Machine Learning Systems Administrator / DevOps Engineer, you will maintain and build the... ...behind both our model training and our inference cloud. You’ll split your time between... ...Terraform) Prior work supporting ML/AI infrastructure, including GPU management...
Work at office
Remote work
Relocation package
Zyphra
San Francisco, CA
3 days ago
Staff ML Systems Engineer - LLM Serving & RL
...RL integration. This hybrid role spans cloud LLM serving, inference optimization, and RL systems. You will advance our ability to evaluate and serve... ...and robust failover across regions. Requires 3+ years on ML/LLM infra, experience with vLLM or TensorRT-LLM, and strong...
Prime Intellect
San Francisco, CA
15 hours ago
Model Bring-up Engineer / ML Compiler Engineer
...We are the first AI inference neocloud, using ASIC... ...lowering, op coverage, kernel selection — when a model... ...you: ~5+ years in systems or ML systems, with real... ...NVIDIA accelerator — TPU, Trainium/Inferentia,... ...tooling that did real engineering work, not demos. #J...
Live in
General Compute
San Francisco, CA
4 days ago
Senior ML Engineer, Voice AI Real-Time Inference Lead
...An AI infrastructure company is looking for a Senior ML Engineer to optimize performance for voice models such as speech-to-text and text... ...on advanced serving engines, focusing on GPU utilization and inference optimization. With over 5 years of experience required, this role...
Together AI
San Francisco, CA
3 days ago
Production ML Systems Engineer — Multimodal AI
...content format. You will join a small team that ships multimodal AI systems and own end-to-end training, evaluation, serving, and latency... ...using Falcon, Finesse, and related tools. You will optimize inference, build evaluators, and ensure low-latency pipelines while translating...
Flam
San Francisco, CA
4 days ago
MLOps Engineer, LLM Performance (Kernels, Profiling, Serving)
$90 - $120 per hour
...week Field: Software Engineering Join a leading AI... ...'re seeking MLOps and ML systems engineers with hands-... ...four areas: accelerator kernel programming,... ..., and high-throughput inference serving. Experience with... ...to v6e), H100, B200, Trainium or MI300, and the ability...
Hourly pay
Full time
Contract work
Local area
Remote work
Worldwide
Weekday work
Mercor
San Francisco, CA
4 days ago
Principle Machine Learning Systems Engineer
...and ship. We build the evaluation systems, datasets, quality signals, and production ML capabilities that reveal where... ...doAs a Principal Machine Learning Engineer, you’ll tackle the open-ended... ...strategy, system architecture, and inference; balancing quality with latency,...
Work at office
Local area
Atlassian
San Francisco, CA
4 days ago
Senior ML Accelerator Engineer - GPU
$170.1k - $258.3k
...-capable fully self-driving systems, to move us toward safer, more... ...mobility. For the AI Kernels & Compilers team, that mission... ...development, and performance engineering so that every cycle on our accelerators... ...the heart of our on‑vehicle ML inference for ADAS and autonomous...
Full time
Local area
Remote work
Work from home
Relocation package
Flexible hours
General Motors
San Francisco, CA
4 days ago
Principal Machine Learning Systems Engineer (GenAI Products & Knowledge Innovations)
...re seeking a Principal Machine Learning Systems Engineer (P60) to lead technical directions of GenAI... ...What You'll Doð Design and Build ML SystemsArchitect and implement scalable... ...Experience with large-scale model training, inference pipelines, or search/retrieval systems.ð...
Work at office
Local area
Atlassian
San Francisco, CA
6 days ago
Staff Machine Learning Engineer, Causal Inference
$203.5k - $299.3k
...next generation of causal decisioning systems for New Verticals: grocery,... ...are hiring a Causal Machine Learning Engineer to help build the causal ML foundation behind how DoorDash grows... ...Deep practical experience with causal inference, econometrics, experimentation, or...
Hourly pay
Work at office
Local area
Remote work
Flexible hours
Doordash
San Francisco, CA
8 days ago
LLM Inference Systems Engineer
...Acceler8 Talent is seeking a Machine Learning Engineer to optimize LLM inference performance in production. The role focuses on squeezing more performance from GPUs, distributed systems, and multi-node setups with Kubernetes-backed infrastructure. You will work on high...
Acceler8 Talent
San Francisco, CA
18 hours ago
Senior ML Engineer - Self-Driving Systems (Work-from-Home)
$158k - $269k
.... Contribute and build the self-driving engineering foundations to develop the next generation... ...improve machine learning training and inference pipelines. Make iterations on the models... ...concepts. Experience in software architecture, system performance, latency and data flow....
Full time
Work at office
Work from home
Flexible hours
Waabi
San Francisco, CA
3 days ago
ML Research Engineer, ML Systems
$189.6k - $237k
Scale’s ML platform (RLXF) team builds our internal distributed... ...language model training and inference. The platform has been... ...have:Strong excitement about system optimizationExperience with multi... ...distributed ML systemsStrong software engineering skills, proficient in...
Full time
Scale AI
San Francisco, CA
8 days ago
ML Infra & DevOps Engineer: Training & Inference Cloud
...Zyphra is seeking a Machine Learning Systems Administrator / DevOps Engineer to maintain and build the core infrastructure behind model training and inference clouds. You will split time between large-scale training clusters and production deployments across heterogeneous...
Zyphra
San Francisco, CA
2 days ago
Staff Inference Systems Engineer High-Throughput AI
...Kindredventures is recruiting infrastructure engineers to scale large-scale inference and evaluation around a physics-based LPM initiative. You will work on high-throughput systems, latency-optimized serving, and distributed orchestration across Kubernetes, Ray, and Slurm...
Kindredventures
San Francisco, CA
4 days ago
Inference Systems Engineer: Low-Latency AI Infra
...North America, Europe, and Asia. We are seeking a Software Engineer on Inference to define Sierra’s inference architecture for self-hosted models... ...providers, focusing on fast, reliable, and cost-efficient systems. This role is a systems-first position intersecting...
Sierra
San Francisco, CA
4 days ago
Senior ML Systems Engineer: Production Pipelines
MakerMaker in San Francisco seeks a senior ML engineer to own end-to-end ML systems, from data pipelines to deployment. You will translate research code into reliable infrastructure, ship at scale, and help the team move fast with trustworthy results. You will collaborate...
MakerMaker
San Francisco, CA
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Systems Engineer: Trainium Inference & Kernels. Be the first to apply!