ML Engineer, Inference Optimization
$2,000 per monthbuild-ai
About Build AI
Build AI is the data hyperscaler for Physical AI. We're vertically integrated across hardware, manufacturing, logistics, collection, and model training to scale the physical labor dataset orders of magnitude faster than anyone in the world.
Job Summary
Inference is about 90% of compute spend. Economics are heavily driven by inference optimization. We’re hiring someone to make inference cheaper, faster, and good enough that we can scale the data engine and the product without the GPU bill eating the company.
Key Responsibilities
Own inference performance: latency, throughput, and cost per unit of work (tokens, frames, or jobs)
Cut the 90% compute line: kernels, batching, quantization, compilation, serving, and hardware utilization
Profile pipelines (Nsight, PyTorch Profiler, or equivalent), find the real bottleneck, and ship the fix
Work with research and product so models that are accurate are also affordable to run at scale
Build the serving and eval path so experiments don’t hide the inference bill
Measure cost as a first-class metric, not an afterthought once quality is “done”
You may be a good fit if you have (Must-have qualifications)
Strong ML / systems engineer with real inference optimization experience (serving, compilers, CUDA/kernels, quantization, or similar)
Comfortable in Python and in C++ or Rust for performance-critical paths
You think in dollars and tokens/frames per second, not only in accuracy tables
Familiarity with PyTorch (or JAX) and with profiling tools
Comfortable in a small research team shipping under cost pressure
Strong candidates may also have experience with (Nice-to-have qualifications)
CUDA, kernels, compilers (TVM, MLIR, TensorRT), or quantization in production
You have owned GPU/accelerator cost as a first-class metric
Serving stacks for video or large models
Understanding of memory hierarchy, data movement, and low-precision compute
Benefits
Competitive pay
Medical, dental, and vision packages with generous premium coverage
$500 per month credit for waiving medical benefits
Housing subsidy of $2k per month for those living within walking distance of the office
Relocation support for those moving to San Francisco (Financial District) or Shenzhen (Nanshan)
Various wellness benefits covering fitness, mental health, and more
Daily lunch and dinner in our office
Unlimited compute budget subject to ROI justification
Unlimited Codex and Claude credits
Travel
How we're different
Build believes in the Bitter Lesson . By taking a general approach of learning from humans, our addressable market is all physical labor.
We are a fully in-person team in San Francisco (Financial District) and Shenzhen (Nanshan), and greatly value engineering skills. We do not have boundaries between engineering and research, and we expect all of our technical staff to contribute to both and work across disciplines as needed.
Build AI is an equal opportunity employer. We review every application. If you do not meet every bullet, still apply. Questions: View email address on jobs.ashbyhq.com
$184k - $272k
...technologies that can be adopted into Waabi’s training and inference frameworks. Examples include designing new CUDA... .../deployment techniques. Work with researchers and ML engineers on best-practices for optimal resource usage. Create and improve tooling and dashboards...SuggestedWork at officeWork from homeFlexible hoursWaabi
San Francisco, CA9 days ago$232k
...for a Staff Machine Learning Engineer to help define and build the next generation of matching optimization systems. This role sits at the... ...matching optimization and ML systems.Design matching objectives... ..., deep learning, causal inference, and sequential decision-making...SuggestedFull timeTemporary workWork at officeRemote workUber
San Francisco, CA2 days ago$203.5k - $299.3k
...are hiring a Causal Machine Learning Engineer to help build the causal ML foundation behind how DoorDash... ...counterfactual policy evaluation, promotion optimization, or marketplace decisioning systems... ...practical experience with causal inference, econometrics, experimentation, or...SuggestedHourly payWork at officeLocal areaRemote workFlexible hoursDoordash
San Francisco, CA2 days ago$148k - $240k
...AI Research team is looking to hire a ML Research Engineer to maximize iteration speed for mid-... ...individual training run but also making these optimizations maintainable, reusable, and adaptable... ...experience. Experience with LLM inference libraries such as vLLM and training...SuggestedFull timeWork experience placementWork at officeLocal areaFlexible hours- ...We're building a research cohort of senior domain experts in ML inference and GPU kernel engineering — spanning inference serving systems, kernel optimization, and large-model deployment infrastructure — to help evaluate how frontier AI models reason about hard, real-world...SuggestedContract work
AfterQuery
San Francisco, CAa month ago - ...physical world. We are a group of engineers, scientists, roboticists, and... ...role you will help scale and optimize our training systems and core... ...role at the intersection of ML, software engineering, and... ...You Will Own training/inference infrastructure: Design, implement...Full time
Physical Intelligence
San Francisco, CA5 days ago $180k - $240k
...clients a Senior Machine Learning Engineer - this is a fully remote role... ...to join our small but mighty ML team building production-... ..., ensuring performance optimization and alignment with broader business... ...AI problems — low latency inference, hallucination reduction, prompt...Remote workFlexible hoursCareer Renew
San Francisco, CA24 days ago$200k - $300k
...About the Role Together AI is seeking a Machine Learning Engineer to join our Inference Engine team, focusing on optimizing and enhancing the performance of our AI inference systems. This role involves working with state-of-the-art large language models models and ensuring...Full time- ...researchers, designers, growth experts, and engineers who step away from the status quo to... ...8VC, and others. About the Role As a ML engineer at Wispr, you’ll play a... ...founding or startup experience Experience optimizing ML inference or engineering systems for research...Full time
$202k
...Posted: 2026-10-14About the RoleThe Maps Optimization team builds and maintains the... ...motivated, entrepreneurial machine learning engineer to join the Maps Optimization team. As a... ...design, build, and optimize large-scale ML systems and models to improve efficiency...Full timeWork at officeRemote workWorldwideUber
San Francisco, CA23 hours ago$150 per hour
...challenging machine learning engineering tasks in a long-horizon AI... ...out of 8 attempts. Focus on inference, evaluation, and systems work... ...or recent role as an ML research engineer , research... ...in training, fine-tuning, or optimizing models in PyTorch or JAX...Contract workSummer workRemote workMercor
San Francisco, CA19 days ago$170.1k - $258.3k
...export, kernel development, and performance engineering so that every cycle on our accelerators... ...sit at the heart of our on‑vehicle ML inference for ADAS and autonomous driving. We own... ...benchmarking, profiling, debugging and optimizing accelerator libraries and kernels to...Full timeLocal areaRemote workWork from homeRelocation packageFlexible hoursGeneral Motors
San Francisco, CA3 days ago- ...advancing post-training and inference for multimodal and physical AI... ...research with GPU compute and optimized inference to help teams post-... ...with research scientists and engineers to make new visual models... ...architectures, compilers, and ML systems research, and rapidly...Full timeWork at office
$181k - $250k
...experimentation setups, debugging processes, and optimization strategies. Analyze system design... ...field ~3+ years of experience in ML Engineering or Applied ML with 8+ years of overall... ..., model distillation, or low-latency inference optimization for production voice...Contract workWorldwideAircall.io, Inc.
San Francisco, CAa month ago$203.5k - $299.3k
...hiring a Causal Machine Learning Engineer to help build the causal ML foundation behind how DoorDash grows... ...policy evaluation, promotion optimization, or marketplace decisioning systems... ...practical experience with causal inference, econometrics, experimentation, or...Hourly payWork at officeLocal areaFlexible hours- ...seeking a Machine Learning Infrastructure Engineer to help architect the compute, training,... ...execution and training pipelines optimized for rapid experimentation, flexibility,... ...to established distributed training or inference engines.Practical experience managing multi...Full timeWork at officeFlexible hours
Objective Paradigm
San Francisco, CA3 days ago $227.33k - $312.58k
We’re looking for a Staff ML Data Engineer to join Procore’s AI & Frontier Models organization... ...learning training, evaluation, or inference workflows.Solid understanding of data... ...infrastructure‑as‑codePerformance & Cost: Optimizing data pipelines for GPU‑backed training...Full timeWork at officeLocal areaImmediate start3 days per weekProcore Technologies
San Francisco, CA4 days ago- ...startup building production-grade ML infrastructure used by... ...are looking for a Senior AI/ML Engineer to own model training pipelines, evaluation systems, and inference serving at scale. Full-time,... ...with distributed training, GPU optimization, or inference serving ~...Full time
Clera
San Francisco, CA14 days ago $298k - $368k
...work jointly with downstream teams on the optimization and integration into the Waymo Driver.... ...a diverse set of sensors, enabling engineers like you to (1) develop methods for efficiently... ...expertise in low-latency on-device inference techniques and a deep understanding of...Full timeRemote workWaymo
San Francisco, CA1 day ago- ...The Machine Learning and Data engineer role will lead the... ...monitoring of Machine Learning (ML) and generative Artificial Intelligence... ...involves managing and optimizing the data and monitoring pipelines... ...efficient ML model training and inference. ~ Demonstrated experience...Full timeFlexible hours1 day per week
University of California, San Francisco
San Francisco, CA8 days ago $190k - $222k
...partner with robotics, controls, and hardware engineers to deliver reliable performance in real-... ..., and sensor fusion. Build ML models and training pipelines, then deploy... ...sensor data across the perception system. Optimize real-time perception for embedded compute...Clera
San Francisco, CA2 days ago$180k - $220k
...About the Role: Crusoe is hiring an AI Engineer for our Developer Relations Engineering... ...applications on Crusoe Cloud and Crusoe Managed Inference. In this role, you will lead... ...Experience: 5+ years as a software engineer, ML engineer, applied AI engineer, forward-...Temporary workCrusoe
San Francisco, CA12 days ago$189.6k - $237k
Scale’s ML platform (RLXF) team builds our internal distributed... ...language model training and inference. The platform has been... ...development. You will be building and optimizing the platform to enable our... ...distributed ML systemsStrong software engineering skills, proficient in...Full timeScale AI
San Francisco, CA2 days ago$110k - $150k
...more companies in our portfolio that are actively hiring AI/ML Engineers . What We’re Looking For: Comfort operating across... ...foundation models, fine-tuning, RAG pipelines, agents, or inference optimization About the role(s): Depending on the team, you could...Full timedragonfly-careers
San Francisco, CA3 days ago- ...every day by a billion people. About the role As a ML engineer at Wispr, you’ll play a crucial role in building the first... ...? Previous founding or startup experience Experience optimizing ML inference or engineering systems for research teams Fluency in...Full timeH1b
- ...Machine Learning Engineer Location: San Francisco, CA Team: Engineering Employment... ...development. You’ll help take ML solutions from experimentation into production... ...with model evaluation, fine-tuning, or inference optimization. Familiarity with healthcare...Remote jobFull time
- ...Job Description Machine Learning (ML) Engineer, Ranking & Retrieval, Machine Learning... ...- Develop efficient classifiers and optimize model accuracy, precision, latency and... ...maintain Machine Learning (ML) training, inference and deployment pipelines. - Debug production...Remote workWork from home
- ...Job title: ML Engineer / Researcher, Large Language Models WORK AUTHORIZATION Must... ...Knowtex's AI stack. You will develop and optimize the models behind our clinical... ...reinforcement learning Research ways to reduce inference cost and latency while maintaining or...Remote jobFull timeWork at officeVisa sponsorship
- ...grade AI systems. As an MLOps Engineer, you will design, deploy, and... ...challenges and enabling ML teams to move faster. Responsibilities... ..., and backend teams. Optimize infrastructure for... ...Familiarity with LLM deployment and inference optimization. Knowledge of...
Sierracorp
San Francisco, CA7 hours ago - ...seeking an experienced MLOps Engineer to design, build, and... ...on enabling production-grade ML systems using modern cloud platforms... ...scoring APIs for real-time inference use cases. Monitoring,... ...platform teams to build and optimize data pipelines and ML infrastructure...Long term contractLocal area
Codinix Technologies Inc.
San Francisco, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Engineer, Inference Optimization. Be the first to apply!
- computer vision machine learning engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- graduate machine learning engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- senior ml engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- machine learning scientist San Francisco, CA
- machine learning part time San Francisco, CA