Staff ML Infra Engineer: Global, Low-Latency ML Systems
Uber
Uber is seeking a Staff Software Engineer for ML Infra in San Francisco to architect and build scalable ML data and backend systems that power the trust and pricing platforms across the global marketplace. You will lead development efforts, mentor engineers, and collaborate with product, science, and ops to translate complex requirements into robust technical roadmaps. Strong experience in MLOps, large language models, and distributed systems is required, focusing on reliability, low latency, #J-18808-Ljbffr Uber
- ...evaluation platform in San Francisco is looking for a Senior Software Engineer specializing in ML infrastructure. The successful candidate will design and develop robust real-time data and API systems, enabling insights for researchers and developers. Ideal applicants...Suggested
- ...general-purpose AI into the physical world. We are a group of engineers, scientists, roboticists, and company builders developing... ...the physically-actuated devices of the future. As an ML Infra Engineer (Data Systems), you’ll build and operate the data infrastructure that...Suggested
- ...Intelligence in San Francisco seeks a Member of Technical Staff - ML Infrastructure software engineer to design and build scalable, real-time data and API... ...researchers and developers. You will architect low-latency pipelines, ensure reliability, and mentor engineers,...Suggested
- ...Responsibilities As a ML System Engineer on the AI & ML Platform’s Inference... ...distributed infrastructure (global KV cache, continuous batching... ..., auto-scaling) to deep low-level optimizations (GPU kernels... ...scheduling, global KV cache).Optimize latency and throughput of model...SuggestedWork at officeLocal area
- ...this role You’ll be among the first ML Systems Engineer, joining a team of machine learning researchers... ...to improve performance, reliability, latency, and efficiency. Partner closely... ...retrieval, where per‑user state and low latency both matter. Work on distributed...SuggestedWork at office
$250k - $350k
...is to develop reliable AI systems for the world’s most important... ..., paired with applied ML research, design, and evaluation... ...like.About the RoleAs a Staff Machine Learning Research Engineer, you will operate across... ....g., training efficiency, latency, cost, or inference...Full time$204k - $216k
...lives in silos, in legacy systems, in the heads of a few... ...: serving, scaling, latency, and cost. Every time a... ...research, and platform engineering, and you make the difference... ...get right. The AI/ML Infrastructure and... ...fast answers, and keep it low as the platform grows....- At Atlassian, we are seeking an ML System Engineer to join the AI & ML Platform Inference team. You... ...systems from distributed infrastructure to low-level performance tuning, enabling... ...robust CI/CD for inference updates in a global environment. #J-18808-Ljbffr Atlassian
- OpenAI in San Francisco is seeking an experienced engineer to architect, build, and scale high-performance distributed training and inference... ...experiments. The role requires deep expertise in distributed systems, networking, and high-throughput computing, plus strong coding...
- ...will join a small team that ships multimodal AI systems and own end-to-end training, evaluation, serving, and latency budgets for production-ready models. Role covers... ...optimize inference, build evaluators, and ensure low-latency pipelines while translating research into...
- ...an insanely fast, globally scalable, cost-efficient... ...quality, tail latency, reliability, scalability... ...where new ML capabilities can meaningfully... ...agentic search systems, addressing tail... ...systems, mentor senior engineers, and align... ...operating large-scale, low-latency search, recommendation...Work at officeLocal area
$206.1k - $269.08k
...Engineering | San Francisco, United States | Remote, Remote Atlassians can... ...ship. We build the evaluation systems, datasets, quality signals, and production ML capabilities that reveal where Rovo... ...; balancing quality with latency, reliability, safety, and cost....Work at officeLocal areaRemote work- ...seeking a Senior Machine Learning Engineer for the Data & Audience Platform... ...sits between Senior MLE and Staff MLE levels, delivering end-to-end production ML systems and guiding architectural decisions... .... You will collaborate with global teams, including Hyderabad, translating...
- Trajectory is seeking an ML Infrastructure Engineer to join our research-driven team in San Francisco. You will own the... ...researchers to translate new algorithms into reliable systems. We value deep specialization in training infra, inference systems, or GPU kernels, strong...
- A leading technology company is looking for an ML Infrastructure Engineer in San Francisco. The successful candidate will build and maintain ML training pipelines and ensure low-latency model serving. Candidates should have over 4 years of experience in ML engineering,...Work at office
- General Legal is seeking a Senior ML Infra Engineer to build the systems that enable rapid experimentation, evaluation, training, and deployment of AI models in a production-ready way. You will sit at the intersection of research and production, making researchers and...
- ...a Principal Machine Learning Systems Engineer (P60) to lead technical directions... ...You'll Doð Design and Build ML SystemsArchitect and... ...grounded data.Develop tools and infra to support rapid experimentation... ..., scalable services.Optimize latency, throughput, and resource...Work at officeLocal area
- Atlassian seeks a Senior Machine Learning Engineer to join the Rovo Chat Quality team... ...lead across teams, and shape production ML systems that improve customer trust and product... ...and deployment decisions across scale, latency, and safety constraints. This role offers...Remote workFlexible hours
$158k - $269k
...visit: You will... Contribute and build the self-driving engineering foundations to develop the next generation autonomy... .../proof of concepts. Experience in software architecture, system performance, latency and data flow. Experience in Machine Learning. Understanding...Full timeWork at officeWork from homeFlexible hours- ...robotics work from the ground up, ensuring customer models run reliably on real robots within strict latency budgets. We're looking for a generalist across ML, systems and robotics who understands policy behavior at inference time, and how batching, scheduling and network...
- Genesis AI in San Francisco is seeking a senior ML infrastructure engineer to design and optimize distributed training systems and performance-critical components. You will profile bottlenecks, implement low‑level code (CUDA, Triton) and ensure efficient hardware utilization...
$190k - $260k
...by our expert team of lawyers, engineers and research scientists. We’ve... ...develop and improve our AI systems, including: fine-tuning large... ...engineering constraints like latency and expensive model inference,... ...Qualifications Evidence of exceptional ML engineering ability....$170.1k - $258.3k
...capable fully self-driving systems, to move us toward... ...development, and performance engineering so that every cycle on... ...of our on‑vehicle ML inference for ADAS and... ...consistently meeting strict latency, throughput, and... ...transformer-basedExperience with low latency or real time...Full timeLocal areaRemote workWork from homeRelocation packageFlexible hours- A global tech company in San Francisco is seeking a Staff Machine Learning Engineer to lead complex AI initiatives. In this role, you will architect cutting-edge systems to transform the platform into an adaptive user experience. Your responsibilities include developing...
$181.1k - $318.4k
...This team also focuses on ML-driven forecasting,... ...As a Sr. ML Optimization Engineer, you will work at the intersection of systems engineering, infrastructure... ...millions of users globally. Our team is at the forefront... ...cost under reliability and latency constraints. Your...Relocation$170.17k - $286k
...operations that power our global economy. Representing more... ...: Safety AI builds the ML and computer vision systems behind Samsara's AI dash cameras... ...: building the resilient, low-latency ML backend systems that... ..., firmware and full-stack engineers, and product managers and...Remote workWork from homeFlexible hours- ...directly in the loop of how those systems improve. This is a rare... ...the opportunity to shape the engineering organization and lead major technical... ...: streaming inference, latency budgets, fail-open vs. fail-... ...also counts ~ Experience with low-latency inference services:...Local area
- Coinbase is seeking a Senior Data Engineer for Market Data on the Institutional Markets team to build and operate real-time data systems with low latency. You will design feed handlers, normalization, and distribution layers, enabling trading across the platform. You’ll...Remote job
$200k - $250k
...Founding ML Engineer — Computer Vision (Object Detection) Full time... ...from research to production — latency, cost, reliability at scale.... ...applied CV, with at least one system shipped to production at meaningful... ...human-in-the-loop pipelines; low-latency API serving at scale;...Full timeWork experience placementRemote work- ...seeking a Machine Learning Infrastructure Engineer to help architect the compute, training,... ...ownership over scaling distributed systems across massive hardware clusters while collaborating... ...experimentation, flexibility, and ultra-low latency serving.Establish comprehensive...Full timeWork at officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff ML Infra Engineer: Global, Low-Latency ML Systems. Be the first to apply!
- project engineer assistant project manager San Francisco, CA
- staff security engineer San Francisco, CA
- staff engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- senior staff systems engineer San Francisco, CA
- engineering aide San Francisco, CA
- senior staff engineer San Francisco, CA
- assistant engineering manager San Francisco, CA
- assistant chief engineer San Francisco, CA
- staff data engineer San Francisco, CA


