Staff / Senior Staff Machine Learning Engineer, Inference - USA
Inworld AI
About Inworld Inworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. We build first-party speech models, serve LLMs, and run the inference behind modular APIs designed for high-volume, realtime workloads. Hundreds of millions of users interact with Inworld powered apps every day and we serve over 10 trillion LLM tokens per month. Our models and infrastructure support consumer applications across companions, healthcare, fitness, education, media, and more. Our work spans model research, realtime inference, large-scale serving infrastructure, and the APIs developers use to bring these capabilities into production. We've raised more than $125M from Lightspeed Venture Partners, Section 32, Kleiner Perkins, Microsoft's M12 venture fund, Founders Fund, Meta, Stanford, and others. Our technology has powered experiences from companies including NVIDIA, Microsoft Xbox, Niantic, Logitech Streamlabs, Wishroll, Little Umbrella, and Bible Chat. Inworld has also been recognized by CB Insights as one of the 100 most promising AI companies globally and named one of LinkedIn's Top 10 Startups in the USA. Who We're Looking For A year ago, reliably working agentic systems and sub-second multimodal inference at scale barely existed. Nobody has a decade of experience here. So we're not screening for a resume template - we're looking for strong people from varied backgrounds who learn fast, thrive in ambiguity, and can show us what they've built, broken, and understood. Experience We Find Useful You don't need all of this. But you need enough to make a case. Inference Optimization. Deep understanding of modern serving frameworks and techniques like vLLM or TRT-LLM. Model Acceleration . Hands-on experience with quantization, distillation, caching strategies , continuous batching, paged attention, and speculative decoding. High-Performance Systems. Proficiency in C++, CUDA, Rust, or highly optimized Python. You know how to profile code and squeeze every ounce of performance out of NVIDIA GPUs. Distributed Systems & Scaling. Experience with Kubernetes, Ray, custom load balancing, multi-GPU/multi-node inference, and reliably handling thousands of concurrent connections. Public work. Non-trivial systems programming projects, open-source contributions to major inference engines, or deep-dive technical write-ups. Full-cycle ownership. You can take a model from the research team, containerize it, optimize its serving, and ensure it runs reliably in production. Background. PhD in CS, Physics, Math, or equivalent practical experience building backend or ML systems. Who Thrives Here You don't need a roadmap to start walking; you're comfortable picking a direction and building the map as you go. You believe engineering isn't finished until it's shipped and stable. You have a bias for impact over purely theoretical optimizations. You don't just ship code; you obsess over the why. You're the first to question an architecture if you think there's a better way to solve the core latency or throughput problem. You aren't satisfied with "the PM said so." You thrive on deep context and want to understand the fundamental logic behind every decision we make. What Working Here Is Like We hand you unclear problems and expect you to make them clear. We value engineers who say "I don't know yet" and then design the benchmark or prototype that finds out. We treat performance, latency, and reliability as first-class product features, not a box to check before launch. Impact comes before everything else, though we support sharing work and open-source contributions that move the field forward. Your work should be visible. Flat structure, fast iterations, minimal process theater. We believe in the power of in-person collaboration to solve the hardest problems and foster a strong team culture. We offer relocation assistance and look forward to you joining us in our Mountain View office. The base salary range for this full-time position is $270,000 - $430,000+ bonus + equity + benefits. Inworld Jobs Privacy Inworld AI
- ...InworldInworld is a research lab and inference provider focused on realtime... ...’s Top 10 Startups in the USA.Who We're Looking ForA year... ...people from varied backgrounds who learn fast, thrive in ambiguity, and... ...to major inference engines, or deep-dive technical write-...SeniorFull timeWork at officeRelocation package
$250k - $300k
...Job Description Job Description Senior Machine Learning Engineer, Inference Job Summary For our client, a fast-growing AI company building realtime voice and LLM technology, we are looking for a Senior Machine Learning Engineer with strong expertise in ML inference...SeniorPermanent employmentFull timeContract workH1bLocal areaRemote workRelocationRelocation package- ...of robots is expensive. We can't rely on one hardware vendor or the most expensive accelerators. We're looking for an Inference Optimization engineer to make Rhoda's models run fast, correctly, and cheaply on a wide range of hardware: AMD Instinct GPUs, Google TPUs, wafer...SeniorFull time
$143k - $286k
...43000 - $286000/yearType: Full time / Regular/PermanentCompany: WalmartBusiness Segment: Home OfficeRole summary: The Senior Machine Learning Engineer will lead the design, development, and deployment of scalable machine learning solutions that address complex business...SeniorFull timeTemporary workPart timeWork experience placement$251k - $310k
Staff/Sr. Staff Machine Learning Engineer - World Modeling, Simulation Waymo is an autonomous driving technology... ...In this role, you will report to a Senior Staff Engineering Manager You Will:... ...Optimize for Production & Serving: Scale inference and evaluation frameworks into...SeniorFull timeRemote work$195.2k - $262.2k
...in-house AI/ML infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across... ...software and AI R&D. The role As a Senior Machine Learning Engineer on the Applied AI team at Nebius...SeniorTemporary workImmediate startRemote work$280k - $350k
...InworldInworld is a research lab and inference provider focused on realtime AI for... ...of LinkedIn’s Top 10 Startups in the USA.About the roleInworld Inference... ...running on capacity reserved for it.As a Staff or Principal Software Engineer, you'll design that platform's core...Full timeWork at officeRelocation$174.08k - $229.04k
...users around the world and 300 billion ideas saved, Pinterest Machine Learning engineers help build personalized experiences to help Pinners create... ...our various ML teams. Please only apply once within the USA or Canada as multiple applications may delay our recruitment...Work at officeLocal area$165.2k - $223.6k
Amazon AI is looking for a machine learning engineer to be part of inference optimization team working on optimizing large... ...other employees, supervisors, and staff; adhere to standards of excellence... ...Learn more about our benefits at .USA, CA, Santa Clara - 165,200.00 - 223...InternshipLocal areaWork from homeFlexible hours$195k - $230k
...more information, visit About the RoleWe are looking for a Senior Machine Learning Engineer to help evolve our large-scale recommendation systems... ...business metrics.Own systems from offline training online inference A/B experimentation metric analysis.Identify and resolve...SeniorFull timeLocal areaWork from home$202k
...Delivery Search team builds large-scale machine learning systems that help consumers... ...scale.Role & ResponsibilitiesAs a Senior Machine Learning Engineer on the Delivery Search team, you will... ...scalable model training, evaluation, and inference pipelines; conduct offline and...SeniorFull timeWork at officeRemote work$188.5k - $282.7k
...SAGE, Rubrik's Semantic AI Governance Engine, which is the first system designed to... ...Engineering High-Performance Model Serving and Inference Infrastructure (25% of time)Designing... ...(or higher) in Computer Science, Machine Learning, Computer Engineering, Statistics, or a...SeniorPermanent employment$175k - $215k
Senior Machine Learning Engineer, Growth Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver... ...systems: feature pipelines, training data generation, batch inference. Strong SQL and Python, plus large-scale data processing...SeniorFull timeRemote workShift work$213k - $263k
Waymo Onboard ML Inference Engineer Waymo is an autonomous driving technology company with the... ...and automate the lifecycle of the machine learning workflow, including feature and experiment... ...hybrid role, you will report to the Senior Manager of Runtime and Optimization....SeniorFull timeRemote work- ...connection. Our computer vision and machine learning (CVML) team of researchers and engineers tackle previously unsolved... ...Description We seek a proactive Senior Machine Learning Engineer to join... ...model efficiency for on-device inference, and ensuring algorithms perform...SeniorWork experience placement
$130k - $260k
...WalmartBusiness Segment: Home OfficePosition Summary... As a Staff Machine Learning Engineer, you will architect and lead the development of scalable,... ..., leveraging containerization, GPU orchestration, and inference optimization frameworks such as NVIDIA TensorRT. Drive...Full timeTemporary workPart timeWork experience placement$130k - $260k
...: WalmartBusiness Segment: Home OfficeRole summary: As a Staff Machine Learning Engineer at Walmart, you will lead the design and deployment of scalable... ...intelligence, machine learning, measurement, and causal inference to redefine retail experiences, optimize operations, and...Full timeTemporary workPart timeWork experience placement- Senior Machine Learning Engineer Applied Intuition, Inc. is powering the future of physical AI. Founded in 2017 and now valued at $15 billion, the... ...and coverage of simulated scenes Scale training and inference of large generative models for production workloads Define...SeniorFull timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shift
- ...get the most out of the frontier models. We are hiring a Senior Machine Learning Engineer to lead this effort. You will own the end-to-end... ...Publications or open-source contributions in forecasting, causal inference, calibration or agentic systems. This range reflects the...SeniorWork at officeWorldwide
$213k - $263k
...time Fleet Monitoring and event response engine to support expansion to global... ...monitoring models, including automated training/inference pipelines, low-latency spatial data... ...product use-cases/services. ~ Prior Machine Learning Engineering experience in Python using...SeniorFull timeRemote work$195.2k - $262.2k
...large in-house AI/ML infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems... ...pipelines, and production engineering. A Senior Machine Learning Engineer owns substantial ML work end to end...SeniorTemporary workImmediate startRemote work$170.6k - $261.3k
...shaping the future of transportation on a global scale.As a Senior Machine Learning Engineer on the State Estimation and Mapping (SEAM) organization,... ...‑sensor conditions. Implement efficient training and inference pipelines, including model optimization techniques (e.g....SeniorFull timeLocal areaRemote workWork from homeRelocation packageFlexible hours$227k - $300k
...production-grade AI on the Edge. We are looking for a great Senior Staff Machine Learning Engineer to join our seasoned AI team and lead the development... ...decent working knowledge of modern C++ (C++14/17 for inference). Deep proficiency with PyTorch or TensorFlow, and...SeniorWork at officeWorldwideFlexible hoursShift work3 days per week$298k - $368k
...team builds the system which learns the spatial-temporal representation... ...set of sensors, enabling engineers like you to (1) develop... ...hybrid role, you'll report to a Senior Staff Technical Lead Manager. You... ...Computer Science, Robotics, Machine Learning, or equivalent practical...SeniorFull timeRemote workShift work- ...workflows, and continuously learn and adapt. Moveworks is trusted... ...with Moveworks’ Reasoning Engine and natural language capabilities... ...Role We are looking for a Machine Learning Engineer to help... ...including distributed training and inference pipeline for large language...SeniorPermanent employmentWork at officeRemote workFlexible hours
$169k - $338k
...WalmartBusiness Segment: Home OfficeRole summary: The Principal, Machine Learning Engineer will lead the design and development of scalable,... ...solutions with organizational goals while mentoring technical staff and promoting engineering excellence. The successful candidate...Full timeTemporary workPart timeWork experience placement- Wayve AV Core Engineering Team Wayve's AV Core organisation builds the... ...join a focused, high-impact senior team working with large-... ...efficiency and reliability of our machine learning operations stack. What you'... ...and large-scale inference. Senior-level ownership and...SeniorWork at officeRemote workVisa sponsorshipRelocation packageFlexible hoursShift work
$175k - $308.5k
Role Number: 200677962Team: Machine Learning and AILocation: Santa Clara; SeattlePosted: 2026... ...-13SummaryWe are the Foundation Model Inference team within Cloud OS and AI Inference... ...help set the technical direction for the engineers around you.This role sits within...SeniorWorldwideRelocation$150k - $210k
...InworldInworld is a research lab and inference provider focused on realtime AI... ...’s Top 10 Startups in the USA.Your impactWe're looking for an AI-native Senior Content Marketing Manager to build... ...marketingSit in on research and engineering conversations and pull out the ideas...SeniorFull timeWork at officeRelocation- ...Information Retrieval, and Knowledge Graphs. We're looking for a senior machine learning engineer to own the conversational intelligence layer: the agent's reasoning and tool-calling, the low-latency LLM inference behind it, and the knowledge services that keep every...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff / Senior Staff Machine Learning Engineer, Inference - USA. Be the first to apply!
- engineering aide Mountain View, CA
- technology administrator Mountain View, CA
- staff engineer Mountain View, CA
- senior staff engineer Mountain View, CA
- assistant engineer Mountain View, CA
- senior staff systems engineer Mountain View, CA
- staff security engineer Mountain View, CA
- software engineer staff Mountain View, CA
- machine learning ai engineer Mountain View, CA
- senior ml engineer Mountain View, CA


