Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff / Senior Staff Machine Learning Engineer, Inference - USA

Inworld AI

About Inworld Inworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. We build first-party speech models, serve LLMs, and run the inference behind modular APIs designed for high-volume, realtime workloads. Hundreds of millions of users interact with Inworld powered apps every day and we serve over 10 trillion LLM tokens per month. Our models and infrastructure support consumer applications across companions, healthcare, fitness, education, media, and more. Our work spans model research, realtime inference, large-scale serving infrastructure, and the APIs developers use to bring these capabilities into production. We've raised more than $125M from Lightspeed Venture Partners, Section 32, Kleiner Perkins, Microsoft's M12 venture fund, Founders Fund, Meta, Stanford, and others. Our technology has powered experiences from companies including NVIDIA, Microsoft Xbox, Niantic, Logitech Streamlabs, Wishroll, Little Umbrella, and Bible Chat. Inworld has also been recognized by CB Insights as one of the 100 most promising AI companies globally and named one of LinkedIn's Top 10 Startups in the USA. Who We're Looking For A year ago, reliably working agentic systems and sub-second multimodal inference at scale barely existed. Nobody has a decade of experience here. So we're not screening for a resume template - we're looking for strong people from varied backgrounds who learn fast, thrive in ambiguity, and can show us what they've built, broken, and understood. Experience We Find Useful You don't need all of this. But you need enough to make a case. Inference Optimization. Deep understanding of modern serving frameworks and techniques like vLLM or TRT-LLM. Model Acceleration . Hands-on experience with quantization, distillation, caching strategies , continuous batching, paged attention, and speculative decoding. High-Performance Systems. Proficiency in C++, CUDA, Rust, or highly optimized Python. You know how to profile code and squeeze every ounce of performance out of NVIDIA GPUs. Distributed Systems & Scaling. Experience with Kubernetes, Ray, custom load balancing, multi-GPU/multi-node inference, and reliably handling thousands of concurrent connections. Public work. Non-trivial systems programming projects, open-source contributions to major inference engines, or deep-dive technical write-ups. Full-cycle ownership. You can take a model from the research team, containerize it, optimize its serving, and ensure it runs reliably in production. Background. PhD in CS, Physics, Math, or equivalent practical experience building backend or ML systems. Who Thrives Here You don't need a roadmap to start walking; you're comfortable picking a direction and building the map as you go. You believe engineering isn't finished until it's shipped and stable. You have a bias for impact over purely theoretical optimizations. You don't just ship code; you obsess over the why. You're the first to question an architecture if you think there's a better way to solve the core latency or throughput problem. You aren't satisfied with "the PM said so." You thrive on deep context and want to understand the fundamental logic behind every decision we make. What Working Here Is Like We hand you unclear problems and expect you to make them clear. We value engineers who say "I don't know yet" and then design the benchmark or prototype that finds out. We treat performance, latency, and reliability as first-class product features, not a box to check before launch. Impact comes before everything else, though we support sharing work and open-source contributions that move the field forward. Your work should be visible. Flat structure, fast iterations, minimal process theater. We believe in the power of in-person collaboration to solve the hardest problems and foster a strong team culture. We offer relocation assistance and look forward to you joining us in our Mountain View office. The base salary range for this full-time position is $270,000 - $430,000+ bonus + equity + benefits. Inworld Jobs Privacy Inworld AI

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Staff / Senior Staff Machine Learning Engineer, Inference - USA in Mountain View, CA vacancy
  •  ...InworldInworld is a research lab and inference provider focused on realtime...  ...’s Top 10 Startups in the USA.Who We're Looking ForA year...  ...people from varied backgrounds who learn fast, thrive in ambiguity, and...  ...to major inference engines, or deep-dive technical write-... 
    Senior
    Full time
    Work at office
    Relocation package

    Inworld AI

    Mountain View, CA
    2 days ago
  • $250k - $300k

     ...Job Description Job Description Senior Machine Learning Engineer, Inference Job Summary For our client, a fast-growing AI company building realtime voice and LLM technology, we are looking for a Senior Machine Learning Engineer with strong expertise in ML inference... 
    Senior
    Permanent employment
    Full time
    Contract work
    H1b
    Local area
    Remote work
    Relocation
    Relocation package

    AIDA Recruitment

    Mountain View, CA
    4 days ago
  •  ...of robots is expensive. We can't rely on one hardware vendor or the most expensive accelerators. We're looking for an Inference Optimization engineer to make Rhoda's models run fast, correctly, and cheaply on a wide range of hardware: AMD Instinct GPUs, Google TPUs, wafer... 
    Senior
    Full time

    rhoda-ai

    Mountain View, CA
    8 days ago
  • $143k - $286k

     ...43000 - $286000/yearType: Full time / Regular/PermanentCompany: WalmartBusiness Segment: Home OfficeRole summary: The Senior Machine Learning Engineer will lead the design, development, and deployment of scalable machine learning solutions that address complex business... 
    Senior
    Full time
    Temporary work
    Part time
    Work experience placement

    Walmart

    Sunnyvale, CA
    4 days ago
  • $251k - $310k

    Staff/Sr. Staff Machine Learning Engineer - World Modeling, Simulation Waymo is an autonomous driving technology...  ...In this role, you will report to a Senior Staff Engineering Manager You Will:...  ...Optimize for Production & Serving: Scale inference and evaluation frameworks into... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    2 days ago
  • $195.2k - $262.2k

     ...in-house AI/ML infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across...  ...software and AI R&D. The role   As a Senior Machine Learning Engineer on the Applied AI team at Nebius... 
    Senior
    Temporary work
    Immediate start
    Remote work

    Nebius

    Palo Alto, CA
    5 days ago
  • $280k - $350k

     ...InworldInworld is a research lab and inference provider focused on realtime AI for...  ...of LinkedIn’s Top 10 Startups in the USA.About the roleInworld Inference...  ...running on capacity reserved for it.As a Staff or Principal Software Engineer, you'll design that platform's core... 
    Full time
    Work at office
    Relocation

    Inworld AI

    Mountain View, CA
    3 days ago
  • $174.08k - $229.04k

     ...users around the world and 300 billion ideas saved, Pinterest Machine Learning engineers help build personalized experiences to help Pinners create...  ...our various ML teams. Please only apply once within the USA or Canada as multiple applications may delay our recruitment... 
    Work at office
    Local area

    Pinterest

    Palo Alto, CA
    12 hours ago
  • $165.2k - $223.6k

    Amazon AI is looking for a machine learning engineer to be part of inference optimization team working on optimizing large...  ...other employees, supervisors, and staff; adhere to standards of excellence...  ...Learn more about our benefits at .USA, CA, Santa Clara - 165,200.00 - 223... 
    Internship
    Local area
    Work from home
    Flexible hours

    Amazon

    Santa Clara, CA
    12 hours ago
  • $195k - $230k

     ...more information, visit About the RoleWe are looking for a Senior Machine Learning Engineer to help evolve our large-scale recommendation systems...  ...business metrics.Own systems from offline training online inference A/B experimentation metric analysis.Identify and resolve... 
    Senior
    Full time
    Local area
    Work from home

    News Break

    Mountain View, CA
    12 hours ago
  • $202k

     ...Delivery Search team builds large-scale machine learning systems that help consumers...  ...scale.Role & ResponsibilitiesAs a Senior Machine Learning Engineer on the Delivery Search team, you will...  ...scalable model training, evaluation, and inference pipelines; conduct offline and... 
    Senior
    Full time
    Work at office
    Remote work

    Uber

    Sunnyvale, CA
    3 hours ago
  • $188.5k - $282.7k

     ...SAGE, Rubrik's Semantic AI Governance Engine, which is the first system designed to...  ...Engineering High-Performance Model Serving and Inference Infrastructure (25% of time)Designing...  ...(or higher) in Computer Science, Machine Learning, Computer Engineering, Statistics, or a... 
    Senior
    Permanent employment

    Rubrik

    Palo Alto, CA
    3 days ago
  • $175k - $215k

    Senior Machine Learning Engineer, Growth Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver...  ...systems: feature pipelines, training data generation, batch inference. Strong SQL and Python, plus large-scale data processing... 
    Senior
    Full time
    Remote work
    Shift work

    Waymo

    Mountain View, CA
    2 days ago
  • $213k - $263k

    Waymo Onboard ML Inference Engineer Waymo is an autonomous driving technology company with the...  ...and automate the lifecycle of the machine learning workflow, including feature and experiment...  ...hybrid role, you will report to the Senior Manager of Runtime and Optimization.... 
    Senior
    Full time
    Remote work

    CapitalG

    Mountain View, CA
    2 days ago
  •  ...connection. Our computer vision and machine learning (CVML) team of researchers and engineers tackle previously unsolved...  ...Description We seek a proactive Senior Machine Learning Engineer to join...  ...model efficiency for on-device inference, and ensuring algorithms perform... 
    Senior
    Work experience placement

    Apple

    Sunnyvale, CA
    2 days ago
  • $130k - $260k

     ...WalmartBusiness Segment: Home OfficePosition Summary... As a Staff Machine Learning Engineer, you will architect and lead the development of scalable,...  ..., leveraging containerization, GPU orchestration, and inference optimization frameworks such as NVIDIA TensorRT. Drive... 
    Full time
    Temporary work
    Part time
    Work experience placement

    Walmart

    Sunnyvale, CA
    1 day ago
  • $130k - $260k

     ...: WalmartBusiness Segment: Home OfficeRole summary: As a Staff Machine Learning Engineer at Walmart, you will lead the design and deployment of scalable...  ...intelligence, machine learning, measurement, and causal inference to redefine retail experiences, optimize operations, and... 
    Full time
    Temporary work
    Part time
    Work experience placement

    Walmart

    Sunnyvale, CA
    4 days ago
  • Senior Machine Learning Engineer Applied Intuition, Inc. is powering the future of physical AI. Founded in 2017 and now valued at $15 billion, the...  ...and coverage of simulated scenes Scale training and inference of large generative models for production workloads Define... 
    Senior
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Day shift

    Applied Intuition

    Sunnyvale, CA
    2 days ago
  •  ...get the most out of the frontier models. We are hiring a Senior Machine Learning Engineer to lead this effort. You will own the end-to-end...  ...Publications or open-source contributions in forecasting, causal inference, calibration or agentic systems. This range reflects the... 
    Senior
    Work at office
    Worldwide

    Unity

    Mountain View, CA
    2 days ago
  • $213k - $263k

     ...time Fleet Monitoring and event response engine to support expansion to global...  ...monitoring models, including automated training/inference pipelines, low-latency spatial data...  ...product use-cases/services. ~ Prior Machine Learning Engineering experience in Python using... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    12 days ago
  • $195.2k - $262.2k

     ...large in-house AI/ML infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems...  ...pipelines, and production engineering. A Senior Machine Learning Engineer owns substantial ML work end to end... 
    Senior
    Temporary work
    Immediate start
    Remote work

    Nebius

    Palo Alto, CA
    2 days ago
  • $170.6k - $261.3k

     ...shaping the future of transportation on a global scale.As a Senior Machine Learning Engineer on the State Estimation and Mapping (SEAM) organization,...  ...‑sensor conditions. Implement efficient training and inference pipelines, including model optimization techniques (e.g.... 
    Senior
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    3 days ago
  • $227k - $300k

     ...production-grade AI on the Edge. We are looking for a great Senior Staff Machine Learning Engineer to join our seasoned AI team and lead the development...  ...decent working knowledge of modern C++ (C++14/17 for inference). Deep proficiency with PyTorch or TensorFlow, and... 
    Senior
    Work at office
    Worldwide
    Flexible hours
    Shift work
    3 days per week

    Energy Jobline ZR

    Mountain View, CA
    2 days ago
  • $298k - $368k

     ...team builds the system which learns the spatial-temporal representation...  ...set of sensors, enabling engineers like you to (1) develop...  ...hybrid role, you'll report to a Senior Staff Technical Lead Manager. You...  ...Computer Science, Robotics, Machine Learning, or equivalent practical... 
    Senior
    Full time
    Remote work
    Shift work

    Waymo

    Mountain View, CA
    12 days ago
  •  ...workflows, and continuously learn and adapt. Moveworks is trusted...  ...with Moveworks’ Reasoning Engine and natural language capabilities...  ...Role We are looking for a Machine Learning Engineer to help...  ...including distributed training and inference pipeline for large language... 
    Senior
    Permanent employment
    Work at office
    Remote work
    Flexible hours

    ServiceNow

    Mountain View, CA
    2 days ago
  • $169k - $338k

     ...WalmartBusiness Segment: Home OfficeRole summary: The Principal, Machine Learning Engineer will lead the design and development of scalable,...  ...solutions with organizational goals while mentoring technical staff and promoting engineering excellence. The successful candidate... 
    Full time
    Temporary work
    Part time
    Work experience placement

    Walmart

    Sunnyvale, CA
    2 days ago
  • Wayve AV Core Engineering Team Wayve's AV Core organisation builds the...  ...join a focused, high-impact senior team working with large-...  ...efficiency and reliability of our machine learning operations stack. What you'...  ...and large-scale inference. Senior-level ownership and... 
    Senior
    Work at office
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours
    Shift work

    Wayve

    Sunnyvale, CA
    2 days ago
  • $175k - $308.5k

    Role Number: 200677962Team: Machine Learning and AILocation: Santa Clara; SeattlePosted: 2026...  ...-13SummaryWe are the Foundation Model Inference team within Cloud OS and AI Inference...  ...help set the technical direction for the engineers around you.This role sits within... 
    Senior
    Worldwide
    Relocation

    Apple

    Santa Clara, CA
    2 days ago
  • $150k - $210k

     ...InworldInworld is a research lab and inference provider focused on realtime AI...  ...’s Top 10 Startups in the USA.Your impactWe're looking for an AI-native Senior Content Marketing Manager to build...  ...marketingSit in on research and engineering conversations and pull out the ideas... 
    Senior
    Full time
    Work at office
    Relocation

    Inworld AI

    Mountain View, CA
    4 days ago
  •  ...Information Retrieval, and Knowledge Graphs. We're looking for a senior machine learning engineer to own the conversational intelligence layer: the agent's reasoning and tool-calling, the low-latency LLM inference behind it, and the knowledge services that keep every... 
    Senior

    Apple

    Cupertino, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff / Senior Staff Machine Learning Engineer, Inference - USA. Be the first to apply!