Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Machine Learning Engineer - Vision Foundation Models

Zoox

Job Description

Job Description

The Perception team at Zoox is responsible for how our purpose-built robotaxi understands the world, including what happens inside the cabin. In this role, you will design, train, and evaluate vision-based in-cabin perception models that understand passengers, objects, and behaviors inside the vehicle. These models support rider safety and the operations that keep each ride running smoothly.

You will independently own a model area end to end, from data curation and training through evaluation and deployment under real-time and compute constraints, working closely with partners across the company. Your work has a direct impact on rider safety and experience as Zoox scales its robotaxi service.

In this role, you will...

  • Design, train, and evaluate vision models that understand passengers, objects, and behaviors inside the vehicle, across detection, pose, and action recognition.

  • Independently own a model or feature area end to end: curate data, define labeling guidelines, train and evaluate models, and take them through deployment.

  • Set the quality bar for the models you own, using rigorous evaluation and error analysis so they are reliable enough to support live operations.

  • Deploy models under real-time and compute constraints shared with the rest of the onboard perception system.

  • Partner across product, operations, safety, and vehicle software to turn requirements into model specifications, metrics, and validation plans.

Qualifications

  • MS or PhD in Computer Science, Machine Learning, Computer Vision, or a related field with 6+ years of industry experience (PhD with 3+ years).

  • Deep expertise in computer vision and deep learning for image and video understanding: object detection, pose and action recognition, and fine-grained classification, with hands-on experience with modern architectures (convolutional and vision-transformer detectors, and self-supervised or foundation-model backbones such as DINOv3).

  • Strong proficiency in Python and PyTorch for model design, training, and evaluation. 

  • Experience with vision-language models or foundation-model backbones, and with auto-labeling or synthetic data for long-tail and rare classes.

  • Track record of owning the full ML lifecycle on real-world data: dataset curation and labeling guidelines, training, metric design (precision, recall, and false-positive rate at an operating point), and error analysis. 

Bonus Qualifications

  • Experience with in-cabin or occupant monitoring (occupant or driver monitoring systems), ideally including multi-camera or fisheye imagery and low-light conditions.

  • Experience deploying deep learning models to real-time, resource-constrained systems (robotics, automotive, or edge devices) with TensorRT / ONNX or similar. 

  • Proficiency in C++ for model integration.

Base Salary Range

There are three major components to compensation for this position: salary, Amazon Restricted Stock Units (RSUs), and Zoox Stock Appreciation Rights. A sign-on bonus may be offered as part of the compensation package. The listed range applies only to the base salary. Compensation will vary based on geographic location and level. Leveling, as well as positioning within a level, is determined by a range of factors, including, but not limited to, a candidate's relevant years of experience, domain knowledge, and interview performance. The salary range listed in this posting is representative of the range of levels Zoox is considering for this position.

Zoox also offers a comprehensive package of benefits, including paid time off (e.g. sick leave, vacation, bereavement), unpaid time off, Zoox Stock Appreciation Rights, Amazon RSUs, health insurance, long-term care insurance, long-term and short-term disability insurance, and life insurance.

About Zoox

Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.


Follow us on LinkedIn


Accommodations

If you need an accommodation to participate in the application or interview process please reach out to View email address on ziprecruiter.com or your assigned recruiter.


A Final Note:

You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Vacancy posted 21 days ago
Similar jobs that could be interesting for youBased on the Machine Learning Engineer - Vision Foundation Models in Foster, CA vacancy
  •  ...understands the world, including what happens inside the cabin. In this role, you will design, train, and evaluate vision-based in-cabin perception models that understand passengers, objects, and behaviors inside the vehicle. These models support rider safety and the operations... 
    Foundation
    Full time

    zoox

    Foster, CA
    5 days ago
  • $209.8k - $285k

     ...Summary We are seeking a Staff Machine Learning Engineer to play a foundational role in building and deploying our next-generation Large Driving Model (LDM) for the Rivian Autonomy stack...  ...benefits including life, medical, dental, vision, short-term disability insurance,... 
    Foundation
    Full time
    Contract work
    Temporary work
    Part time
    Local area
    Shift work

    Rivian

    Palo Alto, CA
    1 day ago
  •  ...post-transformer frontier model that enables recurrent...  ...for 1 or 2 R&D Engineers with a strong track record in machine learning models research . This...  ...an extremely ambitious foundational project. There is a flexible...  ...RL (candidates with a Vision or Robotics ML... 
    Foundation
    Permanent employment
    Full time
    Contract work
    Immediate start
    Remote work
    Flexible hours

    Pathway

    Palo Alto, CA
    16 days ago
  •  ...high-performance deep learning models that generate dense,...  ...and flow . Develop "vision-first" fusion...  ...sensor modalities . Engineer temporal processing modules...  ...Science, Robotics, Machine Learning, or related...  ...Model, or multi-modal 3D foundation model, or World Model... 
    Foundation
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    4 days ago
  •  ...and run the best Computer Vision AI applications that make cameras...  ...We are looking for a Machine Learning Engineer (US-based) to join our team...  ...Design, train and fine‑tune models for object detection, classification...  ...Adapt pretrained and foundation models (YOLO-family... 
    Foundation
    Hourly pay
    Full time

    Chooch AI

    San Mateo, CA
    4 days ago
  • $200k - $331k

     ...Summary We are seeking a Sr. Staff Machine Learning Engineer to lead model pretraining efforts for our Large...  ...role is focused on building the foundation model layer for self-driving: scaling...  ...benefits including life, medical, dental, vision, short-term disability insurance,... 
    Foundation
    Full time
    Contract work
    Temporary work
    Part time
    Local area
    Shift work

    Rivian

    Palo Alto, CA
    2 days ago
  • $212.49k - $295.25k

     ...to explore, create, play, learn, and connect with friends...  ...can imagine to life. Our vision is to reimagine the way...  ...experiences for everyone. As a Machine Learning Engineer on the Foundation AI organization, you will...  ...of our foundation model efforts. While the... 
    Foundation
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    2 days ago
  • $259.03k - $311.43k

     ...explore, create, play, learn, and connect with...  ...imagine to life. Our vision is to reimagine the way...  ...seeking experienced machine learning engineers who thrive on solving...  ...deep learning-based models for performance advertising...  ...work will lay the foundation to deliver effective... 
    Foundation
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    1 day ago
  •  ...using it to train multimodal foundation models that learn the context-dependent...  ...By combining cutting-edge machine learning with the most biologically...  ...a Senior Machine Learning Engineer , you will play a leading...  ...Gold medical as well as vision and dental plans for both the... 
    Foundation
    Work at office
    Visa sponsorship
    Free visa
    3 days per week

    Tahoe Therapeutics

    South San Francisco, CA
    22 days ago
  • $192.5k - $357.5k

     ..., leveraging data and novel computational models to drive impact. Seamless data sharing and...  ...revolutionizing drug discovery with cutting-edge machine learning. We are seeking a Principal Machine Learning Engineer to join our Foundation Models team. In this role, you will drive... 
    Foundation
    Full time
    Local area
    Worldwide
    Relocation package

    Genentech

    South San Francisco, CA
    4 days ago
  • $140k - $230k

     ...powering our collaborative foundation. Business-critical...  ...core challenges of machine learning for 3D perception,...  ...fusion, and computer vision in autonomous vehicles...  ...skilled Machine Learning Engineer to help advance a...  ...perception foundation models leveraging large-scale... 
    Foundation
    Temporary work
    Work at office
    Flexible hours
    3 days per week

    Woven by Toyota

    Palo Alto, CA
    12 days ago
  •  ...Driving Intelligence team is responsible for developing/learning behavior models for road users such as cars, bicycles, and pedestrians...  ...and validate our driving performance. As an ML Agents Machine Learning Engineer, you will work on the bleeding edge of the industry,... 
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    6 days ago
  • $200k - $280k

     ...knit group of bold thinkers—engineers, innovators, and industry...  ...that give our autonomous machines human-like awareness in...  ...You'll develop computer vision and machine learning systems that turns noisy...  ...dense scene representations, foundation-model-driven data engines, and... 
    Foundation
    Full time
    Temporary work
    Flexible hours
    Shift work

    Agtonomy

    South San Francisco, CA
    29 days ago
  • $190k - $202k

     ...Wing is looking for a Machine Learning Engineer to join our Perception team...  ..., you aren’t just building models in a vacuum; you have access...  ...deep learning, or computer vision, ideally within robotics or...  ...image features ~ Vision foundation models, VLMs, VLAs ~ Ability... 
    Foundation
    Full time
    Local area

    Wing

    Palo Alto, CA
    2 days ago
  •  ...ML Research Engineer, Foundation Models About the Team Join a world-class team...  ...tight-knit team of proven deep learning researchers, software...  ...research at the intersection of machine learning, physics, and...  ...benefits: Medical, Dental, and Vision (covered 100% for the... 
    Foundation
    Remote job
    Full time
    Temporary work

    genesis-molecular-ai

    San Mateo, CA
    4 days ago
  • $250k - $400k

     ...generation of frontier multimodal AI models. Founded by former DeepMind...  ...Andrew Dai, previously an engineering leader on Gemini—our mission...  ...and NVIDIA. We are tackling foundational problems in artificial...  ...or orchestration layers for vision-language models. Model Understanding... 
    Foundation
    Full time

    elorian-ai-inc

    Palo Alto, CA
    5 days ago
  • $195k - $350k

     ...by a world-class team: Engineers, designers, and operators...  ...isn't a feature — it's the foundation. We're hiring an Machine Learning Engineer as the volume...  ...engineers who can push our models and agent systems to be faster...  ...⚕️ Health, Dental, Vision and Life Insurance Short... 
    Foundation
    Temporary work
    Work at office
    Local area
    Flexible hours

    Eve

    San Mateo, CA
    1 day ago
  • $295.25k - $345.05k

     ...explore, create, play, learn, and connect with friends...  ...imagine to life. Our vision is to reimagine the way...  ...evaluate, deploy, and operate models quickly and safely—so a...  ...a Principal Platform Engineer who treats platform as...  ...all of Roblox.A Code Machine; you love not only to... 
    Foundation
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    5 days ago
  •  ...knit team of proven deep learning researchers, software engineers, and drug discovery...  ...the next generation of AI foundation models that unlock new therapies...  ...at the intersection of machine learning, physics, and computational...  ...: Medical, Dental, and Vision (covered 100% for the... 
    Foundation
    Remote job
    Full time
    Temporary work
    Local area

    genesis-molecular-ai

    San Mateo, CA
    4 days ago
  • $314.58k

     ..., we’ll explore your foundational skills and how you collaborate...  ...builds the machine-learning systems that make ads...  ...of Machine Learning Engineering to lead a broad portfolio of Ads Quality modeling teams focused on engagement...  ...: Set the technical vision and multi-year... 
    Foundation
    Work at office
    Local area
    Relocation
    Relocation package

    Pinterest

    Palo Alto, CA
    1 day ago
  •  ...Title What You'll Do Build machine learning models for robotics control end-to-end:...  ...excellence in full-stack foundation model research and engineering Exceptional ownership and initiativefinding...  ...Bonus: Experience with Vision-Language-Action models for robotics... 
    Foundation

    Genesis AI

    San Carlos, CA
    2 days ago
  •  ...is currently seeking an AI/ML Engineer / Data Scientist (Predictive Modeling Contractor) for a prominent client...  ...shared data and technical foundations (e.g. Ontologies, Knowledge Graphs...  ...Expertise in predictive modeling, machine learning, and AI prototyping. Hands-on... 
    Foundation
    Contract work
    For contractors
    Work at office
    Remote work

    The Fountain Group LLC

    South San Francisco, CA
    20 days ago
  • Stanford University is seeking a Machine Learning Engineer to support advanced technical research within the Weill Cancer Hub. This role will focus...  ..., reliability, transparency, and clinical utility of ML/AI models intended for translational impact and eventual deployment.... 
    Foundation

    Stanford University

    Palo Alto, CA
    2 days ago
  • $228k - $285k

     ...underpinning Rivian's Perception model training plaform Develop...  ...of entire software engineering life cycle Coordinate with...  ...robust medical/Rx, dental and vision insurance packages for full-time...  ...evaluate your personal technical foundation, real-time problem-solving logic... 
    Foundation
    Full time
    Contract work
    Local area

    Rivian

    Palo Alto, CA
    17 hours ago
  •  ..., we're building the foundation behind the foundation models: the data collection...  ...re hiring a Research Engineer / Scientist to help lead...  ...the intersection of vision-language models and robot learning. You will build...  ...Computer Science, Robotics, Machine Learning, or a... 
    Foundation
    Full time
    Flexible hours

    xdof

    San Mateo, CA
    5 days ago
  • $328.61k - $399.42k

     ...to explore, create, play, learn, and connect with friends...  ...can imagine to life. Our vision is to reimagine the way...  ...tech spectrum, including machine learning, classifiers for 3D models, experimentation, automation...  ...report to the Senior Engineering Manager of the Account Identity... 
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Immediate start
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    9 days ago
  •  ...We are looking for top engineers that combine...  ...robust and performant ML models. AI/ML: Experience...  ..., VLAs, reinforcement learning, and deep neural nets....  ...have a key role in the foundation of our overall AI/ML roadmap...  ...’re building physical machines, so we aim for 5 days... 
    Foundation
    Full time
    Work at office
    Relocation package

    zenos

    San Mateo, CA
    5 days ago
  • $340k

     ...vehicle’s driving trajectory. As a Principal ML Engineer, you will lead the technical development of machine learning algorithms for our next-generation ML Planner...  ...closely with teams specializing in Foundation Models, Perception, Simulation, and Safety Validation... 
    Foundation
    Full time
    Temporary work
    Immediate start
    Relocation package

    Zoox

    San Mateo, CA
    4 days ago
  •  ...industry experience (minimum 4 years in the U.S.) BS/MS in Computer Science or related field Strong foundation in machine learning, deep learning, and computer vision Proven experience with scalable ML infrastructure and distributed systems Proficient in Python... 
    Foundation

    Saxon Global

    Redwood City, CA
    19 hours ago
  •  ...The 3D Simulation group at Zoox is looking for machine learning engineers to bring the latest research in 3D vision to accelerate autonomy by blurring the line between...  ...conditions using reconstruction and generative models. You will have access to the best sensor data in... 
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    9 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Machine Learning Engineer - Vision Foundation Models. Be the first to apply!