Machine Learning Engineer - Vision Foundation Models
Zoox
Job Description
Job Description
The Perception team at Zoox is responsible for how our purpose-built robotaxi understands the world, including what happens inside the cabin. In this role, you will design, train, and evaluate vision-based in-cabin perception models that understand passengers, objects, and behaviors inside the vehicle. These models support rider safety and the operations that keep each ride running smoothly.
You will independently own a model area end to end, from data curation and training through evaluation and deployment under real-time and compute constraints, working closely with partners across the company. Your work has a direct impact on rider safety and experience as Zoox scales its robotaxi service.
In this role, you will...
-
Design, train, and evaluate vision models that understand passengers, objects, and behaviors inside the vehicle, across detection, pose, and action recognition.
-
Independently own a model or feature area end to end: curate data, define labeling guidelines, train and evaluate models, and take them through deployment.
-
Set the quality bar for the models you own, using rigorous evaluation and error analysis so they are reliable enough to support live operations.
-
Deploy models under real-time and compute constraints shared with the rest of the onboard perception system.
-
Partner across product, operations, safety, and vehicle software to turn requirements into model specifications, metrics, and validation plans.
-
MS or PhD in Computer Science, Machine Learning, Computer Vision, or a related field with 6+ years of industry experience (PhD with 3+ years).
-
Deep expertise in computer vision and deep learning for image and video understanding: object detection, pose and action recognition, and fine-grained classification, with hands-on experience with modern architectures (convolutional and vision-transformer detectors, and self-supervised or foundation-model backbones such as DINOv3).
-
Strong proficiency in Python and PyTorch for model design, training, and evaluation.
-
Experience with vision-language models or foundation-model backbones, and with auto-labeling or synthetic data for long-tail and rare classes.
-
Track record of owning the full ML lifecycle on real-world data: dataset curation and labeling guidelines, training, metric design (precision, recall, and false-positive rate at an operating point), and error analysis.
-
Experience with in-cabin or occupant monitoring (occupant or driver monitoring systems), ideally including multi-camera or fisheye imagery and low-light conditions.
-
Experience deploying deep learning models to real-time, resource-constrained systems (robotics, automotive, or edge devices) with TensorRT / ONNX or similar.
-
Proficiency in C++ for model integration.
Base Salary Range
There are three major components to compensation for this position: salary, Amazon Restricted Stock Units (RSUs), and Zoox Stock Appreciation Rights. A sign-on bonus may be offered as part of the compensation package. The listed range applies only to the base salary. Compensation will vary based on geographic location and level. Leveling, as well as positioning within a level, is determined by a range of factors, including, but not limited to, a candidate's relevant years of experience, domain knowledge, and interview performance. The salary range listed in this posting is representative of the range of levels Zoox is considering for this position.
Zoox also offers a comprehensive package of benefits, including paid time off (e.g. sick leave, vacation, bereavement), unpaid time off, Zoox Stock Appreciation Rights, Amazon RSUs, health insurance, long-term care insurance, long-term and short-term disability insurance, and life insurance.
About Zoox
Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.
Follow us on LinkedIn
Accommodations
If you need an accommodation to participate in the application or interview process please reach out to View email address on ziprecruiter.com or your assigned recruiter.
A Final Note:
You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
- ...understands the world, including what happens inside the cabin. In this role, you will design, train, and evaluate vision-based in-cabin perception models that understand passengers, objects, and behaviors inside the vehicle. These models support rider safety and the operations...FoundationFull time
$209.8k - $285k
...Summary We are seeking a Staff Machine Learning Engineer to play a foundational role in building and deploying our next-generation Large Driving Model (LDM) for the Rivian Autonomy stack... ...benefits including life, medical, dental, vision, short-term disability insurance,...FoundationFull timeContract workTemporary workPart timeLocal areaShift work- ...post-transformer frontier model that enables recurrent... ...for 1 or 2 R&D Engineers with a strong track record in machine learning models research . This... ...an extremely ambitious foundational project. There is a flexible... ...RL (candidates with a Vision or Robotics ML...FoundationPermanent employmentFull timeContract workImmediate startRemote workFlexible hours
- ...high-performance deep learning models that generate dense,... ...and flow . Develop "vision-first" fusion... ...sensor modalities . Engineer temporal processing modules... ...Science, Robotics, Machine Learning, or related... ...Model, or multi-modal 3D foundation model, or World Model...FoundationTemporary workRelocation package
- ...and run the best Computer Vision AI applications that make cameras... ...We are looking for a Machine Learning Engineer (US-based) to join our team... ...Design, train and fine‑tune models for object detection, classification... ...Adapt pretrained and foundation models (YOLO-family...FoundationHourly payFull time
$200k - $331k
...Summary We are seeking a Sr. Staff Machine Learning Engineer to lead model pretraining efforts for our Large... ...role is focused on building the foundation model layer for self-driving: scaling... ...benefits including life, medical, dental, vision, short-term disability insurance,...FoundationFull timeContract workTemporary workPart timeLocal areaShift work$212.49k - $295.25k
...to explore, create, play, learn, and connect with friends... ...can imagine to life. Our vision is to reimagine the way... ...experiences for everyone. As a Machine Learning Engineer on the Foundation AI organization, you will... ...of our foundation model efforts. While the...FoundationFull timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to Friday$259.03k - $311.43k
...explore, create, play, learn, and connect with... ...imagine to life. Our vision is to reimagine the way... ...seeking experienced machine learning engineers who thrive on solving... ...deep learning-based models for performance advertising... ...work will lay the foundation to deliver effective...FoundationFull timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to Friday- ...using it to train multimodal foundation models that learn the context-dependent... ...By combining cutting-edge machine learning with the most biologically... ...a Senior Machine Learning Engineer , you will play a leading... ...Gold medical as well as vision and dental plans for both the...FoundationWork at officeVisa sponsorshipFree visa3 days per week
$192.5k - $357.5k
..., leveraging data and novel computational models to drive impact. Seamless data sharing and... ...revolutionizing drug discovery with cutting-edge machine learning. We are seeking a Principal Machine Learning Engineer to join our Foundation Models team. In this role, you will drive...FoundationFull timeLocal areaWorldwideRelocation package$140k - $230k
...powering our collaborative foundation. Business-critical... ...core challenges of machine learning for 3D perception,... ...fusion, and computer vision in autonomous vehicles... ...skilled Machine Learning Engineer to help advance a... ...perception foundation models leveraging large-scale...FoundationTemporary workWork at officeFlexible hours3 days per week- ...Driving Intelligence team is responsible for developing/learning behavior models for road users such as cars, bicycles, and pedestrians... ...and validate our driving performance. As an ML Agents Machine Learning Engineer, you will work on the bleeding edge of the industry,...Temporary workRelocation package
$200k - $280k
...knit group of bold thinkers—engineers, innovators, and industry... ...that give our autonomous machines human-like awareness in... ...You'll develop computer vision and machine learning systems that turns noisy... ...dense scene representations, foundation-model-driven data engines, and...FoundationFull timeTemporary workFlexible hoursShift work$190k - $202k
...Wing is looking for a Machine Learning Engineer to join our Perception team... ..., you aren’t just building models in a vacuum; you have access... ...deep learning, or computer vision, ideally within robotics or... ...image features ~ Vision foundation models, VLMs, VLAs ~ Ability...FoundationFull timeLocal area- ...ML Research Engineer, Foundation Models About the Team Join a world-class team... ...tight-knit team of proven deep learning researchers, software... ...research at the intersection of machine learning, physics, and... ...benefits: Medical, Dental, and Vision (covered 100% for the...FoundationRemote jobFull timeTemporary work
$250k - $400k
...generation of frontier multimodal AI models. Founded by former DeepMind... ...Andrew Dai, previously an engineering leader on Gemini—our mission... ...and NVIDIA. We are tackling foundational problems in artificial... ...or orchestration layers for vision-language models. Model Understanding...FoundationFull time$195k - $350k
...by a world-class team: Engineers, designers, and operators... ...isn't a feature — it's the foundation. We're hiring an Machine Learning Engineer as the volume... ...engineers who can push our models and agent systems to be faster... ...⚕️ Health, Dental, Vision and Life Insurance Short...FoundationTemporary workWork at officeLocal areaFlexible hours$295.25k - $345.05k
...explore, create, play, learn, and connect with friends... ...imagine to life. Our vision is to reimagine the way... ...evaluate, deploy, and operate models quickly and safely—so a... ...a Principal Platform Engineer who treats platform as... ...all of Roblox.A Code Machine; you love not only to...FoundationFull timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to Friday- ...knit team of proven deep learning researchers, software engineers, and drug discovery... ...the next generation of AI foundation models that unlock new therapies... ...at the intersection of machine learning, physics, and computational... ...: Medical, Dental, and Vision (covered 100% for the...FoundationRemote jobFull timeTemporary workLocal area
$314.58k
..., we’ll explore your foundational skills and how you collaborate... ...builds the machine-learning systems that make ads... ...of Machine Learning Engineering to lead a broad portfolio of Ads Quality modeling teams focused on engagement... ...: Set the technical vision and multi-year...FoundationWork at officeLocal areaRelocationRelocation package- ...Title What You'll Do Build machine learning models for robotics control end-to-end:... ...excellence in full-stack foundation model research and engineering Exceptional ownership and initiativefinding... ...Bonus: Experience with Vision-Language-Action models for robotics...Foundation
- ...is currently seeking an AI/ML Engineer / Data Scientist (Predictive Modeling Contractor) for a prominent client... ...shared data and technical foundations (e.g. Ontologies, Knowledge Graphs... ...Expertise in predictive modeling, machine learning, and AI prototyping. Hands-on...FoundationContract workFor contractorsWork at officeRemote work
- Stanford University is seeking a Machine Learning Engineer to support advanced technical research within the Weill Cancer Hub. This role will focus... ..., reliability, transparency, and clinical utility of ML/AI models intended for translational impact and eventual deployment....Foundation
$228k - $285k
...underpinning Rivian's Perception model training plaform Develop... ...of entire software engineering life cycle Coordinate with... ...robust medical/Rx, dental and vision insurance packages for full-time... ...evaluate your personal technical foundation, real-time problem-solving logic...FoundationFull timeContract workLocal area- ..., we're building the foundation behind the foundation models: the data collection... ...re hiring a Research Engineer / Scientist to help lead... ...the intersection of vision-language models and robot learning. You will build... ...Computer Science, Robotics, Machine Learning, or a...FoundationFull timeFlexible hours
$328.61k - $399.42k
...to explore, create, play, learn, and connect with friends... ...can imagine to life. Our vision is to reimagine the way... ...tech spectrum, including machine learning, classifiers for 3D models, experimentation, automation... ...report to the Senior Engineering Manager of the Account Identity...Full timeWork experience placementH1bWork at officeLocal areaImmediate startVisa sponsorshipMonday to Friday- ...We are looking for top engineers that combine... ...robust and performant ML models. AI/ML: Experience... ..., VLAs, reinforcement learning, and deep neural nets.... ...have a key role in the foundation of our overall AI/ML roadmap... ...’re building physical machines, so we aim for 5 days...FoundationFull timeWork at officeRelocation package
$340k
...vehicle’s driving trajectory. As a Principal ML Engineer, you will lead the technical development of machine learning algorithms for our next-generation ML Planner... ...closely with teams specializing in Foundation Models, Perception, Simulation, and Safety Validation...FoundationFull timeTemporary workImmediate startRelocation package- ...industry experience (minimum 4 years in the U.S.) BS/MS in Computer Science or related field Strong foundation in machine learning, deep learning, and computer vision Proven experience with scalable ML infrastructure and distributed systems Proficient in Python...Foundation
- ...The 3D Simulation group at Zoox is looking for machine learning engineers to bring the latest research in 3D vision to accelerate autonomy by blurring the line between... ...conditions using reconstruction and generative models. You will have access to the best sensor data in...Temporary workRelocation package
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Machine Learning Engineer - Vision Foundation Models. Be the first to apply!
- senior ml engineer Foster, CA
- machine learning engineer Foster, CA
- foundation relations Foster, CA
- education foundation Foster, CA
- family foundation Foster, CA
- machine learning Foster, CA
- machine learning research scientist Foster, CA
- machine learning scientist Foster, CA
- internship machine learning Foster, CA
- machine learning remote Foster, CA




