Machine Learning Engineer - Vision Foundation Models
Zoox
Job Description
Job Description
The Perception team at Zoox is responsible for how our purpose-built robotaxi understands the world, including what happens inside the cabin. In this role, you will design, train, and evaluate vision-based in-cabin perception models that understand passengers, objects, and behaviors inside the vehicle. These models support rider safety and the operations that keep each ride running smoothly.
You will independently own a model area end to end, from data curation and training through evaluation and deployment under real-time and compute constraints, working closely with partners across the company. Your work has a direct impact on rider safety and experience as Zoox scales its robotaxi service.
In this role, you will...
-
Design, train, and evaluate vision models that understand passengers, objects, and behaviors inside the vehicle, across detection, pose, and action recognition.
-
Independently own a model or feature area end to end: curate data, define labeling guidelines, train and evaluate models, and take them through deployment.
-
Set the quality bar for the models you own, using rigorous evaluation and error analysis so they are reliable enough to support live operations.
-
Deploy models under real-time and compute constraints shared with the rest of the onboard perception system.
-
Partner across product, operations, safety, and vehicle software to turn requirements into model specifications, metrics, and validation plans.
-
MS or PhD in Computer Science, Machine Learning, Computer Vision, or a related field with 6+ years of industry experience (PhD with 3+ years).
-
Deep expertise in computer vision and deep learning for image and video understanding: object detection, pose and action recognition, and fine-grained classification, with hands-on experience with modern architectures (convolutional and vision-transformer detectors, and self-supervised or foundation-model backbones such as DINOv3).
-
Strong proficiency in Python and PyTorch for model design, training, and evaluation.
-
Experience with vision-language models or foundation-model backbones, and with auto-labeling or synthetic data for long-tail and rare classes.
-
Track record of owning the full ML lifecycle on real-world data: dataset curation and labeling guidelines, training, metric design (precision, recall, and false-positive rate at an operating point), and error analysis.
-
Experience with in-cabin or occupant monitoring (occupant or driver monitoring systems), ideally including multi-camera or fisheye imagery and low-light conditions.
-
Experience deploying deep learning models to real-time, resource-constrained systems (robotics, automotive, or edge devices) with TensorRT / ONNX or similar.
-
Proficiency in C++ for model integration.
Base Salary Range
There are three major components to compensation for this position: salary, Amazon Restricted Stock Units (RSUs), and Zoox Stock Appreciation Rights. A sign-on bonus may be offered as part of the compensation package. The listed range applies only to the base salary. Compensation will vary based on geographic location and level. Leveling, as well as positioning within a level, is determined by a range of factors, including, but not limited to, a candidate's relevant years of experience, domain knowledge, and interview performance. The salary range listed in this posting is representative of the range of levels Zoox is considering for this position.
Zoox also offers a comprehensive package of benefits, including paid time off (e.g. sick leave, vacation, bereavement), unpaid time off, Zoox Stock Appreciation Rights, Amazon RSUs, health insurance, long-term care insurance, long-term and short-term disability insurance, and life insurance.
About Zoox
Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.
Follow us on LinkedIn
Accommodations
If you need an accommodation to participate in the application or interview process please reach out to View email address on ziprecruiter.com or your assigned recruiter.
A Final Note:
You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
$107.66k - $161.7k
...unique platform to learn and connect with... ...variety of AI language models (bots), including... ...: Our small engineering team works on challenging... ...At Poe, we use Machine Learning in... ...understanding of mathematical foundations of Machine... ...medical/dental/vision coverage, equity refreshers...FoundationRemote jobFull timeWork experience placementInternship$198.3k - $247.9k
...telematics data. As a Principal Machine Learning Engineer on the DriveWell Atlas team... ...learning, physics-informed modeling, and experience with sensor... ...Machine Learning Engineer, Foundation Models to help us change... ...(RSUs) Medical, Dental, Vision and Life Insurance,...FoundationTemporary workSummer workWork from homeWorldwideFlexible hours$165k - $185k
...Job Description Senior Machine Learning Engineer - Active LearningAbout Sense... ...disaggregation and fault detection models that are running on meters... ...models and build the foundation model of electrical devices... ...Plan (Medical, Dental & Vision) Retirement Plan (401k, IRA...FoundationTemporary workWork at officeWork from home2 days per week- ...components. As a Senior Staff ML Engineer, you will lead the development of machine learning algorithms that can range in... ...time Build multi-modal foundation models for on-vehicle and offline... ...Experience with modern computer vision techniques Strong...FoundationTemporary workImmediate startRelocation package
$240k - $330k
...long-tail scenarios, and model errors that matter most.... ...framework, is the engine that powers this discovery. As a Principal Machine Learning Engineer, you will serve as a foundational technical leader shaping... ...the long-term, multi-year vision for our foundation model...FoundationTemporary workImmediate start$100k - $315k
...the whole fleet’s learned experience to train... ..., train our own models, work directly with... ...team of researchers, engineers, technicians,... ...expertise in computer vision and robotics, and... ...and language foundation models across our... ...robots to maximize machine learning potentialSkills...FoundationHourly payFull timeWork at office- ...and talent with the singular vision of delivering differentiated... ...future AI-powered operating models for large molecule discovery... ...quantitative and mechanistic foundation that drives portfolio decisions... ...ensuring rapid iteration and learning. Integrate: In vitro / in vivo...FoundationFull time
$100k - $160k
...in the world? Learn more about our unique... ...the Catastrophe Engineering and Analytics (CAT... ...development of models for various natural... ...advanced data science, machine learning, and... ...Strong academic foundation in probability theory... ...Health, Dental and Vision benefits...FoundationTemporary workFlexible hours$95k - $154k
...Job Description Job Description ML Engineer / Junior AI Developer Build AI With Strong Foundations Machine learning and AI roles require more than enthusiasm. Employers... ...who can code, work with data, understand model behavior, evaluate results, and explain decisions...FoundationFull time$35 per hour
...Machine Learning Engineer About the Company Cartesian is building spatial... ...signals and mobile computer vision, we provide a uniquely... ...from the US National Science Foundation, we've bootstrapped to a live... ...framing and data, through modeling and evaluation, to production...Foundation$170k - $200k
...We're looking for a Senior Machine Learning Engineer to help advance the state of... ...-edge machine learning models that power our products. You... ...Full health, dental, and vision coverage Flexible PTO with... .... That's why we've built a foundation of intentional systems: from...FoundationRemote jobFull timeWork at officeFlexible hours$184.7k - $324.8k
Role Number: 200682418Team: Machine Learning and AI, Software and... ...partnering directly with the modeling teams. We're growing the team... ...owns the data and metrics foundation for evaluating speech LLMs... ...Computer Science, Electrical Engineering, or a related field, or equivalent...FoundationRelocation$140k - $190k
...more accessible for all. To learn more about Care Access,... ...joining our team as a Senior Machine Learning Engineer , you will play a pivotal role... .... Develop advanced ML models and LLM-powered agents for critical... ...paid medical, dental, and vision insurance plan options ~...Full timeTemporary workWork at officeLocal areaRemote workWorldwideVisa sponsorshipWork visaFlexible hours- ...followed by the Dill Autonomy Engine: generalized autonomy that... ...rigorous and self-directed Senior Machine Learning Engineer to own machine... ...the data engines that feed our models, training and experimentation... ...Train and Iterate on Large Vision Models: You will fine-tune large...
- ...Responsibilities Design and optimize ML models for computer vision and robotics under tight compute and... ...advanced degree in Computer Science, Engineering, or related field. Hands-on... ...innovation, execution, and continuous learning. Competitive salary, meaningful equity...Remote jobFull time
$197.3k - $225.1k
...AI Engineer 4 (Vision model (VLM) customization experience) At Capital One, we are creating responsible... ...been an industry leader in using machine learning to create real-time, personalized... ...Team Description: The Intelligent Foundations and Experiences (IFX) team is at the...FoundationFull timePart timeLocal area- ...of pioneers in robotics and machine learning. We are now hiring to scale... ...Responsibilities Build computer vision and visual representation... .... Develop visual models that support reinforcement learning... ...learning, and simulation engineers to define the perception strategy...Full timeImmediate startShift work
$110k - $138k
...doing? The Computer Vision Specialist is a... ...computer vision and the machine learning behind it. Customer demand... ...and vision language models. Translate a business... ...to use pretrained or foundation models, fine tune, or... ...in Computer Science, Engineering, Robotics, or a...FoundationFull timeWork experience placementRemote workFlexible hoursShift work$30 per hour
...real projects, work alongside engineers and researchers pushing the... ...who bring strong academic foundations, curiosity that doesn't... ...in training and fine-tuning machine learning models using industry-standard frameworks... ...learning Computer vision Robotics Bonus Qualifications...FoundationHourly payFull timeContract workInternshipWork at office$197.3k - $225.1k
...Overview Lead Machine Learning Engineer (Finance Tech - AI Enablement) At... ...disciplines, such as Ops, Modeling, and Data Engineering. In this... ...machine learning and foundation models, Collaborate as part... ...thought leadership and technical vision to the long term roadmap of...FoundationFull timePart timeInternshipH1bLocal areaFlexible hours- ...collection, cleaning, feature engineering, labeling, training,... ...and evaluate LLMs and other models for reliability, latency, cost... ...higher in Computer Science, Machine Learning, AI, or a related field, or... ...learning. Strong foundation in machine learning, deep learning...FoundationFull time
$180k - $220k
...looking for a Senior Staff Audio Machine Learning Engineer to join the Spot Sensing team.... ...from unsupervised models (e.g., BGMM) to state-of-the-art... ...representations with computer vision, thermal imaging, or multimodal foundation models/VLMs).Background in rotating...FoundationFull timeVisa sponsorship- ...Diffraqtion builds a novel Quantum Vision System that pulls more... ...hiring a Computer Vision Engineer to build the models at the center of our... ...have shipped estimators and learned models that had to work on... ...working knowledge of C++. Solid foundation in image formation, camera...FoundationPermanent employmentLocal area
$181.5k - $278.3k
...leveraging modern approaches in machine learning and artificial intelligence... ...strategic initiatives. Vision and Roadmap: Develop and... ...team of 6-7+ high-performing engineers. Strategically allocate resources... ...of new solutions.Foundation Model Readiness: Architect the compute...FoundationTemporary workRelocation package- ...regular in-person events. Learn more about our flexible approach... ...About the Role: As a Machine Learning Engineer, you will have the... ...and geospatial, as well as foundational problems executing on a high... ...advancing our algorithms and models. About You: Minimum Qualifications...Permanent employmentFull timeWork at officeRemote workWork from homeFlexible hours
- ...of pioneers in robotics and machine learning. We are now hiring to scale... ...: Design simulation models and domain randomization strategies... .... Data & Pipeline Engineering: Develop scalable data management... ...Transformers, CNNs, and Foundation Models. Technical...FoundationFull timeImmediate start
- ...information in natural intuitive are engineers and researchers building AI-... ...help build and evaluate the machine learning systems behind these... ...of NLP large language models and information retrieval. You... ...looking for someone with a strong foundation in computer science and...FoundationInternship
$57 per hour
...2027 Summer Intern Clinical Statistical Modeling Grade: Intern Location: Cambridge... ...? At Sanofi, you'll be empowered to learn, ask questions, and bring your ideas to... ...programming and data analysis Strong foundation in statistical theory and methods (e.g.,...FoundationHourly payApprenticeshipSummer workInternshipSummer internshipH1bWork at officeWorldwideRelocationMonday to Friday$197.3k - $225.1k
...and meet real customer needs. We are seeking Machine Learning Engineers who are passionate about leveraging cutting-... ...AI transformations and scaling production models across Capital One. In Risk Tech, we provide the foundation for Capital One to thrive in an uncertain world...FoundationFull timePart timeH1bLocal area$197.3k - $225.1k
...Overview Machine Learning Engineer 4 Do you love building and pioneering in the AI and technology space?... ...AI transformations and scaling production models across Capital One. In Risk Tech, we provide the foundation for Capital One to thrive in an uncertain world...FoundationFull timePart timeH1bLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Machine Learning Engineer - Vision Foundation Models. Be the first to apply!
- senior ml engineer Boston, MA
- machine learning software engineer Boston, MA
- computer vision machine learning engineer Boston, MA
- machine learning engineer Boston, MA
- machine vision Boston, MA
- foundation relations Boston, MA
- director of foundation relations Boston, MA
- private foundation Boston, MA
- foundation program manager Boston, MA
- national science foundation Boston, MA







