Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Machine Learning Engineer - Vision Foundation Models

Zoox

Job Description

Job Description

The Perception team at Zoox is responsible for how our purpose-built robotaxi understands the world, including what happens inside the cabin. In this role, you will design, train, and evaluate vision-based in-cabin perception models that understand passengers, objects, and behaviors inside the vehicle. These models support rider safety and the operations that keep each ride running smoothly.

You will independently own a model area end to end, from data curation and training through evaluation and deployment under real-time and compute constraints, working closely with partners across the company. Your work has a direct impact on rider safety and experience as Zoox scales its robotaxi service.

In this role, you will...

  • Design, train, and evaluate vision models that understand passengers, objects, and behaviors inside the vehicle, across detection, pose, and action recognition.

  • Independently own a model or feature area end to end: curate data, define labeling guidelines, train and evaluate models, and take them through deployment.

  • Set the quality bar for the models you own, using rigorous evaluation and error analysis so they are reliable enough to support live operations.

  • Deploy models under real-time and compute constraints shared with the rest of the onboard perception system.

  • Partner across product, operations, safety, and vehicle software to turn requirements into model specifications, metrics, and validation plans.

Qualifications

  • MS or PhD in Computer Science, Machine Learning, Computer Vision, or a related field with 6+ years of industry experience (PhD with 3+ years).

  • Deep expertise in computer vision and deep learning for image and video understanding: object detection, pose and action recognition, and fine-grained classification, with hands-on experience with modern architectures (convolutional and vision-transformer detectors, and self-supervised or foundation-model backbones such as DINOv3).

  • Strong proficiency in Python and PyTorch for model design, training, and evaluation. 

  • Experience with vision-language models or foundation-model backbones, and with auto-labeling or synthetic data for long-tail and rare classes.

  • Track record of owning the full ML lifecycle on real-world data: dataset curation and labeling guidelines, training, metric design (precision, recall, and false-positive rate at an operating point), and error analysis. 

Bonus Qualifications

  • Experience with in-cabin or occupant monitoring (occupant or driver monitoring systems), ideally including multi-camera or fisheye imagery and low-light conditions.

  • Experience deploying deep learning models to real-time, resource-constrained systems (robotics, automotive, or edge devices) with TensorRT / ONNX or similar. 

  • Proficiency in C++ for model integration.

Base Salary Range

There are three major components to compensation for this position: salary, Amazon Restricted Stock Units (RSUs), and Zoox Stock Appreciation Rights. A sign-on bonus may be offered as part of the compensation package. The listed range applies only to the base salary. Compensation will vary based on geographic location and level. Leveling, as well as positioning within a level, is determined by a range of factors, including, but not limited to, a candidate's relevant years of experience, domain knowledge, and interview performance. The salary range listed in this posting is representative of the range of levels Zoox is considering for this position.

Zoox also offers a comprehensive package of benefits, including paid time off (e.g. sick leave, vacation, bereavement), unpaid time off, Zoox Stock Appreciation Rights, Amazon RSUs, health insurance, long-term care insurance, long-term and short-term disability insurance, and life insurance.

About Zoox

Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.


Follow us on LinkedIn


Accommodations

If you need an accommodation to participate in the application or interview process please reach out to View email address on ziprecruiter.com or your assigned recruiter.


A Final Note:

You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Vacancy posted 20 days ago
Similar jobs that could be interesting for youBased on the Machine Learning Engineer - Vision Foundation Models in Boston, MA vacancy
  • $107.66k - $161.7k

     ...unique platform to learn and connect with...  ...variety of AI language models (bots), including...  ...: Our small engineering team works on challenging...  ...At Poe, we use Machine Learning in...  ...understanding of mathematical foundations of Machine...  ...medical/dental/vision coverage, equity refreshers... 
    Foundation
    Remote job
    Full time
    Work experience placement
    Internship

    Quora

    Cambridge, MA
    1 day ago
  • $198.3k - $247.9k

     ...telematics data. As a Principal Machine Learning Engineer on the DriveWell Atlas team...  ...learning, physics-informed modeling, and experience with sensor...  ...Machine Learning Engineer, Foundation Models  to help us change...  ...(RSUs) Medical, Dental, Vision and Life Insurance,... 
    Foundation
    Temporary work
    Summer work
    Work from home
    Worldwide
    Flexible hours

    Cambridge Mobile Telematics

    Cambridge, MA
    7 days ago
  • $165k - $185k

     ...Job Description Senior Machine Learning Engineer - Active LearningAbout Sense...  ...disaggregation and fault detection models that are running on meters...  ...models and build the foundation model of electrical devices...  ...Plan (Medical, Dental & Vision) Retirement Plan (401k, IRA... 
    Foundation
    Temporary work
    Work at office
    Work from home
    2 days per week

    Sense

    Cambridge, MA
    20 days ago
  •  ...components.   As a Senior Staff ML Engineer, you will lead the development of machine learning algorithms that can range in...  ...time Build multi-modal foundation models for on-vehicle and offline...  ...Experience with modern computer vision techniques Strong... 
    Foundation
    Temporary work
    Immediate start
    Relocation package

    Zoox

    Boston, MA
    7 days ago
  • $240k - $330k

     ...long-tail scenarios, and model errors that matter most....  ...framework, is the engine that powers this discovery. As a Principal Machine Learning Engineer, you will serve as a foundational technical leader shaping...  ...the long-term, multi-year vision for our foundation model... 
    Foundation
    Temporary work
    Immediate start

    Motional

    Boston, MA
    27 days ago
  • $100k - $315k

     ...the whole fleet’s learned experience to train...  ..., train our own models, work directly with...  ...team of researchers, engineers, technicians,...  ...expertise in computer vision and robotics, and...  ...and language foundation models across our...  ...robots to maximize machine learning potentialSkills... 
    Foundation
    Hourly pay
    Full time
    Work at office

    Tutor Intelligence

    Watertown, MA
    10 hours ago
  •  ...and talent with the singular vision of delivering differentiated...  ...future AI-powered operating models for large molecule discovery...  ...quantitative and mechanistic foundation that drives portfolio decisions...  ...ensuring rapid iteration and learning. Integrate: In vitro / in vivo... 
    Foundation
    Full time

    Takeda Pharmaceutical

    Boston, MA
    1 day ago
  • $100k - $160k

     ...in the world? Learn more about our unique...  ...the Catastrophe Engineering and Analytics (CAT...  ...development of models for various natural...  ...advanced data science, machine learning, and...  ...Strong academic foundation in probability theory...  ...Health, Dental and Vision benefits... 
    Foundation
    Temporary work
    Flexible hours

    Berkshire Hathaway Specialty Insurance

    Boston, MA
    25 days ago
  • $95k - $154k

     ...Job Description Job Description ML Engineer / Junior AI Developer Build AI With Strong Foundations Machine learning and AI roles require more than enthusiasm. Employers...  ...who can code, work with data, understand model behavior, evaluate results, and explain decisions... 
    Foundation
    Full time

    SynergisticIT

    Boston, MA
    21 days ago
  • $35 per hour

     ...Machine Learning Engineer  About the Company Cartesian is building spatial...  ...signals and mobile computer vision, we provide a uniquely...  ...from the US National Science Foundation, we've bootstrapped to a live...  ...framing and data, through modeling and evaluation, to production... 
    Foundation

    Cartesian Systems

    Cambridge, MA
    1 day ago
  • $170k - $200k

     ...We're looking for a Senior Machine Learning Engineer to help advance the state of...  ...-edge machine learning models that power our products. You...  ...Full health, dental, and vision coverage Flexible PTO with...  .... That's why we've built a foundation of intentional systems: from... 
    Foundation
    Remote job
    Full time
    Work at office
    Flexible hours

    modulate

    Somerville, MA
    4 days ago
  • $184.7k - $324.8k

    Role Number: 200682418Team: Machine Learning and AI, Software and...  ...partnering directly with the modeling teams. We're growing the team...  ...owns the data and metrics foundation for evaluating speech LLMs...  ...Computer Science, Electrical Engineering, or a related field, or equivalent... 
    Foundation
    Relocation

    Apple

    Somerville, MA
    3 days ago
  • $140k - $190k

     ...more accessible for all. To learn more about Care Access,...  ...joining our team as a  Senior Machine Learning Engineer , you will play a pivotal role...  .... Develop advanced ML models and LLM-powered agents for critical...  ...paid medical, dental, and vision insurance plan options ~... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Worldwide
    Visa sponsorship
    Work visa
    Flexible hours

    Care Access

    Boston, MA
    9 days ago
  •  ...followed by the Dill Autonomy Engine: generalized autonomy that...  ...rigorous and self-directed Senior Machine Learning Engineer to own machine...  ...the data engines that feed our models, training and experimentation...  ...Train and Iterate on Large Vision Models: You will fine-tune large... 

    Pickle Robot Company

    Charlestown, MA
    5 days ago
  •  ...Responsibilities Design and optimize ML models for computer vision and robotics under tight compute and...  ...advanced degree in Computer Science, Engineering, or related field. Hands-on...  ...innovation, execution, and continuous learning. Competitive salary, meaningful equity... 
    Remote job
    Full time

    tycho-ai

    Cambridge, MA
    4 days ago
  • $197.3k - $225.1k

     ...AI Engineer 4 (Vision model (VLM) customization experience) At Capital One, we are creating responsible...  ...been an industry leader in using machine learning to create real-time, personalized...  ...Team Description: The Intelligent Foundations and Experiences (IFX) team is at the... 
    Foundation
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    4 days ago
  •  ...of pioneers in robotics and machine learning. We are now hiring to scale...  ...Responsibilities Build computer vision and visual representation...  .... Develop visual models that support reinforcement learning...  ...learning, and simulation engineers to define the perception strategy... 
    Full time
    Immediate start
    Shift work

    ekarobotics

    Boston, MA
    4 days ago
  • $110k - $138k

     ...doing? The Computer Vision Specialist is a...  ...computer vision and the machine learning behind it. Customer demand...  ...and vision language models. Translate a business...  ...to use pretrained or foundation models, fine tune, or...  ...in Computer Science, Engineering, Robotics, or a... 
    Foundation
    Full time
    Work experience placement
    Remote work
    Flexible hours
    Shift work

    World Wide Technology

    Cambridge, MA
    3 days ago
  • $30 per hour

     ...real projects, work alongside engineers and researchers pushing the...  ...who bring strong academic foundations, curiosity that doesn't...  ...in training and fine-tuning machine learning models using industry-standard frameworks...  ...learning Computer vision  Robotics Bonus Qualifications... 
    Foundation
    Hourly pay
    Full time
    Contract work
    Internship
    Work at office

    Zoox

    Boston, MA
    4 days ago
  • $197.3k - $225.1k

     ...Overview Lead Machine Learning Engineer (Finance Tech - AI Enablement) At...  ...disciplines, such as Ops, Modeling, and Data Engineering. In this...  ...machine learning and foundation models,  Collaborate as part...  ...thought leadership and technical vision to the long term roadmap of... 
    Foundation
    Full time
    Part time
    Internship
    H1b
    Local area
    Flexible hours

    Capital One

    Cambridge, MA
    26 days ago
  •  ...collection, cleaning, feature engineering, labeling, training,...  ...and evaluate LLMs and other models for reliability, latency, cost...  ...higher in Computer Science, Machine Learning, AI, or a related field, or...  ...learning. Strong foundation in machine learning, deep learning... 
    Foundation
    Full time

    Flagship Pioneering, Inc.

    Cambridge, MA
    11 days ago
  • $180k - $220k

     ...looking for a Senior Staff Audio Machine Learning Engineer to join the Spot Sensing team....  ...from unsupervised models (e.g., BGMM) to state-of-the-art...  ...representations with computer vision, thermal imaging, or multimodal foundation models/VLMs).Background in rotating... 
    Foundation
    Full time
    Visa sponsorship

    Boston Dynamics

    Waltham, MA
    10 hours ago
  •  ...Diffraqtion builds a novel Quantum Vision System that pulls more...  ...hiring a Computer Vision Engineer to build the models at the center of our...  ...have shipped estimators and learned models that had to work on...  ...working knowledge of C++. Solid foundation in image formation, camera... 
    Foundation
    Permanent employment
    Local area

    Diffraqtion

    Somerville, MA
    10 hours ago
  • $181.5k - $278.3k

     ...leveraging modern approaches in machine learning and artificial intelligence...  ...strategic initiatives. Vision and Roadmap: Develop and...  ...team of 6-7+ high-performing engineers. Strategically allocate resources...  ...of new solutions.Foundation Model Readiness: Architect the compute... 
    Foundation
    Temporary work
    Relocation package

    PathAI

    Boston, MA
    3 days ago
  •  ...regular in-person events. Learn more about our flexible approach...  ...About the Role: As a Machine Learning Engineer, you will have the...  ...and geospatial, as well as foundational problems executing on a high...  ...advancing our algorithms and models. About You: Minimum Qualifications... 
    Permanent employment
    Full time
    Work at office
    Remote work
    Work from home
    Flexible hours

    Instacart

    Cambridge, MA
    1 day ago
  •  ...of pioneers in robotics and machine learning. We are now hiring to scale...  ...: Design simulation models and domain randomization strategies...  .... Data & Pipeline Engineering: Develop scalable data management...  ...Transformers, CNNs, and Foundation Models. Technical... 
    Foundation
    Full time
    Immediate start

    ekarobotics

    Boston, MA
    4 days ago
  •  ...information in natural intuitive are engineers and researchers building AI-...  ...help build and evaluate the machine learning systems behind these...  ...of NLP large language models and information retrieval. You...  ...looking for someone with a strong foundation in computer science and... 
    Foundation
    Internship

    Apple

    Cambridge, MA
    5 days ago
  • $57 per hour

     ...2027 Summer Intern Clinical Statistical Modeling Grade: Intern Location: Cambridge...  ...? At Sanofi, you'll be empowered to learn, ask questions, and bring your ideas to...  ...programming and data analysis Strong foundation in statistical theory and methods (e.g.,... 
    Foundation
    Hourly pay
    Apprenticeship
    Summer work
    Internship
    Summer internship
    H1b
    Work at office
    Worldwide
    Relocation
    Monday to Friday

    Sanofi

    Cambridge, MA
    1 day ago
  • $197.3k - $225.1k

     ...and meet real customer needs. We are seeking Machine Learning Engineers who are passionate about leveraging cutting-...  ...AI transformations and scaling production models across Capital One. In Risk Tech, we provide the foundation for Capital One to thrive in an uncertain world... 
    Foundation
    Full time
    Part time
    H1b
    Local area

    Capital One

    Cambridge, MA
    4 days ago
  • $197.3k - $225.1k

     ...Overview Machine Learning Engineer 4 Do you love building and pioneering in the AI and technology space?...  ...AI transformations and scaling production models across Capital One. In Risk Tech, we provide the foundation for Capital One to thrive in an uncertain world... 
    Foundation
    Full time
    Part time
    H1b
    Local area

    Capital One

    Cambridge, MA
    a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Machine Learning Engineer - Vision Foundation Models. Be the first to apply!