Senior, ML Engineer - VLM

Role Description

You will own the offline dataset pipeline, which includes:

• Designing, implementing, testing, and deploying Cloud-based pipelines that convert logged multi-sensor data into VLM/VLA training datasets.
• Building VLM-assisted auto-labeling with open-vocabulary detection, dense captioning, and semantic enrichment.
• Generating reasoning-grounded labels that support VLA training and explainable driving behavior.
• Mining and curating the long tail to improve downstream VLM/VLA model metrics.
• Closing the data flywheel by defining dataset schemas, quality metrics, and validation.
• Partnering with the end-to-end model team to co-define dataset specifications.
• Scaling on cloud infrastructure with distributed, reproducible pipelines.
• Leading and mentoring less-experienced engineers and driving alignment across team interfaces.
• Staying current with advances in multimodal models and translating research into production data systems.

Qualifications

• Bachelor’s Degree in Computer Science, Robotics, Electrical Engineering, or related technical field plus 6+ years of experience; OR Master’s Degree in a related technical field plus 3+ years of experience.
• Considered highly skilled and proficient in discipline; conducts complex work under minimal supervision.

Requirements

• Computer Vision & Deep Learning: model training and at least two of the following: 2D/3D Object Detection, Tracking, Sensor Fusion, Semantic Segmentation, BEV, Depth Estimation.
• Multimodal / VLM experience: hands-on work with vision-language models, open-vocabulary or zero-shot recognition, dense captioning, or semantic embeddings/search.
• Model Data Curation: building targeted datasets that improve downstream model performance; experience with large-scale Parquet data processing.
• Distributed ML & data frameworks: experience with PyTorch, Lightning, Ray, Spark, or equivalent.
• Scaled MLOps & Tooling: experience with experiment tracking, model registry, and ML metrics.
• Development Tools & Eco-System: strong Python software development skills, experience with CI systems and Docker.

Benefits

• A competitive compensation package that includes a bonus component and stock options.
• 100% paid medical, dental, and vision premiums for full-time employees.
• 401K plan with a 6% employer match.
• Flexibility in schedule and generous paid vacation available immediately after start date.
• Company-wide holiday office closures.
• AD+D and Life Insurance.