Senior AI Data Pipeline Engineer (Autonomous Driving)
Full-time
42dot
We are looking for the best About Us 42dot is a mobility AI company committed to solving mobility challenges with software and AI. As the Global Software Center of Hyundai Motor Group, 42dot pioneers the future of mobility by advancing the development of software-defined vehicles. We develop safety-first, user-centric software-defined vehicle technologies that deliver the latest performance through continuous updates like smartphones. By advancing software and AI technology, 42dot envisions a world where everything is connected and moves autonomously through a self-managing urban transportation operating system. Our AI Data Pipeline Engineers build up the core data processing pipelines and datasets readiness for autonomous driving cutting edge algorithms. We develop the distributed system of a scalable data pipeline for large-scale dataset (millions of scenes), as well as high-performance data serving SDKs for ML model training / evaluation. The data pipelines we deliver could highly improve the efficiency of ML model development lifecycle, including training, evaluation, deployment, as well as monitoring in the cloud environment . Responsibilities
- Develop high scale, reliable data extraction pipeline to extract millions of raw data from data collection fleet and convert to high-value scene data
- Develop data labeling pipelines to perform the auto labeling inferences for autonomous driving algorithms
- Develop advanced autonomous driving data SDK, including scene data search, datasets preparation, dataset loading, etc.
- Build up the data lakehouse for autonomous driving scene dataset, including the sensor data, calibration data, as well as annotation data
- Dig into performance bottlenecks all along the data processing pipelines, from data processing latency, data search latency to Test Procedure (TP) coverage.
- Bootstrap and maintain infrastructure for data platform components—data processing pipeline, database, data lakehouse and data serving.
- Collaborate with cross-functional teams, including ML algorithm, ML application, and Cloud Infra to align data pipelines with overall autonomous driving system architecture.
- Bachelor's degree or higher in Computer Science, Engineering, Robotics, or a similar technical field.
- Minimum of 7 years of experience in Data Engineering, DataOps or ML Platform roles
- Proficient in Python and solid experience in Python SDK development
- Solid hands-on experience with data pipeline job orchestration with Databricks Workflows or Apache Airflow, as well as integrating data pipelines with machine learning models
- Solid working experience in Databases (e.g., MongoDB, PostgreSQL, etc)
- Extensive experience with data technologies and architectures such as Data Warehouse (e.g., Hive) or Lakehouse (e.g., Delta Lake)
- Experience with Apache Spark or other big data computing engines
- Excellent leadership and communication skills, with a demonstrated ability to lead technical projects
- Experience with autonomous vehicle sensor data (e.g., LiDAR, camera, radar)
- Experience with ML model training lifecycle (e.g., data preparation, model training / validation / deployment, etc)
- Understanding of modern AI frameworks (e.g., PyTorch, TensorFlow etc.)
- Understanding data governance principles, data privacy regulations, and experience implementing security measures to protect data
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior AI Data Pipeline Engineer (Autonomous Driving) in California vacancy
$180k - $258.75k
...the state of the art in AI, robotics, driving, and material sciences.... ...We are looking for a Senior Data Engineer to design and build the foundational... ...large-scale ingestion pipelines, structured feature... ...systems, ideally in robotics, autonomous driving, or large-scale ML...SeniorLocal areaShift work- ...Design and integrate planning frameworks that bridge end-to-end AI driving models with deterministic safety systems and vehicle dynamics.... ...a related field with over 12 years of industry experience in autonomous systems or safety-critical software. Must possess strong C++...Senior
NVIDIA AI
Santa Clara, CA21 hours ago $203.45k - $344.3k
...of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including... ...of the vehicle-cloud integrated data closed-loop from a strategic perspective... ..., data architecture and closed-loop engineering system. Job Responsbilities Responsible...SeniorFull timeTemporary workWork experience placementXPENG
California25 days ago$184k - $287.5k
...computers, robots and self-driving cars that can perceive... ...for an extraordinary Senior Perception Engineer to develop and productize NVIDIA’s autonomous driving solutions. As... ...and prioritize data-driven development by... ...Intelligent machines powered by AI are no longer science...SeniorOdd jobFull timeWork experience placementRemote workNvidia
Santa Clara, CAa month ago$193.93k - $291.15k
...Nuro believes self-driving vehicles are the... ...opportunity for AI to drive... ...developing Level 4 autonomous driving technology... ...ML and systems engineering converge to push... ...performance forward. As a Senior Perception ML Data Infrastructure... ...sensor parsing, pipeline propagation, and...SeniorImmediate startFlexible hoursNuro
Mountain View, CA10 days ago$244.14k - $413.16k
...innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including... ...of global driving. As a Senior Staff Machine Learning Engineer, you will architect the transition... ...agent interactions. Scaling & Data Strategy: Define scaling laws for...SeniorFull timeOverseasXPENG
Californiaa month ago- # Senior Data EngineerBay Area (Remote-Flexible)Full-timeData EngineeringWe are seeking... ...intersection of data architecture, pipeline engineering, and AI readiness. The ideal candidate looks... ...making it legible and accessible to autonomous systems.Most AI projects fail...SeniorRemote workFlexible hours
Your AI Department
San Francisco, CA2 days ago $128k - $252.5k
...businesses. We are hiring a Senior Data Scientist to... ...define data strategy, drive technical development,... ...tools, products, and AI services. You will work... ...interdisciplinary data scientists, engineers, architects, and... ...and clinical trials, autonomous systems and edge AI,...SeniorVisa sponsorshipDeloitte France
San Francisco, CA10 hours ago$251k - $310k
Waymo is an autonomous driving technology company with the mission to be the... ..., logical, and physical data models. Define core data... ...maintain data warehouse and pipeline solutions. Bring in and transform... ...experience in data engineering or a related field ~ Proven...SeniorFull timeRemote workWaymo
California9 days ago$184k - $287.5k
...into the unlimited potential of AI to define the next era of... ...of computers, robots, and self-driving cars that can understand the world... ...expanding ecosystem of data center platform designs. From... ...searching for a highly motivated engineer to lead performance benchmarking...SeniorFull timeNvidia
Santa Clara, CAa month ago$168k - $270.25k
...using the power of AI to define the next... ...robots, and self-driving cars. Doing what's... ...NVIDIA is hiring a Senior Engineer to build the company's Enterprise Data Governance... ...processing, indexing pipelines, and systems built... ...you're creative and autonomous, we want to hear from...SeniorFull timeShift workNvidia
Santa Clara, CA9 days ago$130k - $145k
Hunter Industries is seeking a Senior Data Engineer who designs, develops, and... ...enterprise data systems and pipelines that enable the organization... ...advanced use cases such as AI and machine learning. The Senior... ...manufacturing industries. Driving our continued success is the...SeniorHourly payFull timeWork experience placementWork at officeLocal areaHunter Industries
San Marcos, CA15 days ago$166k - $220k
...powered by Lattice OS, an AI-powered operating... ...that turns thousands of data streams into a realtime... ...ABOUT THE TEAMAs a Data Engineer on the Analytics Team,... ...build and implement data pipelines and models that enable... ...collaborative roles focused on driving operational execution....SeniorFull timeWork experience placementImmediate startShift workAnduril Industries
Costa Mesa, CAa month ago$213k - $263k
...Waymo is an autonomous driving technology company with... ...advanced ML and engineering team that leverages... ..., and generative AI to automatically... ..., and power the data engine that... ...will report to a Senior Staff Technical Lead... ...data processing pipelines for ML training....SeniorFull timeRemote workWaymo
San Francisco, CA4 days ago$193.93k - $291.15k
...Are Nuro believes self-driving vehicles are the most... ...profound opportunity for AI to drive positive... ...company developing Level 4 autonomous driving technology for... ...generalists where ML and systems engineering converge. This is not... ...raise the bar on the data and evaluation loop...SeniorImmediate startFlexible hours$198k - $297k
...productive, and happy. The Role As a Data Engineer you will handle everything from data architecture and modeling to data pipeline tooling and dashboarding. You will enable other... ...of existing data models through AI code generation on eventing, customer level...SeniorWork at officeLocal areaRemote workFlexible hours$193.93k - $352.29k
...Nuro believes self-driving vehicles are the... ...profound opportunity for AI to drive positive... ...Level 4 autonomous driving technology... ...training and evaluation data. The team plays... ...with system engineers to thoroughly validate... ...and streaming data pipelines that can ingest and...SeniorWork experience placementImmediate startFlexible hours$168k - $264.5k
...the unlimited potential of AI to define the next era of computing... ..., robots, and self-driving cars that can understand the... ...motivated and experienced Senior Data Application Engineer, to join our Enterprise Data... ...enable self-healing data pipelines, automated anomaly detection...SeniorFull timeNvidia
Santa Clara, CA3 days ago- ...have built a platform that uses AI to transform publicly available data into real time operational insights... ..., they are now looking to hire a Senior Data Engineer, who will be an integral part of... ...exciting projects, building new pipelines, migrating from one service to another...SeniorImmediate start
Next Ventures
San Francisco, CA2 days ago $175k - $275k
...everything. HealthLeap is building the AI operating system that helps care teams... ...delivering results that are changing lives. Senior Data Engineer About the role HealthLeap runs on... ...add another 100. You’ll build the core pipelines that move messy clinical data from...SeniorWork at officeWork from homeHome officeHealthLeap
San Francisco, CA1 day ago- ...Senior Data Engineer We are looking for a Senior Data Engineer to work with a leading generative AI company in healthcare. Location: Palo Alto, CA office. This role is expected... ...Build and operate data platforms and pipelines (batch/stream) that feed training, RAG...SeniorWork at office
Investigo
Palo Alto, CA2 days ago $180k - $220k
...Senior Data EngineerBerkeley, CAAt Aircapture we're creating technology... ...our technology by owning the pipelines, models, and analyses that... ...systems into the insights that our engineers and scientists rely upon.... ...Aircapture using your own words (not AI).What You'll Do HereOwn and...SeniorAircapture
Berkeley, CA2 days ago$150.4k - $277.6k
...seeking an exceptional engineer with a background in large... ...engineering team that drives Apache Spark’s state‑of... ...technologies to build data intensive systems,... ...implementation of production data pipelines at scale 4 Years+... ...~ Familiarity with ML/AI workflows and feature...SeniorApple
Sunnyvale, CA2 days ago$205k - $240k
...Senior Data EngineerAt Swoop, our mission is simple: Improving... ...As a market leader in AI-driven, data-powered,... ...the signals that drive earlier diagnosis, better... ...HCPs.As a Senior Data Engineer, you will own Nimble's... ...evolve batch and streaming pipelines on PySpark/EMR, Kinesis...SeniorTemporary workLive outNimbleRx
Redwood City, CA1 day ago$204k - $259k
Waymo is an autonomous driving technology company with the mission to be the world'... ...Waymo’s audacious goals. Waymo data scientists work hand-in-hand with engineering teams at each stage of the software... ...and communicate findings to senior stakeholders. Establish yourself...SeniorFull timeRemote workWaymo
Mountain View, CA21 hours ago- ...Senior Data EngineerKiddom is transforming K–12 education by bringing high-quality... ....We're looking for a Senior Data Engineer to join Kiddom's Content & AI Systems team, building the data... ...content delivery. You'll own the pipelines, schemas, and validation frameworks...SeniorLocal areaFlexible hours
Kiddom
San Francisco, CA2 days ago - ...a high-caliber team, drives growth, and delivers clarity... ...of this journey!! The Senior Software Engineer - Business... ...intelligence solutions, ETL pipelines, enterprise reporting... ...initiatives by contributing to data architecture,... ...Problem Solving Python AI Agent GenAI/LLM Role Design...Senior
Synoptek
Los Angeles, CA10 hours ago $182k - $242k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by... ...at What You’ll Do The Data Engineering Team builds and operates the... ...CoreWeave. We design resilient data pipelines, scalable lakehouse systems,... ...The Role We’re seeking a Senior Data Engineer to design and...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursCoreWeave
San Francisco, CA1 day ago$200k - $250k
...We’re building the AI intelligence... ...to healthcare and drives meaningful ROI for... ...Ambience runs on data: which clinicians... ...verify—is a hard data engineering problem, and it's... ...you'll own. As a Senior Data Engineer, you... ...build and run the pipelines that ingest clinical...SeniorWork at officeRemote workFlexible hoursAmbience Healthcare, Inc.
San Francisco, CA21 hours ago$170k - $200k
...Senior Data EngineerLos Angeles, California, United StatesTatari is on... ...the intelligent application of AI and machine learning, Tatari... ...major era.As a Senior Data Engineer in our Reporting and Measure... ...and own the large-scale data pipelines that turn high-volume raw data...Senior2 days per weekTatari
Los Angeles, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Data Pipeline Engineer (Autonomous Driving). Be the first to apply!
Related searches
- ai developer California
- ai engineer California
- ai engineer remote California
- senior data center engineer California
- senior cloud data engineer California
- senior data integration developer California
- data developer California
- data engineer California
- data engineering intern summer California
- data engineer analytics California