Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Data Engineer, Data Quality & Datasets Pipelines [Remote]

Full-time

wayve

Sunnyvale, CA
  • Remote job

Before the detail, here's the challenge you'd help us solve.

We build the embodied intelligence that moves real vehicles safely, and the ecosystem a billion machines will run on in the future. Very few people in AI can say this. Every role here, whatever the team, plugs into that.

Here’s what this particular role covers.

️ About our Datasets Team

Wayve’s Datasets team own the driving data that our AI Driver learns from, covering ingestion, annotation (automatic and manual), retrieval and data quality. Our data is growing from hundreds of petabytes towards exabyte scale, and not all of it is equally valuable for training. This team decides what we keep and where, and builds the systems that make those decisions work in practice.

 

Your day-to-day

  • Implement and iterate filtering, retention and offload policies across hot, cold, archive and delete storage

  • Build the data movement and pipelines that our pre-ingestion selection model depends on

  • Decide where and how selection models run, balancing compute cost against data value

  • Build early, low-compute decision points that avoid expensive standardisation and enrichment of low-value data

  • Work with the storage and data infra teams, and monitor data quality to make sure our datasets reflect what model training needs

 

What you’ll be working on:

  • Turning our dataset strategy into working systems: moving, filtering, retaining and offloading driving data at hundreds of petabytes

  • The engineering behind our pre-ingestion selection mode(s)l: how data moves, where the model runs and how offload policies work

  • Delivering large, measurable storage-cost savings through early, low-compute decisions

  • Making sure our datasets contain the most useful behavioural and environmental coverage for training. This is as much a data quality challenge as a software engineering one

  • Working as a pair with our dataset strategy lead (who design and builds the models) and closely with the data infra team, shipping practical solutions quickly

 

You should apply if:

  • You’re a senior data or software engineer who has run data ingestion or data quality pipelines at petabyte scale

  • You’re strong in Python and Spark, with cloud data engineering experience

  • You have good judgement on data filtering and quality, and know how to check you haven’t discarded valuable data

  • You ship practical solutions quickly and are comfortable iterating on live systems

  • You’re a software engineer at heart, building the systems around models rather than the models themselves

  • You enjoy working closely with data infra and storage teams

  • You bring experience in AV, robotics, fleet data or high-volume IoT, or with retention, offload and data lifecycle policies (a bonus rather than a requirement)

 

Not ticking every box? That’s totally okay! If you’re passionate about autonomy and keen to learn, we encourage you to apply even if you don’t meet every requirement.

 

More about Wayve:

Wayve is building the leading AI platform for autonomous driving. We are pioneering an end to end AI approach that enables vehicles to learn directly from real world experience, developing the ability to adapt, generalise and improve at scale. Instead of relying on hand coded rules or pre mapped environments, our AI Driver learns to drive by understanding the world around it. The result is technology that navigates complex urban environments with intelligence, precision and natural flow, unlocking meaningful advances in both safety and efficiency. We believe autonomy represents a once in a generation transformation in how people and goods move, comparable to the shift from horses to cars, and from human driven vehicles to intelligent machines.

Our ambition is to make autonomy universal. Wayve’s mapless and hardware agnostic AI platform integrates with global OEM partners, enabling continuous software evolution and unlocking advanced levels of automation from L2 plus through to L4 as our core AI model scales. In a race increasingly defined by intelligence and real world learning, Wayve is taking a distinct approach, building a generalisable driving intelligence that can power any vehicle, anywhere. By combining embodied AI with scalable deployment, we are creating technology that can be shaped to each OEM brand and driver experience, accelerating the transition to a safer, more intelligent future of mobility.

 

How we work — Locations & Flexible Working:

Our main hubs are in London, Sunnyvale, Yokohama, Herzliya, Vancouver and Leonberg. We operate a hybrid working model that combines in-person collaboration in our dedicated office spaces with focused time working remotely. This gives our teams the connection and energy of working together, alongside the flexibility to do their best work in a way that fits their lives.

 

The Interview Process:

Our process is clear and respectful of your time:

  • Initial call / recruiter screen (30 mins)

  • Intro with the hiring manager (Find out more about the role, your exp etc; 1 hour)

  • Competency Interviews (System design and technical leadership; 2 hours)

  • Deep Dive (Domain Interview; 1 hour)

  • Final interview : mission & values alignment (1 hour)

We’ll always explain the format and work around your availability.

 

What’s in it for you (Location dependent):

Salaries benchmarked against the market annually
Meaningful equity, sharing in the ownership and long term success of Wayve
✈️ Relocation support and visa sponsorship where applicable
✅ Hybrid working, core hours and the chance to work hands on in vehicle workshops and labs
Learning and development budgets with support for training, conferences and growth
Comprehensive benefits including health insurance, dental, enhanced maternity and paternity leave, retirement or pension where applicable, access to therapists, wellbeing partner discounts and more

A quick, honest note before you apply.

Wayve is not a mature, fully-structured place with the playbook already written. Much of how we work is still being written, and if you join, you’ll help write it. That suits people who want real ownership more than people who need a settled structure from day one.

If that sounds like the kind of problem you want to spend your time on, we’d really like to hear from you.

At Wayve we're committed to creating a diverse, fair and respectful culture that is inclusive of everyone based on their unique skills and perspectives, and regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, veteran status, pregnancy or related condition (including breastfeeding) or any other basis as protected by applicable law.

For more information visit Careers at Wayve. To learn more about what drives us, visit Values at Wayve

DISCLAIMER: We will not ask about marriage or pregnancy, care responsibilities or disabilities in any of our job adverts or interviews. However, we do look to capture information about care responsibilities, and disabilities among other diversity information as part of an optional DEI Monitoring form to help us identify areas of improvement in our hiring process and ensure that the process is inclusive and non-discriminatory.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Principal Data Engineer, Data Quality & Datasets Pipelines [Remote] in Sunnyvale, CA vacancy
  •  ...for a lead expert in data and platform engineering to guide the...  ...workflows. We are seeking a Principal Data & Platform...  ...services and shared datasets. You will shape the...  ...orchestration, data agreements, quality monitoring,...  ...investigations across pipelines, applications, SQL engines... 
    Pipeline
    Quality
    Full time
    Immediate start

    Nvidia

    Santa Clara, CA
    4 days ago
  • $240k - $320k

     ...by inventing high-quality technologies and services...  ...system integration engineers to define, build,...  ...the Senior Principal Engineer - ADAS & AV Data Loop & AI Flywheel,...  ...cases, auto-labels datasets, retrains deep learning...  ...automation, active learning pipelines, auto-labeling,... 
    Pipeline
    Quality
    Full time
    Work experience placement
    Local area
    Flexible hours

    Robert Bosch

    Sunnyvale, CA
    4 days ago
  • $200k - $245k

     ...and technically accomplished Director, Data Products Engineering to lead the architecture, engineering...  ...responsible for engineering high-quality AI/data products, designing scalable...  ...operationalization of scalable cloud-native data pipelines and data services. Drive... 
    Pipeline
    Quality
    Work from home
    Flexible hours

    PayNearMe

    Santa Clara, CA
    2 days ago
  •  ...Urgent Hiring: Senior Data Analytics Engineer Location: Santa Clara, CA...  ...engineering and operational datasets into actionable insights....  ...anomaly detection ETL / ELT pipelines Working with time-series...  ...human review. Improve data quality, performance, and... 
    Pipeline
    Quality

    SIDRAM TECHNOLOGIES

    Santa Clara, CA
    2 days ago
  • $60 - $65 per hour

     ...and help build analytics that engineers can trust. This role focuses on designing data pipelines and architectures for clean, usable...  ...engineering and operational datasets. What you’ll deliver Analytics...  .... Ongoing improvements to data quality, performance, and accessibility... 
    Pipeline
    Quality
    Hourly pay

    Cloud Destinations LLC.

    Santa Clara, CA
    4 days ago
  • $180k - $330k

     ...build next. SR. ANALYTICS ENGINEER (X) We are seeking a...  ...build and maintain robust data systems that enable high-...  ...optimize end-to-end data pipelines for processing high-volume datasets using tools such as Spark...  ...infrastructure that ensures data quality, consistency, and... 
    Pipeline
    Quality
    Temporary work

    SpaceXSI

    Mountain View, CA
    5 days ago
  • $167k - $270.5k

    Principal IT Data Engineer- Finance Palo Alto Networks Santa Clara, CA Our Mission At Palo Alto Networks...  ...-functional teams to deliver high-quality data solutions. Key Responsibilities Design, develop, and maintain data pipelines to extract, transform, and load (ETL)... 
    Pipeline
    Quality
    Full time
    Work at office
    Visa sponsorship
    Work visa

    Palo Alto Networks

    Santa Clara, CA
    more than 2 months ago
  • $206.2k - $356.4k

     ...better than we found it.The Video Engineering group is looking for an...  ...to lead a team that supports data collection software, firmware...  ...test infrastructure and data pipelines.DescriptionOur team bridges engineering...  ...it needs to deliver high-quality test data and results that... 
    Pipeline
    Quality
    Work at office
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  •  ...Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and...  ...to power AI at scale — the pipelines, lakehouse substrate, and data...  ...data-plane governance — catalog, quality, lineage, observability — that... 
    Pipeline
    Quality
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Mountain View, CA
    2 days ago
  • $184k - $287.5k

     ...organization is seeking a Senior Data Engineer to build and evolve...  ...into trusted, well-modeled datasets that enable data scientists,...  ...datacenter hardware is high quality, accessible, and optimized for...  ...maintain analytics-focused data pipelines that ingest, transform, and... 
    Pipeline
    Quality
    Full time
    Flexible hours

    Nvidia

    Santa Clara, CA
    1 day ago
  • $149.2k - $249k

     ...2026-06-09SummaryThe Finance Data Engineer is a technical expert who creates data interfaces, pipelines and codebase that drives innovative...  ...pipelines and feature-ready datasets• Collaborate with other...  ...interfacesAppreciation for data quality and validation in every... 
    Pipeline
    Quality
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  •  ...organization is looking for a Senior Data Engineer reporting to the Senior Data...  ...efficient, reliable ELT/ETL pipelines capable of processing both large-scale and specialized datasets.Intelligently design robust...  ...and deploy rigorous data quality frameworks to guarantee data... 
    Pipeline
    Quality
    Work at office
    Local area

    Atlassian

    Mountain View, CA
    4 days ago
  • $184k - $287.5k

     ...converts real-world sensor data into high-fidelity,...  ...Senior Synthetic Data Engineer to join the NVIDIA DRIVE...  ...extrapolation, scene completion, quality triage, regression...  ...gaps are found.Develop dataset quality assessments and...  ...and sensor simulation pipelines in data center or cloud... 
    Pipeline
    Quality
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    5 days ago
  • $117k - $234k

     ...scalable, intelligent data solutions that support...  ...this data. Partner with engineering, AI/ML, and product...  ...building complex data pipelines optimized for agent consumption...  ...affect retrieval quality and contextual...  ...and to work with large datasets across cloud-native and... 
    Pipeline
    Quality

    Walmart

    Sunnyvale, CA
    2 days ago
  • $184.7k - $324.8k

     ...better. Apple Services Engineering's Device Compute...  ...Analytics team provides the data foundation for Apple's...  .... You will build the pipelines and table designs that...  ...You will turn them into datasets people can trust and...  ...SQLExperience building data quality checks and monitoring... 
    Pipeline
    Quality
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $272k - $431.25k

     ...seeking an exceptional Principal Perception Engineer to lead the design...  ...real and synthetic datasets to identify failure...  ...when beneficial.Lead data strategy for perception...  ...strategy, labeling quality, and iterative model...  ...-based perception pipelines on embedded or real-... 
    Pipeline
    Quality
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $206.3k - $388k

     ...THE ROLEWe're looking for a Principal ML Engineer to drive down cost per asset...  ...up throughput across the ML pipelines behind Adobe's multimodal foundation...  ...assets into training-ready data, making it faster and cheaper without sacrificing data quality. This is a senior individual... 
    Pipeline
    Quality
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Jose, CA
    1 day ago
  • $184.7k - $324.8k

     ...impact at the intersection of data engineering and iCloud analytics within...  ...about building robust data pipelines, crafting complex data models...  ...structures and very large datasets• Advanced proficiency with Python...  ...with data governance, data quality frameworks, or metadata... 
    Pipeline
    Quality
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  •  ...seeking a Manager of Marketing Data Engineering within the Marketing Analytics...  ...development of scalable data pipelines, canonical data models, and trusted, reusable datasets that enable analytical use cases...  ...the data workflows, quality controls, and documentation needed... 
    Pipeline
    Quality
    Immediate start

    AMD

    Santa Clara, CA
    2 days ago
  • $302k

     ...world operations into high-quality data for our autonomous partners...  ...no one else can match.As a Principal Engineer, you will be at the forefront...  ...offboard systems, and data pipelines that enable better data...  ...high-quality large evaluation datasets, objective performance... 
    Pipeline
    Quality
    Full time
    Work experience placement
    Work at office
    Remote work

    Uber

    Sunnyvale, CA
    2 days ago
  • $180k - $258.75k

     ...on a mission to improve the quality of human life. We’re developing...  ...We are looking for a Senior Data Engineer to design and build the...  ...includes large-scale ingestion pipelines, structured feature stores,...  ...cataloging across large and diverse datasets.Collaborate with ML... 
    Pipeline
    Quality
    Full time
    Local area
    Shift work

    Toyota Research Institute

    Los Altos, CA
    4 days ago
  •  ...energetic and self-sufficient data engineer to join Apples Health...  ...and scalable data processing pipelines that transform complex health...  ...well-understood easy-to-use datasets that can answer existing and...  ...whole team to meet our data quality and monitoring goals. If you... 
    Pipeline
    Quality
    Full time

    Apple

    Sunnyvale, CA
    5 days ago
  • $184.7k - $324.8k

     ...believe it can! We are the ML Data Team of the Intelligent...  ...responsible for building high quality datasets at scale. Every year, our team...  ...exceptional software & data engineer who is passionate about...  ...continuously improve our ML data pipelines.We invite you to join us at... 
    Pipeline
    Quality
    Temporary work
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • We Are The beginning of a new Data & AI decade that will reshape...  ...WorkWe are seeking a Data Engineering, Management & Governance Manager...  ...technical authority on data quality, ontology design, platform versioning...  ..., Azure Synapse, BigQuery), pipeline engineering, and AI-... 
    Pipeline
    Quality
    Live in
    Work at office
    Local area

    Accenture

    Mountain View, CA
    5 days ago
  • $200k - $322k

    We are looking for a Manager of Data & AI Engineering who combines deep technical expertise with strong...  ...robust ETL/ELT, streaming, and CDC pipelines using technologies such as Spark,...  ...governance, and extensibility.Implement data quality frameworks, observability, alerting,... 
    Pipeline
    Quality
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $70 per hour

     ....S. states. Software Engineering builds the brains of Waymo...  ...and improving the quality of the software that drives...  ...for experienced data-minded software engineers...  ...and our recruiting pipeline. Join us at Waymo for...  ...quality ML and evaluation datasets, streamlining curation... 
    Pipeline
    Quality
    Hourly pay
    Full time
    Internship
    Summer internship
    Relocation package

    Waymo

    Mountain View, CA
    1 day ago
  • $247.5k - $335k

     ...decisions based on knowledge and data. We’re looking for a hands-on Principal Knowledge Engineer to be the architect of that...  ...governance strategy for knowledge quality, freshness, lineage, provenance...  ...), embedding and retrieval pipelines, model serving, cloud data platforms... 
    Pipeline
    Quality
    Temporary work
    Flexible hours

    Intuit

    Mountain View, CA
    14 days ago
  • $83.98 - $111.27 per hour

     ...dynamic and experienced Senior Manager of Data Engineering to lead our data engineering teams....  ...build, and maintain our enterprise data pipelines and platforms, and for partnering with...  ...diagnosis and treatment, with outstanding quality, compassion and coordination. With an... 
    Pipeline
    Quality
    Hourly pay

    LE0010 Stanford Health Care

    Palo Alto, CA
    3 days ago
  • $175k - $308.5k

     ...day.DescriptionApple's ML Data Operations group is seeking a Data Operations Engineer to support internal data collection...  ...bring-up, execution, and quality oversight of internal data...  ...familiarity with ML data pipelines, annotation tools, or dataset management practices.... 
    Pipeline
    Quality
    Full time
    Relocation

    Apple

    Santa Clara, CA
    1 day ago
  • $272k - $431.25k

     ...developers to deliver studio‑quality audio and high‑...  ...looking for outstanding engineers to join the NVIDIA AI...  ...the model and pipeline strategy for detecting...  ...forensics pipelines, from data strategy and evaluation...  ...evaluation frameworks and datasets for problems where... 
    Pipeline
    Quality
    Full time
    Local area
    Shift work

    Nvidia

    Santa Clara, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Data Engineer, Data Quality & Datasets Pipelines [Remote]. Be the first to apply!