Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Data Ingestion Systems

Jobleads-US

Before the detail, here's the challenge you'd help us solve. We build the embodied intelligence that moves real vehicles safely, and the ecosystem a billion machines will run on in the future. Very few people in AI can say this. Every role here, whatever the team, plugs into that. Here’s what this particular role covers.

About our Ingestion Systems Team

Our Ingestion Systems team sits within Wayve’s AI Platform organisation and builds the data foundations behind our self-driving technology. We process vast amounts of real-world driving data so it can be used for annotation, model training and evaluation. Operating at petabyte scale, the team focuses on making these critical data flows reliable, efficient and easy to operate.

Your day-to-day

  • Debug and unblock failing ingestion pipelines, stalled jobs and processing queues
  • Investigate corrupt, malformed or unexpected data from a variety of sources.
  • Optimise Spark jobs and batch-processing pipelines for throughput, reliability and compute efficiency.
  • Work alongside permanent engineers to prioritise critical datasets and reduce operational toil.
  • Improve monitoring, retries and failure recovery across multi-step ingestion workflows.

What you’ll be working on

  • High-volume pipelines that process real-world driving data for annotation, data science, model training and evaluation.
  • Resilient systems that isolate problematic data rather than allowing a single bad segment to block a wider workflow.
  • Orchestration across complex dependencies, queues, retries and priority data flows.
  • Pragmatic improvements to the performance, cost and operability of our Spark-based data platform.
  • Ingestion of varied data formats from partners, suppliers and other third-party sources.

You should apply if

  • You have strong production experience with Apache Spark and Python.
  • You have built, operated or debugged large-scale ingestion, ETL or distributed data-processing pipelines.
  • You are comfortable diagnosing production failures involving corrupt data, stalled queues, retries and complex dependencies.
  • You understand how to optimise high-throughput systems for reliability, performance and cost.
  • You can learn an existing system quickly, work independently and deliver practical improvements in a fast-moving environment.
  • Experience with Airflow, Flyte, Databricks, Delta Lake, Scala or Java would be an advantage.

More about Wayve

Wayve is building the leading AI platform for autonomous driving. We are pioneering an end to end AI approach that enables vehicles to learn directly from real world experience, developing the ability to adapt, generalise and improve at scale. Instead of relying on hand coded rules or pre mapped environments, our AI Driver learns to drive by understanding the world around it. The result is technology that navigates complex urban environments with intelligence, precision and natural flow, unlocking meaningful advances in both safety and efficiency. We believe autonomy represents a once in a generation transformation in how people and goods move, comparable to the shift from horses to cars, and from human driven vehicles to intelligent machines. Our ambition is to make autonomy universal. Wayve’s mapless and hardware agnostic AI platform integrates with global OEM partners, enabling continuous software evolution and unlocking advanced levels of automation from L2 plus through to L4 as our core AI model scales. In a race increasingly defined by intelligence and real world learning, Wayve is taking a distinct approach, building a generalisable driving intelligence that can power any vehicle, anywhere. By combining embodied AI with scalable deployment, we are creating technology that can be shaped to each OEM brand and driver experience, accelerating the transition to a safer, more intelligent future of mobility.

How we work

Locations & Flexible Working: Our main hubs are in London, Sunnyvale, Yokohama, Herzliya, Vancouver and Leonberg. We operate a hybrid working model that combines in-person collaboration in our dedicated office spaces with focused time working remotely. This gives our teams the connection and energy of working together, alongside the flexibility to do their best work in a way that fits their lives.

The Interview Process

Our process is clear and respectful of your time

  • Initial call / recruiter screen (30 mins)
  • Competency interview Python Programming (60 mins)
  • Deep-dive technical interview: SQL Domain (60 mins)
  • Final interview: Mission and values alignment (45 mins)

What’s in it for you (Location dependant)

  • Salaries benchmarked against the market annually
  • Meaningful equity, sharing in the ownership and long term success of Wayve
  • Relocation support and visa sponsorship where applicable
  • Hybrid working, core hours and the chance to work hands on in vehicle workshops and labs
  • Learning and development budgets with support for training, conferences and growth
  • Comprehensive benefits including health insurance, dental, enhanced maternity and paternity leave, retirement or pension where applicable, access to therapists, wellbeing partnerships, team socials and more

A quick, honest note before you apply. Wayve is not a mature, fully-structured place with the playbook already written. Much of how we work is still being written, and if you join, you’ll help write it. That suits people who want real ownership more than people who need a settled structure from day one. If that sounds like the kind of problem you want to spend your time on, we’d really like to hear from you.

At Wayve we're committed to creating a diverse, fair and respectful culture that is inclusive of everyone based on their unique skills and perspectives, and regardless of

#J-18808-Ljbffr Jobleads-US
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Software Engineer, Data Ingestion Systems in Sunnyvale, CA vacancy
  • $215k - $250k

     ...company dedicated to freeing data from data platform lock...  ...organizations to ingest data at scale with minute...  ...any downstream query engine and use case (from traditional...  ...large-scale data systems and globally...  ...stack by building the software and data features that... 
    Suggested
    Odd job
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package

    Onehouse

    Sunnyvale, CA
    a month ago
  •  ...Everpure in Santa Clara, CA is seeking a Software Engineer Grad to join the data storage and management team. You will apply foundational CS knowledge...  ...problems from low-level hardware to large-scale cloud systems, contributing to mission-critical features that ensure... 
    Suggested

    Jobleads-US

    Santa Clara, CA
    1 day ago
  • $120k - $200k

    Santa Clara, CAData Engineering - Data Infrastructure /Full-time /HybridPlusAI...  ...AI-based virtual driver software for factory-built autonomous...  ...generates petabyte-scale sensor and system data. In this role, you will...  ...for vehicle-data transfer, ingestion, validation, domain-specific... 
    Suggested
    Full time

    Plus.ai

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

    The NVIDIA DGXC Data Services team builds cloud-native systems, frameworks, and services for managing data across...  ...in AI: storage, access, ingestion, governance, observability, and...  ...production environments.Use modern software engineering practices, including AI-assisted... 
    Suggested
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    4 days ago
  • $160.36k - $240.54k

     ...technology. In an ML-first system, the overall system...  ...training and evaluation data. The team plays a...  ...collaborates closely with system engineers to thoroughly validate...  ...pipelines that can ingest and process data across...  ...practices across broader software organizationA bachelor'... 
    Suggested
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    1 day ago
  • $193.93k - $291.15k

     ...output generalists where ML and systems engineering converge to push autonomy...  .... As a Senior Perception ML Data Infrastructure Engineer, you...  ...tooling.Design the ingestion and pipelines that move sensor...  ...YouBS/MS in Computer Science, Software Engineering, Robotics, or a... 
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    15 hours ago
  • $180k - $197k

     ...robotics in the near future - with software and data at the core.Our mission is...  .... We are a dynamic team of engineers, roboticists, designers, and...  ...our cutting-edge robotics systems. Your software will enable...  ...will be building distributed ingestion systems and services that... 
    Full time
    Local area

    Intrinsic

    Mountain View, CA
    3 days ago
  • $155k - $185k

     ...are looking for an experienced Software Engineer with a passion for building robust and scalable data infrastructure to join our...  ...and develop the foundational systems that power the flow of data across...  ...dataDrive innovation in data ingestion, transformation, and delivery... 
    Permanent employment

    Otter.ai

    Mountain View, CA
    2 days ago
  • $160.36k - $240.54k

     ...technology. In an ML-first system, the overall system...  ...training and evaluation data.The team plays a...  ...collaborates closely with system engineers to thoroughly validate...  ...pipelines that can ingest and process data across...  ...practices across broader software organizationA bachelor'... 
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    1 day ago
  • $184k - $287.5k

     ...forefront of technological advancement. NVIDIA data center systems have become core to NVIDIA's rapidly growing...  ..., and a fully optimized NVIDIA AI and HPC software stack. We are seeking an excellent Senior System Engineer to work on bring up, integration, validation... 
    Full time
    Early shift

    Nvidia

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

    The NVIDIA DGXC Data Services team builds cloud-native systems, frameworks, and services for managing...  ...in AI: storage, access, ingestion, governance,...  ...platform teams, and partner engineering teams to understand requirements...  ...scale.Use modern software engineering practices, including... 
    Full time

    Nvidia

    Santa Clara, CA
    15 hours ago
  • $320k

    NVIDIA data center systems, such as DGX and HGX, have become core to NVIDIA's rapidly growing enterprise...  ...a fully optimized NVIDIA AI and HPC software stack. We’re looking for a strong...  ...in Computer Science, Electrical Engineering or related field (or equivalent experience... 
    Full time
    Shift work

    Nvidia

    Santa Clara, CA
    4 days ago
  • $130.75k - $181k

     ...TeamJoin Eightfolds core Data Platform team to...  ...maintain the large-scale software platforms that serve millions...  ...distributed systems, ensuring our platform...  ...balancing.Performance Engineering: Drive the scaling, optimization...  ...data pipelines, data ingestion and data integration.... 
    Permanent employment
    Work experience placement
    Work at office
    3 days per week

    Eightfold

    Santa Clara, CA
    4 days ago
  • $149.8k - $262.2k

     ...DescriptionIt all started when engineer Fred Luddy wrote code that...  ...brings together any AI, any data, and any workflow— helping 85...  ...We are seeking a Senior Staff Software Engineer (IC5 Level) to join...  ...incident reviews for stateful systems.You will spend significant time... 
    Permanent employment
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    2 days per week

    ServiceNow

    Santa Clara, CA
    15 hours ago
  • $149.8k - $262.2k

     ...DescriptionIt all started when engineer Fred Luddy wrote code that...  ...brings together any AI, any data, and any workflow— helping 85...  ...team: We are seeking a Staff Software Engineer (IC4 Level) to join...  ...programming skills in Go (or another systems language with a willingness... 
    Permanent employment
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    2 days per week

    ServiceNow

    Santa Clara, CA
    15 hours ago
  • $70 per hour

     ...simulation across 15+ U.S. states. Software Engineering builds the brains of Waymo's...  ...with hardware and systems engineers. If you're a software...  ...are looking for experienced data-minded software engineers to...  ...with systems that ingest, store, transform, and output... 
    Hourly pay
    Full time
    Internship
    Summer internship
    Relocation package

    Waymo

    Mountain View, CA
    3 days ago
  • $272k - $431.25k

     ...lasting impact on the world!The Data Center MODS organization seeks a Principal Engineer to architect and scale next-generation L10 and L11 diagnostic systems for Cloud Service Providers (CSPs...  ...distributed systems and hardware / software interfaces is essential for... 
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  •  ...NVIDIA Corporation is seeking a System Software Engineer to join the System Software group focused on Data Center Server Platform Diagnostics. You will help design and maintain software for complex heterogeneous computing systems powering AI, HPC, and accelerated workloads... 

    Jobleads-US

    Santa Clara, CA
    5 days ago
  • $129k - $212k

     ...needs of the team.LinkedIn's Data Science team leverages big data...  ...ways for an ambitious data engineer to have an impact and transform...  ...for a talented and driven Sr Software Engineer, Data Science to...  ...reusable tools, and scalable data systems. You will contribute to both... 
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    15 hours ago
  • $193.93k - $291.15k

     ...of high-output generalists where ML and systems engineering converge. This is not a "run the models...  ...performance, and raise the bar on the data and evaluation loop that drives autonomy...  ...quantitative area.4+ years of industry software engineering experience with Python... 
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    1 day ago
  • $117k - $234k

     ...Segment: Home OfficeRole summary:The Senior Software Engineer will lead the delivery of scoped...  ...operational goals.About the team:The MarTech Data Engineering team develops scalable,...  ...eCommerce environment. They build integrated systems combining enterprise content, catalog,... 
    Full time
    Temporary work
    Part time

    Walmart

    Sunnyvale, CA
    4 days ago
  • $153k - $179k

     ...and so are the rewards.The Data Engineering team builds and maintains the...  ...design reliable, scalable data systems that support product...  ...scalable data pipelines that ingest application events and database...  ...-end data pipelinesHands-on software engineering experience, with... 
    Work at office
    Flexible hours
    Shift work
    3 days per week

    Robinhood Financial

    Menlo Park, CA
    15 hours ago
  • Software Engineer - Data Protection Software Engineering Infrastructure Solutions Group (ISG) builds the products that power infrastructure, solutions...  ...rewrite it.If you're energized by solving complex systems challenges, excited to work alongside AI to amplify your impact... 

    Dell Technologies

    Santa Clara, CA
    1 day ago
  • $135k - $200k

    Santa Clara, CAData Engineering - ML Infrastructure /Full-time /HybridAll...  ...workloads — large-scale data processing, simulation, auto-...  ...infrastructure, or multi-tenant compute systems—and the curiosity and...  ...to candidates at either the Software Engineer or Senior Software Engineer... 
    Full time

    Plus.ai

    Santa Clara, CA
    1 day ago
  • $224k - $356.5k

     ...improve GPU and CPU accelerated software libraries. Projects like...  .... Starting from powering AI, data analytics, image processing,...  ...leadership and guidance to library engineers working with you,find...  ...development practices such as CI/CD systems and project management tools... 
    Full time
    Worldwide

    Nvidia

    Santa Clara, CA
    2 days ago
  • $188k - $275k

     ...the Team The Business Systems team at CoreWeave partners...  ...across Infrastructure, Data Center Operations,...  ...Staff Business Systems Engineer to design, build, and own...  ...role, you will build the software, data models, and...  ...deployed assets Build data ingest pipelines that collect,... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    14 days ago
  • $165.2k - $223.6k

    The MLIL DataPlane team is looking for a Software Development Engineer to own the design and implementation of our inference data plane. We build the software that makes large...  ...Knowledge of computer architecture, operating systems, and parallel computing- Knowledge of Linux... 
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    15 hours ago
  • $193.93k - $352.29k

     ...are looking for a Senior/Staff Software Engineer to serve as a technical leader for Nuro’s ML Data engine. You will sit at the...  ...acting as an architect for the systems that feed our autonomy AI models...  ...and trigger labeling and data ingestion workflows without human... 
    Immediate start
    Flexible hours
    Shift work

    Nuro

    Mountain View, CA
    1 day ago
  • Senior Software Engineer - Data Protection Software Engineering (C, C++)Infrastructure Solutions Group (ISG) builds the products that power infrastructure...  ...rewrite it.If you're energized by solving complex systems challenges, excited to work alongside AI to amplify your... 

    Dell Technologies

    Santa Clara, CA
    4 days ago
  • $253k - $416k

     ...CA OR Bellevue, WA.LinkedIn’s Data Infrastructure team builds...  ...online, offline and serving systems in the world. These systems are...  ...are seeking a Distinguished Engineer with deep expertise in Online...  ...experience10+ years of experience in software engineering, with a focus on... 
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Data Ingestion Systems. Be the first to apply!