Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Large-Scale Data Query Systems

Full-time

Eventual

About Eventual

Every breakthrough Physical AI system — humanoid robots, autonomous vehicles, video generation models — is trained on petabytes of video, lidar, radar, and sensor data. But today's data platforms (Databricks, Snowflake) were built for spreadsheet-like analytics, not the multimodal corpora that power AI. Robotics and video-AI teams now lose 20-40% of their training time to dataloading alone. GPU bandwidth has grown 2-3× per generation. Storage and pipelines haven't. The gap widens every year.


Eventual was founded in 2022 to close it. Our open-source engine, Daft , is the distributed data engine purpose-built for multimodal AI — already running 2 PB/day at Amazon, 60-100 PB at another FAANG company, and in production at Mobileye, TogetherAI, and CloudKitchens. We are building a video-native index on top of our engine for Physical AI that streams curated datasets to GPUs at line rate. Saturates B200s today. Aimed at NVL72 and Vera Rubin tomorrow.


We're building this in partnership with the top PhysicalAI labs and public AI infrastructure companies today. We have raised $30M from Felicis, CRV, Microsoft M12, Citi, Essence, Y Combinator, Caffeinated Capital, Array.vc, and angels from the co-founders of Databricks and Perplexity. We've assembled a world-class team from AWS, Render, Pinecone and Tesla. We have spent our careers powering the last generation of PhysicalAI in self-driving, and are excited to now do this for the next.

Join our small (but powerful!) team working together 4 days/week in our SF Mission district office.

Your Role:

As a Software Engineer on the Systems team, you will build key capabilities for the Daft distributed data engine. You will be working on core architectural design and implementation of various components in Daft. While we are an experienced team that can provide constant guidance and mentorship, we value engineers who can autonomously scope and solve difficult technical challenges.

Key Responsibilities:

  • Planning/Query Optimizer: intelligently optimize users’ workloads with modern database techniques

  • Execution Engine: improve memory stability through the use of streaming computation and more efficient data structures

  • Distributed Scheduler: improve Daft’s resource utilization, task scheduling and fault tolerance

  • Storage: improve Daft integrations with modern data lake technologies such as Apache Parquet, Apache Iceberg and Delta Lake

  • Our goal is to build the world’s best open-source distributed query engine, becoming the leading framework for data engineering and analytics.

  • We are a young startup - so be prepared to wear many hats such as tinkering with infrastructure, talking to customers and participating heavily in the core design process of our product!

What we look for:

  • We are looking for a candidate with a strong foundation in systems programming and ideally experience with building distributed data systems or databases (e.g. Hadoop, Spark, Dask, Ray, BigQuery, PostgreSQL etc)

  • 3+ years of experience working with distributed data systems (query planning, optimizations, workload pipelining, scheduling, networking, fault tolerance etc)

  • Strong fundamentals in systems programming (e.g. C++, Rust, C) and Linux

  • Familiarity and experience with cloud technologies (e.g. AWS S3 etc)

  • Most importantly, we are looking for someone who works well in small, focused teams with fast iterations and lots of autonomy. If you are passionate, intellectually curious and excited to build the next generation of distributed data technologies, we want you on the team!

Perks & Benefits

  • In-person tight knit team with 4x a week in office

  • Competitive comp and startup equity

  • Catered lunches and dinners for SF employees

  • Commuter benefit

  • Team building events & poker nights

  • Health, vision, and dental coverage

  • Flexible PTO

  • Latest Apple equipment

  • 401k plan with match!

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer, Large-Scale Data Query Systems in San Francisco, CA vacancy
  •  ...Team: The Database Systems team specializes in...  ...We are looking for engineers passionate about...  ...across ingestion, query execution, indexing...  ...capabilities and help scale online database reliability...  ...2+ years leading large scale, complex...  ...such as databases, data systems, storage... 
    Data
    Full time

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...tech startup in San Francisco seeks a Senior Software Development Engineer to tackle engineering challenges in providing data access solutions. This role involves writing...  ..., and managing production environments for large-scale data. Candidates should have strong programming... 
    Data

    Zipstack

    San Francisco, CA
    1 day ago
  • Brighterway is hiring a Senior Software Engineer to design, build, and scale production systems across frontend, backend, and ML-adjacent workflows. You will own data models, APIs, and deployment pipelines in a hands-on role with high ownership. The role focuses on building... 
    Data

    Brighterway

    San Francisco, CA
    5 days ago
  • $170k - $216k

     ...Waymo Driver. Our software allows the Waymo Driver...  ...miles of driving data from a diverse set...  ...enabling software engineers like you to...  ...and techniques at scale. Our mission is...  ...overall self-driving system. We act as the crucial...  ...eval for large ML software systems... 
    Data
    Full time
    Remote work

    Waymo

    San Francisco, CA
    1 day ago
  • Black Forest Labs is recruiting a Member of Technical Staff - Research Engineer to own and optimize large-scale generative-model training systems in a hybrid SF/remote setting. You’ll work closely with researchers to push performance, memory footprint, and stability across... 
    Suggested
    Remote work

    BlackForestLabs

    San Francisco, CA
    3 days ago
  • Google is seeking software engineers to develop next‑generation technologies at massive scale. You will design, build, test, deploy, and maintain software solutions across...  ...across full‑stack development, distributed systems, networking, and #J-18808-Ljbffr Socket.dev

    Socket.dev

    San Francisco, CA
    3 days ago
  •  ...About the Team The Frontier Systems team at OpenAI builds,...  ...training. We take data center designs, turn them...  ...working systems and build any software needed for running large-scale frontier model trainings....  ...core to the mission. Engineers here own their work end-... 
    Data
    Full time

    OpenAI

    San Francisco, CA
    1 day ago
  • $200k

     ...fundamentally change how software is built on the...  ...create products that scale and remain simple over...  ...has assembled a team of engineers who have built and designed...  ..., with exabytes of data, millions of transactions...  ...of experience running large systems at scale, but as our... 
    Data
    Full time
    Work at office
    Night shift

    Convex

    San Francisco, CA
    1 day ago
  •  ...unleashing the power of software and data. We enable organizations...  ...all sizes to easily build, scale, and run modern applications...  ...text and vector search queries using the MongoDB Query...  ...scalable yet observable system for customers and engineers. The Atlas Search product... 
    Data
    Full time
    Work at office
    Local area
    Worldwide

    Mongodb

    San Francisco, CA
    1 day ago
  • $350k

     ...We are scientists, engineers, and builders who’ve created...  ...infrastructure and systems engineers to help build...  ...responsible for architecting and scaling the core infrastructure...  ...models, products, and data assets. Note: This...  ...systems and running large Kubernetes clusters... 
    Data
    Full time
    Immediate start
    Visa sponsorship
    Work visa
    Relocation package
    Flexible hours

    Thinking Machines Lab

    San Francisco, CA
    1 day ago
  •  ...text and vector search queries using the MongoDB...  ...focus on relevance and data retrieval instead of the...  ...needed to search data at scale. Our team is...  ...cloud-based distributed systems software responsible for the lifecycle...  ...we are proud of as engineers Have the... 
    Data
    Full time
    Work at office
    Local area
    Worldwide

    Mongodb

    San Francisco, CA
    1 day ago
  • $160k - $194k

     ...the deployment of the data centers that will...  ...the AI economy. Our software helps the world's largest...  ...by pioneers in grid-scale batteries, energy...  ...As a Software Engineer focusing on Distributed Systems at Verse, you will work...  ...schemas, and scale queries for multiple product... 
    Data
    Full time
    Remote work
    Flexible hours

    Ad Verse

    San Francisco, CA
    1 day ago
  •  ...About the Team The Frontier Systems team at OpenAI builds,...  ...model training. We take data center designs, turn them...  ...working systems and build any software needed for running large-scale frontier model trainings....  ...the Role As a Software Engineer on the Frontier Systems... 
    Data
    Full time

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...to our video processing data pipeline, then update...  ...also requires marshaling large quantities of cloud...  ...business logic efficiently at scale. You’ll be...  ...can help make our entire system more robust, scalable,...  ...of millions of users, engineered the foundations of autonomous... 
    Data
    Full time

    The Generalist

    San Francisco, CA
    1 day ago
  • $176k - $209k

     ...advantage.Unlike legacy systems built to route and...  ...an AI-native engineering culture.This...  ...observability systems.Build & Scale: Design and deploy...  ...years of relevant software engineering...  ...shipping complex, large-scale systems.Systems...  ...tuning strategies.Data & Retrieval:... 
    Data
    Work at office

    Dialpad

    San Francisco, CA
    2 days ago
  • $147k - $210k

    Write product or system development code. Collaborate...  ...and contribute to data preparation,...  ...development.Scale the product and defend...  ...experience with software development in one...  ...LLMs, Multi-Modal, Large Vision Models) or...  ...Google's software engineers develop the next-generation... 
    Data

    Google

    San Francisco, CA
    1 day ago
  • $180k - $225k

     ...Software Engineer - Robotics & Autonomous Systems Scale's Robotics business unit is dedicated to solving the data bottleneck in Physical AI across Robotics, Autonomous Vehicles, and Computer...  ...You Will: Own and architect large-scale data processing pipelines for... 
    Data
    Full time

    Scale Ai, Inc.

    San Francisco, CA
    1 day ago
  • $185k

    About the RoleThe Engineering Acceleration team...  ...the foundational systems that engineers use...  ...infrastructure, and software quality. You will...  ...workflows across a large, polyglot monorepo...  ...operated CI systems at scale, especially in...  ...(including the data contained therein)... 
    Data
    Work at office
    Local area
    Remote work
    Flexible hours

    OpenAI

    San Francisco, CA
    8 hours ago
  • $153k - $376k

     ...everything we build. As a Software Engineer on our Infrastructure...  ..., and operate the systems that power our real-time...  ...worldwide. We’re scaling fast, and we’re looking...  ...networking, or real-time data systems, this role offers...  ...with evolving large-scale, shared developer... 
    Data
    Minimum wage
    Full time
    Local area
    Remote work
    Worldwide
    Flexible hours

    Figma

    San Francisco, CA
    2 days ago
  •  ...builds and operates the systems that enable OpenAI...  ...quickly. The work spans software engineering, infrastructure,...  ...improve systems across data infrastructure, processing...  ...how infrastructure scales in practice. Are comfortable...  ...infrastructure, or large-scale fleet management... 
    Data
    Full time

    OpenAI

    San Francisco, CA
    1 day ago
  • $114.2k - $142k

     ...both a space company and data company all rolled...  ...data processing, and software engineering, our office is a truly...  ...Manufacturing team is scaling in many ways, including...  ...interconnected software systems that interface with...  ...use of AI tools—e.g. Large Language Models (LLMs)... 
    Data
    Full time
    Temporary work
    For contractors
    Work at office
    Local area
    Remote work
    Home office

    Planet

    San Francisco, CA
    1 day ago
  •  ...under the practical constraints of robotic platforms. About the Role As a Software Engineer, Distributed Data Systems, you will design and scale the infrastructure that powers large-scale multimodal training and evaluation at OpenAI. You’ll manage distributed data... 
    Data
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    1 day ago
  • $215k - $260k

     ...who believe in the scale of our ambition and...  ...energy, manufacturing, data center construction,...  ...are seeking a Staff Software Engineer to lead distributed systems design and...  ...ingestion, storage, and query. This is a full-time...  ...architecture and evolution of large-scale telemetry... 
    Data
    Full time
    Temporary work

    Crusoe

    San Francisco, CA
    3 days ago
  • $107k - $150k

     ...sensors and tools for engineers, roboticists, and researchers...  ...powered by one chip-scale laser array and one...  ...is seeking a Software Engineer to build, optimize...  ...electrical hardware to our data systems.We treat manufacturing...  ...and optimizing SQL queries (e.g., PostgreSQL, SQLite... 
    Data
    Work experience placement
    Local area
    Flexible hours

    Ouster

    San Francisco, CA
    3 days ago
  • $166k - $225k

     ...passionate about enabling data teams to solve the...  ...business. Founded by engineers — and customer...  ...interfacing with data to scaling our services and infrastructure...  ...of traditional SQL query engines. As a software engineer on the...  ...and processing systems that can outperform specialized... 
    Data
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    3 days ago
  •  ...Chalk is building the data platform that...  ...complexity, latency, and scale barriers that have...  ...We are hiring Software Engineers to join our team....  ...and make a large impact at a high growth...  ...reliable data processing systems that can operate...  ...from compilers, query planners, and... 
    Data
    Full time
    Work at office
    Flexible hours

    Chalk

    San Francisco, CA
    1 day ago
  • $200k - $400k

    Senior Software Engineer - Agentic Systems We are partnered with a highly technical AI research company building...  ...company is well‑funded, executing large‑scale programs, and pushing the frontier...  ...You will work closely with systems, data, and ML teams to integrate agent workflows... 
    Data
    Full time
    Immediate start

    Strativ Group

    San Francisco, CA
    2 days ago
  • $227.2k - $417k

     ...About the Role:As a Software Engineer on the ML Infrastructure...  ...latency ML model serving systems that support Deep...  ...our ML capabilities to scale and deliver exceptional...  ...state of the art.Take a data driven approach to...  ...efficiency of our infra. Lead large scale cross functional... 
    Data
    Full time
    Temporary work
    Local area
    Flexible hours

    Tubi TV

    San Francisco, CA
    2 days ago
  •  ...About the Team The Scaling team is responsible for...  ...the architectural and engineering backbone of OpenAI’s...  ...and deliver advanced systems that support the deployment...  ...Our work spans system software, networking, platform...  ...: image build, user-data/config, cluster join,... 
    Data
    Full time

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...transforming how modern AI and software companies monetize at scale. We've built the next-...  ...role: As an early engineer at Orb, you’ll help to...  ...complex domain (billing, from data ingestion to...  ...real-time ingestion and query systems for large, high-performance deployments... 
    Data
    Full time
    Work at office
    Relocation
    3 days per week

    Orb

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Large-Scale Data Query Systems. Be the first to apply!