Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Infrastructure Engineer

Greylock Partners

Greylock is partnering with an early-stage AI company focused on a gap between model capability and adoption. AI can already change how work gets done, but bringing agents into a real organization remains slow, manual, and difficult to scale beyond individual pilots. The company is building a repeatable path from an initial AI-agent deployment to broader organizational impact. Its goal is to make those agents correct, trustworthy, robust, and scalable-and to help companies build on each successful deployment. Summary We're looking for a senior engineer who has personally built and operated petabyte-scale storage or data infrastructure. You'll help design the foundation for a product whose data volume could eventually reach petabytes per day. The immediate challenge is large-scale storage and processing, including the pipelines that turn raw video into useful representations. This is less about low-latency streaming than about building a dependable, efficient system that can ingest large volumes, process them at high throughput, and make the results available to researchers and agents. You'll work directly with the founders and have unusual influence over the architecture from the beginning. What You’ll Own Design and build storage and processing systems for large volumes of video, accessibility data, and derived workflow data Develop reliable pipelines for high-throughput multimodal captioning and other video-processing workloads Make deliberate choices about data layout, lifecycle, retention, retrieval, reliability, and cost as volume grows Build the infrastructure that connects captured activity to research experiments and production agent workflows Establish observability and operating practices that make data quality, failures, and system performance visible Work with the founders to turn early product needs into a durable data architecture What We’re Looking For Direct ownership of petabyte-scale storage or data platforms in production, including architectural decisions and operational responsibility Strong distributed-systems judgment around storage, throughput, reliability, and cost Experience building data systems that serve demanding downstream workloads, such as ML training, multimodal processing, or large-scale analytics The ability to investigate failures across system boundaries and improve the underlying design Comfort building hands-on in a small team where requirements and scale will evolve quickly Experience with video or multimodal data, object storage, lakehouse systems, or ML data infrastructure is valuable. We care most about evidence that you have owned the storage problem at scale, rather than only run pipelines over large datasets. Real-time streaming expertise is useful, but it is not the center of this role. About Us Greylock is an early-stage investor in companies including Airbnb, LinkedIn, Dropbox, Workday, Cloudera, Facebook, Instagram, Roblox, Coinbase, and Palo Alto Networks. Learn more at greylock.com. How We Work Greylock's Core Talent team provides free candidate referrals and introductions to our active investments. This posting is for direct employment with one of our portfolio companies. We review every application and reach out directly when we believe there's a strong potential fit. #J-18808-Ljbffr

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Infrastructure Engineer in San Francisco, CA vacancy
  •  ...Hyperbolic Labs is seeking its first dedicated Data Engineer to build our data infrastructure from 0 to 1. You will own the data warehouse, pipelines, and tooling, partnering with analysts and engineers to ensure reliable, fast, and cost-efficient data usage. As volumes... 
    Senior

    Hyperbolic Labs

    San Francisco, CA
    3 days ago
  •  ...Platform Integration Database Architecting Performance Tuning Big Data CERTIFICATION Working Language Job Description...  ...be comfortable working across distributed systems, modern data engineering tools, and collaborating with architects, DevOps, and business... 
    Senior
    Work at office
    Remote work

    NewVision Software

    San Francisco, CA
    4 days ago
  •  ...Handshake is seeking a Senior Data Platform Engineer to build and operate the data infrastructure that powers our career marketplace and AI products. You will own the systems orchestrating batch workloads, delivering trustworthy data to engineers and product teams, while... 
    Senior
    Remote work

    Handshake

    San Francisco, CA
    3 days ago
  •  ...Reach Security is seeking a Senior Staff Data Platform Engineer to design, build, and manage the platform and infrastructure powering robust data pipelines and analytic query engines. You will work with Trino, Redshift, BigQuery, Iceberg, and other columnar tech, taking... 
    Senior
    Remote work

    Ballistic Ventures

    San Francisco, CA
    3 days ago
  •  ...Metriport, a data intelligence platform for healthcare, seeks a Senior Data Engineer in the San Francisco area. You will scale our data platform, build pipelines, and own end-to-end data delivery to customers, while collaborating with AI/ML teams and ensuring data reliability... 
    Senior

    Metriport

    San Francisco, CA
    4 days ago
  •  ...LiveRamp is seeking a Senior Software Engineer for the Identity Engineering team in San Francisco to maintain the graph processing engine...  ...to deliver modular, scalable applications and modernize infrastructure using Spark, batch processing, REST APIs, and cloud platforms... 
    Senior

    LiveRamp

    San Francisco, CA
    4 days ago
  •  ...Ouster in San Francisco seeks a Sr. Data Infrastructure / Quality Engineer to architect, build, and validate cloud data pipelines powering autonomous sensing products. You will transform raw LiDAR and multimodal streams into robust, reproducible training datasets for... 
    Senior

    Ouster

    San Francisco, CA
    4 days ago
  •  ...Formation Bio seeks a Senior Data Engineer to build trusted data systems across clinical operations, asset evaluation, and analytics, enabling AI-enabled employees and agents. You will design ingestion pipelines across clinical, operational, and vendor data while shaping... 
    Senior

    Formation Bio

    San Francisco, CA
    3 days ago
  • $200k - $275k

     ...Peregrine is seeking a Staff Data Infrastructure Engineer in San Francisco. The role focuses on designing high-throughput data integration systems and optimizing distributed processing pipelines. Candidates should have over 8 years of experience in data infrastructure... 
    Senior

    Peregrine Corporation

    San Francisco, CA
    3 days ago
  •  ...Leadout Capital is seeking a Senior Software Architect to design the Sales Intelligence Platform (SIP) powering Sales Cloud AI. You will own architecture, reliability, and performance for real-time ingestion and streaming pipelines. The ideal candidate has 7+ years of... 
    Senior

    Leadout Capital

    San Francisco, CA
    11 hours ago
  •  ...Astranis is seeking a Senior Data Platform Engineer in San Francisco to define core data architecture, build unified data tooling, and deliver scalable pipelines from production data sources to analytical warehouses. You will partner with hardware, software, finance, and... 
    Senior

    Astranis

    San Francisco, CA
    3 days ago
  • $112.8k - $153.7k

     ...willing to listen to your ideas. This is a senior engineering role. You will architect, operate, and continuously improve cloud data and analytics platforms (e.g., Microsoft...  ..., Databricks) and own BI delivery infrastructure (e.g., Power BI, Tableau). You set the standards... 
    Senior
    Full time
    Contract work
    Local area
    Flexible hours

    Armanino

    San Francisco, CA
    7 days ago
  • $240k - $360k

    About the RoleWe're looking for a Senior Staff Data Engineer to be the technical backbone of our Data & ML Platform team — the foundation powering...  ...ML platform — feature pipelines, serving layers, and the infrastructure that makes ML models production-ready.This is not a role... 
    Senior
    Work at office
    Local area
    Immediate start
    Remote work
    Worldwide
    3 days per week

    Hinge Health

    San Francisco, CA
    7 days ago
  •  ...Crusoe Energy is hiring a Senior Data Engineer to join our on-site Data Science and Engineering team in Sunnyvale, CA or San Francisco, CA. You will architect and build the foundational data platform powering Crusoe's AI and cloud operations. You will implement scalable... 
    Senior

    Crusoe

    San Francisco, CA
    3 days ago
  • $170k - $240k

     ...SentiLink in San Francisco is looking for a Senior Software Engineer to enhance the data platform supporting their identity verification products. The role focuses on building and optimizing data infrastructure, ETL/ELT processes, and collaborating with cross-functional... 
    Senior
    Remote work

    SentiLink

    San Francisco, CA
    2 days ago
  •  ...Apollo.io seeks a Senior Director of Engineering, Native Data to lead the data platform that powers core datasets across the Apollo platform. You will own the data strategy, quality, freshness, and enrichment pipelines, and grow multiple teams across geographies to meet... 
    Senior

    Apollo.io

    San Francisco, CA
    2 days ago
  • $172.5k - $260.1k

     ...pipeline management. We are looking for engineers to develop the Sales Intelligence Platform...  ...Platform (SIP) processes conversational data from voice, video, and email to power...  ...or Azure) and high-performance backend infrastructure.Proficiency in object-oriented programming... 
    Senior
    Full time

    Salesforce

    San Francisco, CA
    5 days ago
  • $197.3k - $365.2k

     ...how people build software and analyze data. Slack’s data platform needs to support...  ...process.We’re looking for a Staff or Senior Staff engineer to help build out Agentic Analytics at...  ...many parts of the data stack: ingestion, infrastructure, semantic layers, and the interfaces... 
    Senior
    Full time

    Salesforce

    San Francisco, CA
    3 days ago
  •  ...Sigma Computing is seeking a Partner Operations Senior Engineer for our Partnerships Team in San Francisco HQ. You will own data infrastructure, pipelines, and production apps powering our partner ecosystem, turning partner data into actionable workflows and insights.... 
    Senior

    Sigma Computing

    San Francisco, CA
    10 hours ago
  •  ...started in Melbourne in 2015 to build the infrastructure global commerce runs on. We're the...  ..., are tool-agnostic, and expect engineers to own problems end-to-end. We collaborate...  ...has. About the Role As a Senior Manager of Data Platform Engineering, you’ll lead the... 
    Senior

    Airwallex

    San Francisco, CA
    2 days ago
  • $197.3k - $365.2k

     ...Job Category Software Engineering Job Details About Salesforce Salesforce...  ...build software and analyze data. Slack’s data platform needs...  ...’re looking for a Staff or Senior Staff engineer to help build...  ...the data stack: ingestion, infrastructure, semantic layers, and the... 
    Senior

    Salesforce, Inc.

    San Francisco, CA
    2 days ago
  • Scion Staffing, Inc. is seeking a Senior Data Platform Engineer for a fast-growing tech company delivering AI-powered solutions. This fully remote role requires US residency and PST hours. The engineer will design a scalable data platform from the ground up and transform... 
    Senior
    Remote job

    Scion Staffing, Inc.

    San Francisco, CA
    3 days ago
  • fal is building the data infrastructure that turns internal systems and partner APIs into a clear view of cost, margin, and performance. You...  ...near real-time analytics for the entire company and freeing engineers to focus on product development. You will partner with infra... 
    Senior

    Fal.ai Inc.

    San Francisco, CA
    1 day ago
  • Chime is seeking a senior data platform engineer to design, build, and operate self‑serve ETL/ELT frameworks for both batch and streaming workloads. You will own pipeline reliability, data quality SLAs, and schema evolution, while setting the technical standards for data... 
    Senior

    Chime Enterprise

    San Francisco, CA
    1 day ago
  • Firstup seeks a Senior Data Engineer to design scalable data pipelines and analytics solutions. You will build natural language interfaces to data, apply GenAI to data workflows, and partner with engineering, analytics, and business teams to improve quality and observability... 
    Senior

    Logoslabs

    San Francisco, CA
    4 days ago
  • $160k - $260k

     ...Senior Data Engineer Hiring Location: San Francisco What You’ll Do Part 1. Data Modeling Design and implement robust and scalable data models that support business intelligence, machine learning, and operational needs. Possess a deep understanding of data schemas and... 
    Senior

    Airwallex

    San Francisco, CA
    3 days ago
  • Cloudflare in Austin, TX is hiring a Senior Systems Engineer for the Go-To-Market Data Team. You will own GTM-facing software and data products, from the data foundation to signals that guide sales reps, delivering across multiple teams with autonomy. The role blends data... 
    Senior

    CloudFlare

    San Francisco, CA
    1 day ago
  • Salesforce is seeking senior Software Engineer to design and operate a high-scale, low-latency platform for Sales Cloud AI. You will architect real-time ingestion and streaming pipelines and guide engineers across teams to deliver reliable, enterprise-grade systems. Role... 
    Senior

    Salesforce

    San Francisco, CA
    3 days ago
  •  ...Salesforce is seeking a Senior Director of Data Engineering to lead a ~40-person organization and own the full data stack—from infrastructure and ingestion through data products and AI-facing services. You will partner with Data Science & Analytics to drive a bold vision... 
    Senior

    Slack

    San Francisco, CA
    4 days ago
  • $300k - $390k

     ...highly motivated and experienced engineering leader to lead a team responsible for our Lila's product data platform. You will own the data platform and infrastructure end-to-end — architecture,...  ...5+ years of experience leading senior engineers. ~ Experience with building... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences, Inc.

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Infrastructure Engineer. Be the first to apply!