Foundation Model Data Engineer: Petabyte-Scale Data Pipelines
Sciforium
Sciforium is seeking a highly technical Foundation Model Data Engineer to own end-to-end data lifecycle for large-scale AI models. You will architect dataset strategies, curate petabyte-scale data, and design post-training alignment datasets to improve model reasoning and safety. Ideal candidates have 5+ years in data science or ML, deep Python skills, and experience with petabyte-scale datasets, roadmapping data pipelines, and RLHF/DPO data workflows. #J-18808-Ljbffr
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Foundation Model Data Engineer: Petabyte-Scale Data Pipelines in San Francisco, CA vacancy
- ...early-stage AI company to build a durable data foundation for large-scale video and multimodal data. We seek a senior engineer who has owned petabyte-scale storage and data platforms in... .... You'll design storage, processing pipelines, and observability, collaborating with...PipelineFoundation
Greylock Partners
San Francisco, CA3 days ago - ...generation multimodal AI models and a proprietary,... ...support from AMD engineers the team is scaling rapidly to build... ...technical and visionary Foundation Model Data Engineer to lead... ...and post-training pipelines that ensure our... ...model performance. Petabyte-Scale Curation:...PipelineFoundationFlexible hours
Sciforium
San Francisco, CA4 days ago - ...hybrid working model for this role. This... ...members for our Data Platform roles... ...looking for a Data Engineer to join our Data Foundations team and help us... ...complex data pipelines and systems, including... ...and runs large-scale ETL pipelines that process petabytes of data and...PipelineFoundationWorldwideHome officeFlexible hours
Coda
San Francisco, CA3 days ago $155.4k - $208.4k
...Posting Title:Sr Data EngineerReq ID:... ...of engineers, product developers... ...technological foundation and consumer media... ...to come. Reach, Scale & Impact: More... ...data processing pipelines and backend to... ...existing data models with input from... ...datasets at the petabyte level.Strong Python...PipelineFoundationFull timeWork experience placementHulu
San Francisco, CA6 days ago- ...authentic way.Staff Data Engineer, Enterprise Core Datasets... ...the technical data foundations that help Airbnb... ...ecosystem that includes petabyte-scale datasets, you will improve... ...of high-impact data pipelines across AI usage and... ...consistent data models that support those definitions...PipelineFoundationCasual workLive inWork at officeImmediate startRemote work
Airbnb
San Francisco, CA7 days ago - ...on a gap between model capability and... ...and difficult to scale beyond individual... ...for a senior engineer who has personally... ...built and operated petabyte-scale storage or data infrastructure.... ...help design the foundation for a product... ..., including the pipelines that turn raw video...PipelineFoundationImmediate start
Greylock Partners
San Francisco, CA3 days ago - ...Principal Data Engineer For Marketing And Consumer... ...technological foundation and consumer media... ...years to come.Reach, Scale & Impact: More... ...-time data at petabyte scale.Responsibilities... ...Data — including pipeline architecture,... ...foundational data — data modeling, batch and near-...PipelineFoundationWork experience placement
The Walt Disney Studios
San Francisco, CA3 days ago - Avala is seeking a senior ML infrastructure engineer in San Francisco to scale neural network training infrastructure for Physical AI data needs. You will optimize data loading, pipelines, and distributed training across massive GPU clusters. Join a team building cutting...Pipeline
$167.7k - $245.2k
...million devices worldwide, ingesting petabytes of data every day. This data powers... .... We’re looking for a Data Engineer to help build and operate the large-scale systems that make this possible... ...and operate scalable data pipelines capable of ingesting petabyte-scale...PipelineFull timeTemporary workWork experience placementLocal areaWorldwideFlexible hoursCisco
San Francisco, CA3 days ago- TRM Labs is seeking a Senior Software Engineer for the Data Platform team in San Francisco to own... ...relational data infrastructure at petabyte scale. You will design, build, and operate... ...product engineering to optimize data models, implement automation, and drive AI-enabled...
- ...interactive world models: systems that generate... ...Dean to build the foundational layer for the... ...looking for exceptional engineers to help build the... ..., trajectory data, and scalable evaluation... ...for larger-scale RL across both digital... ...and post-training pipelines for multimodal,...PipelineFoundation
Embedding VC
San Francisco, CA3 hours ago - ...B is recruiting a Senior Data Engineer to build the data foundation powering business decisions... ...systems into reliable pipelines and datasets, collaborating... ...Growth, and GTM teams to scale data capabilities across... ...You will own data quality, modeling, and accessibility,...PipelineFoundation
E2B
San Francisco, CA12 hours ago $135k - $180k
...searching for an Analytics Engineer to bridge Analytics... ...Business Intelligence, and Data Analysis. As a key strategic... ...responsible for the data modeling and pipelines that enable our... ...the business and play a foundational role in scaling the data team. Candid Health...PipelineFoundationCandid Health
San Francisco, CA8 days ago$136.44k - $265.11k
...structured scientific data and AI are built... ...run AI agents and models directly in their... ...AI fluency is the foundation we build on; it's... ...intersection of software engineering, biology, and... ...these tasks at scale.RESPONSIBILITIESBuild... ..., creating pipelines that curate, transform...PipelineFoundationWork at officeLocal areaMonday to FridayShift workBenchling
San Francisco, CA4 days ago- ..., Inc. is seeking a Founding Data Engineer in San Francisco to build our... ...will own the core data systems, pipelines, and the standards that ensure data reliability as we scale. Turn data into a trusted... ...rare opportunity to shape data foundations at a fast-growing company. #J...PipelineFoundation
Reducto, Inc.
San Francisco, CA2 days ago $170k - $200k
...RoleWe're looking for a Data Engineer who wants to operate... ...board, or optimizing pipelines in a mature environment... ...infrastructure, and AI, building foundational systems that directly... ...shifts from models to data. The best AI systems... ...systems that scale beyond themselvesuse AI...PipelineFoundationWork at officeRemote workFlexible hoursShift work11x AI
San Francisco, CA6 days ago- ...We are a group of engineers, scientists,... ...builders developing foundation models and learning algorithms... ...Infra Engineer (Data Systems), you’ll... ...powers large-scale robot learning. Your... ..., evaluation pipelines, and the tooling... ...Movement: Move petabytes efficiently across...PipelineFoundation
Physical Intelligence
San Francisco, CA4 days ago $200k - $230k
...San Francisco is scaling rapidly and investing... ...heavily in the data infrastructure that... ...for a senior data engineering leader to own and... ...infrastructure, data modeling, and governance -... .... Own end-to-end pipeline orchestration using... ...with a strong foundation in software development...PipelineFoundationStrategic Employment Partners
San Francisco, CA3 days ago- ...you'll doYou will build the foundational data infrastructure that powers... ...and maintain scalable data pipelines, manage secure data environments... ...simple hypotheses into engineered features, manage secure... ...focused on innovating and scaling next-generation AI capabilities...PipelineFoundationApprenticeshipWork at officeLocal areaEasy work
McKinsey & Company
San Francisco, CA6 days ago - # Senior Data EngineerBay Area (Remote-Flexible)Full-timeData... ...intersection of data architecture, pipeline engineering, and AI readiness. The ideal... ...need to operate* •Build the foundation for Cogs. Every autonomous... ...at large tech companies and scaled our own startups from zero....PipelineFoundationRemote workFlexible hours
Your AI Department
San Francisco, CA4 days ago $260k - $340k
...investor support. We’re scaling fast and defining a new category... ...Role Overview As the Engineering Manager for Model Infrastructure, you'll... ...to shape the technical foundation of Harvey's AI platform and... ...efforts, including data pipelines, model operations, training...PipelineFoundationHarvey AI
San Francisco, CA12 hours ago$320k - $405k
...Back to jobs New Data Engineer, Billing & Payments San Francisco... ...team and build the foundation for accurate, scalable billing... ...have trustworthy data that scales with our growth, and you'll... ...Design, build and maintain data models and pipelines in dbt that transform raw...PipelineFoundationWork at officeVisa sponsorshipFlexible hoursRoyper Royco LLC
San Francisco, CA2 days ago- ...We build a persistent model of your identity, your... ...level is a retrieval and data problem. The assistant... ...touch. You'll build the foundation the whole product... ...the realtime and batch pipelines that keep it fresh and... ...it fast and reliable at scale: latency, cost, freshness...PipelineFoundationWork at office
Town.com, Inc.
San Francisco, CA4 days ago - ...fastest-growing AI data business in... ...economy, at global scale, with impact your... ...Work together with engineers, scientists, operators... ...data ingestion, data pipelines, our data... ...development, from model and agent workflows... ...Improve the cloud foundation behind data workloads...PipelineFoundationFull timeWork at officeLocal areaRemote workFlexible hours
Handshake
San Francisco, CA3 days ago - ...dynamic hybrid working model for this role.... ...members for our Data Platform roles are... ...to build the data foundations behind how Superhuman... ...? As a Data Engineer on the Finance & Revenue... ..., you’ll own the pipelines, models, and... ...grow quickly as we scale.QualificationsYou...PipelineFoundationWorldwideHome officeFlexible hours
Superhuman
San Francisco, CA6 days ago - ...enterprise performance at scale. We provide a... ...house and leading frontier models to power efficient and... ...As Reducto's Founding Data Engineer, you'll build our data... ...data lives in, to the pipelines that move it. You’ll make the foundational architecture decisions...PipelineFoundationWork at officeFlexible hours
Reducto
San Francisco, CA3 days ago - ...Founding Data Engineer San Francisco About the company... ...systems need to scale with us. You will establish our data foundation, make architectural decisions... ...the company runs on, modeling them so they can be... ...will own the ingestion pipelines that feed it, the architecture...PipelineFoundationFlexible hours
Braintrust Data, Inc.
San Francisco, CA1 day ago $140k - $200k
...efficient world.The Sr. Data Infrastructure / Quality Engineering role will play a... ...up. You will build the foundation for scalable pipelines capable of handling the... ...validation, and production-scale releaseExperience... ...sensor data ingestion, model/data/label versioning...PipelineFoundationWork experience placementLocal areaOuster
San Francisco, CA7 days ago$190k - $265k
...passionate about enabling data and AI teams to... .... Founded by engineers — and customer-obsessed... ...with data to scaling our services and infrastructure... ...apps, AI agents, model training, model... ...of AI.The Foundation Model Inference... ...architecture, deployment pipelines, and system...PipelineFoundationLocal areaWorldwideDataBricks
San Francisco, CA8 days ago$180k - $225k
...therapist, and investing in the platform foundations to enable this at scale, and building much of it with AI.... ...for the better. About the Data Engineering Team Headway is looking for a... ...design and implement robust data pipelines, define and uphold data governance...PipelineFoundationWork from homeFlexible hoursHeadway
San Francisco, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Foundation Model Data Engineer: Petabyte-Scale Data Pipelines. Be the first to apply!
Related searches
- data systems engineer San Francisco, CA
- finance data engineer San Francisco, CA
- data engineer contract San Francisco, CA
- big data devops engineer San Francisco, CA
- sr data engineer San Francisco, CA
- senior data engineer San Francisco, CA
- entry level big data engineer San Francisco, CA
- principal data engineer San Francisco, CA
- etl data engineer San Francisco, CA
- data engineer manager San Francisco, CA