Data Infra Engineer - Petabyte-Scale Storage & Video Pipelines
Greylock Partners
Greylock Partners is partnering with an early-stage AI company to build a durable data foundation for large-scale video and multimodal data. We seek a senior engineer who has owned petabyte-scale storage and data platforms in production, shaping architectures with long-term impact. You'll design storage, processing pipelines, and observability, collaborating with founders to turn early product needs into scalable, robust data infrastructure for researchers and agents. #J-18808-Ljbffr
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Data Infra Engineer - Petabyte-Scale Storage & Video Pipelines in San Francisco, CA vacancy
- ...highly technical Foundation Model Data Engineer to own end-to-end data lifecycle for large-scale AI models. You will architect dataset strategies, curate petabyte-scale data, and design post-... ...scale datasets, roadmapping data pipelines, and RLHF/DPO data workflows. #J...Pipeline
Sciforium
San Francisco, CA3 days ago - ...-on support from AMD engineers the team is scaling rapidly to build the... ...visionary Foundation Model Data Engineer to lead the... ..., and post-training pipelines that ensure our... ...model performance. Petabyte-Scale Curation: Design... ...of vision and video data, navigating the...PipelineVideoFlexible hours
Sciforium
San Francisco, CA4 days ago - ...Cogent, an Applied AI Lab in the cybersecurity space, is hiring a Senior Storage Infrastructure Engineer to own data storage, protection, and scale. You will implement backup and encryption policies across Aurora RDS, Clickhouse, and MSK, and build dashboards to monitor...Suggested
Cogent
San Francisco, CA3 days ago - ...manual, and difficult to scale beyond individual pilots.... ...We're looking for a senior engineer who has personally built and operated petabyte-scale storage or data infrastructure. You'll help... ...processing, including the pipelines that turn raw video into useful representations...PipelineVideoImmediate start
Greylock Partners
San Francisco, CA3 days ago - ...Sr Data EngineerDisney Entertainment... ...of engineers, product developers... ...to come.Reach, Scale & Impact: More... ...and streaming video through the power... ...from streaming pipelines and embedding pipelines... ...scalable storage and retrieval patterns... ...engineering, infra, and product teams...PipelineVideo
Disney
San Francisco, CA4 days ago - ...We are a group of engineers, scientists,... ...future. As an ML Infra Engineer (Data Systems), you’ll... ...that powers large-scale robot learning. Your... ...systems, storage, and machine learning... ...platforms, evaluation pipelines, and the tooling... ...Movement: Move petabytes efficiently...Pipeline
Physical Intelligence
San Francisco, CA4 days ago - ...team members for our Data Platform roles are... ...looking for a Data Engineer to join our Data... ...building complex data pipelines and systems,... ...develops and runs large-scale ETL pipelines that process petabytes of data and billions... ...experience with modern data storage technologies (for...PipelineWorldwideHome officeFlexible hours
Coda
San Francisco, CA3 days ago $167.7k - $245.2k
...worldwide, ingesting petabytes of data every day. This data powers... ...re looking for a Data Engineer to help build and operate the large-scale systems that make this... ..., processing, and storage systems that turn raw... ...operate scalable data pipelines capable of ingesting petabyte...PipelineFull timeTemporary workWork experience placementLocal areaWorldwideFlexible hoursCisco
San Francisco, CA3 days ago- ...Growth Data EngineerOpenArt is an AI Storytelling... ...enabling anyone to create videos, visuals, characters,... ...attribution layer of a fast-scaling AI company.Direct... ...looking for a Growth Data Engineer to build and own... ...validate marketing and pipeline dashboards, ensuring data...PipelineVideoWorldwideVisa sponsorship
OpenArt AI
San Francisco, CA4 days ago $190.8k - $238.8k
...Amsterdam.Making data-driven decisions is... ...that, we need to scale our data systems while... ...to teams across engineering, product, and... ...orchestrate data pipelines and define workflows... ...order of 500TB to petabytes)You value SQL as a... ...needs while balancing infra and business needs...PipelineFull timeWork experience placementLocal areaFlexible hoursPlaid Financial
San Francisco, CA8 days ago- ...A rapidly growing tech start-up in San Francisco is seeking a Senior Data Engineer to enhance their cloud infrastructure and develop PB scale data pipelines. The role requires over 7 years of experience in data engineering, particularly in start-ups, with skills in Snowflake...Pipeline
Evolve Group, Inc.
San Francisco, CA4 days ago - ...thing: high-quality data from the real... ...operational scale with the specialized engineering that physical-world... ...a configurable pipeline feature. Prior... ...pipelines, formats, and storage methods. If you'... ...reliably at petabyte scale Partner... ...across video, depth, inertial...PipelineVideo
WorldEngine
San Francisco, CA1 day ago - ...Discord is seeking Senior Data Engineers to join our world class Data team. You will own data models and end-to-end pipelines that power analytics, experiments, dashboards, and models... ...instrumentation, ensure data quality at scale, and optimize performance and cost. You’ll...Pipeline
Discord
San Francisco, CA4 days ago $46 per hour
...Data Engineer InternSan Francisco, CA • New York, NYFigma is growing our team of passionate... ...interns who are excited to help scale the systems and pipelines that power decision-making at Figma.... ...closed captioning on video conferencingEnsuring all written communication...PipelineVideoHourly payInternshipFigma
San Francisco, CA18 hours ago- ...model is trained on petabytes of video, lidar, radar, and sensor data. Today's data... .... Our open-source engine, Daft, is purpose-... ...infrastructure, to our data storage/querying layers... ...exposure to scaling cloud infrastructure... ...heavy-compute data pipelines (bonus points for...PipelineVideoWork at officeFlexible hoursNight shift
Mixpeek
San Francisco, CA4 days ago - ...Arena Intelligence seeks a skilled Data Infrastructure Engineer to build scalable data pipelines powering real-world AI evaluation. You will process tens of millions... ...with researchers and product leadership to scale data systems, ensure data quality, and enable transparent...Pipeline
Arena Intelligence, Inc.
San Francisco, CA4 days ago $150k - $250k
...everything from text-to-video AI avatars to real-time... ..., we’re rapidly scaling and looking for exceptional... ...If you're ready to own data strategy at a high-growth... ...build. As Senior Data Engineer , you won’t just clean datasets and maintain pipelines. You’ll own the entire...PipelineVideoFull timeRemote workFlexible hours- ...autonomous vehicles, video generation models — is trained on petabytes of video, lidar, radar, and sensor data. But today's data... ...× per generation. Storage and pipelines haven't. The gap... .... Our open‑source engine, Daft, is the distributed... ...that make corpus‑scale annotation...PipelineVideoHourly payWork at officeFlexible hoursNight shift1 day per week
Eventual
San Francisco, CA4 days ago - ...physical world from video: millions of hours... ...is building data curation for Physical... ...and sensor data at petabyte scale and extract signals... ...team where every engineer has high ownership... ...infrastructure, to our data storage/querying layers... ...-compute data pipelines (bonus points for...PipelineVideoWork at officeFlexible hoursNight shift
Mixpeek
San Francisco, CA4 days ago - ...full-time About This Role Scale Avala's neural network training... ...infrastructure to handle the massive data requirements of Physical AI. Optimize training pipelines, implement efficient data... ...ensure our ML systems can leverage petabytes of multimodal robotics and AV data...PipelineFull time
Avala
San Francisco, CA14 hours ago $206.3k - $388k
...re looking for a Principal ML Engineer to architect and scale the multimodal data processing pipelines and infrastructure behind Adobe... ...foundation models (image, video, audio). In this role, you’ll... ...processing, and delivery, from storage and I/O to compute scheduling...PipelineVideoFull timeTemporary workLocal areaWorldwideAdobe Systems
San Francisco, CA5 days ago- ...Strava is seeking a Senior Data Engineer to join the Data Products team in San Francisco. You’ll build and operate data pipelines, access layers, and platform tooling that power Strava’s data products and embeddings at scale. You’ll collaborate with ML engineers, data...Pipeline3 days per week
Strava
San Francisco, CA17 hours ago $130k - $150k
...a highly skilled Lead Data Engineer to design develop and... ...implementation of modern data pipelines mentor engineering... ...implement enterprise scale data ingestion... ...related to data ingestion storage processing and governance... ...capture your image (video or screenshot) during...PipelineVideoFull timeWork at officeLocal area3 days per weekCapgemini
San Francisco, CA4 days ago- ...Avala is seeking a skilled Data Engineer to build the data infrastructure... ..., processes, and manages petabytes of sensor data from autonomous... ...on designing scalable pipelines that transform raw data into... ...emphasizing data quality, scalable storage, and collaboration with ML...Pipeline
Avala
San Francisco, CA4 days ago - ...believe culture can be engineered - but when it... ...'re looking for a data engineer to help us... ...and maintain pipelines that ingest, validate... ...making decisions that scale with the team and... ...multi-modal data (video, point clouds,... ...GCP or AWS - object storage, serverless triggers...PipelineVideoLocal areaFlexible hours
$240k - $360k
...re looking for a Senior Staff Data Engineer to be the technical backbone... ...as the company's AI ambitions scale. You'll work in a modern... ...meets ML platform — feature pipelines, serving layers, and the infrastructure... ...such as sitting, typing, and video conferencing.About Hinge...PipelineVideoWork at officeLocal areaImmediate startRemote workWorldwide3 days per weekHinge Health
San Francisco, CA7 days ago- ...seeking a Backend / Infrastructure Engineer who thrives at the... ...systems, SDK design, and large-scale inference infrastructure. You... ...backbone powering NomadicML’s video intelligence platform—from secure... ...to distributed GPU inference pipelines—collaborating with ML...PipelineVideoWorldwide
Nomadic AI
San Francisco, CA15 hours ago $172.5k - $260.1k
...refine their lead outreach and pipeline management. We are looking for engineers to develop the Sales Intelligence... ..., and operation of a high-scale, low-latency platform that manages... ...(SIP) processes conversational data from voice, video, and email to power various Sales...PipelineVideoFull timeSalesforce
San Francisco, CA5 days ago- ...Computing is building out its Data Platform team to own data... ...and to develop scalable ETL pipelines for internal and demo use cases... ...you’ll work across product, engineering, and GTM to deliver high-visibility... ...with analytics and infra teams to enable trusted insights...Pipeline
We Love AI Jobs
San Francisco, CA3 days ago - ...through various formats—text, images, video, sound, and even 3D. We're building better... ...this medium. Supercomputing / AI Infra at Krea We build and operate the infrastructure... ...training, 1000+ K8s GPU clusters, petabyte scale data pipelines, etc. We build a lot of this from...PipelineVideo
Krea
San Francisco, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Infra Engineer - Petabyte-Scale Storage & Video Pipelines. Be the first to apply!
Related searches
- data systems engineer San Francisco, CA
- finance data engineer San Francisco, CA
- data engineer contract San Francisco, CA
- big data devops engineer San Francisco, CA
- sr data engineer San Francisco, CA
- senior data engineer San Francisco, CA
- entry level big data engineer San Francisco, CA
- principal data engineer San Francisco, CA
- etl data engineer San Francisco, CA
- data engineer manager San Francisco, CA