Staff Data Infra Engineer - Petabyte Pipelines
$200k - $275kWatney
Watney in San Francisco is seeking an experienced engineer to architect and develop petabyte-scale data pipelines for their production robots. The ideal candidate will have over 7 years of software development experience, with strong proficiency in programming and a foundation in building and optimizing data pipelines. This role offers an annual salary of $200,000 - $275,000, alongside equity and comprehensive benefits. #J-18808-Ljbffr
- ..., based in San Francisco, is seeking a Senior Data Infrastructure Engineer to design and scale real-time data pipelines critical for agent behavior analysis. The ideal... ...years of experience managing high-throughput, petabyte-scale data systems and possess deep expertise...Pipeline
- ...Unleash 3D Creativity by transforming the content creation pipeline. Meshy makes it effortless for both professional... ...research citations. About this role We are seeking a Software Engineer Intern to join our Data Infra team and help improve our model evaluation and...PipelineInternshipWork at officeRemote workFlexible hours1 day per week
- ...A leading AI Time platform is seeking a Data Infrastructure Engineer to design and maintain scalable data pipelines and architectures, focusing on Python API services and automation. Candidates must have strong Python skills, experience with Airflow, Kubernetes, and AWS...PipelineRemote work
$190.8k - $286.8k
...and Amsterdam. Making data‑driven decisions is... ...tooling to teams across engineering, product, and business... ...Retool to orchestrate data pipelines and define workflows.... ...the order of 500TB to petabytes). Comfortable with... ...while balancing infra and business needs. Champion...PipelineLocal areaFlexible hours$200k - $275k
...increase the speed and capacity of buildout, starting with data centers. The Role As one of the foundational members of our Engineering team, you will architect and develop petabyte-scale data pipelines for our fast-growing fleet of production robots. For a startup...Pipeline$240k - $275k
...playback experiences. Data at Philo Data... ...events annually in a petabyte-scale data lake and supporting... .... Philo's Data Engineering team encompasses both... ...maintenance, per-query infra cost optimization, implementation... ...Design scalable data pipelines and infrastructure;...PipelineFull timeFor contractorsWork at officeRemote workHome officeFlexible hours3 days per week$176k - $210k
Komodo Health Inc is seeking a Senior Data Engineer based in San Francisco to develop and maintain AWS cloud infrastructure and enhance... ...expert knowledge of AWS services, along with experience in CI/CD pipelines and big-data tools. This role offers a salary range of $176,0...Pipeline$102.4k - $181.2k
Staff Data & AI Technical Solutions Engineer P-1398 Note: this is a hybrid role and requires ~3 days in the office in Plano, Tx. Mission As a Staff... ...customers - including deep diving into production data pipelines, AI workflows, streaming data ingestion, and more....PipelineFor contractorsWork at officeLocal areaWorldwide- ...Meshy LLC. is seeking a Software Engineer Intern to join its Data Infra team in San Francisco. You will collaborate with a senior engineer to enhance our model evaluation platform, and be involved in end-to-end feature development across multiple domains. This role offers...Internship
- ...AI Co-Scientist Engineer We envision a world where novel drugs and... ...teams to go from messy biological data to novel insights in minutes.... ...ingestion & normalization pipeline to import data from a wide variety... ...(product, bioinformatics, infra) and translate real-world messy...PipelineWork at office
$160k - $240k
...Senior Data Engineer San Francisco About the Role Together AI is looking for a Senior... ...distributed data platforms, stream processing pipelines, ETLs, etc ~ Expert-level skills in... ...clear, well-tested, and maintainable infra-as-code and software for both new and existing...PipelineFull time- ...Senior Data Engineer Disney Entertainment and ESPN Product & Technology is a global organization... ...and optimized stores, from streaming pipelines and embedding pipelines to vector stores... ...able to partner across AI engineering, infra, and product teams. ~ Familiarity with...Pipeline
$120k - $160k
...Data Engineer Los Angeles; New York; Remote; San Francisco EDO is the TV outcomes company... ...our next-generation Ad EnGage data pipeline. This pipeline measures and optimizes the... ...-scale datasets (hundreds of TBs to petabyte-scale systems) using a modern data stack...PipelineFull timeWork experience placementWork at officeImmediate startRemote workFlexible hours$138.9k - $186.2k
...Senior Data Engineer Disney Entertainment and ESPN Product & Technology is a global organization... ...and optimized stores, from streaming pipelines and embedding pipelines to vector stores... ...able to partner across AI engineering, infra, and product teams. ~ Familiarity with...Pipeline- ...The Role: We are looking for a Senior Data Infrastructure Engineer to build and scale the real-time data pipelines that power agent behavior analysis at production... ...as it happens. We need someone who has built petabyte-scale data systems, knows how to squeeze performance...Pipeline
- ...A technology startup in California is seeking a Machine Learning Engineer to develop robust solutions for ML/CV software relating to farm image data. The role involves building scalable ETL pipelines and collaborating with a dedicated team. An ideal candidate has 2+ years...PipelineFull time
- Obsidian is looking for a Level 3 / Tier 3 network support engineer in San Francisco who is keen on data science. This role entails reviewing and analyzing... ...troubleshooting experience with AI-driven data pipelines. Ideal candidates will have enterprise networking experience...Pipeline
- ...robotics company in San Francisco seeks an applied ML engineer to design and scale the ML systems for their data platform. This hands-on role focuses on deploying production infrastructure, optimizing inference pipelines, and working on retrieval applications over...PipelineRemote work
$250k - $380k
...the Role We are looking for an engineer to design and implement the... ...standardized dataset interfaces, scaling pipelines across thousands of GPUs, and... ...researchers, and other infra groups to ensure datasets are... ...including for multimodal (MM) data that cannot fit in memory. Build...PipelineFull timeWork at officeLocal areaRelocation packageFlexible hours- ...Advisor - Scientific Data Engineer page is loaded## Advisor - Scientific Data Engineerlocations... ...’s mission is connecting scientists to petabyte-scale data through natural language... ...consumable layers* Build and optimize ETL/ELT pipelines that produce denormalized views, pre-...Pipeline
- ...Amplitude is looking for a Software Engineer to join their infrastructure team in San Francisco. This role involves taking infrastructure... ...production, designing reliable backend services, and optimizing data infrastructure. Candidates should have 5+ years in Software Engineering...PipelineFlexible hours
- ...AI-Native Data Engineer @ TrueMeter SF Bay Area | Hybrid (3 days onsite, 2 remote) About... ...data and AI infrastructure end-to-end: pipelines, databases, APIs, and the foundations for... ...scale and cost efficiency. Building infra that allows coding agents and AI tools to...PipelineImmediate startRemote work
- ...member of the AI technical staff to join the founding team. Someone... ...Responsibilities: Scale infra for post-training of... ...Work closely with product engineers to translate cutting‑edge AI... ...performance of multimodal LLMs (data/tensor/pipeline/context/expert parallelism,...PipelineWork at officeRelocationVisa sponsorship
- ...in neurotechnology is seeking a Senior Machine Learning Infrastructure Engineer to design and scale critical infrastructure powering ML applications. This role involves creating robust data pipelines and optimizing modeling processes, essential for developing innovative...Pipeline
- ...F2 AI is seeking a knowledgeable Infrastructure Engineer to design and secure infrastructure for our AI data platform in San Francisco. The role requires 6+ years... ...responsibilities include building data ingestion pipelines, implementing security-first architectures, and...Pipeline
- ...reusable and efficient JAX training pipelines. You’ll work closely with researchers and model engineers to translate ideas into... ...team works closely with research, data, and platform engineers to ensure... ...Translate research needs into infra capabilities and guide best...Pipeline
- ...Senior Software Engineer, ML Data San Francisco, CA • Hybrid • Reports... ...ML models. You'll work with petabytes of data streaming from... ...customer cameras, and build pipelines to ingest, search, label, version... ...closely with applied CV, ML infra and Platform engineers. What...PipelineWork at officeFlexible hours
$192k - $344.85k
...global, high-throughput Product Data platform that powers design,... ...enjoys leading teams solving petabyte scale problems and building... ...three industries - Architecture, Engineering and Construction (AEC),... ...permissions, stream processing, data pipelines, search, granular data...PipelineFor contractorsRemote work- ...versioned REST APIs, contracts, governance. Batch and real-time data pipelines: Kafka or comparable streaming, plus CDC or incremental... ...comparable; embeddings and retrieval patterns. AI software engineering: hands-on building data infrastructure for AI and ML use cases...Pipeline
$150k - $250k
...redefine productivity and quality. The Role We are hiring a Sr Data Engineer / Data Lead to own the data layer that powers Factory OS. You will design and operate petabyte-scale data pipelines that ingest visual, telemetry, and manufacturing data from the factory...PipelineFull timeContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Data Infra Engineer - Petabyte Pipelines. Be the first to apply!
- staff automation engineer San Francisco, CA
- staff data engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- assistant engineer San Francisco, CA
- staff engineer San Francisco, CA
- assistant mechanical engineer San Francisco, CA
- software engineer staff San Francisco, CA
- assistant engineering manager San Francisco, CA
- senior staff systems engineer San Francisco, CA
- assistant civil engineer San Francisco, CA



