Staff Data Infrastructure Engineer (Petabyte-scale)
Causal Labs
Causal Labs is building a Large Physics foundation Model and seeks a data platform engineer to design and operate its petabyte-scale storage and processing systems. You will own the shared compute platform and end-to-end data loading for training, enabling high-throughput pipelines and reliable data workflows. You will work with state-of-the-art data lake tech and cloud infrastructure, shaping data ingestion strategies and ensuring reproducibility across experiments in a fast-paced research #J-18808-Ljbffr Causal Labs
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Staff Data Infrastructure Engineer (Petabyte-scale) in San Francisco, CA vacancy
- Kindredventures is building a Large Physics foundation Model and seeks a data engineer to design and operate the data platform for petabyte-scale storage, real-time and batch queries, and scalable ingestion. You will own the compute and orchestration platforms (Spark,...Suggested
- Causal is building a Large Physics foundation Model and seeks a data engineer to design the data platform that underpins this effort,... ...ingestion, fast querying, and reliable training. You will design petabyte-scale storage, manage a shared compute and orchestration layer,...Suggested
- Inception seeks experienced engineers to architect and scale the core infrastructure behind distributed training pipelines and petabyte-scale data catalogs. You will work directly with researchers to accelerate experiments, develop new datasets, improve infrastructure...Suggested
- ...Discord is seeking a Software Engineer to help build the next generation Data Platform that powers decisions... ...design and implement scalable data infrastructure, process petabytes of data, and contribute to... ...gamers connect and create communities at scale. #J-18808-LjbffrSuggestedWorldwide
EngineersOfAI
San Francisco, CA20 hours ago - Garuda Ventures is hiring a Sr Data Engineer to manage petabyte-scale data pipelines that will power Factory OS. The role involves designing data architectures and ensuring data quality across various environments. The ideal candidate should have 5-7 years of data engineering...Suggested
$248k - $279k
A leading gaming platform in San Francisco is seeking an Engineering Manager excited to build data infrastructure at scale. You will lead teams that process petabytes of data for millions of users and make impactful technical decisions. The ideal candidate has significant...Relocation package- ...Discord is seeking a senior software engineer to help build a scalable data platform that powers decisions for millions of gamers worldwide.... ...Java, Rust, or Go, and hands-on expertise in large-scale data infrastructure such as pipelines, streaming, orchestration, or #J...Worldwide
Triwill Group
San Francisco, CA20 hours ago - ...Persona is seeking a Senior Engineer for the Data Platform team in San Francisco, California. In... ...systems that manage data at massive scale, working on datalakes and data pipelines... ...with engineering, data science, and infrastructure teams to ensure performance,...Full time
Persona
San Francisco, CA20 hours ago $140k - $180k
Sigma Computing is expanding its Data Platform team in San Francisco. As a Data Platform Engineer, you will own the underlying data architecture... ...will collaborate with Analytics and Infrastructure teams, drive data governance, and scale Terraform deployments as the company...- StratITech is hiring a senior network engineer to architect and operate secure, high-performance data center and edge networks supporting AI and distributed compute workloads. You will translate loosely defined needs into concrete requirements and plans, and own the end...
$257k - $327k
About the TeamOpenAI is building the infrastructure foundation for the next generation of AI. The Data Center Engineering team defines the strategy, reference architectures,... ...requirements, and delivery standards for the large-scale data centers that support OpenAI research,...For contractorsWork at officeLocal areaFlexible hours- ...Parafin is seeking a Senior Software Engineer to join the Infrastructure team and lead the Data Platform development. You will design, build, and maintain data ingestion, transformation, and serving systems across the company, partnering with Data Science and Product...Remote work
Unchain Data
San Francisco, CA20 hours ago - ...Discord is building the next generation Data Platform to power decisions for millions of gamers. You... ...decisions across the platform. We seek a Software Engineer with 5+ years of experience and hands-on data infrastructure knowledge (BigQuery, Kafka, Spark, Flink,...Relocation
Discord
San Francisco, CA1 day ago $140k - $200k
...autonomous systems - from robots to smart infrastructure - building a safer and more efficient world.The Sr. Data Infrastructure / Quality Engineering role will play a crucial part in... ...data quality validation, and production-scale releaseExperience architecting and validating...Work experience placementLocal area- LanceDB is seeking an experienced Senior Customer Success Engineer to act as a trusted advisor to our most strategic customers. You will... ...outstanding communication to ensure success in deploying and scaling LanceDB across production workloads. You will work across onboarding...
- ...A cutting-edge technology company in San Francisco is seeking a Data Platform Engineer to drive architecture and implementation of core systems. The ideal candidate has extensive experience with backend systems and demonstrates strong analytical skills in fields such...
Hive
San Francisco, CA20 hours ago - A growing tech company in San Francisco is looking for a Software Engineer to design and build scalable data systems. The ideal candidate has at least 3 years of experience in software engineering, particularly in data engineering. You will develop robust data pipelines...
$230k - $280k
...build of a world-class data platform from the... ...Principal Data Platform Engineer to lead the buildout of... ...challenges and shaping the infrastructure that supports real-... ...and AI/ML at scale, this role is for you.... ...architecture end-to-end Tackle petabyte-scale data challenges...Remote work- Cogent is seeking a Senior Storage Infrastructure Engineer to own how we store, protect, and operate data at scale on our Core Platform. You will build the backup, observability, and operations layer across relational, streaming, and analytical stores, making it agent-forward...
- Sapiom, Inc. is seeking an early data engineer to own the data infrastructure end-to-end for a payments platform. You will design and scale ETL pipelines, define robust schemas, and establish governance standards to support 10x growth. You’ll build standardized data models...
- Sieve, Inc. is seeking an infrastructure engineer to design and scale ML/ETL data pipelines, running on distributed cloud infrastructure in San Francisco. You... ...with Go, Python, and Rust. The role involves handling petabyte-scale data processing with a focus on reliability...
- A rapidly growing tech start-up in San Francisco is seeking a Senior Data Engineer to enhance their cloud infrastructure and develop PB scale data pipelines. The role requires over 7 years of experience in data engineering, particularly in start-ups, with skills in Snowflake...
$158k - $260k
...combination of proprietary infrastructure and software, we... ...embedded finance at a global scale.Proudly founded in... ...of our company's data and AI strategy. We are... ...systems that process petabytes of data at a global scale. As a champion of engineering rigor, you will advocate...Temporary workLocal areaWorldwide$146.4k - $235.38k
...unleashes business-critical data that is trapped inside of documents... ...doThe Data and AI Platform Engineer will design, build, and... ...science, and AI/ML capabilities at scale. Reporting to the Sr.... ...technical expert on Snowflake and AI infrastructure, with a strong focus on...Contract workWork at officeLocal areaRemote work2 days per week$210k - $240k
...platform supporting GPU infrastructure, distributed compute,... .... This is a network engineering role first . We are looking... ...senior engineer with Staff-level ownership who... ...designed and operated modern data center networks using... ...a startup or rapidly scaling technical environment...Immediate start$196k - $245k
...Live, every Quest completed, there's data, petabytes of it, telling the story of how... ...who gets excited about building data infrastructure at massive scale and cares deeply about the gaming communities... ...for Discord users and Discord engineers. We’re building the next generation...Full timeWorldwideRelocationRelocation package- ...and experience working with data at various classification levels... ...experience as a data engineer, with a strong focus on cloud... ..., and Klemens Hjartar and is scaling to a large team of full-stack... ...working with multiple cloud infrastructures (AWS, Azure, GCP) and docker...ApprenticeshipEasy work
- Sanity is hiring a Data Engineer (Senior to Staff) to build and scale data infrastructure powering the company. You will own pipelines from ingestion to analytics, and partner with product telemetry and analytics teams to enable data-driven decisions across departments...
$405k
United States Digital Space LLC is looking for an Engineering Manager for Data Architecture in San Francisco. This role involves leading a team that builds and maintains critical data infrastructure, ensuring compliance and security across multiple cloud environments....$226k - $285k
About the TeamOpenAI is building the infrastructure foundation for the next generation of AI. The Data Center Engineering team defines the strategy, reference architectures,... ...requirements, and delivery standards for the large-scale data centers that support OpenAI research,...Work at officeLocal areaFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Data Infrastructure Engineer (Petabyte-scale). Be the first to apply!
Related searches
- assistant engineering manager San Francisco, CA
- assistant civil engineer San Francisco, CA
- assistant mechanical engineer San Francisco, CA
- assistant engineer San Francisco, CA
- staff engineer San Francisco, CA
- staff data engineer San Francisco, CA
- software engineer staff San Francisco, CA
- assistant electrical engineer San Francisco, CA
- staff design engineer San Francisco, CA
- senior staff engineer San Francisco, CA