Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Data Infrastructure Engineer: Scale AI Pipelines

Inception

Inception seeks experienced engineers to architect and scale the core infrastructure behind distributed training pipelines and petabyte-scale data catalogs. You will work directly with researchers to accelerate experiments, develop new datasets, improve infrastructure efficiency, and enable key insights across our data assets. You will design, build, and operate scalable, fault-tolerant infrastructure for LLM research, including distributed compute, data orchestration, and storage; develop #J-18808-Ljbffr Inception

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Staff Data Infrastructure Engineer: Scale AI Pipelines in San Francisco, CA vacancy
  •  ...foundation Model and seeks a data platform engineer to design and operate its petabyte-scale storage and processing systems...  ...training, enabling high-throughput pipelines and reliable data workflows....  ...-art data lake tech and cloud infrastructure, shaping data ingestion... 
    Pipeline

    Causal Labs

    San Francisco, CA
    19 hours ago
  • $140k - $180k

     ...Computing is expanding its Data Platform team in San...  .... As a Data Platform Engineer, you will own the underlying...  ...build and optimize ETL pipelines for internal and demo...  ...with Analytics and Infrastructure teams, drive data governance, and scale Terraform deployments as... 
    Pipeline

    Sigma Computing

    San Francisco, CA
    3 days ago
  • Persona is seeking a Senior Engineer for the Data Platform team in San Francisco, California...  ...that manage data at massive scale, working on datalakes and data pipelines. This position demands...  ...engineering, data science, and infrastructure teams to ensure performance, reliability... 
    Pipeline
    Full time

    Persona

    San Francisco, CA
    3 days ago
  • Kindredventures is building a Large Physics foundation Model and seeks a data engineer to design and operate the data platform for petabyte-scale storage, real-time and batch queries, and scalable ingestion. You will own the compute and orchestration platforms (Spark,... 
    Pipeline

    Kindredventures

    San Francisco, CA
    2 days ago
  • Garuda Ventures is hiring a Sr Data Engineer to manage petabyte-scale data pipelines that will power Factory OS. The role involves designing data architectures and ensuring data quality across various environments. The ideal candidate should have 5-7 years of data engineering... 
    Pipeline

    Garuda Ventures

    San Francisco, CA
    2 days ago
  • Discord is seeking a senior software engineer to help build a scalable data platform that powers decisions for millions of gamers worldwide...  ...Rust, or Go, and hands-on expertise in large-scale data infrastructure such as pipelines, streaming, orchestration, or #J-18808-Ljbffr... 
    Pipeline
    Worldwide

    Triwill Group

    San Francisco, CA
    3 days ago
  • $120k - $150k

    The Opportunity As a Data Engineer, you are passionate and drive excellence across data ingestion...  ...Optimize how data gets delivered, and scale our data systems where needed Design...  ...as we enhance our data platform and infrastructure Required to work on-site 3 days a week... 
    Pipeline
    Full time
    3 days per week

    Kandji

    San Francisco, CA
    19 hours ago
  • $140k - $200k

     ...future of Physical AI. Our advanced vision...  ...robots to smart infrastructure - building a safer...  ...efficient world.The Sr. Data Infrastructure / Quality Engineering role will play a...  ...foundation for scalable pipelines capable of handling...  ..., and production-scale releaseExperience... 
    Pipeline
    Work experience placement
    Local area

    Ouster

    San Francisco, CA
    4 days ago
  • Sapiom, Inc. is seeking an early data engineer to own the data infrastructure end-to-end for a payments platform. You will design and scale ETL pipelines, define robust schemas, and establish governance standards to support 10x growth. You’ll build standardized data models... 
    Pipeline

    Sapiom, Inc.

    San Francisco, CA
    1 day ago
  •  ...experience working with data at various...  ...experience as a data engineer, with a strong...  ...background in data pipeline performance and diagnosticsExcellent...  ...developing an AI Platform that will...  ...Hjartar and is scaling to a large team of...  ...multiple cloud infrastructures (AWS, Azure, GCP)... 
    Pipeline
    Apprenticeship
    Easy work

    McKinsey & Company

    San Francisco, CA
    19 hours ago
  •  ...start-up in San Francisco is seeking a Senior Data Engineer to enhance their cloud infrastructure and develop PB scale data pipelines. The role requires over 7 years of...  ...opportunity to join a team that's leveraging AI to innovate in the data engineering space and... 
    Pipeline

    Evolve Group, Inc.

    San Francisco, CA
    19 hours ago
  • $230k - $385k

     ...the teamThe Monetization Data Platform team builds...  ...data to help Product, Engineering, Finance, and GTM teams...  ...building systems that scale with the growth and complexity...  ...and batch data pipelines that process product, financial...  ...OpenAIOpenAI is an AI research and deployment... 
    Pipeline
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    2 days ago
  • $240k - $360k

     ...RoleWe're looking for a Senior Staff Data Engineer to be the technical backbone...  ...platform evolves as the company's AI ambitions scale. You'll work in a modern stack...  ...meets ML platform — feature pipelines, serving layers, and the infrastructure that makes ML models... 
    Pipeline
    Work at office
    Local area
    Immediate start
    Remote work
    Worldwide
    3 days per week

    Hinge Health

    San Francisco, CA
    4 days ago
  • $197.6k - $296.4k

    About the RoleAs a Staff Data Engineer, you will be a technical...  ...of the data infrastructure that powers real-time...  ...experiences, analytics, and AI across Hinge Health....  ...Engineer owns individual pipelines and systems, you own...  ...data platforms at scale.4+ years of strong proficiency... 
    Pipeline
    Work at office
    Local area
    Immediate start
    Remote work
    Worldwide
    3 days per week

    Hinge Health

    San Francisco, CA
    4 days ago
  • A tech-driven AI company in San Francisco is looking for a Data Engineer to build and scale its internal data platform. The successful candidate will design data models, create data pipelines, and ensure data integrity to support strategic decision-making. This position... 
    Pipeline

    Baseten

    San Francisco, CA
    3 days ago
  • $220k - $330k

     ...Health is building the data and ML backbone...  .... As a Data Engineering Manager leading our...  ...learning reliable at scale. You’ll guide our...  ...This is not a pure infrastructure or ML engineering...  ...batch and streaming pipelines, data models,...  ...features of the platform.AI-forward... 
    Pipeline
    Work at office
    Local area
    Remote work
    Worldwide
    Flexible hours
    3 days per week

    Hinge Health

    San Francisco, CA
    1 day ago
  •  ...tech company in San Francisco is looking for a Software Engineer to design and build scalable data systems. The ideal candidate has at least 3 years of...  ...particularly in data engineering. You will develop robust data pipelines and support data science initiatives, using modern... 
    Pipeline

    Crustdata (YC F24)

    San Francisco, CA
    19 hours ago
  • Metriport, a data intelligence platform for healthcare, seeks a Senior Data Engineer in the San Francisco area. You will scale our data platform, build pipelines, and own end-to-end data delivery to customers, while collaborating with AI/ML teams and ensuring data reliability... 
    Pipeline

    Metriport

    San Francisco, CA
    2 days ago
  •  ...Design team in San Francisco seeks a Senior Data Engineer to build scalable data foundations for experimentation, AI features, and analytics across Illustrator,...  ...governance with Unity Catalog, and cost-aware data pipelines at scale, while advancing privacy and data quality... 
    Pipeline

    Adobe

    San Francisco, CA
    2 days ago
  • $150k - $170k

     ...Senior Data Platform Engineer Ellipsis Health is creating cutting-edge AI/ML products that solve healthcare...  ...experience in building, scaling, and optimizing...  ...implement end-to-end ML Ops pipelines Architect and...  ...implement scalable infrastructure for Large Language... 
    Pipeline
    Remote work
    Flexible hours

    Ellipsis Health

    San Francisco, CA
    3 days ago
  • Parafin is seeking a Senior Software Engineer to join the Infrastructure team and lead the Data Platform development. You will design, build, and maintain data...  ...-driven product decisions. You will own core data pipelines, optimize lakehouse infrastructure, and mentor engineers... 
    Pipeline
    Remote job

    Unchain Data

    San Francisco, CA
    1 day ago
  • $300k - $330k

     ...combination of proprietary infrastructure and software, we...  ...at a global scale.Proudly founded in...  ...end-to-end. You use AI to work smarter and...  ...hiring a Director, Data and Knowledge Platform Engineering (based in San Francisco...  ...tools, automated pipelines, API endpoints, and... 
    Pipeline
    Temporary work
    Local area
    Worldwide

    Airwallex

    San Francisco, CA
    19 hours ago
  • Airwallex is hiring a Data Engineering Manager in San Francisco hybrid to scale data foundations powering analytics and product...  ...data engineers on data modeling, pipelines, and governance, partnering with...  ...batch/streaming ETL, and drive AI-enabled data thinking while growing... 
    Pipeline

    Airwallex

    San Francisco, CA
    2 days ago
  • $315k

    Anthropic is seeking an Engineering Manager to lead the Pretraining Data Platform team, responsible for the data platforms that create datasets for training AI models. This role requires managing large-scale data pipelines and ensuring data processing efficiency. The ideal... 
    Pipeline
    Work at office

    Anthropic

    San Francisco, CA
    2 days ago
  •  ...orchestrating multi-agent AI systems, powering 300...  ..., and customer base scale, data is becoming one of...  ...first dedicated data engineering hire. Your job is to...  ...exists, improve the infrastructure, define trusted metrics...  ...engineering: pipelines, warehouse/lake design... 
    Pipeline

    CrewAI

    San Francisco, CA
    3 days ago
  • CoreWeave, the AI hyperscaler, is hiring a Staff Engineer for Performance Engineering in San Francisco...  ...the W&B platform and infrastructure, designing experiments to...  ...thinking into CI/CD pipelines and cross-functional initiatives at scale. #J-18808-Ljbffr Weights... 
    Pipeline

    Weights & Biases

    San Francisco, CA
    1 day ago
  • $200k - $250k

    Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the...  ...this role:As a Data Platform Engineer at Astronomer, you’ll be a key...  ...Python scripting skills for data pipeline support.Experience with open-... 
    Pipeline

    Astronomer

    San Francisco, CA
    3 days ago
  •  ...Rippling’s unified data platform that makes...  ...workflows.We’re hiring a Staff Software Engineer to build the AI platforms within...  ..., reliability, and scale.What you will...  ...Cloud’s AI training pipelines for data retrieval,...  ...with AI Platform, Infrastructure, Security, and Product... 
    Pipeline
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    2 days ago
  • $130k - $200k

     ...Vercel is the agentic infrastructure company. We free...  ...behind Next.js, v0, and AI SDK, we create products...  ...'re looking for a Data Platform Engineer to join our Data Engineering...  ...isn't a reporting or pipelines-for-a-dashboard role....  ...reliable as usage scales.If you're excited to... 
    Pipeline
    Work from home
    Worldwide
    Flexible hours

    Vercel

    San Francisco, CA
    14 hours ago
  • B Capital is seeking a Data Engineer for their San Francisco office to build and operate data ingestion systems. The role requires collaboration with researchers to enhance model performance through effective data management. The ideal candidate has experience in web crawling... 
    Pipeline
    Work at office

    B Capital

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Data Infrastructure Engineer: Scale AI Pipelines. Be the first to apply!