Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Platform Engineer Lakehouse & AI-Driven Pipelines

Programmers.io

Programmers.io is looking for a strategic Lead Data Engineer in Sunnyvale, California. This role involves designing and implementing large-scale data platforms to enhance analytics, AI/ML, and business intelligence across organizations. The ideal candidate should have over 10 years of experience in Data Engineering, expertise in PySpark, Apache Iceberg, and strong SQL skills. Responsibilities include leading a team, optimizing data pipelines, and engaging with stakeholders to meet business needs. #J-18808-Ljbffr Programmers.io

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead Data Platform Engineer Lakehouse & AI-Driven Pipelines in Sunnyvale, CA vacancy
  •  ...skilled and strategic Lead Data Engineer with strong...  ..., and modern Data Lakehouse architectures. The...  ...enterprise‑scale data platforms that enable analytics, AI/ML, and business...  ...‑performance data pipelines using PySpark and...  ...optimization, and AI‑driven solutions. Strong... 
    Pipeline

    programmers.io

    Sunnyvale, CA
    5 hours ago
  •  ...We are seeking a Lead Data Engineer to architect, build...  ...cloud-based data platforms that support...  ...within a modern Lakehouse architecture. The...  ...of scalable data pipelines supporting ingestion...  ...architecture, and domain‑driven design principles...  .... USE OF AI TOOLS As a technology... 
    Pipeline

    Q-Cells

    Santa Clara, CA
    2 days ago
  • $139k - $257.55k

     ...Operations and Engineering team in Growth...  ...(GMI) handles data architecture, transformation...  ...an Engineering Lead to manage the...  ...develop data pipelines, refine ETL...  ...of the data platform behind Adobe’s...  ...Experience with Cursor AI or similar...  ...for data-driven development. Excellent... 
    Pipeline
    Temporary work
    Local area

    Adobe

    San Jose, CA
    4 days ago
  •  ...Role: Senior Data Engineer Location: Dallas...  ...-scale batch pipelines, data serving, data lakehouse, and analytics...  ...making, downstream, AI-powered...  ...infrastructure and platforms that power modern...  ...Data- and AI-driven business at scale...  ...& Analytics Lead and mentor... 
    Pipeline
    Long term contract

    Hermitage Infotech

    Mountain View, CA
    4 days ago
  • $150k - $250k

    Cylake Inc. is hiring a Data Architect in Sunnyvale, California, to design and maintain a scalable, open-source data lakehouse architecture for petabyte-scale analytics. The role involves architecting end-to-end data pipelines and requires experience with large-scale data... 
    Pipeline

    Cylake Inc.

    Sunnyvale, CA
    16 hours ago
  • $150k - $250k

     ...cybersecurity startup in Sunnyvale is seeking a professional to design, build, and maintain a scalable data lakehouse architecture for analytics workloads. You will architect data pipelines ensuring high performance and quality. Ideal candidates will have a solid background in... 
    Pipeline

    Cylake, Inc

    Sunnyvale, CA
    4 days ago
  • $182k - $242k

     ...Essential Cloud for AI™. Built for...  ...CoreWeave delivers a platform of technology,...  .... Trusted by leading AI labs, startups...  ...What You’ll Do The Data Engineering Team builds and...  ...resilient data pipelines, scalable lakehouse systems, and...  ...operating event‑driven architectures using... 
    Pipeline
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    1 day ago
  • $135k - $180k

    PlusAI in Santa Clara is seeking a talented Software Engineer to create and maintain an optimal data processing pipeline architecture. You will build the required infrastructure, automate processes, and provide actionable insights into business performance metrics. The... 
    Pipeline

    PlusAI

    Santa Clara, CA
    3 days ago
  • PlusAI is seeking a data engineer to create and maintain optimal data processing pipeline architecture in Santa Clara, California. The role involves building infrastructure for data extraction, transforming, and loading, while also automating manual processes and optimizing... 
    Pipeline

    Medium

    Santa Clara, CA
    4 days ago
  • Q CELLS USA Corp. in Santa Clara, California, is looking for a Lead Data Engineer who will architect and develop cloud-based data platforms. The role requires deep expertise in SQL and Python and experience with Azure data services. The ideal candidate will lead the design... 

    Q-Cells

    Santa Clara, CA
    2 days ago
  • $215k - $263k

     ...to partner with the CMO and drive user growth through analytics. The role involves building AI-driven workflows, collaborating with cross-functional teams, and developing data-driven insights. The ideal candidate will have over 7 years in analytics with strong SQL and... 
    Pipeline
    Work at office
    2 days per week

    EarnIn

    Mountain View, CA
    15 days ago
  • $217.57k - $260k

     ...embrace the thoughtful use of AI tools in our daily work and...  ...seeking a Staff Software Engineer - Data Platform to lead the design, build, and...  ...Evolve and optimize data pipelines that support downstream analytics...  ..., and operate event-driven and batch data platforms such... 
    Pipeline
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours

    ID.me

    Mountain View, CA
    4 days ago
  •  ...The Role We're looking for a Lead Data Engineer to own the data infrastructure that powers GXL's AI products (eg. Paperclip). You'll be responsible for designing, building, and maintaining the pipelines, warehouses, and systems that our research and products depend on.... 
    Pipeline
    Visa sponsorship

    GXL

    Palo Alto, CA
    2 days ago
  • $153k - $204k

     ...Essential Cloud for AI™. Built for...  ...delivers a platform of technology,...  ...confidence. Trusted by leading AI labs,...  ...As a Senior Data Engineer you will own...  ...Superset) and ETL pipelines, while...  ...questions into data-driven insights and...  ...with modern data lakehouse technologies... 
    Pipeline
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    1 day ago
  •  ...Overview: TENEX is an AI-native, automation...  ..., and AI-driven solutions. Backed by leading investors, we are...  ...landscape. As a Head of Platform Engineering at TENEX, you will...  ...foundational infrastructure, data pipelines, and engineering...  ...data warehousing/lakehouse technologies (e.g.... 
    Pipeline

    TenEx

    San Jose, CA
    3 days ago
  •  ...A leading technology firm in San Jose is seeking an Analytics Engineer to support data, automation, and AI initiatives, particularly for Revenue Cycle Management. This role involves designing scalable data models and developing automated workflows. The ideal candidate... 
    Pipeline

    Insight Global

    San Jose, CA
    1 day ago
  •  ...intelligence. Our no-code platform empowers every...  ...of production-grade AI agents, without the need...  ...automate tasks, analyze data, and enhance team...  ...and compliance. Data Engineer Position overview We...  ...Kafka, EMR, and data pipelines, to support data-driven decision-making. Ensure... 
    Pipeline
    Flexible hours

    brevian-careers

    Sunnyvale, CA
    23 hours ago
  •  ...Senior AI Engineer Dexmate is building the foundation...  ...physical AI — a unified platform that combines high-...  ...multi-step reasoning pipelines, tool-calling workflows...  ...internal APIs, robot data streams — enabling agents...  ..., observability-driven agent iteration, and agent... 
    Pipeline

    Dexmate

    Santa Clara, CA
    4 days ago
  •  ...42dot is a mobility AI company committed to...  ...At 42dot, our AD ML Platform Engineers build the core data platform and ML training...  ...Build up the data lakehouse for autonomous...  ...the data processing pipelines, from data processing...  ...demonstrated ability to lead technical projects... 
    Pipeline
    Full time
    Work experience placement

    42dot Inc.

    Sunnyvale, CA
    2 days ago
  • $251k - $310k

     ...applied to a range of vehicle platforms and product use cases....  ...Staff TLM. You will: Lead, mentor, and grow a team of data engineers responsible for the...  ...Lake and associated data pipelines. Define and drive the technical...  ...a fast-paced, product-driven environment. Excellent... 
    Pipeline
    Full time
    Remote work

    Waymo

    Mountain View, CA
    16 hours ago
  • $110k - $180k

    Rhombus Power, Inc. in Palo Alto is seeking a Data Engineer to drive national security projects by designing and implementing data engineering activities. You'll automate data ingestion and enhance management processes while collaborating with a multidisciplinary team.... 
    Pipeline

    Rhombuspower

    Palo Alto, CA
    3 days ago
  • $181.1k - $272.1k

     ...passion for using data to drive...  ...a Senior Data Engineer to join our App...  ...that power data-driven innovation for...  ...products, including pipelines, analytical outputs...  ...-service data platforms, and implement...  ...Store data. Lead the technical design...  ...adoption of AI-augmented... 
    Pipeline
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • $120k - $165k

     ...Fractal is a strategic AI partner to Fortune...  ...Global Product Leads, Product...  ...synthesize advertiser data, conduct analysis,...  ...measurement model data pipelines, manage quarterly...  ...frameworks using modern AI-driven tools. Core...  ...). Provide data engineering outputs and pipeline... 
    Pipeline
    Hourly pay
    Full time
    Work experience placement
    Local area

    Fractal, Inc.

    Mountain View, CA
    16 hours ago
  • $170k - $210k

    ## Sr. Data EngineerApplyremote type: On-...  ...Summary**Sr Data Engineer – Samsung Ads About...  ...effective advertising platforms in the world. As...  ...-performance data pipelines for ingestion,...  ...of concept • Adopt AI-assisted development...  ...methods and data-driven performance analysis... 
    Pipeline
    Hourly pay
    Full time
    Internship

    Samsung Electronics Perú

    Mountain View, CA
    23 hours ago
  • $184k - $287.5k

    NVIDIA is the platform for every new AI-powered application. We seek a senior engineer to own and evolve the core NIM...  ...download and caching pipelines across multiple cloud...  ...guidelines in test-driven development, agentic...  ...in high-performance data pipelines with parallel... 
    Pipeline

    NVIDIA Gruppe

    Santa Clara, CA
    16 hours ago
  • $150k

     ...Data Engineer Specializing In Natural Language Processing (NLP) We are...  ...the next generation of AI builders, and drive transformative...  ...contributions to a knowledge-driven economy. As part of our team...  ...refinement, and robust data pipelines, primarily leveraging Python... 
    Pipeline
    Visa sponsorship

    Institute of Foundation Models

    Sunnyvale, CA
    4 days ago
  • $129.4k - $212.3k

    # Senior Data Engineer## General MotorsPublished 28 Mar 2026...  ...developing analytics-driven solutions to help GM Marketing...  ...and maintaining data pipelines, databases and data...  ...regulations.\\+ Lead and mentor team members...  ...Experience with cloud platforms Azure preferred; AWS or... 
    Pipeline
    Contract work
    H1b
    Local area
    Remote work
    Relocation
    Relocation package
    Flexible hours

    Towards AI, Inc.

    Mountain View, CA
    3 days ago
  • $153k - $222k

     ...global adoption of safe, AI-driven machines. Founded in...  ...looking for a Staff Data Platform Engineer to shape the strategy...  ...needs. You will lead the design and development...  ...with complex ETL pipelines, data ingestion...  ...stores (e.g., AWS S3), lakehouse architectures, and data... 
    Pipeline
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Day shift

    Applied Intuition

    Mountain View, CA
    more than 2 months ago
  • $160k - $200k

     ...We are seeking a Data Engineer with strong analytics...  ..., scalable data pipelines, and curated datasets...  ...events, and AI-generated signals...  ...Databricks and ensure SLA‑driven freshness and...  ...Product, BI, AI/ML, Platform, and Finance to...  ...or similar cloud lakehouse platforms, including... 
    Pipeline

    Arlo Technologies, Inc.

    Milpitas, CA
    2 days ago
  •  ...lasting impact. A Build Engineering AI & Data Engineer is more than...  ...leverage the watsonx platform and modern data and...  ...Develop data and AI‑driven applications using foundation...  ...that accelerate pipeline creation, code...  ...architectures including lakehouse, vector databases, and... 
    Pipeline

    IBM Computing

    San Jose, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Platform Engineer Lakehouse & AI-Driven Pipelines. Be the first to apply!