Lead Data Platform Engineer Lakehouse & AI-Driven Pipelines
Programmers.io
Programmers.io is looking for a strategic Lead Data Engineer in Sunnyvale, California. This role involves designing and implementing large-scale data platforms to enhance analytics, AI/ML, and business intelligence across organizations. The ideal candidate should have over 10 years of experience in Data Engineering, expertise in PySpark, Apache Iceberg, and strong SQL skills. Responsibilities include leading a team, optimizing data pipelines, and engaging with stakeholders to meet business needs. #J-18808-Ljbffr Programmers.io
- ...skilled and strategic Lead Data Engineer with strong... ..., and modern Data Lakehouse architectures. The... ...enterprise‑scale data platforms that enable analytics, AI/ML, and business... ...‑performance data pipelines using PySpark and... ...optimization, and AI‑driven solutions. Strong...Pipeline
- ...We are seeking a Lead Data Engineer to architect, build... ...cloud-based data platforms that support... ...within a modern Lakehouse architecture. The... ...of scalable data pipelines supporting ingestion... ...architecture, and domain‑driven design principles... .... USE OF AI TOOLS As a technology...Pipeline
$139k - $257.55k
...Operations and Engineering team in Growth... ...(GMI) handles data architecture, transformation... ...an Engineering Lead to manage the... ...develop data pipelines, refine ETL... ...of the data platform behind Adobe’s... ...Experience with Cursor AI or similar... ...for data-driven development. Excellent...PipelineTemporary workLocal area- ...Role: Senior Data Engineer Location: Dallas... ...-scale batch pipelines, data serving, data lakehouse, and analytics... ...making, downstream, AI-powered... ...infrastructure and platforms that power modern... ...Data- and AI-driven business at scale... ...& Analytics Lead and mentor...PipelineLong term contract
$150k - $250k
Cylake Inc. is hiring a Data Architect in Sunnyvale, California, to design and maintain a scalable, open-source data lakehouse architecture for petabyte-scale analytics. The role involves architecting end-to-end data pipelines and requires experience with large-scale data...Pipeline$150k - $250k
...cybersecurity startup in Sunnyvale is seeking a professional to design, build, and maintain a scalable data lakehouse architecture for analytics workloads. You will architect data pipelines ensuring high performance and quality. Ideal candidates will have a solid background in...Pipeline$182k - $242k
...Essential Cloud for AI™. Built for... ...CoreWeave delivers a platform of technology,... .... Trusted by leading AI labs, startups... ...What You’ll Do The Data Engineering Team builds and... ...resilient data pipelines, scalable lakehouse systems, and... ...operating event‑driven architectures using...PipelinePermanent employmentTemporary workCasual workWork at officeFlexible hours$135k - $180k
PlusAI in Santa Clara is seeking a talented Software Engineer to create and maintain an optimal data processing pipeline architecture. You will build the required infrastructure, automate processes, and provide actionable insights into business performance metrics. The...Pipeline- PlusAI is seeking a data engineer to create and maintain optimal data processing pipeline architecture in Santa Clara, California. The role involves building infrastructure for data extraction, transforming, and loading, while also automating manual processes and optimizing...Pipeline
- Q CELLS USA Corp. in Santa Clara, California, is looking for a Lead Data Engineer who will architect and develop cloud-based data platforms. The role requires deep expertise in SQL and Python and experience with Azure data services. The ideal candidate will lead the design...
$215k - $263k
...to partner with the CMO and drive user growth through analytics. The role involves building AI-driven workflows, collaborating with cross-functional teams, and developing data-driven insights. The ideal candidate will have over 7 years in analytics with strong SQL and...PipelineWork at office2 days per week$217.57k - $260k
...embrace the thoughtful use of AI tools in our daily work and... ...seeking a Staff Software Engineer - Data Platform to lead the design, build, and... ...Evolve and optimize data pipelines that support downstream analytics... ..., and operate event-driven and batch data platforms such...PipelineFull timeTemporary workWork at officeRemote workFlexible hours- ...The Role We're looking for a Lead Data Engineer to own the data infrastructure that powers GXL's AI products (eg. Paperclip). You'll be responsible for designing, building, and maintaining the pipelines, warehouses, and systems that our research and products depend on....PipelineVisa sponsorship
$153k - $204k
...Essential Cloud for AI™. Built for... ...delivers a platform of technology,... ...confidence. Trusted by leading AI labs,... ...As a Senior Data Engineer you will own... ...Superset) and ETL pipelines, while... ...questions into data-driven insights and... ...with modern data lakehouse technologies...PipelinePermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours- ...Overview: TENEX is an AI-native, automation... ..., and AI-driven solutions. Backed by leading investors, we are... ...landscape. As a Head of Platform Engineering at TENEX, you will... ...foundational infrastructure, data pipelines, and engineering... ...data warehousing/lakehouse technologies (e.g....Pipeline
- ...A leading technology firm in San Jose is seeking an Analytics Engineer to support data, automation, and AI initiatives, particularly for Revenue Cycle Management. This role involves designing scalable data models and developing automated workflows. The ideal candidate...Pipeline
- ...intelligence. Our no-code platform empowers every... ...of production-grade AI agents, without the need... ...automate tasks, analyze data, and enhance team... ...and compliance. Data Engineer Position overview We... ...Kafka, EMR, and data pipelines, to support data-driven decision-making. Ensure...PipelineFlexible hours
- ...Senior AI Engineer Dexmate is building the foundation... ...physical AI — a unified platform that combines high-... ...multi-step reasoning pipelines, tool-calling workflows... ...internal APIs, robot data streams — enabling agents... ..., observability-driven agent iteration, and agent...Pipeline
- ...42dot is a mobility AI company committed to... ...At 42dot, our AD ML Platform Engineers build the core data platform and ML training... ...Build up the data lakehouse for autonomous... ...the data processing pipelines, from data processing... ...demonstrated ability to lead technical projects...PipelineFull timeWork experience placement
$251k - $310k
...applied to a range of vehicle platforms and product use cases.... ...Staff TLM. You will: Lead, mentor, and grow a team of data engineers responsible for the... ...Lake and associated data pipelines. Define and drive the technical... ...a fast-paced, product-driven environment. Excellent...PipelineFull timeRemote work$110k - $180k
Rhombus Power, Inc. in Palo Alto is seeking a Data Engineer to drive national security projects by designing and implementing data engineering activities. You'll automate data ingestion and enhance management processes while collaborating with a multidisciplinary team....Pipeline$181.1k - $272.1k
...passion for using data to drive... ...a Senior Data Engineer to join our App... ...that power data-driven innovation for... ...products, including pipelines, analytical outputs... ...-service data platforms, and implement... ...Store data. Lead the technical design... ...adoption of AI-augmented...PipelineRelocation$120k - $165k
...Fractal is a strategic AI partner to Fortune... ...Global Product Leads, Product... ...synthesize advertiser data, conduct analysis,... ...measurement model data pipelines, manage quarterly... ...frameworks using modern AI-driven tools. Core... ...). Provide data engineering outputs and pipeline...PipelineHourly payFull timeWork experience placementLocal area$170k - $210k
## Sr. Data EngineerApplyremote type: On-... ...Summary**Sr Data Engineer – Samsung Ads About... ...effective advertising platforms in the world. As... ...-performance data pipelines for ingestion,... ...of concept • Adopt AI-assisted development... ...methods and data-driven performance analysis...PipelineHourly payFull timeInternship$184k - $287.5k
NVIDIA is the platform for every new AI-powered application. We seek a senior engineer to own and evolve the core NIM... ...download and caching pipelines across multiple cloud... ...guidelines in test-driven development, agentic... ...in high-performance data pipelines with parallel...Pipeline$150k
...Data Engineer Specializing In Natural Language Processing (NLP) We are... ...the next generation of AI builders, and drive transformative... ...contributions to a knowledge-driven economy. As part of our team... ...refinement, and robust data pipelines, primarily leveraging Python...PipelineVisa sponsorship$129.4k - $212.3k
# Senior Data Engineer## General MotorsPublished 28 Mar 2026... ...developing analytics-driven solutions to help GM Marketing... ...and maintaining data pipelines, databases and data... ...regulations.\\+ Lead and mentor team members... ...Experience with cloud platforms Azure preferred; AWS or...PipelineContract workH1bLocal areaRemote workRelocationRelocation packageFlexible hours$153k - $222k
...global adoption of safe, AI-driven machines. Founded in... ...looking for a Staff Data Platform Engineer to shape the strategy... ...needs. You will lead the design and development... ...with complex ETL pipelines, data ingestion... ...stores (e.g., AWS S3), lakehouse architectures, and data...PipelineFull timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shift$160k - $200k
...We are seeking a Data Engineer with strong analytics... ..., scalable data pipelines, and curated datasets... ...events, and AI-generated signals... ...Databricks and ensure SLA‑driven freshness and... ...Product, BI, AI/ML, Platform, and Finance to... ...or similar cloud lakehouse platforms, including...Pipeline- ...lasting impact. A Build Engineering AI & Data Engineer is more than... ...leverage the watsonx platform and modern data and... ...Develop data and AI‑driven applications using foundation... ...that accelerate pipeline creation, code... ...architectures including lakehouse, vector databases, and...Pipeline
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Platform Engineer Lakehouse & AI-Driven Pipelines. Be the first to apply!
- platform engineering manager Sunnyvale, CA
- platform developer Sunnyvale, CA
- data platform engineer Sunnyvale, CA
- senior platform engineer Sunnyvale, CA
- platform engineer Sunnyvale, CA
- data Sunnyvale, CA
- data collection researcher Sunnyvale, CA
- data technician Sunnyvale, CA
- provider data management Sunnyvale, CA
- data cabling Sunnyvale, CA

