Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Engineer

Qcells North America

Position Description We are seeking a Lead Data Engineer to architect, build, and lead the development of scalable, cloud-based data platforms that support enterprise analytics, operational reporting, and advanced data use cases. This role provides technical leadership in designing and optimizing ETL/ELT frameworks using Azure data services (Fabric, Data Lake, Data Factory), integrating data from ERP, CRM, and operational systems, and establishing robust data models within a modern Lakehouse architecture. The ideal candidate brings deep SQL and Python expertise, extensive experience with distributed data platforms, and strong knowledge of data architecture, governance, and performance optimization. This individual will serve as a technical leader and mentor, partnering closely with architects, analysts, application teams, and business stakeholders to deliver reliable, scalable, and well-governed enterprise data solutions. Responsibilities Lead the design, development, and optimization of scalable data pipelines supporting ingestion, transformation, and enterprise-wide data consumption. Architect and implement enterprise-grade ETL/ELT frameworks using Azure Fabric or comparable cloud data platforms. Oversee and optimize data integrations from ERP (NetSuite/SAP), CRM (Salesforce), internal systems, APIs, and third-party data sources. Design and govern high-quality, scalable data models supporting analytics, reporting, operational systems, and advanced use cases. Partner with Data Architects to define and implement Lakehouse patterns, Delta Lake strategies, medallion architecture, and domain-driven design principles. Establish and enforce data quality frameworks, validation standards, lineage tracking, and observability practices. Drive performance optimization, scalability, reliability, and cost governance across cloud environments. Provide technical leadership and mentorship to data engineers; conduct design reviews and enforce engineering best practices. Collaborate cross-functionally with analysts, application teams, and business stakeholders to translate requirements into scalable data solutions. Lead MDM, metadata management, governance, and data standardization initiatives. Oversee CI/CD automation, DevOps integration, testing frameworks, and monitoring strategies for data workflows. Evaluate emerging technologies and recommend platform improvements aligned with enterprise strategy. Minimum Qualifications 10+ years of experience in data engineering, data architecture, or related roles. Proven experience leading large-scale data platform initiatives in cloud environments. Extensive hands‑on experience with Azure data services (Data Lake, Data Factory, Fabric, Synapse, or similar). Advanced proficiency in SQL and Python; experience with Spark or distributed processing frameworks. Deep experience designing and implementing enterprise ETL/ELT frameworks. Strong expertise in data modeling (dimensional modeling, star schema, lakehouse/Delta modeling). Experience integrating complex enterprise systems (ERP, CRM, operational platforms). Strong understanding of data governance, metadata management, MDM, and data quality frameworks. Experience with performance tuning, workload optimization, and cloud cost management. Demonstrated ability to lead technical teams, conduct architecture reviews, and mentor engineers. Strong problem‑solving, debugging, and system design skills. Travel may be required up to 5%, depending on business needs. Preferred Qualifications Experience with Delta Tables, Snowflake, Synapse, or comparable cloud data platforms. Experience with event-driven and streaming architectures (Kafka, Event Hub, streaming pipelines). Familiarity with finance, operations, energy, or ERP-driven data domains. Experience designing API-based data integrations and modern integration patterns. Azure certifications (Data Engineer Associate, Solutions Architect, or equivalent). Experience enabling analytics teams, data science workflows, or ML pipelines. Experience implementing enterprise data security and compliance frameworks. Use of AI Tools As a technology organization, Qcells expects team members to leverage AI models and AI-assisted tools in their daily workflows where appropriate. Candidates should be comfortable working in an AI-augmented environment and applying sound judgment when using AI-generated outputs. During the interview process, candidates will be asked to share examples of how they have used AI tools or models in their work. Physical, Mental & Environmental Demands Mobility: Standing 20% of time, Sitting 70% of time, Walking 10% of time. Strength: Pulling up to 10 Pounds, Pushing up to 10 Pounds, Carrying up to 10 Pounds, Lifting up to 10 Pounds. Dexterity: Typing F, Handling F, Reaching F. Agility: Turning F, Twisting F, Bending O, Crouching O, Balancing N, Climbing N, Crawling N, Kneeling N. #J-18808-Ljbffr Qcells North America

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in San Francisco, CA vacancy
  • $215.2k - $245.6k

    ## Lead Data EngineerApplylocations: San Francisco, CAtime type: Full timeposted on: Posted Todayjob requisition id: R243912Lead Data...  ...real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging... 
    Suggested
    Full time
    Part time
    Internship
    H1b
    Local area

    Capital One

    San Francisco, CA
    55 minutes ago
  •  ...Lead Data Integration Engineer - Medicaid & MDM Location: San Francisco, CA - Onsite Duration: 6 months IT experience in Requirements Analysis, Design, Development, Implementation and testing of Data Warehousing and Data Integration Solutions. Expertise... 
    Suggested

    AceStack LLC

    San Francisco, CA
    3 days ago
  •  ...build intelligent software that automates media buying, making big data actionable for marketers and connects them to their next customer. Based in San Francisco, we are seeking a talented Lead Data Engineer. RadiumOne generates first‑party data about actual customers —... 
    Suggested

    Stepping Up Solutions

    San Francisco, CA
    2 days ago
  • $215.2k - $245.6k

    Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast‑paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you’ll be part of a big group of makers, breakers... 
    Suggested
    Internship
    Local area

    Capital One National Association

    San Francisco, CA
    4 days ago
  • SwiftCruit is looking for a Lead Data Engineer to solve complex problems within a collaborative environment. You will work with technologies like Java, Scala, and Python, as well as cloud services like AWS and Redshift to drive data engineering efforts. Ideal candidates... 
    Suggested

    SwiftCruit

    San Francisco, CA
    1 day ago
  • Hebbia, Inc. is seeking its first Data Engineer to refine data infrastructure and drive best practices for data pipelines in San Francisco. The ideal candidate has over 5 years of software development experience focused on data engineering, alongside a Bachelor's or Master... 

    Hebbia, Inc.

    San Francisco, CA
    4 days ago
  • $215.2k - $245.6k

    Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast‑paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers... 
    Full time
    Part time
    Internship
    Local area

    SwiftCruit

    San Francisco, CA
    1 day ago
  • Stepping Up Solutions in San Francisco is looking for a talented Lead Data Engineer to join their Data Technology team. In this role, you will design and implement scalable data infrastructure and processes while working closely with product management and data analysts... 

    Stepping Up Solutions

    San Francisco, CA
    2 days ago
  • A consumer fintech startup in San Francisco is seeking a Lead Data Engineer to build and optimize data engineering functions. You will establish data architecture, mentor junior engineers, and collaborate with cross-functional teams. The position requires extensive data... 
    Full time

    Cerebras

    San Francisco, CA
    4 days ago
  • Salesforce, Inc. is seeking a Data Engineer for its Enterprise Knowledge Graph & AI team in San Francisco, California. The role involves developing and optimizing core knowledge graph components and AI frameworks, focusing on innovation and engineering excellence. The ideal... 
    Flexible hours

    Salesforce

    San Francisco, CA
    5 days ago
  • Role: Lead Data Engineer Location: San Francisco, CA (1-2 days a week onsite is must) Job Type: W2 Contract Contract Length: 9 months with possible extension Experience Level: Senior/Lead Main Skills SQL Databricks Azure Data Factory (ADF) DataStage (or other ETL... 
    Contract work
    2 days per week
    1 day per week

    Saransh

    San Francisco, CA
    4 days ago
  • A leading sleep technology company is looking for a Data Engineer to drive the construction of data infrastructure that supports millions of users. This role requires 6+ years of experience building data platforms and mastery of tools like SQL and Python. You will work... 

    Eight Sleep

    San Francisco, CA
    4 days ago
  • Salesforce is looking for talented engineers at the Senior and Lead Member of Technical Staff levels to join our Master Data Management (MDM) Engineering team. These roles involve designing and developing critical capabilities while leveraging modern AI technologies. Candidates... 

    Salesforce

    San Francisco, CA
    4 days ago
  • Centaur Labs in San Francisco is looking for a Senior Member of Technical Staff or Lead Member of Technical Staff to lead Master Data Management (MDM) Engineering efforts. You'll develop AI-powered tools and maintain MDM integrations, ensuring high-quality, scalable systems... 

    Centaur Labs

    San Francisco, CA
    1 day ago
  • McAfee is looking for a hands-on Lead AI Data Engineer to join the eCommerce Operational Intelligence team. This role involves building enterprise-scale data pipelines to drive operational insights and business impact. You will be responsible for transforming analytics,... 

    McAfee

    San Francisco, CA
    4 days ago
  • Role Overview Join our eCommerce Operational Intelligence team as a hands‑on Lead AI Data Engineer. You will build enterprise‑scale data pipelines and analytics foundations (SQL, Spark/PySpark, ETL/ELT) that produce reliable operational insights and measurable business... 
    Work from home
    Home office
    Relocation package

    McAfee

    San Francisco, CA
    4 days ago
  • $200k

     ...company in San Francisco seeks a Developer Experience Lead to enhance internal tools for their pre-training data team. This role involves leading tooling efforts...  .... Candidates should have strong software engineering fundamentals and experience with CI systems. Annual... 

    Magic

    San Francisco, CA
    2 days ago
  • A leading technology company is seeking a Controls Commissioning Engineer in San Francisco to lead the commissioning and startup of SCADA/BMS/EPMS systems for industrial applications. This role requires over 5 years of experience in controls commissioning, strong expertise... 
    For contractors

    Fluidstack

    San Francisco, CA
    1 day ago
  • $150k - $220k

    Mochi Health, based in San Francisco, is seeking a Data Manager to lead the Data team. The role involves executing analytics and data engineering projects while tracking important KPIs. Candidates should have strong SQL and Python skills and experience managing technical... 

    Mochi-Health

    San Francisco, CA
    2 days ago
  • $215.2k - $245.6k

    Capital One is looking for a Lead Data Engineer in San Francisco. This role involves building and maintaining data platforms that help understand customer spending. You'll work with Agile teams, utilizing technologies like AWS, Redshift, and big data tools to drive solutions... 

    Capital One

    San Francisco, CA
    5 days ago
  • Databricks is seeking a Product Manager to lead product management for Lakeflow, a core product in their data and AI platform. The role involves owning all aspects...  ..., collaborating across teams to improve data engineering solutions, and requires a solid background in product... 

    Databricks Inc.

    San Francisco, CA
    3 days ago
  • $215.2k - $245.6k

    Capital One National Association is seeking a Lead Data Engineer in San Francisco, CA. The role involves driving technological transformations and collaborating with agile teams to build technical solutions using programming languages like Python, SQL, and Scala. Ideal... 

    Capital One National Association

    San Francisco, CA
    5 days ago
  • Epoch Biodesign in San Francisco is seeking a Senior Data Engineer to architect and build foundational data platform infrastructure for AI operations. This full-time position requires proficiency in Python and systems-level languages, experience with data platforms, and... 
    Full time

    Epoch Biodesign

    San Francisco, CA
    3 days ago
  • $135k - $150k

    Resource Innovations is seeking a Lead Java Software and Data Integration Engineer to join our growing Software as a Service (SaaS) team. As a hands‑on technical lead at Resource Innovations, you will be instrumental in the design, development and deployment of innovative... 
    Work experience placement
    Work at office
    Local area
    Remote work

    Resource Innovations

    San Francisco, CA
    1 day ago
  • $148.5k - $260.1k

     ...is seeking both a Senior Member of Technical Staff (SMTS) and a Lead Member of Technical Staff (LMTS) to enhance its Enterprise...  ...Ideal candidates will have significant experience in software engineering, particularly with graph databases and AI technologies. The roles... 

    SwiftCruit

    San Francisco, CA
    5 days ago
  • A leading energy transformation firm is seeking a Lead Java Software and Data Integration Engineer to join their SaaS team. This remote position involves designing and developing data integration solutions and APIs for enterprise systems. Ideal candidates will have 8+... 
    Remote job

    Resource Innovations

    San Francisco, CA
    4 days ago
  • A leading financial technology company is seeking a Senior Staff Software Engineer to design advanced data acquisition systems. In this role, you will leverage your 10+ years of experience to architect scalable solutions that ensure high data quality and reliability. Collaborate... 
    Remote job

    WEX

    San Francisco, CA
    4 days ago
  • Saransh Inc is hiring a Lead Data Engineer in San Francisco, CA. The role involves building data ingestion pipelines and designing data warehouse architecture. Candidates should have a minimum of 8-10 years in software development with strong experience in SQL, Databricks... 
    Contract work
    2 days per week
    1 day per week

    Saransh

    San Francisco, CA
    4 days ago
  • $139.2k - $232.6k

     ...Jacobs is seeking a Senior Engineering Authority in San Francisco, CA to lead telecommunications and ICT systems in data center projects. You will be responsible for design delivery, managing subcontractors, and ensuring project quality through inspections and engineering... 
    For subcontractor
    Flexible hours

    Jacobs

    San Francisco, CA
    11 hours ago
  •  ...expertise in model innovation and systems engineering paired with a design‑minded product...  ...models and experiences. We’re funded by leading investors at Index Ventures and Lightspeed...  ...AI, our models must be trained on data that reflects the world’s diversity of languages... 
    Work at office
    Relocation package

    Cartesia

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!