Lead Data Engineer
Qcells North America
Position Description We are seeking a Lead Data Engineer to architect, build, and lead the development of scalable, cloud-based data platforms that support enterprise analytics, operational reporting, and advanced data use cases. This role provides technical leadership in designing and optimizing ETL/ELT frameworks using Azure data services (Fabric, Data Lake, Data Factory), integrating data from ERP, CRM, and operational systems, and establishing robust data models within a modern Lakehouse architecture. The ideal candidate brings deep SQL and Python expertise, extensive experience with distributed data platforms, and strong knowledge of data architecture, governance, and performance optimization. This individual will serve as a technical leader and mentor, partnering closely with architects, analysts, application teams, and business stakeholders to deliver reliable, scalable, and well-governed enterprise data solutions. Responsibilities Lead the design, development, and optimization of scalable data pipelines supporting ingestion, transformation, and enterprise-wide data consumption. Architect and implement enterprise-grade ETL/ELT frameworks using Azure Fabric or comparable cloud data platforms. Oversee and optimize data integrations from ERP (NetSuite/SAP), CRM (Salesforce), internal systems, APIs, and third-party data sources. Design and govern high-quality, scalable data models supporting analytics, reporting, operational systems, and advanced use cases. Partner with Data Architects to define and implement Lakehouse patterns, Delta Lake strategies, medallion architecture, and domain-driven design principles. Establish and enforce data quality frameworks, validation standards, lineage tracking, and observability practices. Drive performance optimization, scalability, reliability, and cost governance across cloud environments. Provide technical leadership and mentorship to data engineers; conduct design reviews and enforce engineering best practices. Collaborate cross-functionally with analysts, application teams, and business stakeholders to translate requirements into scalable data solutions. Lead MDM, metadata management, governance, and data standardization initiatives. Oversee CI/CD automation, DevOps integration, testing frameworks, and monitoring strategies for data workflows. Evaluate emerging technologies and recommend platform improvements aligned with enterprise strategy. Minimum Qualifications 10+ years of experience in data engineering, data architecture, or related roles. Proven experience leading large-scale data platform initiatives in cloud environments. Extensive hands‑on experience with Azure data services (Data Lake, Data Factory, Fabric, Synapse, or similar). Advanced proficiency in SQL and Python; experience with Spark or distributed processing frameworks. Deep experience designing and implementing enterprise ETL/ELT frameworks. Strong expertise in data modeling (dimensional modeling, star schema, lakehouse/Delta modeling). Experience integrating complex enterprise systems (ERP, CRM, operational platforms). Strong understanding of data governance, metadata management, MDM, and data quality frameworks. Experience with performance tuning, workload optimization, and cloud cost management. Demonstrated ability to lead technical teams, conduct architecture reviews, and mentor engineers. Strong problem‑solving, debugging, and system design skills. Travel may be required up to 5%, depending on business needs. Preferred Qualifications Experience with Delta Tables, Snowflake, Synapse, or comparable cloud data platforms. Experience with event-driven and streaming architectures (Kafka, Event Hub, streaming pipelines). Familiarity with finance, operations, energy, or ERP-driven data domains. Experience designing API-based data integrations and modern integration patterns. Azure certifications (Data Engineer Associate, Solutions Architect, or equivalent). Experience enabling analytics teams, data science workflows, or ML pipelines. Experience implementing enterprise data security and compliance frameworks. Use of AI Tools As a technology organization, Qcells expects team members to leverage AI models and AI-assisted tools in their daily workflows where appropriate. Candidates should be comfortable working in an AI-augmented environment and applying sound judgment when using AI-generated outputs. During the interview process, candidates will be asked to share examples of how they have used AI tools or models in their work. Physical, Mental & Environmental Demands Mobility: Standing 20% of time, Sitting 70% of time, Walking 10% of time. Strength: Pulling up to 10 Pounds, Pushing up to 10 Pounds, Carrying up to 10 Pounds, Lifting up to 10 Pounds. Dexterity: Typing F, Handling F, Reaching F. Agility: Turning F, Twisting F, Bending O, Crouching O, Balancing N, Climbing N, Crawling N, Kneeling N. #J-18808-Ljbffr Qcells North America
$215.2k - $245.6k
## Lead Data EngineerApplylocations: San Francisco, CAtime type: Full timeposted on: Posted Todayjob requisition id: R243912Lead Data... ...real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging...SuggestedFull timePart timeInternshipH1bLocal area- ...Lead Data Integration Engineer - Medicaid & MDM Location: San Francisco, CA - Onsite Duration: 6 months IT experience in Requirements Analysis, Design, Development, Implementation and testing of Data Warehousing and Data Integration Solutions. Expertise...Suggested
- ...build intelligent software that automates media buying, making big data actionable for marketers and connects them to their next customer. Based in San Francisco, we are seeking a talented Lead Data Engineer. RadiumOne generates first‑party data about actual customers —...Suggested
$215.2k - $245.6k
Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast‑paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you’ll be part of a big group of makers, breakers...SuggestedInternshipLocal area- SwiftCruit is looking for a Lead Data Engineer to solve complex problems within a collaborative environment. You will work with technologies like Java, Scala, and Python, as well as cloud services like AWS and Redshift to drive data engineering efforts. Ideal candidates...Suggested
- Hebbia, Inc. is seeking its first Data Engineer to refine data infrastructure and drive best practices for data pipelines in San Francisco. The ideal candidate has over 5 years of software development experience focused on data engineering, alongside a Bachelor's or Master...
$215.2k - $245.6k
Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast‑paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers...Full timePart timeInternshipLocal area- Stepping Up Solutions in San Francisco is looking for a talented Lead Data Engineer to join their Data Technology team. In this role, you will design and implement scalable data infrastructure and processes while working closely with product management and data analysts...
- A consumer fintech startup in San Francisco is seeking a Lead Data Engineer to build and optimize data engineering functions. You will establish data architecture, mentor junior engineers, and collaborate with cross-functional teams. The position requires extensive data...Full time
- Salesforce, Inc. is seeking a Data Engineer for its Enterprise Knowledge Graph & AI team in San Francisco, California. The role involves developing and optimizing core knowledge graph components and AI frameworks, focusing on innovation and engineering excellence. The ideal...Flexible hours
- Role: Lead Data Engineer Location: San Francisco, CA (1-2 days a week onsite is must) Job Type: W2 Contract Contract Length: 9 months with possible extension Experience Level: Senior/Lead Main Skills SQL Databricks Azure Data Factory (ADF) DataStage (or other ETL...Contract work2 days per week1 day per week
- A leading sleep technology company is looking for a Data Engineer to drive the construction of data infrastructure that supports millions of users. This role requires 6+ years of experience building data platforms and mastery of tools like SQL and Python. You will work...
- Salesforce is looking for talented engineers at the Senior and Lead Member of Technical Staff levels to join our Master Data Management (MDM) Engineering team. These roles involve designing and developing critical capabilities while leveraging modern AI technologies. Candidates...
- Centaur Labs in San Francisco is looking for a Senior Member of Technical Staff or Lead Member of Technical Staff to lead Master Data Management (MDM) Engineering efforts. You'll develop AI-powered tools and maintain MDM integrations, ensuring high-quality, scalable systems...
- McAfee is looking for a hands-on Lead AI Data Engineer to join the eCommerce Operational Intelligence team. This role involves building enterprise-scale data pipelines to drive operational insights and business impact. You will be responsible for transforming analytics,...
- Role Overview Join our eCommerce Operational Intelligence team as a hands‑on Lead AI Data Engineer. You will build enterprise‑scale data pipelines and analytics foundations (SQL, Spark/PySpark, ETL/ELT) that produce reliable operational insights and measurable business...Work from homeHome officeRelocation package
$200k
...company in San Francisco seeks a Developer Experience Lead to enhance internal tools for their pre-training data team. This role involves leading tooling efforts... .... Candidates should have strong software engineering fundamentals and experience with CI systems. Annual...- A leading technology company is seeking a Controls Commissioning Engineer in San Francisco to lead the commissioning and startup of SCADA/BMS/EPMS systems for industrial applications. This role requires over 5 years of experience in controls commissioning, strong expertise...For contractors
$150k - $220k
Mochi Health, based in San Francisco, is seeking a Data Manager to lead the Data team. The role involves executing analytics and data engineering projects while tracking important KPIs. Candidates should have strong SQL and Python skills and experience managing technical...$215.2k - $245.6k
Capital One is looking for a Lead Data Engineer in San Francisco. This role involves building and maintaining data platforms that help understand customer spending. You'll work with Agile teams, utilizing technologies like AWS, Redshift, and big data tools to drive solutions...- Databricks is seeking a Product Manager to lead product management for Lakeflow, a core product in their data and AI platform. The role involves owning all aspects... ..., collaborating across teams to improve data engineering solutions, and requires a solid background in product...
$215.2k - $245.6k
Capital One National Association is seeking a Lead Data Engineer in San Francisco, CA. The role involves driving technological transformations and collaborating with agile teams to build technical solutions using programming languages like Python, SQL, and Scala. Ideal...- Epoch Biodesign in San Francisco is seeking a Senior Data Engineer to architect and build foundational data platform infrastructure for AI operations. This full-time position requires proficiency in Python and systems-level languages, experience with data platforms, and...Full time
$135k - $150k
Resource Innovations is seeking a Lead Java Software and Data Integration Engineer to join our growing Software as a Service (SaaS) team. As a hands‑on technical lead at Resource Innovations, you will be instrumental in the design, development and deployment of innovative...Work experience placementWork at officeLocal areaRemote work$148.5k - $260.1k
...is seeking both a Senior Member of Technical Staff (SMTS) and a Lead Member of Technical Staff (LMTS) to enhance its Enterprise... ...Ideal candidates will have significant experience in software engineering, particularly with graph databases and AI technologies. The roles...- A leading energy transformation firm is seeking a Lead Java Software and Data Integration Engineer to join their SaaS team. This remote position involves designing and developing data integration solutions and APIs for enterprise systems. Ideal candidates will have 8+...Remote job
- A leading financial technology company is seeking a Senior Staff Software Engineer to design advanced data acquisition systems. In this role, you will leverage your 10+ years of experience to architect scalable solutions that ensure high data quality and reliability. Collaborate...Remote job
- Saransh Inc is hiring a Lead Data Engineer in San Francisco, CA. The role involves building data ingestion pipelines and designing data warehouse architecture. Candidates should have a minimum of 8-10 years in software development with strong experience in SQL, Databricks...Contract work2 days per week1 day per week
$139.2k - $232.6k
...Jacobs is seeking a Senior Engineering Authority in San Francisco, CA to lead telecommunications and ICT systems in data center projects. You will be responsible for design delivery, managing subcontractors, and ensuring project quality through inspections and engineering...For subcontractorFlexible hours- ...expertise in model innovation and systems engineering paired with a design‑minded product... ...models and experiences. We’re funded by leading investors at Index Ventures and Lightspeed... ...AI, our models must be trained on data that reflects the world’s diversity of languages...Work at officeRelocation package
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
- data cabling installation San Francisco, CA
- data recovery San Francisco, CA
- data capturer San Francisco, CA
- sap master data San Francisco, CA
- data loss prevention engineer San Francisco, CA
- data technician San Francisco, CA
- data analysis part time San Francisco, CA
- sap data migration San Francisco, CA
- data operator San Francisco, CA
- data processor San Francisco, CA


