Lead Data Engineer
$160k - $220kQ-Cells
Lead Data Engineer
Location: Santa Clara, CA, United States Location Type: On-site Salary Range: 160000 - 220000 USD Annually
We are seeking a Lead Data Engineer to architect, build, and lead the development of scalable, cloud-based data platforms that support enterprise analytics, operational reporting, and advanced data use cases. This role provides technical leadership in designing and optimizing ETL/ELT frameworks using Azure data services (Fabric, Data Lake, Data Factory), integrating data from ERP, CRM, and operational systems, and establishing robust data models within a modern Lakehouse architecture. The ideal candidate brings deep SQL and Python expertise, extensive experience with distributed data platforms, and strong knowledge of data architecture, governance, and performance optimization. This individual will serve as a technical leader and mentor, partnering closely with architects, analysts, application teams, and business stakeholders to deliver reliable, scalable, and well-governed enterprise data solutions.
Responsibilities
- Lead the design, development, and optimization of scalable data pipelines supporting ingestion, transformation, and enterprise-wide data consumption.
- Architect and implement enterprise-grade ETL/ELT frameworks using Azure Fabric or comparable cloud data platforms.
- Oversee and optimize data integrations from ERP (NetSuite/SAP), CRM (Salesforce), internal systems, APIs, and third-party data sources.
- Design and govern high-quality, scalable data models supporting analytics, reporting, operational systems, and advanced use cases.
- Partner with Data Architects to define and implement Lakehouse patterns, Delta Lake strategies, medallion architecture, and domain-driven design principles.
- Establish and enforce data quality frameworks, validation standards, lineage tracking, and observability practices.
- Drive performance optimization, scalability, reliability, and cost governance across cloud environments.
- Provide technical leadership and mentorship to data engineers; conduct design reviews and enforce engineering best practices.
- Collaborate cross-functionally with analysts, application teams, and business stakeholders to translate requirements into scalable data solutions.
- Lead MDM, metadata management, governance, and data standardization initiatives.
- Oversee CI/CD automation, DevOps integration, testing frameworks, and monitoring strategies for data workflows.
- Evaluate emerging technologies and recommend platform improvements aligned with enterprise strategy.
Minimum Qualifications
- 10+ years of experience in data engineering, data architecture, or related roles.
- Proven experience leading large-scale data platform initiatives in cloud environments.
- Extensive hands-on experience with Azure data services (Data Lake, Data Factory, Fabric, Synapse, or similar).
- Advanced proficiency in SQL and Python; experience with Spark or distributed processing frameworks.
- Deep experience designing and implementing enterprise ETL/ELT frameworks.
- Strong expertise in data modeling (dimensional modeling, star schema, lakehouse/Delta modeling).
- Experience integrating complex enterprise systems (ERP, CRM, operational platforms).
- Strong understanding of data governance, metadata management, MDM, and data quality frameworks.
- Experience with performance tuning, workload optimization, and cloud cost management.
- Demonstrated ability to lead technical teams, conduct architecture reviews, and mentor engineers.
- Strong problem-solving, debugging, and system design skills.
- Travel may be required up to 5%, depending on business needs.
Preferred Qualifications
- Experience with Delta Tables, Snowflake, Synapse, or comparable cloud data platforms.
- Experience with event-driven and streaming architectures (Kafka, Event Hub, streaming pipelines).
- Familiarity with finance, operations, energy, or ERP-driven data domains.
- Experience designing API-based data integrations and modern integration patterns.
- Azure certifications (Data Engineer Associate, Solutions Architect, or equivalent).
- Experience enabling analytics teams, data science workflows, or ML pipelines.
- Experience implementing enterprise data security and compliance frameworks.
As a technology organization, Qcells expects team members to leverage AI models and AI-assisted tools in their daily workflows where appropriate. Candidates should be comfortable working in an AI-augmented environment and applying sound judgment when using AI-generated outputs. During the interview process, candidates will be asked to share examples of how they have used AI tools or models in their work. Hanwha Q CELLS America Inc. ("HQCA") is a Qcells company, one of the world's largest manufacturers and providers of solar photovoltaic (PV) products and solutions. Headquartered in Irvine, California, HQCA has been rapidly expanding its business in North America through the expansion of products and solutions, including distributed energy solutions, direct-to-homeowner solar sales and financing, and EPC services. We provide an opportunity to be part of an exciting and growing world-class global business in an interesting and expanding industry of the future.
Physical, Mental & Environmental Demands: To comply with the Rehabilitation Act of 1973 the essential physical, mental and environmental requirements for this job are listed below. These are requirements normally expected to perform regular job duties. Incumbent must be able to successfully perform all of the functions of the job with or without reasonable accommodation.
Mobility Standing 20% of time Sitting 70% of time Walking 10% of time Strength Pulling up to 10 Pounds Pushing up to 10 Pounds Carrying up to 10 Pounds Lifting up to 10 Pounds Dexterity (F = Frequently, O = Occasionally, N = Never) Typing F Handling F Reaching F - Mobility - Standing - 20% of time - Sitting - 70% of time - Walking - 10% of time - Strength - Pulling - up to 10 Pounds - Pushing - up to 10 Pounds - Carrying - up to 10 Pounds - Lifting - up to 10 Pounds - Dexterity (F = Frequently, O = Occasionally, N = Never) - Typing - F - Handling - F - Reaching - F - Agility (F = Frequently, O = Occasionally, N = Never) Turning F Twisting F Bending O Crouching O Balancing N Climbing N Crawling N Kneeling N - Agility (F = Frequently, O = Occasionally, N = Never) - Turning - F - Twisting - F - Bending - O - Crouching - O - Balancing - N - Climbing - N - Crawling - N - Kneeling - N
The salary range is required by the California Pay Transparency Act and may differ depending on the location of those candidates hired nationwide. Actual compensation is influenced by a wide array of factors including but not limited to, skill set, education, licenses and certifications, essential job duties and requirements, and the necessary experience relative to the job's minimum qualifications.
*This target salary range is for CA positions only and should not be interpreted as an offer of compensation.
- ...Lead Data EngineerWe are seeking a highly skilled and strategic Lead Data Engineer with strong expertise in PySpark Apache Iceberg, Trino, and modern Data Lakehouse architectures. The ideal candidate will be responsible for designing and driving enterprise-scale data...Suggested
$160k - $220k
...Lead Data EngineerLocation: Santa Clara, CA, United States Location Type: On-site Salary Range: 160000 - 220000 USD AnnuallyWe are seeking a Lead Data Engineer to architect, build, and lead the development of scalable, cloud-based data platforms that support enterprise...Suggested- ...Senior Lead Data EngineerLocation: San Jose, CA 95125 Hybrid(local) No GCKey Responsibilities:Architect, construct, test and maintain ELT pipelines using Hadoop and Spark SQLManage and optimize the infrastructure ensuring reliability and performanceDesign and implement...SuggestedLocal area
- ...Lead Data Engineer RadiumOne is seeking a Lead Data Engineer to join our Data Technology team with the responsibility of designing and implementing scalable data infrastructure, as well as implementing data transformations developed by data scientists as scalable and...Suggested
- ...Role Lead Data Engineer Required Skills Matillion ELT Snowflake DataStage Azure Data Services such as ADLS, SQL Server Dbt tool Experience in Data platform migration projects Experience in design documentation Responsibilities The core requirement for developers will...Suggested
- ...Location: Sunnyvale, CA (3x/ week onsite) Duration: 6 months Data Engineer ***Only share profile, who is interested to appear for face to face interview in Cupertino, CA*** • 8+ years of experience in Data Engineering with advanced SQL skills...
$139k - $257.55k
...yours! The Opportunity The Marketing Operations and Engineering team in Growth Marketing and Insights (GMI) handles data architecture, transformation, and engineering for... ..., and lifetime value. We want an Engineering Lead to manage the data enabling the team’s work. You...Temporary workLocal area- UST is seeking a Senior Lead I Data Engineer to design, develop, and maintain real-time and batch data pipelines using Spark and Kafka, with cloud services (GCP) and data warehousing in BigQuery. You will optimize performance and ensure data quality across scalable architectures...Full time
- Stepping Up Solutions in Sunnyvale is looking for a Lead Data Engineer to design and implement scalable data infrastructure. This role involves leading a team, delivering quality projects, and collaborating with data professionals. The ideal candidate will have expertise...
$147k - $237.5k
A cybersecurity company in Santa Clara is seeking a Principal Engineer to design and develop groundbreaking SASE technologies. The ideal... ...with system software in networking devices, a strong background in data plane architecture, and proficiency in programming languages...Full time- Glint Tech Solutions is looking for a highly experienced Data Scientist / Computer Vision Engineer to join their innovative AI team. The role involves designing and optimizing computer vision solutions for enterprise applications, focusing on NVIDIA DeepStream and GPU performance...
$251k - $310k
...Tech Lead Manager, Data EngineerWaymo is an autonomous driving technology company with the mission to be the world's most trusted driver.... ...Sr. Staff TLM.You will:Lead, mentor, and grow a team of data engineers responsible for the Waymo Commercialization Data Lake and associated...Full timeRemote work- ...Coupang is seeking a skilled Database Engineer in Mountain View, California, to join the Customer Success team. You will be responsible for ensuring the reliability and performance of databases in a high-traffic e-commerce environment. The role requires strong expertise...
- ...Role: Lead Data Engineer Location: Mountain View, CA / Dallas, TX (Onsite) About the Role Data team builds and operates the data marts and pipelines that power HR/Workforce reporting and analytics across Intuit. We're looking for a hands-on Data Engineer...
- ...A leading digital financial platform in Palo Alto is seeking a Machine Learning Engineer to design scalable data ingestion pipelines and monitor data quality. The role requires over six years of experience in machine learning and data engineering, with expertise in Python...
$151.8k - $265.35k
...the Role We are looking for a Senior Machine Learning Engineer to join our Applied Science Data Frameworks team responsible for building the foundational... ...personalized customer experiences. Adobe’s industry-leading offerings including Adobe Acrobat Studio, Adobe Express...Full timeTemporary workLocal areaWorldwide$174.72k - $295.68k
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies... ..., and smart connectivity.We are seeking a Machine Learning Data Curation Engineer to spearhead the data pipeline development and dataset...Full time$152k - $190k
...constantly pushing the envelope, leveraging the world’s largest security data lake to power our cloud-native Zero Trust Exchange platform.... ...future of cybersecurity.RoleWe are looking for a Staff Software Engineer to join our team. This is a hybrid, based in San Jose, CA 3 days...Full timeWork at officeLocal areaWorldwide3 days per week$148.75k - $361k
...streamers around the world while gaining meaningful experience across a variety of disciplines.About the teamThe mission of Roku's Data Engineering team is to develop a world-class big data platform that enables internal and external customers to leverage data to grow their...Work at officeLocal areaRemote workWorldwideMonday to ThursdayFlexible hours$88.15k - $157.85k
...Culture, Great Rewards, and Great Careers. The Contact Center Data Engineer II is an experienced analytics professional responsible for... ...ownership, stronger technical depth, and a higher expectation to lead analysis, influence decisions, improve data practices, and...Hourly payFull timeWork experience placementWork at officeLocal area2 days per week3 days per week$148k - $224.25k
...record in technology and the skills for GPU product definition for Data Center. We are a small, dynamic, and motivated team that... ...experience in technology with previous product management, AI related engineering, design or development experience highly valuedBS or MS or...Full time- ...for managing an organization.Job DescriptionPrimary Skills:Big Data experience8+ years exp in Java, Python and ScalaWith Spark and... ..., calling APIs, write SQL queries, etc.).Work closely with our engineering team to integrate and build algorithmsProcess unstructured data...
$184k - $287.5k
NVIDIA is currently seeking a highly motivated Senior DevTech Compute Engineer for Compression and Data Processing! Would you enjoy prototyping and developing ground breaking methods and data formats to accelerate complex distributed workflows? Do you love investigating...Full timeRemote work- Company: Tredence Inc. Position Title: Senior Data Engineer Location: 1900 Camden Ave., Suite 66, San Jose, CA 95124 Position Responsibilities: Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders...Remote work
- ...roleGridmatic’s business is complex, and we need to build a robust data layer to be able to answer core questions around profit and loss... ...our renewable supply.We’re looking for a startup-minded data engineer who can wear a lot of hats, work with multiple teams, and build...Work at officeHome officeFlexible hours3 days per week
$135k - $180k
Santa Clara, CAData Engineering - Backend Engineering /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver... ...fast-growing teams.Responsibilities: Create and maintain optimal data processing pipeline architectureBuild the infrastructure...Full time- Position: Data Engineer IILocation: Sunnyvale, CaliforniaDuration: ContractJob ID: 175305Job Overview: We are seeking a skilled and detail... ...solving and communication skills.About PTR Global: PTR Global is a leading provider of information technology and workforce solutions....Full time
- ...GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than... ...key workloads with ultra high-speed inference.RoleThe Data Center Provisioning Engineer will be responsible for provisioning, commissioning, and...Work at office
$75 - $85 per hour
Position: Battery Data Engineer III Location: Cupertino, California Duration: Contract Job ID: 171364 Job Description:This will be a data... ...CS/ChemE/MechE is preferred. About PTR Global: PTR Global is a leading provider of information technology and workforce solutions....Full timeContract work$140.25k - $210.38k
Introduction to the jobThe senior lead SQA engineer is responsible for leading validation activities for shared Data & Compute platform capabilities across multiple products. The role focuses on validating new functionality and platform enhancements in areas such as Data...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
- data loss prevention analyst Santa Clara, CA
- data labeling Santa Clara, CA
- data collection Santa Clara, CA
- data technician Santa Clara, CA
- data governance Santa Clara, CA
- data visualization Santa Clara, CA
- test data management Santa Clara, CA
- data processor Santa Clara, CA
- clinical data Santa Clara, CA
- data tech Santa Clara, CA

