Lead Data Engineer
$160k - $220kQ-Cells
Lead Data Engineer
Location: Santa Clara, CA, United States Location Type: On-site Salary Range: 160000 - 220000 USD Annually
We are seeking a Lead Data Engineer to architect, build, and lead the development of scalable, cloud-based data platforms that support enterprise analytics, operational reporting, and advanced data use cases. This role provides technical leadership in designing and optimizing ETL/ELT frameworks using Azure data services (Fabric, Data Lake, Data Factory), integrating data from ERP, CRM, and operational systems, and establishing robust data models within a modern Lakehouse architecture. The ideal candidate brings deep SQL and Python expertise, extensive experience with distributed data platforms, and strong knowledge of data architecture, governance, and performance optimization. This individual will serve as a technical leader and mentor, partnering closely with architects, analysts, application teams, and business stakeholders to deliver reliable, scalable, and well-governed enterprise data solutions.
Responsibilities:
- Lead the design, development, and optimization of scalable data pipelines supporting ingestion, transformation, and enterprise-wide data consumption.
- Architect and implement enterprise-grade ETL/ELT frameworks using Azure Fabric or comparable cloud data platforms.
- Oversee and optimize data integrations from ERP (NetSuite/SAP), CRM (Salesforce), internal systems, APIs, and third-party data sources.
- Design and govern high-quality, scalable data models supporting analytics, reporting, operational systems, and advanced use cases.
- Partner with Data Architects to define and implement Lakehouse patterns, Delta Lake strategies, medallion architecture, and domain-driven design principles.
- Establish and enforce data quality frameworks, validation standards, lineage tracking, and observability practices.
- Drive performance optimization, scalability, reliability, and cost governance across cloud environments.
- Provide technical leadership and mentorship to data engineers; conduct design reviews and enforce engineering best practices.
- Collaborate cross-functionally with analysts, application teams, and business stakeholders to translate requirements into scalable data solutions.
- Lead MDM, metadata management, governance, and data standardization initiatives.
- Oversee CI/CD automation, DevOps integration, testing frameworks, and monitoring strategies for data workflows.
- Evaluate emerging technologies and recommend platform improvements aligned with enterprise strategy.
Minimum Qualifications:
- 10+ years of experience in data engineering, data architecture, or related roles.
- Proven experience leading large-scale data platform initiatives in cloud environments.
- Extensive hands-on experience with Azure data services (Data Lake, Data Factory, Fabric, Synapse, or similar).
- Advanced proficiency in SQL and Python; experience with Spark or distributed processing frameworks.
- Deep experience designing and implementing enterprise ETL/ELT frameworks.
- Strong expertise in data modeling (dimensional modeling, star schema, lakehouse/Delta modeling).
- Experience integrating complex enterprise systems (ERP, CRM, operational platforms).
- Strong understanding of data governance, metadata management, MDM, and data quality frameworks.
- Experience with performance tuning, workload optimization, and cloud cost management.
- Demonstrated ability to lead technical teams, conduct architecture reviews, and mentor engineers.
- Strong problem-solving, debugging, and system design skills.
- Travel may be required up to 5%, depending on business needs.
Preferred Qualifications:
- Experience with Delta Tables, Snowflake, Synapse, or comparable cloud data platforms.
- Experience with event-driven and streaming architectures (Kafka, Event Hub, streaming pipelines).
- Familiarity with finance, operations, energy, or ERP-driven data domains.
- Experience designing API-based data integrations and modern integration patterns.
- Azure certifications (Data Engineer Associate, Solutions Architect, or equivalent).
- Experience enabling analytics teams, data science workflows, or ML pipelines.
- Experience implementing enterprise data security and compliance frameworks.
Use Of AI Tools:
As a technology organization, Qcells expects team members to leverage AI models and AI-assisted tools in their daily workflows where appropriate. Candidates should be comfortable working in an AI-augmented environment and applying sound judgment when using AI-generated outputs. During the interview process, candidates will be asked to share examples of how they have used AI tools or models in their work. Hanwha Q CELLS America Inc. ("HQCA") is a Qcells company, one of the world's largest manufacturers and providers of solar photovoltaic (PV) products and solutions. Headquartered in Irvine, California, HQCA has been rapidly expanding its business in North America through the expansion of products and solutions, including distributed energy solutions, direct-to-homeowner solar sales and financing, and EPC services. We provide an opportunity to be part of an exciting and growing world-class global business in an interesting and expanding industry of the future.
Physical, Mental & Environmental Demands:
To comply with the Rehabilitation Act of 1973 the essential physical, mental and environmental requirements for this job are listed below. These are requirements normally expected to perform regular job duties. Incumbent must be able to successfully perform all of the functions of the job with or without reasonable accommodation.
Mobility Standing 20% of time Sitting 70% of time Walking 10% of time Strength Pulling up to 10 Pounds Pushing up to 10 Pounds Carrying up to 10 Pounds Lifting up to 10 Pounds Dexterity (F = Frequently, O = Occasionally, N = Never) Typing F Handling F Reaching F - Mobility - Standing - 20% of time - Sitting - 70% of time - Walking - 10% of time - Strength - Pulling - up to 10 Pounds - Pushing - up to 10 Pounds - Carrying - up to 10 Pounds - Lifting - up to 10 Pounds - Dexterity (F = Frequently, O = Occasionally, N = Never) - Typing - F - Handling - F - Reaching - F - Agility (F = Frequently, O = Occasionally, N = Never) Turning F Twisting F Bending O Crouching O Balancing N Climbing N Crawling N Kneeling N
The salary range is required by the California Pay Transparency Act and may differ depending on the location of those candidates hired nationwide. Actual compensation is influenced by a wide array of factors including but not limited to, skill set, education, licenses and certifications, essential job duties and requirements, and the necessary experience relative to the job's minimum qualifications.
*This target salary range is for CA positions only and should not be interpreted as an offer of compensation.
- ...Lead Data Engineer RadiumOne is seeking a Lead Data Engineer to join our Data Technology team with the responsibility of designing and implementing scalable data infrastructure, as well as implementing data transformations developed by data scientists as scalable and...Suggested
- Stepping Up Solutions in Sunnyvale is looking for a Lead Data Engineer to design and implement scalable data infrastructure. This role involves leading a team, delivering quality projects, and collaborating with data professionals. The ideal candidate will have expertise...Suggested
- Google is seeking a Structural Engineer to develop design strategies for modular and prefabricated... ...structures in Sunnyvale, CA. You will lead complex projects involving innovative... ...benefits. Join us to contribute to cutting-edge data center infrastructure! #J-18808-Ljbffr...Suggested
- Glint Tech Solutions is looking for a highly experienced Data Scientist / Computer Vision Engineer to join their innovative AI team. The role involves designing and optimizing computer vision solutions for enterprise applications, focusing on NVIDIA DeepStream and GPU performance...Suggested
$165k - $267.5k
Palo Alto Networks, Inc. is seeking an engineering leader to oversee the development of cutting-edge SaaS and Data Security solutions. You will lead teams through the entire product development cycle, from design to deployment, and drive technology strategy while fostering...Suggested- The Role We're looking for a Lead Data Engineer to own the data infrastructure that powers GXL's AI products (eg. Paperclip). You'll be responsible for designing, building, and maintaining the pipelines, warehouses, and systems that our research and products depend on....Visa sponsorship
- GXL is seeking a Lead Data Engineer in Palo Alto to own the data infrastructure for their AI products. The role involves designing and maintaining scalable ETL/ELT pipelines, enhancing database performance, and collaborating with product teams. The ideal candidate has...Visa sponsorship
$181.1k - $272.1k
...Machine Learning Engineer, Computer Vision - Strategic Data Solutions Sunnyvale, California, United States • Machine Learning and AI Apple's Strategic Data... ...The day-to-day work consists of identifying new fraud leads by connecting different data sources together; working...Local areaRelocation- ...Data Center Engineering Lead (Contract) Department : Infrastructure, Planning & Process (IPP) Company : NVIDIA Job Summary The IPP division at NVIDIA designs, scales, and optimizes the global data center footprint powering our AI platforms and cloud environments. We are...Contract work
$95k - $154k
...curiosity. Employers value candidates who can program, work with data, build models, use APIs, and explain how AI output supports a... ...Full stack developers, Python/Java developers, Data analysts/Data Engineers/ Data Scientists, Machine Learning engineers for full time...Full timeRemote work$85.12k - $134.4k
...Position Overview The Data Engineer is responsible for the integration build, data pipeline construction and operations, connector implementation, ETL development, and Astreya proprietary data pipeline operations that underpin Astreya's Intelligence Suite deployment at...Temporary workFlexible hours- ...Big Data Engineer: Must Have: • Proficiency in managing and manipulating huge datasets in the order of terabytes (TB) is essential • Expertise in big data technologies like Hadoop, Apache Spark (Scala preferred), Apache Hive, or similar frameworks on the...
$150k
...Data Engineer Specializing In Natural Language Processing (NLP) We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative...Visa sponsorship- ...Role: Data Engineer 3 Location: Hybrid, Santa Clara, CA Visa: USC/GC only Duration: 6+ months Mode of interview: Zoom... ...latest technologies that thrive our resources to deliver industry-leading capabilities to our clients and customers, making it...
- ...Contract Data Engineer (API & Database Focus) We are seeking an experienced and highly skilled Contract Data Engineer. This role is focused on building robust data pipelines, primarily involving the integration of data from various APIs and managing critical data infrastructure...Contract work
- ...• Expertise in SQL: You possess a deep understanding of SQL for data manipulation, querying, and performance optimization across various... ...track record of successfully contributing to and potentially leading data-centric projects, understanding the full lifecycle from data...
- ...location is Sunnyvale, CA although will accept candidates from Bentonville, AR. Job Description: We are seeking a skilled Data Engineer with strong expertise in Big Data, Cloud platforms, and distributed data systems . The ideal candidate will have hands-on...
- ...Data Engineer II Rootshell Enterprise Technologies Inc. is a recognized provider of professional IT Consulting services in the US. We are actively seeking Data Engineer II for one of our client. Role: Data Engineer II Location: Santa Clara, CA Duration: Long Term...
- ...Position: Data Engineer II Location: Sunnyvale, California Duration: Contract Job ID: 175305 Job Overview: We are seeking a skilled and detail... ...and communication skills. About PTR Global: PTR Global is a leading provider of information technology and workforce solutions....Full timeContract work
- ...Data Engineer Rootshell Enterprise Technologies Inc. is a recognized provider of professional IT Consulting services in the US. We are actively seeking a Data Engineer for one of our clients. Location: Santa Clara, CA - Onsite We are seeking a highly skilled and...
$182k - $242k
...Senior Data Engineer CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology... ...innovators to build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines...Permanent employmentTemporary workCasual workWork at officeFlexible hours- ...Data Engineer 3 Location: Sunnyvale, CA with a hybrid schedule Max W2 pay rate to your USC, GC, OPT, H4 or F1 visa candidates... ..., and cloud architecture across AWS and GCP. Also lead major database migration and upgrade projects while building...H1b
- ...Principal Big Data Engineer As a Principal Big Data Engineer, you will be an integral member of our data ingestion and processing platform team responsible for architecture, design and development. Having the dynamic ability to adapt to conventional big-data frameworks...
- ...Job Description: We are looking for a Senior Data Engineer with advanced knowledge of SQL and intermediate knowledge of Python. Nice to have (but not required) beginner or intermediate level java experience Your primary focus will be the writing...
- ...Big Data Developer Location: Columbus, OH Client: Banking / Virtusa Pay Rate: $65 - 70/Hr on c2c Need only USC/GC candidates Working proficiency in developmental toolsets with minimum of 10 plus years of experience with the following; Hive, Kafka, Scala...
- ...Data Engineer A Fintech is seeking a strong and passionate data engineer with experience in large scale system implementation, with a focus on complex data pipelines. The candidate must be able to design and drive large projects from inception to production. The right...
- ...Job Title: Data Engineer . Location: Sunnyvale, CA. Direct Client: Req. Key Qualifications: ~ Data Engineer (TERMINUS) ~3+ years of hands-on Data Warehousing and Data Engineering experience. ~ Database design and development...
- ...Data Engineer Austin, TX / Sunnyvale, CA onsite Contract Role Description: Posting Title Data Engineer (Python,Java, SQL,Spark, PySpark, Java Spark) Count: 2 Description Looking for a Data Engineer who has a passion for building scalable and...Contract workImmediate start
- ...from multiple sources Develop reports, dashboards, and visualizations to present insights Use SQL queries to extract and manipulate data from databases Identify trends, patterns, and insights that support business strategies Work closely with business stakeholders and...
- NVIDIA Gruppe is looking for a Senior Machine Learning Engineer to join their autonomous driving team in Santa Clara, California. You will... ...understanding of modern deep learning, experience in building data pipelines, and collaboration across teams. A competitive salary,...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
- data cabling installation Santa Clara, CA
- data recovery Santa Clara, CA
- data capturer Santa Clara, CA
- sap master data Santa Clara, CA
- data loss prevention engineer Santa Clara, CA
- data technician Santa Clara, CA
- data analysis part time Santa Clara, CA
- sap data migration Santa Clara, CA
- data operator Santa Clara, CA
- data processor Santa Clara, CA

