Lead Data Engineer
United IT
Lead Data Engineer
Data team builds and operates the data marts and pipelines that power HR/Workforce reporting and analytics across Intuit. We're looking for a hands-on Data Engineer who can operate independently. High-visibility, high-ownership — direct exposure to AI initiatives, cross-functional stakeholders, and the chance to meaningfully reduce day-to-day operational load for the team.
• Build, maintain, and troubleshoot Spark/EMR ETL pipelines feeding HR and Workforce data marts.
• Monitor and remediate Data Asset Score issues (data quality rules, governance/PII-minimization actions) to keep HR data assets compliant ahead of deadlines.
• Be the daily coordination point between US HR business stakeholders, the IDC (India) engineering team, and platform/infra teams - translating requirements, unblocking IDC, and reporting status.
• Triage and resolve Jira tickets/bugs raised against HR data mart pipelines; write clear runbooks and pipeline documentation.
• Build semantic layers and Retrieval-Augmented Generation (RAG) pipelines.
• Integrate REST and/or GraphQL APIs into data workflows.
• Operate with minimal oversight: escalating only true blockers and proactively flag risks before they become incidents.
• 8+ years in Data Engineering, with strong hands-on Spark (PySpark/Scala), SQL, and Python.
• Experience building and operating ETL/ELT pipelines on cloud platforms (AWS EMR/S3, Databricks, or equivalent); workflow orchestration (Airflow or similar).
• Comfortable owning pipeline operations end-to-end: reading dependency graphs, diagnosing failures, working with on-call /PagerDuty/Splunk, and driving fixes with multiple teams.
• Working knowledge of data warehousing/data mart design, data governance, and PII handling practices.
• AI-native mindset: familiarity with LLM capabilities, evaluation frameworks, and the creative application of AI principles to engineering challenges.
• Proficiency with GenAI productivity tools (e.g., Claude, Cursor, Codex) to enhance engineering workflows.
• Strong communicator; comfortable directing an offshore IDC team with minimal handholding.
$251k - $310k
...simulation across 15+ U.S. states. This role follows a hybrid work schedule and reports to Sr. Staff TLM. You will: Lead, mentor, and grow a team of data engineers responsible for the Waymo Commercialization Data Lake and associated data pipelines. Define and drive the...SuggestedFull timeRemote workWaymo
Mountain View, CA4 days ago- UST is seeking a Senior Lead I Data Engineer to design, develop, and maintain real-time and batch data pipelines using Spark and Kafka, with cloud services (GCP) and data warehousing in BigQuery. You will optimize performance and ensure data quality across scalable architectures...SuggestedFull time
- Job Description RadiumOne is seeking a Lead Data Engineer to join our Data Technology team with the responsibility of designing and implementing scalable data infrastructure, as well as implementing data transformations developed by data scientists as scalable and robust...Suggested
- Stepping Up Solutions in Sunnyvale is looking for a Lead Data Engineer to design and implement scalable data infrastructure. This role involves leading a team, delivering quality projects, and collaborating with data professionals. The ideal candidate will have expertise...Suggested
- About Nu Nu is the leading digital bank in Latin America, serving 135 million customers across... ...an industry transformation by leveraging data and proprietary technology to develop... ...financial products. As a Machine Learning Engineer in AI Core, Data Intelligence, you’ll...SuggestedWork at officeWork from homeRelocation packageFlexible hours
- A leading digital financial platform in Palo Alto is seeking a Machine Learning Engineer to design scalable data ingestion pipelines and monitor data quality. The role requires over six years of experience in machine learning and data engineering, with expertise in Python...Remote job
- Glint Tech Solutions is looking for a highly experienced Data Scientist / Computer Vision Engineer to join their innovative AI team. The role involves designing and optimizing computer vision solutions for enterprise applications, focusing on NVIDIA DeepStream and GPU performance...
- ...Hello Everyone, No GC, Role: Senior Lead Data Engineer Location: San Jose, CA 95125 Hybrid(Locals) Key: Hadoop, Spark SQL strong • Key Responsibilities: • Architect, construct , test and maintain ELT pipelines using Hadoop and Spark SQL •...Local area
Argyll Infotech, Inc.
San Jose, CA2 days ago $139k - $257.55k
...yours! The Opportunity The Marketing Operations and Engineering team in Growth Marketing and Insights (GMI) handles data architecture, transformation, and engineering for... ..., and lifetime value. We want an Engineering Lead to manage the data enabling the team’s work. You...Temporary workLocal areaAdobe
San Jose, CA3 days ago- Strong expertise in data modeling (dimensional modeling, star schema, lakehouse/Delta modeling). Description We are seeking a Lead Data Engineer to architect, build, and lead the development of scalable, cloud-based data platforms that support enterprise analytics, operational...
- Role Lead Data Engineer Required Skills Matillion ELT Snowflake DataStage Azure Data Services such as ADLS, SQL Server Dbt tool Experience in Data platform migration projects Experience in design documentation Responsibilities The core requirement for developers...
$166k - $244k
...and scalable.About the RoleWe are looking for a Machine Learning Data Engineer (DataOps) to build and unify the data infrastructure that powers our model training pipelines. In this role, you will lead the effort to consolidate fragmented data sources into a cohesive,...Full timeRemote work$100.79k - $160.26k
...DLA Piper is a place you can engage in meaningful work and grow your career. Let’s see what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate raw data into...Full timeWork at officeRemote workRelocationVisa sponsorshipRelocation package$106k - $150k
...frameworks for use by Third-Party Developer Operations (3PDO) Data Engineers and Operations team members. Partner with data providers and consumers... ...scope of a larger project with guidance from manager, team lead, or colleagues, within bounded time. You will have an...$180k - $258.75k
...new tools and capabilities to amplify the human experience. To lead this transformative shift in mobility, we’ve built a world-... ...Policy and Large Behavior Models.We are looking for a Senior Data Engineer to design and build the foundational data infrastructure and tools...Full timeLocal areaShift work- Position: Data Engineer IILocation: Sunnyvale, CaliforniaDuration: ContractJob ID: 175305Job Overview: We are seeking a skilled and detail... ...solving and communication skills.About PTR Global: PTR Global is a leading provider of information technology and workforce solutions....Full time
$185k - $230k
The OpportunityWe are looking for a Senior Data Engineer to join our Data Platform team and build the core data foundations that power analytics... ....With over 1B meetings transcribed, Otter.ai is the world’s leading tool for meeting transcription, summarization, and...Permanent employment$128k - $249k
...to join us. Perhaps our search for talented visionaries and your search for important and impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the Enterprise Applications, Data, and AI...Full timeTemporary workLocal areaRemote workFlexible hoursAfternoon shift- ...GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than... ...key workloads with ultra high-speed inference.RoleThe Data Center Provisioning Engineer will be responsible for provisioning, commissioning, and...Work at office
$175k - $221k
...feed ranking decision, every recommendation, every A/B test, and every ML model we ship runs on the data infrastructure you'd own. We're looking for a senior engineer to build and scale the batch and streaming pipelines at the core of that platform — someone who takes...Full timeLocal areaWork from home$147k - $237.5k
A cybersecurity company in Santa Clara is seeking a Principal Engineer to design and develop groundbreaking SASE technologies. The ideal... ...with system software in networking devices, a strong background in data plane architecture, and proficiency in programming languages...Full time$143k - $286k
...Segment: Home OfficePosition Summary...What you'll do...Principal Data Engineer - Agentic Data PlatformsThe MissionAs a Principal Data... ...structured, semi-structured, and unstructured data across domains.Lead Agentic Data EnablementDefine enterprise patterns for agent-ready...Full timeTemporary workPart time$207k - $301k
Own the data engineering strategy for high-stakes Search initiatives, designing multi-stage data products that process data for billions of... ...consumption.Collaborate with Product Data Scientists and Engineering leads to identify growth and quality opportunities, bridging the...$202.5k - $274k
..., innovative ways to make that possible.Job OverviewCome join the QuickBooks Capital and Lending Platform as a Staff Software Engineer in Data. You will join an innovative and passionate team of engineers using cutting edge technologies like Python, PySpark, Spark, SQL...Worldwide- ...architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10... ...looking for a hands-on Infrastructure Engineer to join our team and support our high-... ...downtimeQualifications:3-5+ years of experience in data center, lab, or infrastructure...Remote work
$143k - $286k
...$143000 - $286000/yearType: Full time / Regular/PermanentCompany: WalmartBusiness Segment: Home OfficeRole summary: As a Staff Data Engineer at Walmart, you will design and implement scalable data solutions that support complex business needs across multiple domains. This...Full timeTemporary workPart time- ...have the opportunity to work on the core of cutting‑edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You will participate in the development of groundbreaking...Visa sponsorship
Ifm Us
Sunnyvale, CA1 day ago $175k - $200k
...Overview East West Bank is looking for a motivated Senior Data Engineer to contribute towards the success of our Data and Analytics Technology initiatives. This is a hands‑on technical role and this person will be responsible for the development and build of scalable solutions...Work experience placementEast West Bank
Palo Alto, CA1 day ago- ...Data Engineer Location: Mountain View, CA Commitment: Full-time This is an exciting position to work on a very talented team of engineers. The ideal candidate's favorite words are learning, data, scale, and agility. You will leverage your strong collaboration...Full time
Autoroboto
Mountain View, CA4 days ago $73 per hour
...Data Engineer MAHIN-JOB-35556 We are looking for Data Engineer in Sunnyvale,CA Day 1 onsite ( 3 days a week hybrid) FTE- 130k per annum + benefits Subcon-73 $ per hour ( no layers are accepted) Job Description: Strong Python development and software...Hourly pay3 days per week1 day per weekKeylent Inc
Sunnyvale, CA14 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
- data loss prevention analyst Mountain View, CA
- data labeling Mountain View, CA
- data collection Mountain View, CA
- data technician Mountain View, CA
- data governance Mountain View, CA
- data visualization Mountain View, CA
- test data management Mountain View, CA
- data processor Mountain View, CA
- clinical data Mountain View, CA
- data tech Mountain View, CA