Big Data Engineering Lead
Full-time
Sequoia Connect
Role Description
We are currently searching for a Big Data Engineering Lead:
- Provide technical leadership, engineering delivery, and quality assurance for the Data Foundation platform.
- Lead the team responsible for building and maintaining enterprise data pipelines, data products, canonical data models, and data services to enable analytics, AI, integration, and operational reporting.
- Partner closely with the Service Owner, Architecture Team, and Platform Engineering Lead to deliver scalable, trusted, and maintainable data solutions aligned with enterprise standards and strategic objectives.
- Take accountability for engineering execution, solution quality, operational reliability, and the development of a high-performing data engineering team.
- Successfully deliver Data Foundation engineering commitments while ensuring data pipeline reliability, performance, and scalability.
- Drive data quality improvements across enterprise data assets, adopt engineering standards, reduce technical debt, and improve operational stability through incident reduction.
- Increase reuse of canonical data models, data products, and engineering frameworks.
Qualifications
- 8+ years of experience in data engineering, software engineering, or enterprise data platform development.
- 3+ years of technical leadership experience leading engineering teams or large-scale data initiatives.
- Proven experience designing and delivering enterprise data platforms, pipelines, and data products.
- Experience operating within agile software development environments.
- Advanced SQL and data modeling expertise.
- Strong Python and PySpark development experience.
- Deep understanding of ETL and ELT architecture patterns.
- Strong technical leadership, coaching capabilities, and problem-solving skills.
- High-Performance Mindset: Resilience, emotional intelligence, and a focus on agile delivery.
- Technologist DNA: A deep understanding of the difference between "coding" and "engineering."
Requirements
- Experience implementing Master Data Management solutions.
- Experience building RESTful APIs and data services.
- Familiarity with GraphQL and modern integration approaches.
- Understanding of microservices-based architectures.
- Experience implementing event-driven and real-time data processing solutions.
- Strong understanding of data quality frameworks, metadata management, and data lineage concepts.
- Familiarity with cloud-native foundations or AI coding assistants.
Work Arrangement
We value flexibility to support your lifestyle. This position is available as:
- Remote
Vacancy posted 10 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineering Lead in Remote vacancy
$176.4k - $327.6k
...Associate Director, Clinical Data EngineeringAbout the role: Are you ready to make... ...for a visionary Associate Director to lead Clinical Data Engineering within our Oncology Data Science (... ...Spark, Artificial Intelligence (AI), Big Data, Data Governance, Data Literacy,...Big dataRemote work- ## Data Engineering Tech LeadApplylocations: WORK AT HOME - OHIOtime type: Full timeposted on: Posted... ...Summary:**Looking for an experienced Lead Data Engineer with background in... ...pipelines* Strong working experience with Big Data technologies (Spark, Data Bricks) for...Big dataWork experience placementLocal areaImmediate startWork from homeShift work
- Job Description:DXC Technology is a leading global technology services provider helping the world's largest enterprises and public... ...Property & Casualty, and Specialty Insurance.Position SummaryThe Data Engineering Lead is responsible for the design, development, governance,...SuggestedMinimum wageFull timeWorldwide
- ...motivated candidate to join our talented Team. Job Title: Data Intelligence - Lead Data Engineer Location: Reston, VA (Remote) Job Summary: The Lead... ...scaling cloud OR on-premise infrastructure targeting big data and platform data management (Relational and NoSQL,...Big dataWork experience placementRemote work
$136.28k - $158.7k
Req ID:380834NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to... ...organization, apply now.We are currently seeking a Power BI - Data Engineering Lead (On-Site) to join our team on-site in either Westlake, TX or...SuggestedFull timeTemporary workWork at officeRemote workRelocationFlexible hoursShift work- Role Description We are currently searching for a Data Engineer Lead : Our Client is looking for a Lead Data Engineer who will help in implementing... ...in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem and cloud data platforms -...Big dataRemote work
$152.6k - $283.4k
...build the foundation that powers trusted, AI-ready data at scale? As Associate Director, Data Engineering, you will play a pivotal role in shaping how enterprise... ...supporting critical business and data domains.Lead the enterprise data contract lifecycle, including review...Full timeContract workRemote workWorldwideRelocationHome officeVisa sponsorshipRelocation package$126.28k - $157.85k
...Who You Are You've built a track record of data engineering work others rely on, typically over the course of 6 or more years . You own the... ...feedback What You’ll Do At 8th Light As a data engineering lead on client projects, you'll work with a variety of clients,...Full timeLocal areaImmediate startFlexible hours- Polarits seeks an AWS Tech Lead for Capital One, a 6-month contracting engagement with strong extension potential, 5 positions available. The role is 100% remote and requires leading six data engineering teams to deliver on time while guiding sprint ceremonies and collaboration...Remote jobContract work
- ...remote role with periodic in-person team meetings in Pomona, CA . About the Role We are seeking an experienced Senior Data Engineering & Analytics Lead to drive data strategy, build scalable data infrastructure, and deliver actionable insights that support strategic...Work at officeRemote work
- A leading aerospace and defense company is looking for an experienced engineering leader to manage its Data Engineering team. This role involves defining and maintaining a roadmap, driving data pipelines in Databricks, and mentoring engineers. The ideal candidate will have...Remote job
- A professional services company is seeking a Senior Data Engineering & Analytics Lead to drive data strategy and build scalable data infrastructure. This remote role includes leading the design of data solutions, applying advanced analytical methods, and developing dashboards...Remote job
$152.6k - $283.4k
...build the foundation that powers trusted, AI-ready data at scale? As Associate Director, Data Engineering, you will play a pivotal role in shaping how enterprise... ...supporting critical business and data domains. ~Lead the enterprise data contract lifecycle, including...Full timeContract workWorldwide- Doximity is seeking a Senior Data Engineer and People Manager to lead data pipelines and ML-driven initiatives in a fast-growing healthcare technology environment. You will mentor a team, collaborate with product managers, and drive end-to-end data projects from conception...Remote job
- ...Job Description Job Description About the Role: Westport Partners ( is seeking a highly skilled Data Engineering, Data Architect and Technical Lead to join our team onsite at our client in Tysons Corner, VA. In this critical leadership role, you will evaluate our...Remote work
- OhioHealth is seeking an experienced Data Engineering Tech Lead to oversee the data platform architecture and ETL development in a cloud-centric environment. You will act as SME within IT and collaborate across vendors, analysts, and architects to deliver complex data...Remote job
- Natera, Inc. is seeking a Manager of Data Science Production Engineering within the DSPE department to lead a Data Engineering & Delivery team, handling PB-sized datasets and cloud-based data products that support Lab Operations and genetic counseling. You will translate...Remote job
- Job ID: 19797312Reference Number: 23-00904Title: AWS Big Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2023-05-18Contact: Shyam MaramContact Email: ****@*****.*** Phone: (***) ***-****Company: HAN StaffingAws Big Data EngineerCharlotte, NC - Hybrid...Big dataRemote work
$205k - $305k
...clients.Job DescriptionWe are seeking a Data Strategy Lead for our Portfolio Management business... ...Data Science, Computer Science, Financial Engineering, or related quantitative field... ...experience with cloud-based data platforms and big data technologies such as AWS and...Big dataFull timeWork at officeFlexible hours$99k - $225k
Data Science Engineer, LeadThe Opportunity: As a Data Science Engineer, you’ll help build advanced technology solutions and implement data science and engineering activities on some of the most mission-driven projects in the industry. You’ll deploy and develop workflows...Full timeContract workPart timeWork at officeLocal areaRemote work- ...Warrants ~ Annual bonus ~401(k) ~401(k) matching ~ Competitive salary ~ Health insurance ~ Paid time off Data & AI Engineering Lead Full Time | Hybrid Preferred | Chicago Metro Area Preferred Build the data and agent foundation for POWR:Suite...Full timeRemote workWork from homeFlexible hours
- Primary ResponsibilityAs a Principal Data Engineer, you must be an expert with Big Data technologies like Hadoop, Hive, Hbase, Spark, and various AWS technologies... ...mentor junior/senior engineers on the team.Define and lead the frameworks for compliance with data management...Big dataWork experience placement
- ...highly motivated candidate to join our talented Team. Job Title: Data Engineer. Location: McLean, VA. Overview:We are seeking a highly... ...extensive experience in data engineering, cloud services, and big data technologies, with a strong focus on AWS services, Python...Big dataLocal areaRemote work
- 1Password is seeking a Senior Data Platform Engineer to help build a next-generation data platform. In this role, you will design, implement, and... ...in data engineering, focusing on cloud platforms, big data technologies, and distributed systems. This role is remote...Big dataRemote work
- ...Bright Vision Technologies is seeking an experienced Big Data Engineer for a 100% remote role in the United States. The candidate will design, build, and operate large-scale data pipelines on Hadoop ecosystems, ingesting data from diverse sources and delivering reliable...Big dataRemote work
$95.7k - $149.6k
Job DescriptionAs an Advanced Data Engineer within the Data Engineering Unit, you will be an integral part of our team, focusing on designing... ...languages such as SQL and Python, and experience with big data technologies like Apache Spark or Hadoop.Experience with database...Big data$100 - $130 per hour
A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-130/hrUS Citizens or GC Holders... .../CD pipelinesPresto, Hive, SparkSQL, Cassandra, or Solr other Big Data query and transformation experience is a plus Experience...Big dataRemote work- ...5Reference Number: 23-00987Title: SR AWS Big Data EngineerLocation: Iselin, NJ, 08830Posted... ...(***) ***-****Company: HAN StaffingData Engineer PA, NC,AZMust Day One Hybrid - No Remote... ...the business to implement data solutions.Leads all phases of solution development. Explains...Big dataFor contractorsRemote workRelocation
- Data Visualization Engineer Job #1098Clearance: U.S. Citizenship is required. Active Public Trust in DHS... ...databases, data integration, data mining, big data, data visualizationAt least one... ...paid training opportunitiesIndustry-leading benefits including a choice of two health...Big dataRemote workFlexible hours
- ...Sr. Data Engineer This role is responsible for providing technical expertise and leadership to design and deliver end-to-end data engineering... ...highly optimal codebase and perform Spark optimizations for Big Data use cases. Design, develop and deploy optimal...Big dataFor contractorsRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineering Lead. Be the first to apply!
Related searches
- data center engineer Remote
- senior cloud data engineer Remote
- data infrastructure engineer Remote
- sr information security engineer Remote
- hadoop big data developer Remote
- data visualization developer Remote
- remote data engineer Remote
- etl data engineer Remote
- data engineer analytics Remote
- sr data engineer Remote


