Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Engineering Lead

Full-time

Sequoia Connect

Role Description

We are currently searching for a Big Data Engineering Lead:

  • Provide technical leadership, engineering delivery, and quality assurance for the Data Foundation platform.
  • Lead the team responsible for building and maintaining enterprise data pipelines, data products, canonical data models, and data services to enable analytics, AI, integration, and operational reporting.
  • Partner closely with the Service Owner, Architecture Team, and Platform Engineering Lead to deliver scalable, trusted, and maintainable data solutions aligned with enterprise standards and strategic objectives.
  • Take accountability for engineering execution, solution quality, operational reliability, and the development of a high-performing data engineering team.
  • Successfully deliver Data Foundation engineering commitments while ensuring data pipeline reliability, performance, and scalability.
  • Drive data quality improvements across enterprise data assets, adopt engineering standards, reduce technical debt, and improve operational stability through incident reduction.
  • Increase reuse of canonical data models, data products, and engineering frameworks.

Qualifications

  • 8+ years of experience in data engineering, software engineering, or enterprise data platform development.
  • 3+ years of technical leadership experience leading engineering teams or large-scale data initiatives.
  • Proven experience designing and delivering enterprise data platforms, pipelines, and data products.
  • Experience operating within agile software development environments.
  • Advanced SQL and data modeling expertise.
  • Strong Python and PySpark development experience.
  • Deep understanding of ETL and ELT architecture patterns.
  • Strong technical leadership, coaching capabilities, and problem-solving skills.
  • High-Performance Mindset: Resilience, emotional intelligence, and a focus on agile delivery.
  • Technologist DNA: A deep understanding of the difference between "coding" and "engineering."

Requirements

  • Experience implementing Master Data Management solutions.
  • Experience building RESTful APIs and data services.
  • Familiarity with GraphQL and modern integration approaches.
  • Understanding of microservices-based architectures.
  • Experience implementing event-driven and real-time data processing solutions.
  • Strong understanding of data quality frameworks, metadata management, and data lineage concepts.
  • Familiarity with cloud-native foundations or AI coding assistants.

Work Arrangement

We value flexibility to support your lifestyle. This position is available as:

  • Remote
Vacancy posted 10 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineering Lead in Remote vacancy
  • $176.4k - $327.6k

     ...Associate Director, Clinical Data EngineeringAbout the role: Are you ready to make...  ...for a visionary Associate Director to lead Clinical Data Engineering within our Oncology Data Science (...  ...Spark, Artificial Intelligence (AI), Big Data, Data Governance, Data Literacy,... 
    Big data
    Remote work

    Novartis

    Cambridge, MA
    2 days ago
  • ## Data Engineering Tech LeadApplylocations: WORK AT HOME - OHIOtime type: Full timeposted on: Posted...  ...Summary:**Looking for an experienced Lead Data Engineer with background in...  ...pipelines* Strong working experience with Big Data technologies (Spark, Data Bricks) for... 
    Big data
    Work experience placement
    Local area
    Immediate start
    Work from home
    Shift work

    Berger Health System

    Brooklyn, NY
    21 hours ago
  • Job Description:DXC Technology is a leading global technology services provider helping the world's largest enterprises and public...  ...Property & Casualty, and Specialty Insurance.Position SummaryThe Data Engineering Lead is responsible for the design, development, governance,... 
    Suggested
    Minimum wage
    Full time
    Worldwide

    DXC Technology

    Charleston, SC
    2 days ago
  •  ...motivated candidate to join our talented Team. Job Title: Data Intelligence - Lead Data Engineer Location: Reston, VA (Remote) Job Summary: The Lead...  ...scaling cloud OR on-premise infrastructure targeting big data and platform data management (Relational and NoSQL,... 
    Big data
    Work experience placement
    Remote work

    Ampcus

    Reston, VA
    16 hours ago
  • $136.28k - $158.7k

    Req ID:380834NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to...  ...organization, apply now.We are currently seeking a Power BI - Data Engineering Lead (On-Site) to join our team on-site in either Westlake, TX or... 
    Suggested
    Full time
    Temporary work
    Work at office
    Remote work
    Relocation
    Flexible hours
    Shift work

    NTT DATA

    Texas
    2 days ago
  • Role Description We are currently searching for a Data Engineer Lead : Our Client is looking for a Lead Data Engineer who will help in implementing...  ...in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem and cloud data platforms -... 
    Big data
    Remote work

    Sequoia Connect

    Remote
    3 days ago
  • $152.6k - $283.4k

     ...build the foundation that powers trusted, AI-ready data at scale? As Associate Director, Data Engineering, you will play a pivotal role in shaping how enterprise...  ...supporting critical business and data domains.Lead the enterprise data contract lifecycle, including review... 
    Full time
    Contract work
    Remote work
    Worldwide
    Relocation
    Home office
    Visa sponsorship
    Relocation package

    Novartis

    East Hanover, NJ
    16 hours ago
  • $126.28k - $157.85k

     ...Who You Are You've built a track record of data engineering work others rely on, typically over the course of 6 or more years . You own the...  ...feedback What You’ll Do At 8th Light As a data engineering lead on client projects, you'll work with a variety of clients,... 
    Full time
    Local area
    Immediate start
    Flexible hours

    8th Light

    Remote
    15 days ago
  • Polarits seeks an AWS Tech Lead for Capital One, a 6-month contracting engagement with strong extension potential, 5 positions available. The role is 100% remote and requires leading six data engineering teams to deliver on time while guiding sprint ceremonies and collaboration... 
    Remote job
    Contract work

    Polarits

    Mc Lean, VA
    4 days ago
  •  ...remote role with periodic in-person team meetings in Pomona, CA . About the Role We are seeking an experienced Senior Data Engineering & Analytics Lead to drive data strategy, build scalable data infrastructure, and deliver actionable insights that support strategic... 
    Work at office
    Remote work

    PM2CM, Inc.

    Pomona, CA
    3 days ago
  • A leading aerospace and defense company is looking for an experienced engineering leader to manage its Data Engineering team. This role involves defining and maintaining a roadmap, driving data pipelines in Databricks, and mentoring engineers. The ideal candidate will have... 
    Remote job

    Northrop Grumman

    Falls Church, VA
    4 days ago
  • A professional services company is seeking a Senior Data Engineering & Analytics Lead to drive data strategy and build scalable data infrastructure. This remote role includes leading the design of data solutions, applying advanced analytical methods, and developing dashboards... 
    Remote job

    PM2CM, Inc.

    Pomona, CA
    3 days ago
  • $152.6k - $283.4k

     ...build the foundation that powers trusted, AI-ready data at scale? As Associate Director, Data Engineering, you will play a pivotal role in shaping how enterprise...  ...supporting critical business and data domains. ~Lead the enterprise data contract lifecycle, including... 
    Full time
    Contract work
    Worldwide

    Novartis

    Remote
    7 days ago
  • Doximity is seeking a Senior Data Engineer and People Manager to lead data pipelines and ML-driven initiatives in a fast-growing healthcare technology environment. You will mentor a team, collaborate with product managers, and drive end-to-end data projects from conception... 
    Remote job

    Mosaec

    San Francisco, CA
    4 days ago
  •  ...Job Description Job Description About the Role: Westport Partners ( is seeking a highly skilled Data Engineering, Data Architect and Technical Lead to join our team onsite at our client in Tysons Corner, VA. In this critical leadership role, you will evaluate our... 
    Remote work

    Westport Partners

    Tysons Corner, VA
    3 days ago
  • OhioHealth is seeking an experienced Data Engineering Tech Lead to oversee the data platform architecture and ETL development in a cloud-centric environment. You will act as SME within IT and collaborate across vendors, analysts, and architects to deliver complex data... 
    Remote job

    Berger Health System

    Brooklyn, NY
    21 hours ago
  • Natera, Inc. is seeking a Manager of Data Science Production Engineering within the DSPE department to lead a Data Engineering & Delivery team, handling PB-sized datasets and cloud-based data products that support Lab Operations and genetic counseling. You will translate... 
    Remote job

    Natera, Inc.

    Brooklyn, NY
    21 hours ago
  • Job ID: 19797312Reference Number: 23-00904Title: AWS Big Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2023-05-18Contact: Shyam MaramContact Email: ****@*****.*** Phone: (***) ***-****Company: HAN StaffingAws Big Data EngineerCharlotte, NC - Hybrid... 
    Big data
    Remote work

    HAN Staffing

    Iselin, NJ
    1 day ago
  • $205k - $305k

     ...clients.Job DescriptionWe are seeking a Data Strategy Lead for our Portfolio Management business...  ...Data Science, Computer Science, Financial Engineering, or related quantitative field...  ...experience with cloud-based data platforms and big data technologies such as AWS and... 
    Big data
    Full time
    Work at office
    Flexible hours

    Pimco

    Newport Beach, CA
    21 hours ago
  • $99k - $225k

    Data Science Engineer, LeadThe Opportunity: As a Data Science Engineer, you’ll help build advanced technology solutions and implement data science and engineering activities on some of the most mission-driven projects in the industry. You’ll deploy and develop workflows... 
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work

    Booz Allen Hamilton

    McLean, VA
    4 days ago
  •  ...Warrants ~ Annual bonus ~401(k) ~401(k) matching ~ Competitive salary ~ Health insurance ~ Paid time off Data & AI Engineering Lead Full Time | Hybrid Preferred | Chicago Metro Area Preferred Build the data and agent foundation for POWR:Suite... 
    Full time
    Remote work
    Work from home
    Flexible hours

    Intelligent Generation

    Oak Brook, IL
    21 days ago
  • Primary ResponsibilityAs a Principal Data Engineer, you must be an expert with Big Data technologies like Hadoop, Hive, Hbase, Spark, and various AWS technologies...  ...mentor junior/senior engineers on the team.Define and lead the frameworks for compliance with data management... 
    Big data
    Work experience placement

    NTT DATA

    Albany, NY
    1 day ago
  •  ...highly motivated candidate to join our talented Team. Job Title: Data Engineer. Location: McLean, VA. Overview:We are seeking a highly...  ...extensive experience in data engineering, cloud services, and big data technologies, with a strong focus on AWS services, Python... 
    Big data
    Local area
    Remote work

    Ampcus

    McLean, VA
    21 hours ago
  • 1Password is seeking a Senior Data Platform Engineer to help build a next-generation data platform. In this role, you will design, implement, and...  ...in data engineering, focusing on cloud platforms, big data technologies, and distributed systems. This role is remote... 
    Big data
    Remote work

    1Password

    United States
    4 days ago
  •  ...Bright Vision Technologies is seeking an experienced Big Data Engineer for a 100% remote role in the United States. The candidate will design, build, and operate large-scale data pipelines on Hadoop ecosystems, ingesting data from diverse sources and delivering reliable... 
    Big data
    Remote work

    United States Digital Space LLC

    United States
    4 days ago
  • $95.7k - $149.6k

    Job DescriptionAs an Advanced Data Engineer within the Data Engineering Unit, you will be an integral part of our team, focusing on designing...  ...languages such as SQL and Python, and experience with big data technologies like Apache Spark or Hadoop.Experience with database... 
    Big data

    Naval Nuclear Laboratory

    West Mifflin, PA
    16 hours ago
  • $100 - $130 per hour

    A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-130/hrUS Citizens or GC Holders...  .../CD pipelinesPresto, Hive, SparkSQL, Cassandra, or Solr other Big Data query and transformation experience is a plus Experience... 
    Big data
    Remote work

    Open Systems Technologies

    New York, NY
    21 hours ago
  •  ...5Reference Number: 23-00987Title: SR AWS Big Data EngineerLocation: Iselin, NJ, 08830Posted...  ...(***) ***-****Company: HAN StaffingData Engineer PA, NC,AZMust Day One Hybrid - No Remote...  ...the business to implement data solutions.Leads all phases of solution development. Explains... 
    Big data
    For contractors
    Remote work
    Relocation

    HAN Staffing

    Iselin, NJ
    1 day ago
  • Data Visualization Engineer Job #1098Clearance: U.S. Citizenship is required. Active Public Trust in DHS...  ...databases, data integration, data mining, big data, data visualizationAt least one...  ...paid training opportunitiesIndustry-leading benefits including a choice of two health... 
    Big data
    Remote work
    Flexible hours

    Dev Technology Group

    Ashburn, VA
    16 hours ago
  •  ...Sr. Data Engineer This role is responsible for providing technical expertise and leadership to design and deliver end-to-end data engineering...  ...highly optimal codebase and perform Spark optimizations for Big Data use cases. Design, develop and deploy optimal... 
    Big data
    For contractors
    Remote work

    1872 Consulting

    Oak Brook, IL
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineering Lead. Be the first to apply!