Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer

Full-time

Wise Skulls

Hiring: Lead Data Engineer – Databricks | Manhattan, NY | Hybrid | Remote Also Available

We're looking for an experienced Lead Data Engineer with strong hands-on expertise in Databricks, SQL, Python, and PySpark to design and optimize scalable data pipelines and enterprise data platforms. The ideal candidate will provide technical leadership and implement data engineering best practices to support analytics, digital products, and AI-driven use cases.

Location: New York, NY (3 days/week or US Remote)

Experience: 6–12 Years

Interview Process: 3 Rounds, Including One Onsite Round in NY/NJ or at Any Client Office Across the US

Work Authorization: USC & GC Candidates Only

Key Skills:

  • 6+ years of data engineering experience with substantial hands-on Databricks expertise
  • Strong proficiency in SQL, Python, and PySpark
  • Experience designing and developing scalable data pipelines using Medallion Architecture
  • Strong understanding of Databricks Lakehouse architecture, Delta Lake, and Unity Catalog
  • Experience with batch and incremental data processing, workflow orchestration, and data transformation
  • Expertise in SQL query optimization, distributed processing, and performance tuning
  • Experience with data quality, observability, lineage, and production troubleshooting
  • Familiarity with Git, CI/CD, and production deployment practices
  • Experience with AWS services, particularly S3, is a plus
  • Knowledge of Auto Loader, Structured Streaming, CDC, Databricks Asset Bundles, or Apache Airflow is preferred
  • Databricks Data Engineer Associate or Professional certification is a plus
  • Experience with streaming, clickstream, or advertising datasets is an added advantage

What We're Looking For:

A technically strong Lead Data Engineer who can build production-grade Databricks solutions, optimize data pipelines for performance and cost efficiency, lead solution design and code reviews, and mentor engineers while delivering scalable and reliable data platforms.

Interested? Apply now or DM us to explore this opportunity!

You can share resumes at View email address on click.appcast.io

Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Data Engineer in United States vacancy
  • $97k - $175k

     ...of cybersecurity starts with you. About the Role: Support Data Center capacity planning across CrowdStrike's global data...  ...and dashboards; and partner with Data Center Operations, Network Engineering, Supply Chain, and Systems Infrastructure teams to ensure capacity... 
    Suggested
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    Remote
    8 days ago
  •  ...Job Category: Information Technology Requisition Number: DATAE002046 Description Our Data Engineers help Delta Defense turn complex data into clear, actionable insights that support smarter business decisions. This hands-on role builds reliable data solutions... 
    Suggested

    Delta Defense

    West Bend, WI
    16 days ago
  •  ...scalable pipelines for camera, LiDAR, GNSS, IMU, and telemetry data. • Normalize, synchronize, enrich, and package multimodal data...  ...Must Have Technical/Functional Skills • 5+ years of data engineering experience. • Demonstrated experience processing unstructured... 
    Suggested
    Full time

    Techvilla Solutions

    Dallas, TX
    29 days ago
  •  ...Required) * Hands-on Docker containerization : 5 years (Required) * deploying and troubleshooting containerized applications: 5 years (Required) * integrating data into applications (SQL, APIs, files): 5 years (Required) * own applications end-to-end: 5 years (Required)
    Suggested

    Exor Solutions Inc

    Falls Church, VA
    13 hours ago
  •  ...We are seeking a detail-oriented and analytical Annotation Data Engineer to support annotation quality, machine learning data operations, and dataset validation for AI/ML initiatives. The ideal candidate will have experience in annotation quality management, data quality... 
    Suggested
    Full time

    2T Consulting

    Dallas, TX
    a month ago
  • Hiring: Data Engineer Experience: 5-6 Years Job Type: Full-Time Work Location: Remote / Hybrid / Onsite Interview Mode: Webcam / Technical Interview Job Summary: We are looking for an experienced Data Engineer with 5-6 years of hands-on experience in designing, developing... 
    Full time
    Remote work

    Iresh Technologies

    San Antonio, TX
    13 hours ago
  • $116k - $209k

     ...other. Ready to join a mission that matters? The future of cybersecurity starts with you. About the Role: As a Sr. Data Infrastructure Engineer, you will be a key member of the Data Platform Operations team, responsible for building out the AWS GovCloud... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    Remote
    11 days ago
  • $60 - $65 per hour

     ...USC or GC ONLY HYBRID WORK SETUP   Job Summary: · Lead end-to-end design and delivery of scalable data engineering solutions using Snowflake, dbt and Python, ensuring high-performance data pipelines and robust data warehousing practices. · Drive data modeling... 
    Contract work

    Long Finch Technologies

    Denver, CO
    28 days ago
  •  ...Job Description: Sr. Data Engineer – Data Ingestion Framework Python, DBT, and orchestration technologies such as Dagster or Control-M. The solution will utilize AWS S3 as the data Lakehouse storage layer and Snowflake as the target data platform.   Experience:... 
    Contract work
    Local area
    Remote work

    Long Finch Technologies

    Boston, MA
    2 days ago
  • Senior Data Engineer ***Sponsorship is not provided*** ***No Third Party Resumes*** Onsite in Peachtree Corners, GA - Hybrid Salary - Competitive Position Summary We are seeking an experienced, highly motivated Senior Data Engineer to help design, develop, and optimize... 
    Temporary work

    Capstone Logistics LLC

    Peachtree Corners, GA
    13 hours ago
  • $110k - $130k

     ...We are looking for an experienced Senior Data Engineer with strong expertise in Databricks, Python, PySpark, Apache Spark, and large-scale data engineering. The ideal candidate will be responsible... 
    Full time

    Neshent Technologies

    Atlanta, GA
    9 days ago
  • $50 - $55 per hour

     ...Development: Design and implement Hadoop MapReduce jobs for complex data processing tasks. Utilize HiveQL for querying and manipulating...  ...architecture, data manipulation, and query optimization. Data Engineering Concepts: Knowledge of data ingestion, transformation, data... 
    Temporary work
    Local area

    CYNET SYSTEMS

    Alpharetta, GA
    1 day ago
  •  ...skills and technical expertise to drive innovation and adoption of new technology. Your role and responsibilities As an Intern Data Engineer at IBM, you'll gain hands-on experience helping organizations transform data into actionable insights, automate business... 
    Full time
    Contract work
    Part time
    Fixed term contract
    Internship
    Shift work
    1 day per week

    IBM

    Monroe, LA
    2 days ago
  •  ...or volunteer activity up to $1,500 annually. Campbell's has a variety of Employee Resource Groups (ERGs) to support employees. Data Engineer / AI Engineer (Co-op) We are seeking a motivated and curious Data Engineer / AI Engineer to join our team. This co-op / internship... 
    Temporary work
    Internship
    Immediate start

    The Campbell's Company

    Camden, NJ
    13 hours ago
  • $106.59k

     ...Amazon, our tech isn't just a tool, it's your playground. Our engineers work on scalable systems, cloud services, and customer-facing products...  ...to this position, your application will be considered for all Data Engineer roles at all locations we hire for in the United... 
    Full time
    Summer work
    Internship
    Work at office
    Monday to Friday

    Amazon

    Seattle, WA
    1 day ago
  • $250k

     ...our world-class trading platform From optimizing our core trading engine to building custom hardware, we leverage the latest agentic...  ...drives our trading and business needs. What You'll Do: Our data engineering internship is an intensive 10-week experience with our... 
    Full time
    Work experience placement
    Summer work
    Internship
    Visa sponsorship
    Work visa

    Jump Trading

    Chicago, IL
    4 days ago
  • $20 per hour

     ...to make healthcare better. Opportunities Available As a Data Analytics intern at Stryker, you may be placed in one of the following...  ...(IT), Information Systems (MIS), Statistics, Computer Engineering, Computer Science, Software Engineering, Supply Chain Management... 
    Hourly pay
    Internship
    Summer internship
    Live out
    Work at office
    Relocation package

    Stryker

    Fort Wayne, IN
    2 days ago
  • $25 per hour

     ...fresh perspectives to help us innovate and build meaningful relationships for years to come. We are currently looking to add Data Engineering Interns to our team for Summer 2027 at a Fortune 500 company in the financial services industry. As a Data Engineering Intern... 
    Hourly pay
    Full time
    Summer work
    Internship
    Summer internship
    Work at office
    Relocation
    Flexible hours

    Pacific Life Insurance

    Newport Beach, CA
    2 days ago
  •  ...possible not only in your community, but around the world. About the Role We are seeking a motivated and detail-oriented Data Engineering Intern to join our Enterprise Data Operations team for Summer 2027. In this role, you will help design, build, and maintain... 
    Summer work
    Internship
    Work at office
    Local area

    HDR, Inc.

    Omaha, NE
    3 days ago
  •  ...JOB DESCRIPTION Change the world. Love your job. As a Data Engineering intern, you'll help build the data infrastructure that powers TI's AI/ML initiatives, analytics, and data-driven decision-making across the organization. You'll work with cutting-edge data technologies... 
    Internship
    Visa sponsorship

    Texas Instruments

    Dallas, TX
    1 day ago
  •  ...mobility company, Enterprise Fleet Management (EFM), an affiliate of Enterprise Mobility is excited to announce the opening of a Data Engineer Intern . The Information Technology (IT) department of Enterprise Fleet Management builds and implements powerful solutions... 
    Work experience placement
    Summer work
    Internship
    Summer internship
    Work at office
    Remote work
    Work from home
    Monday to Friday

    Enterprise

    Saint Louis, MO
    13 hours ago
  •  ...solutions across Application Services and Consulting, Digital Product Engineering, Digital Workplace Services, Private Cloud Services, AI/...  ...Job Overview Job Summary We are seeking an experienced Data Migration Lead to drive end-to-end data migration initiatives... 
    Temporary work
    Local area
    Worldwide

    Milestone Technologies, Inc.

    United States
    4 days ago
  •  ...Redhorse Corporation. We are a solution-driven company delivering data insights and technology solutions to customers with missions...  ...technology. To support this mission, we are seeking a Senior Data Engineer / Lead to join our team supporting the US National Defense Strategy... 
    Contract work

    Redhorse Corporation

    United States
    1 day ago
  •  ...Responsibilities Design, develop, and maintain ETL processes and scalable data pipelines for enterprise data integration. Build data...  ...and database performance bottlenecks. Collaborate with data engineers, application developers, architects, and business stakeholders... 
    Contract work

    Neshent Technologies

    Dallas, TX
    a month ago
  •  ...Job Family : Data Science Consulting Travel Required : Up to 25% Clearance Required : Active Secret What You Will Do : Guidehouse is seeking a Data Engineer who will provide data engineering and analysis consulting to a DoD client. You will work... 
    Temporary work
    Flexible hours

    Guidehouse

    Huntsville, AL
    2 days ago
  • $125k - $225k

     ...mission that matters? The future of cybersecurity starts with you. About the Role: We're seeking an experienced Platform Data Engineer to architect, deploy, and operate the core data infrastructure and platform services underpinning CrowdStrike's analytics ecosystem... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    Remote
    a month ago
  • $50 - $55 per hour

     ..., scalable, and high-performing. Responsibilities: Operational Engineering: Proactively identify and resolve technical bottlenecks in the...  ...Optimization: Design, build, and maintain the high-performance tech and data stack powering the systematic block market making business.... 
    Temporary work
    Local area

    CYNET SYSTEMS

    New York, NY
    8 hours ago
  •  ...Only Candidates with US Work Authorization will be considered. Position Overview: The Lead Data Engineer turns business and domain needs into secure, observable, reusable, and documented pipelines. The role combines hands-on technical leadership, portfolio delivery... 
    Local area
    Shift work

    Bradesco Bank

    Coral Gables, FL
    27 days ago
  •  ...Job Description: Lead Data Engineer (GCP Dataproc & BigQuery) Location: Edison, NJ (Onsite) Employment Type: Full-Time Experience Required: 10+ Years Position Overview We are seeking a highly skilled Lead Data Engineer with deep expertise in Google Cloud... 
    Full time

    Tredence Inc.

    Edison, NJ
    2 days ago
  •  ...Programming & Data Engineering Expert - level proficiency in Python, Scala, and PySpark, with a strong track record of designing and delivering production-ready, modular, and well-tested solutions; developing and troubleshooting Spark workloads; and optimizing large-... 
    Contract work

    Altimetrik

    Cary, NC
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!