Lead Data Engineer
Net2Source (N2S)
Lead Data Engineer
Location: NYC
Contract
must be from healthcare background
Python, Pyspark, SQL
Need 15-16 years of profile
Job Description:
The Senior Data Engineer leads complex data engineering projects, working on designing data architectures that align with business requirements.
This role focuses on optimizing data workflows, managing data pipelines, and ensuring the smooth operation of data systems.
Minimum Qualifications
15+ Years overall IT experience with minimum 8 years of work experience in below techskills?
Tech Skills
Strong experience in Python Scripting and PySpark for data processing?
Proficiency in SQL, dealing with big data processing?
Proven experience in data processing for data lake in Iceberg format, with strong understanding of architecture?
Experience in AWS Glue jobs?
Experience in AWS cloud platform and its data services (S3, Redshift, Lambda, EMR, Airflow, Postgres, SNS, Event bridge)?
Expertise in BASH/Shell scripting? Strong understanding of healthcare Finance systems and experience leading data engineering teams?
Experience in Agile environments.? Excellent problem-solving skills and attention to detail.? Effective communication and collaboration skills.
Responsibilities
Leads development of data pipelines and architectures that handle large-scale data sets.?
Designs, constructs, and tests data architecture aligned with business requirements.?
Provides technical leadership for data projects, ensuring best practices and high-quality data solutions.?
Collaborates with product, finance, and other business units to ensure data pipelines meet business requirements.?
Oversees development of data solutions that enable predictive and prescriptive analytics.?
Ensures the technical quality of solutions, managing data as it moves across environments.
• Aligns data architecture to Healthfirst solution architecture.
$170k - $210k
...diverse, and we are therefore committed to embracing diversity of thought and experience within our team. We are looking for a Lead Data Engineer to join our team. This is a high-impact, strategic role focused equally on technical leadership and hands-on execution. You...SuggestedRemote workWork visaShift workMark43
New York, NY19 days ago- ...About the job Lead Data Engineer Job Title: Lead Data Engineer No of Positions:2 Location: Jersey City/ Bedford, NJ (Hybrid) (3 days from office per week) Experience: 10+ years specifically Key Skills: Snowflake, SQL, Python, Spark, AWS...SuggestedWork experience placementWork at office3 days per week
Inizio Partners
Jersey City, NJ4 days ago - TBD Gen is proud to be an equal-opportunity employer, committed to diversity and inclusivity. We base employment decisions on merit, experience, and business needs, without considering race, color, national origin, age, religion, sex, pregnancy, genetic information,...Suggested
Gen Digital Inc
New York, NY5 days ago - ...Job Overview As a Lead Matillion Data Engineer you will spearhead the design, development, and implementation of ETL pipelines for processing healthcare data. Your role is pivotal in ensuring efficient, scalable, and high-performance data solutions that maintain consistency...Suggested
TechDigital Group
New York, NY4 days ago $220k - $300k
...Overview The Lead Data Engineer on the Nebula team plays a significant technical leadership role in shaping and scaling the data foundation that powers analytics, reporting, AI development, and operational decision-making across the organization. This role combines...SuggestedLocal areaRemote workFlexible hoursBayview Asset Management
New York, NY3 days ago$175k - $255k
...deserve, we'd love to meet you. About the Role The Revenue Engine team at Charlie Health services all parts of our business... ...externally sourced datasets, and building user-facing products. As a data engineer on the Revenue Engine team, you will be responsible for...Full timeWork at officeLocal areaCharlie Health Outreach
New York, NY2 days ago- ...Lead Snowflake Data Engineer Our client is seeking a Lead Snowflake Data Engineer to design, own, and deliver end-to-end data engineering solutions in modern cloud environments. This role requires full lifecycle ownership across Snowflake pipelines, data modeling,...
TheStaffed
New York, NY2 days ago $156.8k - $235.2k
...Paramount Pictures is seeking a Senior Lead Data Engineer in New York to build and scale data foundations for personalization systems powering Home, Search/Browse, Notifications, and Artwork. This high-impact role requires expertise in large-scale ETL/streaming, distributed...Paramount Pictures
New York, NY4 days ago$250.8k - $286.2k
...Senior Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers...Full timePart timeInternshipLocal areaCapital One Financial Corp
New York, NY5 days ago- ...Carlsbad Tech is looking for a Lead Data Engineer to develop and optimize data pipelines in New York, NY. This role requires expertise in building data solutions using technologies like Kafka and Snowflake, ensuring scalable and reliable data processing. Join a team that...
Carlsbad Tech
New York, NY5 days ago - ...Schneider Electric is seeking an Engineering Project Lead Technical Expert for their Prefabricated Data Center in Kentucky. This role involves leading a multidisciplinary team on medium and large projects, providing engineering analysis, managing project timelines, and...
Schneider Electric
Brooklyn, NY1 day ago $220k - $230k
...is a global leader in digital assets and data center infrastructure, delivering solutions... ...Are: You're a senior, hands-on data engineer with 8+ years of experience designing,... ...platforms at scale - and you're ready to lead. You set the technical direction for data...Local areaFlexible hoursGalaxy USA
New York, NY5 days ago- ...Hi, Position: Lead Data Engineer Experience Required: 12 years+ Location: Jersey City, NJ | Onsite Employment Type: Full-Time NOTE - Must have taken care of team size of Minimum of 10 or more people and sole contributer required...Full time
Centraprise
Jersey City, NJ2 days ago - ...TMX Careers The TMX group of companies includes leading global exchanges such as the Toronto Stock Exchange... ...lines of business: Indexing, Digital Distribution, and Data & Analytics. Made up of developers, data engineers, designers, and project managers, the platform team...
TMX Group
New York, NY1 day ago - ...A global cybersecurity leader is seeking a Lead Data Engineer to steer their data engineering efforts. This position involves designing robust data pipelines, guiding junior engineers, and setting the vision for data architecture. The ideal candidate should have over...
OPSWAT
New York, NY3 days ago - ...Technical Leader to build and manage large-scale data systems. The role demands deep expertise in web crawling, data engineering, and cloud environments. You will mentor... ...engage with clients to analyze requirements, and lead architecture discussions. The ideal candidate...
Virtus Lab sp. z o.o. (Ltd.)
New York, NY4 days ago - Job Description: Must Have : DBT Core , Snowflake and Python, AWS Airflow , Container services(Docker) , Terraform Good to Have : BI tooling experience(Power BI or Tableau), understanding of Agile processes( Kanban or Jira) . We need strong person as this...
ECHO IT SOLUTIONS INC .
New York, NY12 days ago - ...position sits within the newly consolidated Data and Analytics (D&A) organization... ...data infrastructure, data governance, data engineering, data modeling, data analysis to business... ...intelligence, data science, and AI. The Lead Data Engineer is crucial to D&A USB’s Eligibility...
MetLife
New York, NY1 day ago $160k - $220k
...Lead Data Engineer Deliberate AI | Hybrid (NYC or Boston) | Full-Time About Deliberate AI: We're a venture-backed company at the frontier of precision mental health. In partnerships with some of the world's top ranked medical schools and psychiatric hospitals, we...Full timeWorldwideRelocationFlexible hoursShift workNight shiftDay shiftDeliberate AI
New York, NY2 days ago- ...A leading athletic apparel company is seeking a Lead Data Engineer to establish and maintain database systems while building efficient data pipelines. The role requires strong skills in Python and SQL, along with 8+ years of data engineering experience. This remote position...Contract workRemote work
NIKE
New York, NY3 days ago - ...Lead Data Engineer - Palantir & PySpark (Lead Data engineer role where experience should be on both hands on and leading the team.) Candidate preference : Should be in the United States and from East coast. Experience : 8-15 Years Location...Remote work
VBeyond
Jersey City, NJ4 days ago $174k - $230k
...The Job We are looking for our first in-house Data Engineer to own and evolve our core data infrastructure. This is an early and high-impact role. As the data engineering function grows under Engineering, you’ll have a real voice in shaping how it’s built - the processes...For contractorsRemote workAtticus Inc
New York, NY3 days ago- ...Role: Lead Data Engineer Location: New York Mode of Work: Onsite 60/hour. Responsibilities - Lead the design and implementation of a robust, scalable, and reusable data ingestion framework using Microsoft Fabric - Building...
Maintec Technologies
New York, NY1 day ago $220k
...Specialist Recruiter | Databricks Data Engineer Recruitment | Connecting Top Talent with Leading US Opportunities Job Title: Lead Data Engineer Location: Remote Employment Type: Full-time Compensation: Up to $220k + benefits About the Role We’re hiring experienced Lead...Full timeRemote workFlexible hoursKDR Talent Solutions USA
New York, NY3 days ago- ...collaborate directly with the client's team, make business trips.... Digis islooking for anexperienced, proactive, and self-driven Lead Data Engineer tojoin our fully remote team. About the Project You’ll bepartofalarge-scale platform focused on performance management and...Remote work
DIGIS Corporation
New York, NY3 days ago $106.61k - $284.28k
...Position Summary Lead Data Privacy Engineer to assist in leading our Data Protection Engineering, Monitoring, and Audit efforts. This role is responsible for embedding privacy by design principles into systems and processes, designing and maintaining technical controls...Work experience placementLocal area9025 CVS Shared Services Resources LLC
Brooklyn, NY4 days ago- ...Microsoft Fabric Developer / Data Engineer Overview strong expertise in architecture design and implementation. proven experience in customer interaction and stakeholder management. Experience in job scheduling , monitoring and maintaining jobs in on-premise using MS SQL...
Career Steer Services
New York, NY3 days ago - ...A leading technology firm is seeking a Mid-Senior level Data Engineering Lead to manage a team for complex data integration projects. Your responsibilities will include designing data models, developing ETL/ELT pipelines, and ensuring data accuracy. The ideal candidate...Remote work
Largeton Group
New York, NY3 days ago - ...Lead / Principal Data Engineer - Marketing Technology (Contract) - Job#5799 Location : New York, New York - W2 ONLY Reports To : VP - Data Science and Data Engineering Type : Senior Individual Contributor Who You Are You are a seasoned senior...Contract workTemporary workImmediate start
Delphi-US
New York, NY5 days ago $150k - $195k
Enercon Services, Inc. is looking for a Principal Data Center MEP Engineer to lead design and project direction in the power industry. You will drive impactful solutions, manage teams, develop detailed designs and ensure project execution. This role requires a Bachelor...Remote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
