Lead Data Engineer
The Judge Group, LLC
Lead Data Engineer
New York, NY (10001)
6+ months Contract to Perm About the Role
We are seeking a Lead Software Engineer - Data Engineering to design and build scalable, cloud-native data platforms and pipelines. You will lead the development of robust data solutions, drive architectural decisions, and mentor engineers while ensuring reliability, security, and operational excellence. Responsibilities
Design and develop large-scale data pipelines and data platforms.
Build cloud-native solutions using AWS services and Spark.
Lead data modeling, warehousing, migration, and analytics initiatives.
Improve system performance, resilience, monitoring, and automation.
Collaborate with cross-functional teams and mentor junior engineers. Required Qualifications
9-12+ Experience in Data Engineering.
Strong proficiency in Python and/or Java with Spark/PySpark.
Experience with Data Pipelines, Data Modeling, Data Warehousing, and Data Migration.
Hands-on experience with AWS (Glue, EMR, S3, Athena, Kinesis/MSK, Airflow, Lambda, Step Functions, Lake Formation).
Knowledge of Kubernetes, CI/CD, Agile methodologies, and software design principles.
Experience with data formats such as Parquet, Iceberg, Avro, or JSON.
Understanding of AWS security concepts including IAM, KMS, Encryption, and Secrets Manager. Preferred Qualifications
Experience building REST APIs using Java.
Knowledge of Hybrid Cloud architectures.
Exposure to Jenkins, Git, Linux Scripting, JIRA, and TDD.
Strong leadership, problem-solving, and communication skills. Tech Stack: Python, Java, Spark, AWS, Kubernetes, Airflow, Glue, EMR, Athena, Kinesis, Parquet, Iceberg, CI/CD.
New York, NY (10001)
6+ months Contract to Perm About the Role
We are seeking a Lead Software Engineer - Data Engineering to design and build scalable, cloud-native data platforms and pipelines. You will lead the development of robust data solutions, drive architectural decisions, and mentor engineers while ensuring reliability, security, and operational excellence. Responsibilities
Design and develop large-scale data pipelines and data platforms.
Build cloud-native solutions using AWS services and Spark.
Lead data modeling, warehousing, migration, and analytics initiatives.
Improve system performance, resilience, monitoring, and automation.
Collaborate with cross-functional teams and mentor junior engineers. Required Qualifications
9-12+ Experience in Data Engineering.
Strong proficiency in Python and/or Java with Spark/PySpark.
Experience with Data Pipelines, Data Modeling, Data Warehousing, and Data Migration.
Hands-on experience with AWS (Glue, EMR, S3, Athena, Kinesis/MSK, Airflow, Lambda, Step Functions, Lake Formation).
Knowledge of Kubernetes, CI/CD, Agile methodologies, and software design principles.
Experience with data formats such as Parquet, Iceberg, Avro, or JSON.
Understanding of AWS security concepts including IAM, KMS, Encryption, and Secrets Manager. Preferred Qualifications
Experience building REST APIs using Java.
Knowledge of Hybrid Cloud architectures.
Exposure to Jenkins, Git, Linux Scripting, JIRA, and TDD.
Strong leadership, problem-solving, and communication skills. Tech Stack: Python, Java, Spark, AWS, Kubernetes, Airflow, Glue, EMR, Athena, Kinesis, Parquet, Iceberg, CI/CD.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in New York, NY vacancy
$195k - $215k
New York, NYTechnology - Software Engineering /Full Time /HybridAbout TodayTix Group:TodayTix... ...innovative product design and industry-leading technology. Our portfolio of brands--including... ...in live entertainment.Powered by vast data and insights, TTG helps theatres,...SuggestedFull timeContract workWork at officeFlexible hoursShift work2 days per week$120k - $180k
...position sits within the newly consolidated Data and Analytics (D&A) organization... ...data infrastructure, data governance, data engineering, data modeling, data analysis to business intelligence, data science, and AI.The Lead Data Engineer is crucial to D&A USB’s Eligibility...SuggestedFull timeTemporary workWork at officeLocal areaRelocation package3 days per week$165k - $180k
Data Engineering ManagerLocation: Remote (NY/NJ residents only) Direct Hire OverviewSeeking a hands-on engineering leader to guide a small data engineering team while driving modernization of a cloud-based data platform. ResponsibilitiesLead, mentor, and perform code reviews...SuggestedWork at officeLocal areaRemote work- Job ID: 25729598Reference Number: 25-00664Title: Lead Data EngineerLocation: NYC, NYPosted Date: 2025-06-17Contact: Mahi MahiContact Email... ...8019Company: HAN Staffing Required Skills:Proficiency in data engineering programming languages (preferably Python, alternatively Scala...Suggested
$145.2k - $217.88k
DescriptionThe Scientific Computing and Data team at the Icahn School of Medicine at Mount Sinai partners with scientists and... ...utilize these resources for translational science. The Lead Data Warehouse Engineer is a senior technical specialist responsible for leading the...SuggestedTraineeshipLocal area- ...Lead Data Engineer – Big Data & Cloud (AWS)(Python) Location: New York, NY (Onsite) Contract: 6 Months Visa Status: ONLY GC & USC Strong Python and Big Data expertise JOB DESCRIPTION: We are seeking a Senior Data Engineer / Technology Lead with 10–15...Contract work
Argyle Infotech
New York, NY5 days ago $135k - $180k
...million patients, Medidata offers industry-leading expertise, analytics-powered insights, and one of the largest clinical trial data sets in the industry. More than 1 million... ...including product, delivery, data science, engineering, partnerships, and biostatistics....Ongoing contractWork at officeLocal areaFlexible hoursDassault Systèmes
New York, NYa month ago$179.4k - $204.7k
...Overview Lead Data Engineer (Bank Tech) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of...Full timePart timeInternshipH1bLocal areaCapital One
New York, NYa month ago- ...Job Description Job Description Tech Lead – Data Platform | Remote A fast-growing financial technology company is seeking a Tech... ...architecture of the data platform, partner with Product and Engineering leadership, and lead the implementation of scalable, cloud-...Remote work
The Cypress Group
New York, NYa month ago - ...Snowflake Lead – Data Engineering San Antonio, TX / New York, NY (Onsite) Local to San Antonio, TX / New York, NY only! P&C / Specialty Insurance exp Must Must-Have Skills – Snowflake Lead (Data Engineering) * 12+ years of Data Engineering / Analytics experience...Temporary workLocal area
Delan Associates, Inc
New York, NY16 days ago - Data Engineering Manager Location: Remote (NY/NJ residents only) Direct Hire Overview Seeking a hands-on engineering leader to guide... ...modernization of a cloud-based data platform. Responsibilities Lead, mentor, and perform code reviews for a team of engineers....For contractorsWork at officeLocal areaRemote work
Vaco
New York, NY10 hours ago $200k - $230k
...win business. Collaborators to build it. Data pros who turn numbers into insights. Product... ...catches problems before clients do (for engineers and AI agents alike). In this role... ...AI-assisted triage, and a runbook. Lead and grow the domain's data engineers . Define...Hourly payFull timeWork experience placementLocal areaKargo
New York, NY2 days ago- ...Lead Data Engineer This role is for a Senior Data Engineer with at least 5+ years of experience in Data Engineering roles at the senior level who can provide support to our existing engineers. Help build a connected data system (Data Fabric) and use hands...
3B Staffing LLC
New York, NY5 days ago $110k - $130k
...Based on your background, your experience may align well with this role. Position Details: Role: Snowflake Lead Data Engineering Locations: New York, NY Employment Type: Full-Time (W2 only) Work Model: 5days...Full timeContract workImmediate startSiri InfoSolutions Inc
New York, NY2 days ago- ...Lead Data Engineer Client needs a forward-thinking Lead Data Engineer willing to work on-site in New York NY. This opportunity is in the Asset Management/Financial Services/Investment Management/Hedge Funds industry and requires a proven track record of flawless execution...
ShiftCode Analytics
New York, NY4 days ago - TBD Gen is proud to be an equal-opportunity employer, committed to diversity and inclusivity. We base employment decisions on merit, experience, and business needs, without considering race, color, national origin, age, religion, sex, pregnancy, genetic information,...
Gen Digital Inc
New York, NY3 days ago $170k - $220k
...About the Role We are looking for a leader of the Coast data engineering team to shape our company's data culture and underlying infrastructure... ...our modern, cloud-native data platform. This is a chance to lead a small, high-leverage team and make a definitive impact,...Work at officeLocal areaRelocation packageFlexible hoursCoast
New York, NY4 days ago- ...Role: Lead Data Engineer Location: New York Mode of Work: Onsite 60/hour. Responsibilities - Lead the design and implementation of a robust, scalable, and reusable data ingestion framework using Microsoft Fabric - Building...
Maintec Technologies
New York, NY4 days ago $159.1k - $265.1k
Position Summary Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation, and help make... ...ventures, and fuel growth through innovation. Work You’ll Do As a Lead AI and Data Science Engineer II on the team, you will be responsible for...Local area- ...Title: Lead Analytics/ Data Engineer Duration: 6+months Location: Remote Required Qualifications 7+ years in BI/analytics engineering with production Looker/LookML experience (models, explores, derived tables, PDTs, access filters) - not just dashboard...Remote work
Conch Technologies Inc
New York, NY1 day ago $197.3k - $225.1k
...Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment?...Full timePart timeInternshipH1bLocal areaCapital One
New York, NY3 days ago$220k - $230k
...is a global leader in digital assets and data center infrastructure, delivering solutions... ...You Are: You're a senior, hands-on data engineer with 8+ years of experience designing,... ...platforms at scale — and you're ready to lead. You set the technical direction for data...Local areaFlexible hours$209k - $238.5k
...disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a...InternshipLocal area- The Lead Data Engineer is a hands‑on technical leader responsible for designing, building, and operating enterprise‑grade data integration and analytics platforms across the firm. This role owns core data pipelines, data models, and production data operations, and establishes...Casual work
$180k - $250k
...experience — talk with your recruiter to learn more. Base pay range $180,000.00/yr - $250,000.00/yr A world-leading trading firm is seeking a Lead Data Engineer to architect, scale, and optimize the data infrastructure powering its multi-billion-dollar systematic trading...Full time- A technology solutions firm is looking for a Lead Data Engineer to work remotely on building end-to-end data solutions. The ideal candidate will design and maintain scalable data pipelines and collaborate with AI/ML teams. The position requires strong skills in Databricks...Remote job
- Lead Market Data Engineer - Systematic Data Join to apply for the Lead Market Data Engineer - Systematic Data role at Balyasny Asset Management L.P. The Lead Market Data Engineer will architect, build, and optimize the platforms that deliver high‑quality market data to...Full time
$140k - $160k
Fitch Group is currently seeking a Associate Director/Lead Data Engineer based out of our Chicago office. As a leading, global financial information services provider, Fitch Group delivers vital credit and risk insights, robust data, and dynamic tools to champion more...Temporary workWork at officeImmediate startWorldwideShift work2 days per week$135k - $150k
New York, United States | Posted on 08/30/2023 The position of Lead Data Engineer is open in New YorkCity, New York, within the Insurance industry. The role offers flexiblework-from-home days while requiring occasional on-site presence for clientmeetings. The Lead Data...$110k - $130k
...ETL Roles & Responsibilities The Snowflake Lead will serve as the onsite technical lead for CLEARBROOK ’s enterprise data platform, responsible for end to end Snowflake... ...on expertise in Snowflake, strong data engineering fundamentals, and the ability to integrate AI...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
Related searches