Lead Data Engineer
Zortech Solutions
Lead Data Engineer
Location: Tarrytown NY 10591 (Hybrid role – 3 days onsite 2 days WFH)
Duration: 6-12+ Months
Job Description:
Must have AWS, Apache Airflow, Pyspark, Redshift
- Candidate should have 12+ years of experience in Data Engineering
- Designing, creating, testing and maintaining the complete data management & processing systems.
- Working closely with the stakeholders & solution architect.
- Ensuring architecture meets the business requirements.
- Building highly scalable, robust & fault-tolerant systems.
- Taking care of the complete ETL process.
- Knowledge of Hadoop ecosystem and different frameworks inside it – HDFS, YARN, MapReduce, Apache Pig, Hive, Flume, Sqoop, ZooKeeper, Oozie, Impala and Kafka
- Must have knowledge and working experience in Real-time processing Framework (Apache Spark), PySpark and in AWS Redshift
- Must have experience on SQL-based technologies (e.g. MySQL/ Oracle DB) and NoSQL technologies (e.g. Cassandra and MongoDB)
- Should have Python/Scala/Java Programming skills
- Discovering data acquisitions opportunities
- Finding ways & methods to find value out of existing data.
- Improving data quality, reliability & efficiency of the individual components & the complete system.
- Creating a complete solution by integrating a variety of programming languages & tools together.
- Creating data models to reduce system complexities and hence increase efficiency & reduce cost.
- Introducing new data management tools & technologies into the existing system to make it more efficient.
- Setting & achieving individual as well as the team goal.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Tarrytown, NY vacancy
- ...We are seeking a Lead Data Engineer with 10–12+ years of experience to design, build, and optimize modern enterprise data platforms and AI-enabled data solutions. This hands‑on individual contributor role focuses on developing scalable data ecosystems, enabling AI-driven...Suggested
Compunnel
Montvale, NJ3 days ago - The UFL is seeking a Data Engineer in White Plains to own and evolve its data platform, pipelines, and models. You will work with Fivetran, dbt, and BigQuery, driving reliability and scalability for Sales, Sponsorships, Marketing, and Football Operations. As the first in...Suggested
$150.5k - $245.5k
...work. We focus on developing and improving data pipelines, infrastructure, architecture,... ...transformation. Working with a team of engineers, analysts, and scientists, you will contribute... ...of 5 years’ experience developing and leading the implementation of data engineering...SuggestedFull timeWorldwide- A global engineering firm based in New York is seeking a Sr. Electrical Engineer to join their Data Center Facilities design team. The role involves leading design efforts for innovative electrical infrastructure solutions, managing project engineering teams, and ensuring...Suggested
$102k - $128k
...Generative AI.As a Junior SAP SAC Integration Engineer, you will support the design and... ...analytics ecosystem that enables faster, data‑driven decisions.This role is well‑suited... ...secure and reliable at large scale.Work with Lead Data Engineer to provide guidance and direction...SuggestedFlexible hours- ...and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: Senior Data Engineer Location(s): White Plains, NYWe are seeking a Senior Data Engineer to join our Data Services team. The ideal candidate will be...
- ...consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: Senior Data Engineer Location(s): White Plains, NY Project Overview ~ Client current on-premises Enterprise Resource Planning (...
Ampcus
White Plains, NY5 days ago - ...Top Skills An Azure Data Engineer designs, builds, and manages data pipelines and storage systems within the Microsoft Azure ecosystem... ...consumer use and disposal. Key Responsibilities: Lead development of advanced data integration and analytics...Flexible hours
3B Staffing LLC
Valhalla, NY5 days ago - ...Job Title Required Skills: 8+ Year experience Azure Data Factory and Data bricks Good understanding on Data modeling... ...Data Factory. Azure Databricks and SQL. Experienced data engineer with expertise in SQl/NoSQL processing using Azure technology stack...
Syntricate Technologies
Montvale, NJ4 days ago $127k - $137k
...Responsibilities As a Senior Data Engineer on DAPI's Tetris team, you will own the design and delivery of complex data engineering solutions... ...analytics, AI, and reporting capabilities. Reporting to the Lead Data Engineer, you will drive technical decisions, set...Work at officeLocal areaNew York Blood Center
Rye, NY1 day ago- ...Senior Data EngineerWe are seeking a Senior Data Engineer. Job functions and responsibilities include:Cloud Data Engineering & Integration: Design and implement... ...major technology vendors and continually develops leading-edge offerings in service areas such as digital...Local areaMonday to Friday
Spruce Technology
White Plains, NY1 day ago $125k - $155k
...Position Data Engineer Reports to VP, Data & Business Intelligence Location White Plains, NY (Hybrid) ABOUT THE UFL The United Football League... ...data platform built on Fivetran, dbt, and BigQuery, while leading its evolution as the league grows. You’ll be responsible for configuring...Work at officeLocal areaRemote workFlexible hoursNight shiftWeekend workXFL Properties LLC DBA United Football League
White Plains, NY3 days ago- ...underserved communities, we are looking to the future of being a data driven organization and tech-enabled care delivery to create... ...to create a tangible impact with the healthcare system. The Data Engineer role within the data engineering vertical will play a pivotal role...
ViziRecruiter
Yonkers, NY2 days ago - ...Overview The Senior Data Engineer role within the data engineering vertical will play a pivotal role at the forefront of our data and analytics technology transformation initiatives. We are seeking an expert senior data engineer to build, enhance, and support a wide variety...
ViziRecruiter
Yonkers, NY2 days ago - ..., Seramount, Fair360 and others. If you're as passionate about your future as we are, join our team.KPMG is currently seeking a Data Engineer to join our Audit Technology Alliance organization.Responsibilities:Take ownership of designing and implementing data pipelines...Local area
- ...predictive analytics, supported by AI-ready data assets and AI-assisted development... ...supporting the Claims Analytics group, you will lead end-to-end delivery of complex data... ...including leading and developing a team of data engineers. You will work closely with business and...Full timeTemporary workRemote workWork from home
- ...Job Description Insight Global is seeking a Data Analytics Engineer for a top professional sports and sports technology client. This candidate will serve as a core analytics consultant supporting elite athlete performance and operational decision-making. The role focuses...Contract work
Insight Global
Harrison, NY5 days ago $132k - $142k
...Responsibilities The Analytics Engineer is a highly technical, business-facing role responsible for delivering deep analytical insights, rapid analytics solutions, and advanced data products in support of discovery and research teams. This role bridges analytics, data...Local areaRemote workFlexible hoursNew York Blood Center
Rye, NY3 days ago- ViziRecruiter,LLC. is seeking a Senior Data Engineer in Yonkers to lead data transformation initiatives. This role involves building and enhancing robust data pipelines from diverse sources, critical for business insights in the healthcare sector. The ideal candidate will...
- Qualifications Bachelor’s Degree in Computer Science, 3+ years related IS experience and 2+ years in BI / data warehousing Solid understanding of data warehousing concepts, terminology, and architecture Excellent ETL, SQL and database design and development experience...
- ...Montefiore Difference” - who we are at Montefiore and all that we have to offer our associates, please click here. Overview The Data Engineer, Research Informatics plays a critical role in enabling data-driven clinical and translational research across Montefiore. This...
- JLL is seeking an Operating Engineer - Critical Environments to maintain 100% uptime in a mission-critical data center. The role requires expertise across electrical, HVAC, plumbing, or central utility operations with multi-skill capabilities. The position operates on a...Night shiftDay shift
- JLL in Orangeburg, NY seeks an Operating Engineer - Critical Environments to maintain uptime of facility systems in a data center. Requires expertise in electrical, HVAC, piping/plumbing, or central utility plant operations, plus multi-skill capabilities. Night shift on...Night shift
- ...your future as we are, join our team.KPMG is currently seeking a Data Scientist to join our Audit Technology Alliance organization.... ...of generative AI solutions, including RAG pipelines and context engineering features, within our established architecture; driving quality...InternshipH1bLocal area
$93.5k - $156.45k
...North America retailers.ResponsibilitiesThe Data Science Associate Principal Scientist will... ...as a core owner of the GTM forecasting engine, ensuring the onboarded markets evolve into... ...business units to validate and refine outputs.Lead prioritization and delivery of product...PepsiCo
Purchase, NY1 day ago- Swiss Re is seeking an Underwriting Portfolio Engineer to enhance portfolio decisions using data engineering and analytics. You will frame business questions, explore data, build production-grade Palantir workflows and continuously improve solutions across the full lifecycle...
$132k - $142k
New York Blood Center is seeking an Analytics Engineer responsible for delivering analytical insights and developing data products for discovery and research teams. Ideal candidates will have 5+ years of advanced analytics experience and strong skills in SQL and Python....$109.9k - $179.3k
...diseases. We are seeking an Associate Manager, Production AI/ML Engineering to join our Advanced Informatics team. In this role, you will... ...applications — transforming population-scale clinical and claims data into reliable, production-grade model inference — while...Full timeWorldwide- ...Data Center Operations EngineerWe are seeking a motivated Data Center Operations Engineer to support the deployment, maintenance, and reliability of critical production infrastructure. This role is ideal for someone who enjoys solving technical problems, working with Linux...Work at officeNight shiftRotating shiftAfternoon shift
ACAV and Associates LLC
Orangeburg, NY2 days ago - A leading engineering design firm in White Plains, NY is seeking a Senior Electrical Engineer for critical facilities. The role involves designing electrical systems for data centers, managing projects, and collaborating with various stakeholders. Ideal candidates have...Remote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
Related searches