Lead Data Engineer
Zortech Solutions
Lead Data Engineer
Location: Tarrytown NY 10591 (Hybrid role – 3 days onsite 2 days WFH)
Duration: 6-12+ Months
Job Description:
Must have AWS, Apache Airflow, Pyspark, Redshift
- Candidate should have 12+ years of experience in Data Engineering
- Designing, creating, testing and maintaining the complete data management & processing systems.
- Working closely with the stakeholders & solution architect.
- Ensuring architecture meets the business requirements.
- Building highly scalable, robust & fault-tolerant systems.
- Taking care of the complete ETL process.
- Knowledge of Hadoop ecosystem and different frameworks inside it – HDFS, YARN, MapReduce, Apache Pig, Hive, Flume, Sqoop, ZooKeeper, Oozie, Impala and Kafka
- Must have knowledge and working experience in Real-time processing Framework (Apache Spark), PySpark and in AWS Redshift
- Must have experience on SQL-based technologies (e.g. MySQL/ Oracle DB) and NoSQL technologies (e.g. Cassandra and MongoDB)
- Should have Python/Scala/Java Programming skills
- Discovering data acquisitions opportunities
- Finding ways & methods to find value out of existing data.
- Improving data quality, reliability & efficiency of the individual components & the complete system.
- Creating a complete solution by integrating a variety of programming languages & tools together.
- Creating data models to reduce system complexities and hence increase efficiency & reduce cost.
- Introducing new data management tools & technologies into the existing system to make it more efficient.
- Setting & achieving individual as well as the team goal.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Tarrytown, NY vacancy
- ...We are seeking a Lead Data Engineer with 10–12+ years of experience to design, build, and optimize modern enterprise data platforms and AI-enabled data solutions. This hands‑on individual contributor role focuses on developing scalable data ecosystems, enabling AI-driven...Suggested
Compunnel
Montvale, NJ3 days ago - ...Associates, Inc is seeking a Mechanical Controls Engineer for their White Plains, NY location. This role involves leading automation design teams, mentoring engineers,... ...experience with BMS/BAS systems, particularly in data center environments. Competitive salaries and benefits...Suggested
$150.5k - $245.5k
...work. We focus on developing and improving data pipelines, infrastructure, architecture,... ...transformation. Working with a team of engineers, analysts, and scientists, you will contribute... ...of 5 years’ experience developing and leading the implementation of data engineering...SuggestedFull timeWorldwide$75k - $90k
Mechanical Engineer - Data Center Facilities Valhalla, USA-NY or Los Angeles, USA-CA Full-time At Ramboll, you will find a dedicated group of professionals that are pioneers and leaders in Data Center Strategy, Planning, Design, Integration, Commissioning and Testing...SuggestedFull timeFor contractorsWork at officeFlexible hours- A global engineering firm based in New York is seeking a Sr. Electrical Engineer to join their Data Center Facilities design team. The role involves leading design efforts for innovative electrical infrastructure solutions, managing project engineering teams, and ensuring...Suggested
- Ramboll is seeking a Mechanical Design Engineer for their Data Center Facilities team based in Valhalla, NY or Los Angeles, CA. In this full-time role, you will be tasked with developing HVAC mechanical designs for mission-critical environments, including data centers....Full time
$102k - $128k
...Generative AI.As a Junior SAP SAC Integration Engineer, you will support the design and... ...analytics ecosystem that enables faster, data‑driven decisions.This role is well‑suited... ...secure and reliable at large scale.Work with Lead Data Engineer to provide guidance and direction...Flexible hours$106.9k - $200.6k
...opportunity In EY’s Office of the CTO, the Advanced Forward Engineering (AFE) team is comprised of cells of Forward Deployed Engineers... ...experience in using EY’s products. We are seeking a Data Engineer to join AFE delivery pods, where AI‑native systems are...Full timeSummer holidayWork at officeFlexible hours- ...and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: Senior Data Engineer Location(s): White Plains, NYWe are seeking a Senior Data Engineer to join our Data Services team. The ideal candidate will be...
- ...Senior Data EngineerWe are seeking a Senior Data Engineer. Job functions and responsibilities include:Cloud Data Engineering & Integration: Design and implement... ...major technology vendors and continually develops leading-edge offerings in service areas such as digital...Local areaMonday to Friday
Spruce Technology
White Plains, NY1 day ago $125k - $155k
...Position Data Engineer Reports to VP, Data & Business Intelligence Location White Plains, NY (Hybrid) ABOUT THE UFL The United Football League... ...data platform built on Fivetran, dbt, and BigQuery, while leading its evolution as the league grows. You’ll be responsible for configuring...Work at officeLocal areaRemote workFlexible hoursNight shiftWeekend workXFL Properties LLC DBA United Football League
White Plains, NY3 days ago- ...Senior Data EngineerAmpcus Inc. is a certified global provider of a broad range of Technology and Business consulting services. We... ...across all departments.Job Functions & ResponsibilitiesCloud Data Engineering & Integration: Design and implement data pipelines across AWS,...
Ampcus
White Plains, NY1 day ago - ...Overview The Senior Data Engineer role within the data engineering vertical will play a pivotal role at the forefront of our data and analytics technology transformation initiatives. We are seeking an expert senior data engineer to build, enhance, and support a wide variety...
ViziRecruiter
Yonkers, NY2 days ago - ...underserved communities, we are looking to the future of being a data driven organization and tech-enabled care delivery to create... ...to create a tangible impact with the healthcare system. The Data Engineer role within the data engineering vertical will play a pivotal role...
ViziRecruiter
Yonkers, NY2 days ago - ...Senior Data EngineerAs a Senior Data Engineer on DAPI's Tetris team, you will own the design and delivery of complex data engineering solutions that power... ..., AI, and reporting capabilities. Reporting to the Lead Data Engineer, you will drive technical decisions, set engineering...
New York Blood Center
Rye, NY5 days ago - ...Job Title Required Skills: 8+ Year experience Azure Data Factory and Data bricks Good understanding on Data modeling... ...Data Factory. Azure Databricks and SQL. Experienced data engineer with expertise in SQl/NoSQL processing using Azure technology stack...
Syntricate Technologies
Montvale, NJ4 days ago - ...Top Skills An Azure Data Engineer designs, builds, and manages data pipelines and storage systems within the Microsoft Azure ecosystem... ...consumer use and disposal. Key Responsibilities: Lead development of advanced data integration and analytics...Flexible hours
3B Staffing LLC
Valhalla, NY5 days ago - ..., Seramount, Fair360 and others. If you're as passionate about your future as we are, join our team.KPMG is currently seeking a Data Engineer to join our Audit Technology Alliance organization.Responsibilities:Take ownership of designing and implementing data pipelines...Local area
- ...predictive analytics, supported by AI-ready data assets and AI-assisted development... ...supporting the Claims Analytics group, you will lead end-to-end delivery of complex data... ...including leading and developing a team of data engineers. You will work closely with business and...Full timeTemporary workRemote workWork from home
$132k - $142k
...Responsibilities The Analytics Engineer is a highly technical, business-facing role responsible for delivering deep analytical insights, rapid analytics solutions, and advanced data products in support of discovery and research teams. This role bridges analytics, data...Local areaRemote workFlexible hoursNew York Blood Center
Rye, NY3 days ago- ...Job Description Insight Global is seeking a Data Analytics Engineer for a top professional sports and sports technology client. This candidate will serve as a core analytics consultant supporting elite athlete performance and operational decision-making. The role focuses...Contract work
Insight Global
Harrison, NY5 days ago - ...Montefiore Difference” - who we are at Montefiore and all that we have to offer our associates, please click here. Overview The Data Engineer, Research Informatics plays a critical role in enabling data-driven clinical and translational research across Montefiore. This...
- JLL is seeking an Operating Engineer - Critical Environments to maintain 100% uptime in a mission-critical data center. The role requires expertise across electrical, HVAC, plumbing, or central utility operations with multi-skill capabilities. The position operates on a...Night shiftDay shift
- JLL in Orangeburg, NY seeks an Operating Engineer - Critical Environments to maintain uptime of facility systems in a data center. Requires expertise in electrical, HVAC, piping/plumbing, or central utility plant operations, plus multi-skill capabilities. Night shift on...Night shift
- ViziRecruiter,LLC. is seeking a Senior Data Engineer in Yonkers to lead data transformation initiatives. This role involves building and enhancing robust data pipelines from diverse sources, critical for business insights in the healthcare sector. The ideal candidate will...
- Qualifications Bachelor’s Degree in Computer Science, 3+ years related IS experience and 2+ years in BI / data warehousing Solid understanding of data warehousing concepts, terminology, and architecture Excellent ETL, SQL and database design and development experience...
$106.9k - $200.6k
...help to build a better working world. The opportunity We are seeking an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, including the data stores, memory tiers, and event streaming systems that hold and move every piece of state in...Full timeSummer holidayFlexible hours- ...your future as we are, join our team.KPMG is currently seeking a Data Scientist to join our Audit Technology Alliance organization.... ...of generative AI solutions including RAG pipelines and context engineering features within the established architecture; drive quality into...H1bLocal area
$100k - $160k
...This role reports into a Director of Data Science & Analytics. The Financial Services... ...collections agencies and retail banks. You will lead analytic client engagements involving... ...mathematics, financial mathematics, engineering, operations research, or another highly quantitative...Full timeTemporary workWork experience placementWork at officeFlexible hours2 days per week$93.5k - $156.45k
...North America retailers.ResponsibilitiesThe Data Science Associate Principal Scientist will... ...as a core owner of the GTM forecasting engine, ensuring the onboarded markets evolve into... ...business units to validate and refine outputs.Lead prioritization and delivery of product...PepsiCo
Purchase, NY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
Related searches