Data Engineer
Quadrant IQ Solutions LLC
Get AI-powered advice on this job and more exclusive features. Job Type: W2 Visa's Accepted: H4-EAD, GC-EAD, L2S, GC, USC, H1B Must-Have Skills Python & PySpark – Expert-level proficiency with very strong Apache Spark experience (large-scale data processing, optimization, performance tuning). AWS Cloud ECS (Elastic Container Service) – Required AWS Glue and/or AWS Lake Formation – Strongly preferred Data Warehousing Snowflake or Teradata (hands-on experience with large analytical datasets) Core Responsibilities Design, build, and optimize high-performance Spark-based data pipelines using Python/PySpark. Develop and maintain ETL/ELT workflows for large-scale structured and semi-structured data. Deploy and manage data workloads on AWS ECS . Implement data ingestion, transformation, and governance using AWS Glue / Lake Formation . Integrate data pipelines with Snowflake or Teradata for analytics and reporting. Ensure scalability, reliability, and performance of distributed data processing systems. Collaborate with analytics, platform, and cloud engineering teams. Seniority level Mid-Senior level Employment type Full-time Job function Data Engineering We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in New York, NY vacancy
- ...Job Description: Job Summary: We are seeking an experienced Data Engineer / Support Analyst with strong expertise in Databricks, Azure cloud services, Bloomberg terminal and BBG data integration, and batch job support. The ideal candidate will have a background in financial...Suggested
ALLTECH CONSULTING SVC INC
New York, NY10 hours ago - ...Role Value Proposition The MetLife Corporate Functions Data Office is part of the Data and Analytics Organization (D&A) within GTO.... ...MetLife as we head into our New Frontier strategy! The Lead Data Engineer plays a critical role in big data development within the data analytics...SuggestedWork at office
MetLife
New York, NY4 days ago $70 - $85 per hour
...Lead Data Engineer Location: Remote Duration: 6+ months Compensation: $70.00 - 85.00/hr Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S. Summary We are looking for a Lead Data Engineer who excels in data modeling and can build end-to-end data...SuggestedContract workLocal areaRemote workFlexible hoursINSPYR Solutions
New York, NY4 days ago- ...small businesses with property and casualty insurance and risk engineering services; affluent and high net worth individuals with substantial... ...Overview: We are seeking a highly skilled and experienced lead data engineer to join our dynamic team. The ideal candidate will be...SuggestedWork experience placementLocal area
Chubb
Jersey City, NJ4 days ago - ...primarily in Python, increasingly leveraging generative AI and LLM-based tooling to accelerate development and surface insights. GraphQL Data Access : Query and transform data across multiple sources using GraphQL and SQL, building reliable data access layers that feed...Suggested
Perennial Resources International
New York, NY4 days ago $175k - $255k
...About The Role The Revenue Engine team at Charlie Health services all parts of our business related to revenue collection, financial reporting, and the patient financial experience. As a data engineer on this team, you will be responsible for building ELT pipelines, developing...Full timeWork at officeCharlie Health
New York, NY4 days ago$125k - $140k
...achieving the goals of our three core lines of business: Indexing, Digital Distribution, and Data & Analytics. This role focuses on driving technical excellence in data engineering, statistical techniques, and domain‑specific applications within VettaFi’s digital...TMX Group
New York, NY10 hours ago- ...About the job Lead Data Engineer Job Title: Lead Data Engineer No of Positions:2 Location: Jersey City/ Bedford, NJ (Hybrid) (3 days from office per week) Experience: 10+ years specifically Key Skills: Snowflake, SQL, Python, Spark, AWS-...Work experience placementWork at office3 days per week
Inizio Partners
Jersey City, NJ4 days ago $125k - $140k
...the vision and achieving the goals of our three core lines of business: Indexing, Digital Distribution, and Data & Analytics. Made up of developers, data engineers, designers, and project managers, the platform team is the engine that drives forward the technical...VettaFi
New York, NY4 days ago- ...Job Overview As a Lead Matillion Data Engineer you will spearhead the design, development, and implementation of ETL pipelines for processing healthcare data. Your role is pivotal in ensuring efficient, scalable, and high-performance data solutions that maintain consistency...
TechDigital Group
New York, NY4 days ago $220k - $230k
...Who We Are: Galaxy is a global leader in digital assets and data center infrastructure, delivering solutions that accelerate progress... ...Teams. Who You Are: You're a senior, hands-on data engineer with 8+ years of experience designing, building, and operating production...Local areaFlexible hoursGalaxy USA
New York, NY10 hours ago$135k - $150k
...New York, United States | Posted on 08/30/2023 The position of Lead Data Engineer is open in New YorkCity, New York, within the Insurance industry. The role offers flexiblework-from-home days while requiring occasional on-site presence for clientmeetings. The Lead Data...Career-Mover
New York, NY4 days ago- Job Description: Must Have : DBT Core , Snowflake and Python, AWS Airflow , Container services(Docker) , Terraform Good to Have : BI tooling experience(Power BI or Tableau), understanding of Agile processes( Kanban or Jira) . We need strong person as this...
ECHO IT SOLUTIONS INC .
New York, NY17 days ago - ...Must have skills: Azure Cloud, MS Fabric, ADF, Azure SQL, Synapse, DBT Preferred skills: Data Mesh implementation, Insurance domain Detailed Job Description Designs, builds, and maintains scalable data pipelines and architectures, leading a team to deliver robust data...
TechDigital Group
New York, NY4 days ago - ...optimization Clustering keys Micro-partitioning Warehouse scaling Data marts Distributed processing Data governance Data security AWS... ...Python SQL React Job Description We are seeking a senior Lead Data Engineer for a fully onsite contract engagement in New York, NY with a...Contract work
Elios AI
New York, NY10 hours ago $100k - $200k
...Who We Are Galaxy is a global leader in digital assets and data center infrastructure, delivering solutions that accelerate progress... .... Build Dream Teams. Who You Are You’re a senior, hands‑on data engineer with 8+ years of experience designing, building, and operating production...Local areaFlexible hoursGalaxy USA
New York, NY10 hours ago- ...We’re an AI-first global tech company with 25+ years of engineering leadership, 2,000+ team members, and 500+ active projects powering Fortune... ..., and constantly evolving. What You’ll Do Review available data sources, access patterns, interfaces, and integration options Assess...Contract workWork at officeLocal areaRemote work
Exadel open positions
New York, NY10 hours ago $140k - $160k
...Fitch Group is currently seeking a Associate Director/Lead Data Engineer based out of our Chicago office. As a leading, global financial information services provider, Fitch Group delivers vital credit and risk insights, robust data, and dynamic tools to champion more...Temporary workWork at officeImmediate startWorldwideShift work2 days per weekFitch Ratings
New York, NY4 days ago$220k
...Specialist Recruiter | Databricks Data Engineer Recruitment | Connecting Top Talent with Leading US Opportunities Job Title: Lead Data Engineer Location: Remote Employment Type: Full-time Compensation: Up to $220k + benefits About the Role We’re hiring experienced Lead...Full timeRemote workFlexible hoursKDR Talent Solutions USA
New York, NY3 days ago$174k - $230k
...The Job We are looking for our first in-house Data Engineer to own and evolve our core data infrastructure. This is an early and high-impact role. As the data engineering function grows under Engineering, you’ll have a real voice in shaping how it’s built - the processes...For contractorsRemote workAtticus Inc
New York, NY3 days ago- ...Lead Data Engineer - Palantir & PySpark (Lead Data engineer role where experience should be on both hands on and leading the team.) Candidate preference : Should be in the United States and from East coast. Experience : 8-15 Years Location...Remote work
VBeyond
Jersey City, NJ4 days ago - ...Proposition: The position sits within the newly consolidated Data and Analytics (D&A) organization supporting the U.S. Business... ...data science, from data infrastructure, data governance, data engineering, data modeling, data analysis to business intelligence, data science...
MetLife
New York, NY1 day ago $160k - $220k
...Lead Data Engineer Deliberate AI | Hybrid (NYC or Boston) | Full-Time About Deliberate AI: We're a venture-backed company at the frontier of precision mental health. In partnerships with some of the world's top ranked medical schools and psychiatric hospitals, we...Full timeWorldwideRelocationFlexible hoursShift workNight shiftDay shiftDeliberate AI
New York, NY2 days ago- ...company on a mission to ethically democratize the benefits of data and AI . Since 2019, we have built one of the largest consented... ...room to shape the architecture and culture from the ground up. Engineers here own major surface areas , build 0→1 systems in large‑scale...Remote workFlexible hours
Yobi AI
New York, NY10 hours ago - ...English, both spoken and written. Please note that all resumes should be submitted in English. We are seeking two Data Analysts, one specializing in data engineering & migration, and another focused on data pipeline & automation. Candidates with strengths in either area are...Full timeTemporary workRemote workMonday to Friday
World Business Lenders
New York, NY3 days ago - ...collaborate directly with the client's team, make business trips.... Digis islooking for anexperienced, proactive, and self-driven Lead Data Engineer tojoin our fully remote team. About the Project You’ll bepartofalarge-scale platform focused on performance management and...Remote work
DIGIS Corporation
New York, NY3 days ago $180k - $250k
...with your recruiter to learn more. Base pay range $180,000.00/yr - $250,000.00/yr A world-leading trading firm is seeking a Lead Data Engineer to architect, scale, and optimize the data infrastructure powering its multi-billion-dollar systematic trading business. In this...Full timeEvolve Group, Inc.
New York, NY4 days ago- ...The position will lead technical and business analysis that is critical in discovery process requirement for additional data loads – this would include new and existing datasets supporting the taxonomy for JJMD – (Core & Non-core taxonomy subject areas) Strong collaboration...Work experience placementInterim role
Element Technologies
New York, NY10 hours ago $106.61k - $284.28k
...Position Summary Lead Data Privacy Engineer to assist in leading our Data Protection Engineering, Monitoring, and Audit efforts. This role is responsible for embedding privacy by design principles into systems and processes, designing and maintaining technical controls...Work experience placementLocal area9025 CVS Shared Services Resources LLC
Brooklyn, NY4 days ago- ...Hi, Position: Lead Data Engineer Experience Required: 12 years+ Location: Jersey City, NJ | Onsite Employment Type: Full-Time NOTE - Must have taken care of team size of Minimum of 10 or more people and sole contributer required...Full time
Centraprise
Jersey City, NJ2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- remote data engineer New York, NY
- data engineer intern New York, NY
- entry level big data engineer New York, NY
- big data devops engineer New York, NY
- entry level data engineer New York, NY
- data engineer New York, NY
- data engineer contract New York, NY
- software data engineer New York, NY
- data engineer graduate New York, NY
- data intelligence engineer New York, NY