Data Engineer
Quadrant IQ Solutions LLC
Get AI-powered advice on this job and more exclusive features. Job Type: W2 Visa's Accepted: H4-EAD, GC-EAD, L2S, GC, USC, H1B Must-Have Skills Python & PySpark – Expert-level proficiency with very strong Apache Spark experience (large-scale data processing, optimization, performance tuning). AWS Cloud ECS (Elastic Container Service) – Required AWS Glue and/or AWS Lake Formation – Strongly preferred Data Warehousing Snowflake or Teradata (hands-on experience with large analytical datasets) Core Responsibilities Design, build, and optimize high-performance Spark-based data pipelines using Python/PySpark. Develop and maintain ETL/ELT workflows for large-scale structured and semi-structured data. Deploy and manage data workloads on AWS ECS . Implement data ingestion, transformation, and governance using AWS Glue / Lake Formation . Integrate data pipelines with Snowflake or Teradata for analytics and reporting. Ensure scalability, reliability, and performance of distributed data processing systems. Collaborate with analytics, platform, and cloud engineering teams. Seniority level Mid-Senior level Employment type Full-time Job function Data Engineering We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in New York, NY vacancy
- ...Job Description: Job Summary: We are seeking an experienced Data Engineer / Support Analyst with strong expertise in Databricks, Azure cloud services, Bloomberg terminal and BBG data integration, and batch job support. The ideal candidate will have a background in financial...Suggested
ALLTECH CONSULTING SVC INC
New York, NY22 hours ago - ...We are partnered with an established Financial Services firm based in New York. They are hiring a Lead Data Engineer to lead the design and delivery of scalable data pipelines and cloud-based transformation frameworks across its Azure data platform. This is a hands‑on...Suggested
SO Digital Recruitment
New York, NY4 days ago $140k - $160k
...Fitch Group is currently seeking a Associate Director/Lead Data Engineer based out of our Chicago office. As a leading, global financial information services provider, Fitch Group delivers vital credit and risk insights, robust data, and dynamic tools to champion more...SuggestedTemporary workWork at officeImmediate startWorldwideShift work2 days per weekFitch Ratings
New York, NY4 days ago- ...We are seeking a highly motivated Engineering Consultant with experience in the Pharmaceutical or Life Sciences domain to work on data and analytics-driven initiatives. This role requires a blend of engineering expertise, domain understanding, and consulting capabilities...Suggested
MathCo
New York, NY22 hours ago $100k - $200k
...Who We Are Galaxy is a global leader in digital assets and data center infrastructure, delivering solutions that accelerate progress... .... Build Dream Teams. Who You Are You’re a senior, hands‑on data engineer with 8+ years of experience designing, building, and operating production...SuggestedLocal areaFlexible hoursGalaxy USA
New York, NY22 hours ago- ...Position Overview We are seeking a Lead Data Engineer to join a rapidly growing Data & Analytics organization responsible for delivering enterprise-scale data products, analytics solutions, and cloud-based data platforms. This role will lead the design, development, and...
Burtch Works
New York, NY22 hours ago $215.2k - $245.6k
...of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity...Full timePart timeInternshipH1bLocal areaCapital One
New York, NY2 days ago- ...We're hiring a Data Engineering Lead to help scale and guide a growing team of data engineers. This role is ideal for someone who enjoys solving technical challenges hands‑on while also shaping engineering best practices, coaching others, and helping cross‑functional...
Forbes Advisor
New York, NY3 days ago - ...Qualifications 10+ years of hands‑on data engineering experience, including technical leadership of data platform initiatives Strong, hands‑on expertise with the Databricks Lakehouse Platform, including Delta Lake, Delta Live Tables, Databricks Workflows, and Unity Catalog...
Altraize
New York, NY1 day ago $70 - $85 per hour
...Lead Data Engineer Location: Remote Duration: 6+ months Compensation: $70.00 - 85.00/hr Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S. Summary We are looking for a Lead Data Engineer who excels in data modeling and can build end-to-end data...Contract workLocal areaRemote workFlexible hoursINSPYR Solutions
New York, NY4 days ago$170k - $220k
...Fleet and Fuel Card built on a cutting-edge spend management platform. About the Role We are looking for a leader of the Coast data engineering team to shape our company’s data culture and underlying infrastructure. At Coast, the success of our data platform is driving...Work at officeLocal areaRelocation packageFlexible hoursCoastpay
New York, NY4 days ago- ...company on a mission to ethically democratize the benefits of data and AI . Since 2019, we have built one of the largest consented... ...room to shape the architecture and culture from the ground up. Engineers here own major surface areas , build 0→1 systems in large‑scale...Remote workFlexible hours
Yobi AI
New York, NY22 hours ago - ...W Talent is partnering with a leading organisation within the Financial Services sector to appoint a Lead Data Engineer as part of a significant investment in its Data & Analytics capability. This is an excellent opportunity to join a growing team responsible for delivering...
W Talent
New York, NY4 days ago $135k - $150k
...New York, United States | Posted on 08/30/2023 The position of Lead Data Engineer is open in New YorkCity, New York, within the Insurance industry. The role offers flexiblework-from-home days while requiring occasional on-site presence for clientmeetings. The Lead Data...Career-Mover
New York, NY4 days ago- ...We are seeking a Senior Analytic Data Engineer to join our technical team, with primary responsibilities spanning the design, development, and maintenance of our organizational data and programming infrastructure for Hedis. This role is critical for establishing and maintaining...
Openkyber
New York, NY3 days ago $125k - $140k
...the vision and achieving the goals of our three core lines of business: Indexing, Digital Distribution, and Data & Analytics. Made up of developers, data engineers, designers, and project managers, the platform team is the engine that drives forward the technical...VettaFi
New York, NY4 days ago$220k - $230k
...Overview Galaxy is a global leader in digital assets and data center infrastructure, delivering solutions that accelerate progress... ...efficient, and well-tested code, following best practices in software engineering Mentor and develop other engineers, lead code reviews, and...Local areaFlexible hours(Brand Shop) Ttl Trading Private Limited- Thoppumpady
New York, NY1 day ago- ...The position will lead technical and business analysis that is critical in discovery process requirement for additional data loads – this would include new and existing datasets supporting the taxonomy for JJMD – (Core & Non-core taxonomy subject areas) Strong collaboration...Work experience placementInterim role
Element Technologies
New York, NY22 hours ago - ...Insurance domain, Snowflake, SQL, Python, Spark, AWS- Glue, Big Data Concepts Responsibilities Lead the design, development, and... ...analytics. Provide technical leadership and mentorship to junior data engineers. Work closely with stakeholders to gather requirements and...Work experience placement
CSM Technologies
New York, NY4 days ago $160k - $220k
...healthcare settings across four continents — and we're hiring the engineering team to build what comes next. About the Role A patient wears... ...all flow into the same clinical picture alongside the wearable data. Your job is to make sure every one of those signals — from raw...Permanent employmentFull timeWork experience placementH1bWorldwideRelocationFlexible hoursShift workNight shiftDay shiftDeliberate Solutions, Inc.
New York, NY22 hours ago$149.3k - $200.2k
...products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news. The Product & Data Engineering team is responsible for end to end development for Disney’s world-class consumer-facing products, including streaming...Work experience placementWorldwideThe Walt Disney Company
New York, NY22 hours ago$180k - $250k
...with your recruiter to learn more. Base pay range $180,000.00/yr - $250,000.00/yr A world-leading trading firm is seeking a Lead Data Engineer to architect, scale, and optimize the data infrastructure powering its multi-billion-dollar systematic trading business. In this...Full timeEvolve Group, Inc.
New York, NY4 days ago- Job Description Must Have: DBT Core, Snowflake and Python, AWS Airflow, Container services (Docker), Terraform Good to Have: BI tooling experience (Power BI or Tableau), understanding of Agile processes (Kanban or Jira) We need a strong person for this position...
Echo IT Solutions
New York, NY2 days ago - ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities: Lead the design...Long term contractWork at office
InterSources
New York, NY2 days ago - ...Proposition: The position sits within the newly consolidated Data and Analytics (D&A) organization supporting the U.S. Business... ...data science, from data infrastructure, data governance, data engineering, data modeling, data analysis to business intelligence, data science...Temporary workWork at officeLocal area3 days per week
MetLife
New York, NY1 day ago $189.59k
...monitoring, alerting tools, dashboards, and frameworks to support data-driven decision-making and manage potential risks. Support... ...analytics systems through continuous performance tuning and re-engineering. Design and implement cloud-native solutions to leverage...Hourly payRemote workBarclays
New York, NY11 days ago- ...Graph Data Engineer NYC, NY - 3 days on site Long Term Consulting Assignment **Onsite Interview Required Position Overview: The graph data engineer is responsible for developing and enhancing Jefferies knowledge graph to empower several applications...
3B Staffing LLC
New York, NY11 hours ago - ...The Market Data team designs and operates the high-performance systems that power our production trading environment. In our business... ...performance or stability. We are seeking a self‑driven Senior Market Data Engineer to take end-to-end ownership of core components of our market...
Citadel Securities
New York, NY4 days ago - ...we are looking for entry-level software programmers, Java full stack developers, Python/Java developers, data analysts/data scientists, machine learning engineers for full time positions with clients. Who should apply? Recent computer science/engineering/mathematics/statistics...Full timeH1bImmediate startRemote work
SynergisticIT
New York, NY3 days ago $60 - $85 per hour
...A fast-growing AI company''s Finance organization is looking for a Data Engineer to develop and maintain the data infrastructure that supports its CFO team. This role offers the opportunity to join a small, dynamic team with a wide-ranging mandate: build data pipelines...Hourly payFull timeContract workSaidGig
New York, NY4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- senior data center engineer New York, NY
- data engineer machine learning New York, NY
- remote data engineer New York, NY
- data engineer intern New York, NY
- data systems engineer New York, NY
- junior data engineer New York, NY
- data engineer graduate New York, NY
- data science developer New York, NY
- big data engineer New York, NY
- data engineering intern summer New York, NY