Lead Data Engineer
ShiftCode Analytics
Interview : Video
Visa : USC, GC, GC EAD, H4, L2 This is onsite from day-1 Description :Client needs a forward-thinking Lead Data Engineer willing to work on-site) in New York NY. This opportunity is in the Asset Management/ Financial Services / Investment Management / Hedge Funds industry and requires a proven track record of flawless execution of the below skills:
ETL/ELT process and frameworks.
Expertise in SQL, Oracle, MySql, PostgreSQL
Proficient in Python and Scala programming
Strong in Git repo and CI/CD deployment process
Experience with Big Data - Hadoop, Spark. Job Description: Job Duties: • At least 8+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution.
• Strong Application development experience in Scala/Python.
• Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch
• Strong Database SQL experience, preferably Redshift.
• Strong in Git repo and CI/CD deployment process.
• Experience in Snowflake .
• Experience with ETL/ELT process and frameworks is a must.
• Create integration and application technical design documentation.
• Conduct peer-reviews of functional design documentation.
• Complete development, configuration, test cases and unit testing
• Perform code reviews and ensure standards are applied to each solution component.
• Resolve complex defects during testing phases and identify root causes.
• Drive performance testing.
• Production Support: Assist in troubleshooting production environment and tuning environments.
• Ensure best practices are followed from a technical perspective during all phases of the project.
Domain Experience :
• Asset Management
• Financial Services
• Investment Management
• Hedge Funds
Minimum Skills Required: Experience with ETL/ELT process and frameworks is a must
Expertise in SQL and experience with relational databases like Oracle, MySql, PostgreSQL
Proficient in Python and Scala programming for data engineering tasks, automations
Strong in Git repo and CI/CD deployment process
Experience with Big Data - Hadoop, Spark
Domain Experience :
• Asset Management
• Financial Services
• Investment Management
• Hedge Funds
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in New York, NY vacancy
$125k - $140k
...business: Indexing, Digital Distribution, and Data & Analytics. This role focuses on driving technical excellence in data engineering, statistical techniques, and domain‑specific... ...’s digital ecosystem. Responsibilities Lead the technical direction of the data engineering...SuggestedTMX Group
New York, NY1 day ago$170k - $220k
...About the Role We are looking for a leader of the Coast data engineering team to shape our company's data culture and underlying infrastructure... ...our modern, cloud-native data platform. This is a chance to lead a small, high-leverage team and make a definitive impact,...SuggestedWork at officeLocal areaRelocation packageFlexible hoursCoast
New York, NY3 days ago- ...Lead Data Engineer – Big Data & Cloud (AWS)(Python) Location: New York, NY (Onsite) Contract: 6 Months Visa Status: ONLY GC & USC Strong Python and Big Data expertise JOB DESCRIPTION: We are seeking a Senior Data Engineer / Technology Lead with 10–15...SuggestedContract work
Argyle Infotech
New York, NY4 days ago - ...Role Value Proposition The MetLife Corporate Functions Data Office is part of the Data and Analytics Organization (D&A) within... ...solutions for MetLife as we head into our New Frontier strategy! The Lead Data Engineer plays a critical role in big data development within the data...SuggestedWork at office
MetLife
New York, NY1 day ago $70 - $85 per hour
...Lead Data Engineer Location: Remote Duration: 6+ months Compensation: $70.00 - 85.00/hr Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S. Summary We are looking for a Lead Data Engineer who excels in data modeling and can build end-to-end data...SuggestedContract workLocal areaRemote workFlexible hoursINSPYR Solutions
New York, NY1 day ago$215.2k - $245.6k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers...Full timePart timeInternshipH1bLocal areaCapital One
New York, NY1 day ago$140k - $160k
...Fitch Group is currently seeking a Associate Director/Lead Data Engineer based out of our Chicago office. As a leading, global financial information services provider, Fitch Group delivers vital credit and risk insights, robust data, and dynamic tools to champion more...Temporary workWork at officeImmediate startWorldwideShift work2 days per weekFitch Ratings
New York, NY1 day ago- ...We are partnered with an established Financial Services firm based in New York. They are hiring a Lead Data Engineer to lead the design and delivery of scalable data pipelines and cloud-based transformation frameworks across its Azure data platform. This is a hands‑on...
SO Digital Recruitment
New York, NY1 day ago - ...A leading Behavioral AI company in New York is seeking a Lead Data Engineer to oversee data workflows and ensure the reliability of their products. This hands-on role involves working on schema modeling and orchestration techniques while collaborating with cross-functional...Remote work
Yobi AI
New York, NY2 days ago - ...A technology solutions firm is looking for a Lead Data Engineer to work remotely on building end-to-end data solutions. The ideal candidate will design and maintain scalable data pipelines and collaborate with AI/ML teams. The position requires strong skills in Databricks...Remote work
INSPYR Solutions
New York, NY1 day ago $220k - $300k
...Overview The Lead Data Engineer on the Nebula team plays a significant technical leadership role in shaping and scaling the data foundation that powers analytics, reporting, AI development, and operational decision-making across the organization. This role combines...Local areaRemote workFlexible hoursBayview Asset Management
New York, NY22 hours ago$125k - $140k
...– TMX Careers. The TMX group of companies includes leading global exchanges such as the Toronto Stock Exchange... ...lines of business: Indexing, Digital Distribution, and Data & Analytics. Made up of developers, data engineers, designers, and project managers, the platform team...VettaFi
New York, NY1 day ago$135k - $150k
...New York, United States | Posted on 08/30/2023 The position of Lead Data Engineer is open in New YorkCity, New York, within the Insurance industry. The role offers flexiblework-from-home days while requiring occasional on-site presence for clientmeetings. The Lead Data...Career-Mover
New York, NY1 day ago$160k - $220k
...healthcare settings across four continents — and we're hiring the engineering team to build what comes next. About the Role A patient wears... ...all flow into the same clinical picture alongside the wearable data. Your job is to make sure every one of those signals — from raw...Permanent employmentFull timeWork experience placementH1bWorldwideRelocationFlexible hoursShift workNight shiftDay shift- The position will lead technical and business analysis that is critical in discovery process requirement for additional data loads - this would include new and existing datasets supporting the taxonomy for JJMD - (Core & Non-core taxonomy subject areas) Strong collaboration...Work experience placementInterim role
$209k - $238.5k
...disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a...InternshipLocal area- We are seeking a highly motivated Engineering Consultant with experience in the Pharmaceutical or Life Sciences domain to work on data and analytics-driven initiatives. This role requires a blend of engineering expertise, domain understanding, and consulting capabilities...
$149.3k - $200.2k
...audiences experience sports, entertainment & news. The Product & Data Engineering team is responsible for end to end development for Disney’s... ...personalization, search, messaging and data. Job Summary As a Lead Data Engineer in the Data Platforms team, you will be partnering...Work experience placementWorldwide$180k - $250k
...experience — talk with your recruiter to learn more. Base pay range $180,000.00/yr - $250,000.00/yr A world-leading trading firm is seeking a Lead Data Engineer to architect, scale, and optimize the data infrastructure powering its multi-billion-dollar systematic trading...Full time- Lead Market Data Engineer - Systematic Data Join to apply for the Lead Market Data Engineer - Systematic Data role at Balyasny Asset Management L.P. The Lead Market Data Engineer will architect, build, and optimize the platforms that deliver high‑quality market data to...Full time
- Position Overview We are seeking a Lead Data Engineer to join a rapidly growing Data & Analytics organization responsible for delivering enterprise-scale data products, analytics solutions, and cloud-based data platforms. This role will lead the design, development, and...
- ...through innovative product design and industry-leading technology. Our portfolio of brands––... ...entertainment. Powered by vast data and insights, TTG helps theatres, producers... ...the Role: We’re looking for a Lead Data Engineer to join TodayTix Group and own how we scale...Full timeContract workWork at officeFlexible hoursShift work2 days per week
TodayTix Group
New York, NY1 day ago - ...Job Description Job Description Tech Lead – Data Platform | Remote A fast-growing financial technology company is seeking a Tech... ...architecture of the data platform, partner with Product and Engineering leadership, and lead the implementation of scalable, cloud-...Remote work
The Cypress Group
New York, NY23 days ago $190k - $220k
...diverse, and we are therefore committed to embracing diversity of thought and experience within our team. We are looking for a Lead Data Engineer to join our team. This is a high-impact, strategic role focused equally on technical leadership and hands-on execution. You...Remote workWork visaShift workMark43
New York, NY26 days ago$197.3k - $225.1k
Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At...Full timePart timeInternshipH1bLocal area- ...Lead Data Platform Engineer At Disney, we're storytellers. We make the impossible, possible. The Walt Disney Company is a world-class entertainment and technological leader. Walt's passion was to continuously envision new ways to move audiences around the world—a passion...Work experience placement
Disney France
New York, NY3 days ago $135k - $150k
A leading tech recruitment firm is seeking a Lead Data Engineer in New York City. This role involves managing a team, designing data pipelines, and ensuring project requirements are met. The ideal candidate has over 10 years in the field and 5 years in team management,...Remote jobWork from homeFlexible hours- Lutron Electronics Co., Inc is looking for a Lead Data Engineer based in Coopersburg or Philadelphia, PA to develop a cloud-native data and AI platform. In this role, you will shape the architecture of the enterprise data ecosystem and lead scalable data solutions. With...
$130k - $155k
...BI/Tableau Report Developer to join our data team, specializing in the Media and Entertainment... ...Media Data Visualization Leadership: Lead the entire lifecycle (design, development... .... Collaborate extensively with Data Engineers and Scientists to define and refine data...Full timeTemporary workPart timeLocal areaTegna
New York, NY22 hours ago- ...Lead Data Warehouse Developer (Position A) Data Warehouse Developer (Position B) Preferred Qualifications Additional years of experience beyond what is required to meet Minimum Qualification A2; Additional years of experience beyond what is required to...
Compu-Vision Consulting
New York, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
