Data Engineer
Full-time
Wise Skulls
Hiring: Lead Data Engineer – Databricks | Manhattan, NY | Hybrid
We're looking for an experienced Lead Data Engineer with strong hands-on expertise in Databricks, SQL, Python, and PySpark to design and optimize scalable data pipelines and enterprise data platforms. The ideal candidate will provide technical leadership and implement data engineering best practices to support analytics, digital products, and AI-driven use cases.
Location: Manhattan, New York (Hybrid)
Experience: 6–12 Years
Interview Process: 3 Rounds, Including One Onsite Round in NY/NJ or at Any Client Office Across the US
Work Authorization: USC & GC Candidates Only
Key Skills:
- 6+ years of data engineering experience with substantial hands-on Databricks expertise
- Strong proficiency in SQL, Python, and PySpark
- Experience designing and developing scalable data pipelines using Medallion Architecture
- Strong understanding of Databricks Lakehouse architecture, Delta Lake, and Unity Catalog
- Experience with batch and incremental data processing, workflow orchestration, and data transformation
- Expertise in SQL query optimization, distributed processing, and performance tuning
- Experience with data quality, observability, lineage, and production troubleshooting
- Familiarity with Git, CI/CD, and production deployment practices
- Experience with AWS services, particularly S3, is a plus
- Knowledge of Auto Loader, Structured Streaming, CDC, Databricks Asset Bundles, or Apache Airflow is preferred
- Databricks Data Engineer Associate or Professional certification is a plus
- Experience with streaming, clickstream, or advertising datasets is an added advantage
What We're Looking For:
A technically strong Lead Data Engineer who can build production-grade Databricks solutions, optimize data pipelines for performance and cost efficiency, lead solution design and code reviews, and mentor engineers while delivering scalable and reliable data platforms.
Interested? Apply now or DM us to explore this opportunity!
You can share resumes at View email address on click.appcast.io
Vacancy posted 11 hours ago
Similar jobs that could be interesting for youBased on the Data Engineer in New York, NY vacancy
- Job ID: 25729598Reference Number: 25-00664Title: Lead Data EngineerLocation: NYC, NYPosted Date: 2025-06-17Contact: Mahi MahiContact... ...-8019Company: HAN Staffing Required Skills:Proficiency in data engineering programming languages (preferably Python, alternatively Scala...Suggested
HAN Staffing
New York, NY3 days ago $120k - $180k
...Value Proposition:The position sits within the newly consolidated Data and Analytics (D&A) organization supporting the U.S. Business... ...data science, from data infrastructure, data governance, data engineering, data modeling, data analysis to business intelligence, data science...SuggestedFull timeTemporary workWork at officeLocal areaRelocation package3 days per weekMetropolitan Life Insurance Company
New York, NY5 days ago- ...expertise across Cybersecurity, Digital Core, Finance, Industry and Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology. We serve approximately 9,000 clients and generated...SuggestedWork experience placementLive inWork at officeLocal area
Accenture
New York, NY5 days ago $105.4k - $207.8k
Position Summary Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation, and help make a significant... ..., and fuel growth through innovation.Work you'll do As a Data Engineer III on the AI & Data team, you will be responsible for...SuggestedLocal areaDeloitte
New York, NY1 day ago- ...our unparalleled access to a wide range of publicly available data sources.About our Team: KEPL is a fast-growing team at Cubist Systematic... ....RequirementsMaster/PhD degree in math, computer science, engineering, or other related fields.1-3 years of professional experience...Suggested
Point72
New York, NY1 day ago $100k - $140k
...& vision starting day one401(k), tuition reimbursement & longevity bonusesResponsibilitiesWe are hiring a hands-on senior level Data Engineer to build trustworthy, well governed data products and turn them into insights that drive underwriting, claims, product, distribution...Work at officeRemote work3 days per weekGUARD Insurance Group
New York, NY1 day ago$70 - $78 per hour
Snowflake Data Engineer (HVR REQUIRED) - U.S. Citizens OnlyU.S. CITIZENS ONLYNO SPONSORSHIP NOW OR IN THE FUTURENO H1BNO OPTNO CPTNO C2CNO THIRD-PARTY CANDIDATESMUST HAVE - READ BEFORE APPLYINGThis is NOT a general Snowflake Data Engineer position.HVR (High Volume Replication...Contract workTemporary workRemote workTEKsystems
New York, NY1 day ago$101.7k - $119.6k
Are you ready to make an impact?West Monroe is seeking a talented Data Engineer to join our Data Engineering & Analytics team. In this role, you will collaborate with our clients to address their most complex needs, working alongside a team of highly skilled engineers and...Local areaImmediate startFlexible hours2 days per weekWest Monroe Partners
New York, NY4 days ago$100k - $180k
$100,000-$180,000 per annum New York, United States Permanent Data Catalog EngineerNew York, NY - Hybrid (3 Days Per Week in Office) My client is seeking a Data Catalog Engineer to join a growing Data Governance team focused on improving data discovery, lineage...Permanent employmentWork at office3 days per weekApollo Solutions
New York, NY14 hours ago$133k - $166k
Job Description & ResponsibilitiesPersistent Systems is seeking a Data Engineer to join our team in our New York City headquarters. The Data Engineer will design, build, and operate the pipelines, lakehouses, and data models that deliver trusted, well-governed data for...Flexible hoursPersistent Systems
New York, NY4 days ago$200k - $300k
...to uncover insights about companies, industries, and the broader economy through deep fundamental research and applying data science and engineering techniques to alternative data sets. You’ll work alongside a talented team with diverse skills, backgrounds, and perspectives...Work experience placementPoint72
New York, NY1 day ago$175k - $240k
We are partnering with a highly successful and growing investment management firm seeking a Senior Data Engineer to help modernize and transform its enterprise data platform. This is a hands-on engineering role for someone with deep Snowflake, Python, and SQL experience...Remote workSolomon Page
New York, NY3 days ago$164k - $295k
...cybersecurity starts with you. About the Role: We're hiring a Product Analytics Engineer for CrowdStrike's Product Insights team. Our team designs, builds, and maintains the analytics data systems that power the award-winning Falcon Console. This work is foundational;...Permanent employmentWork experience placementWork at officeLocal areaWorldwideNew York, NY4 days ago$80k - $120k
Job PurposeICE Data Services, a part of Intercontinental Exchange, is seeking a Data Engineer to join our Derivatives Market Data team. This group supports critical processes across front, middle, and back offices globally, delivering cross-asset analytical solutions,...Full timeIntercontinental Exchange
New York, NY4 days ago$180k
...York , NYJob Type: PermanentPay: $150000Posted: 2026-09-10Title: Data EngineerLocation: New York, NY - Hybrid 3x per weekClient:... ...established financial markets company is looking for a hands-on Data Engineer to join their IT Infrastructure team. This is a 50/50 role - you...Talener
New York, NY1 day ago- ...all.Who You’ll Work WithAt Slalom, we co-create custom software, data, AI, and cloud solutions with clients who are ready to... ...products, experiences, and organizations.Our Data Architecture & Engineering team sees data as the foundation for decision-making, artificial...Temporary workWork at officeLocal area
Slalom
New York, NY3 days ago - ...motivated candidate to join our talented Team. Top 3 Must Have Skills:Informatica workflow design and implementation requiredAWS data engineering (Glue, Lambda, EventBridge Cradle, S3) highly preferredFormer Informatica experience, Databricks, SnowflakeNice to Haves:...Work at office
Ampcus
New York, NY3 days ago - ...Data Engineers – Global Investment Firm | New York & London Build the data platform behind trading, research and risk at a top-tier investment firm. My direct client, a premier global investment firm is investing heavily in its data. The CTO has a big mandate to modernise...Full timeVisa sponsorship
$30 Global Investment Firm
New York, NY11 hours ago - ...The Role To build the data foundation that powers Stuut's intelligence layer. You'll work closely with our product and engineering teams to transform raw financial data into actionable insights that help our customers get paid faster. This is a foundational role, you...Full timeFlexible hours
Stuut
New York, NY1 day ago - ...COMPANY Global Asset Manager with over $50B of AUM. JOB TITLE Data Engineer RESPONSIBILITIES Own end-to-end data workflows that move, transform, and surface pricing, security, and reference information across the firm. Connect third-party data feeds...Full time
Wall Street Careers®
New York, NY5 days ago - ...Overview Do you have the right skills and experience for this role Read on to find out, and make your application. The Lead Data Engineer will own the design, development, and maintenance of robust data architecture and pipelines leveraging cloud-based technologies,...
THE PHOENIX GROUP
New York, NY27 days ago $95k - $154k
...Job Description Job Description Java Data Career Path Keep Your Options Open Not sure whether to choose software development... ...SQL, full-stack development, data analytics, data science, data engineering, BI, and ML/AI. This opportunity is ideal for candidates who...Full timeFlexible hoursSynergisticIT
New York, NY8 days ago$150k
...Data Engineer – Quantitative Trading Location: New York City (Hybrid) Salary: Up to $150,000 Base + Performance Bonus Employment Type: Full-Time About the Opportunity We're partnering with an established, global multi-strategy hedge fund seeking a talented...Full timeRadley James
New York, NY4 days ago$150k - $250k
...Data Engineer - $150k - $250k Base ($200k - $400k TC) – NYC/ Chicago/ London (Hybrid) – Prop Trading Overview We are currently partnered with a leading global proprietary trading firm seeking an experienced Data Engineer to join their growing technology function...Intec Select
New York, NY4 days ago- ...capture, organize and synthesize private conversations into source-backed knowledge a firm can build on. We are now hiring a Data Engineer, based in New York. You will build the pipelines everything else depends on: ingesting conversations and documents, keeping...Full timeImmediate start
Syntrace
New York, NY11 hours ago - ...Job Title: Senior Data Engineer Duration: 6 months contract to Perm Location: New York, NY 10001, (onsite) Tech Stack: Python, Java, Spark, AWS, Kubernetes, Airflow, Glue, EMR, Athena, Kinesis, Parquet, Iceberg, CI/CD. About the Role We are seeking a Lead...Permanent employmentContract work
The Judge Group
New York, NY4 days ago $62k - $80k
...maintaining, and operating integrations, reporting pipelines, and data transformation systems. Qualifications: ● Passion for... ...operational & performance issues. ● Work with architecture/engineering leads and other teams to ensure quality solutions are...Full timeVisa sponsorshipWork visaBeaconFire Inc.
New York, NY11 hours ago$40 - $50 per hour
Our client, a leading global luxury organization, is seeking a motivated and detail-oriented Data Engineer to join its growing North American Data team in New York City, with a hybrid schedule requiring four days onsite and one day remote per week. This individual...Temporary workWork at officeRemote work1 day per weekPyramid Consulting Group, LLC
New York, NY11 hours ago$180k - $200k
...Data Engineer Location: New York, NY (On-site) Comp: $180k - $200k + Equity Industry: FinTech / AI Who you'll join An early-stage fintech building a production-grade data platform for public markets. The data team is small, works close to the product,...Full timeOpen Select
New York, NY11 hours ago- ...Data Engineer Location: NYC- 3 days on site downtown NYC (final onsite interview) Duration: It might get extended past 6 months Key Responsibilities: Design, develop, and maintain data marts tailored to the specific needs of the insurance business. Develop...Full time
TALENDICA
New York, NY11 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- data engineer contract New York, NY
- entry level big data engineer New York, NY
- big data engineer New York, NY
- entry level data engineer New York, NY
- senior data engineer New York, NY
- big data cloud engineer New York, NY
- azure data engineer New York, NY
- senior data center engineer New York, NY
- junior data engineer remote New York, NY
- data engineer machine learning New York, NY