Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer

Full-time

Wise Skulls

Hiring: Lead Data Engineer – Databricks | Manhattan, NY | Hybrid | Remote Also Available

We're looking for an experienced Lead Data Engineer with strong hands-on expertise in Databricks, SQL, Python, and PySpark to design and optimize scalable data pipelines and enterprise data platforms. The ideal candidate will provide technical leadership and implement data engineering best practices to support analytics, digital products, and AI-driven use cases.

Location: New York, NY (3 days/week or US Remote)

Experience: 6–12 Years

Interview Process: 3 Rounds, Including One Onsite Round in NY/NJ or at Any Client Office Across the US

Work Authorization: USC & GC Candidates Only

Key Skills:

  • 6+ years of data engineering experience with substantial hands-on Databricks expertise
  • Strong proficiency in SQL, Python, and PySpark
  • Experience designing and developing scalable data pipelines using Medallion Architecture
  • Strong understanding of Databricks Lakehouse architecture, Delta Lake, and Unity Catalog
  • Experience with batch and incremental data processing, workflow orchestration, and data transformation
  • Expertise in SQL query optimization, distributed processing, and performance tuning
  • Experience with data quality, observability, lineage, and production troubleshooting
  • Familiarity with Git, CI/CD, and production deployment practices
  • Experience with AWS services, particularly S3, is a plus
  • Knowledge of Auto Loader, Structured Streaming, CDC, Databricks Asset Bundles, or Apache Airflow is preferred
  • Databricks Data Engineer Associate or Professional certification is a plus
  • Experience with streaming, clickstream, or advertising datasets is an added advantage

What We're Looking For:

A technically strong Lead Data Engineer who can build production-grade Databricks solutions, optimize data pipelines for performance and cost efficiency, lead solution design and code reviews, and mentor engineers while delivering scalable and reliable data platforms.

Interested? Apply now or DM us to explore this opportunity!

You can share resumes at View email address on click.appcast.io

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineer in Manhattan, KS vacancy
  •  ...Data Engineer Location: Manhattan, NY Schedule: Hybrid | 3 Days Onsite, 2 Days Remote A growing consumer products organization is seeking a Data Engineer to play a critical role in modernizing and scaling its enterprise data and analytics environment. This individual... 
    Suggested
    Full time
    Remote work

    Tenth Revolution Group

    Manhattan, KS
    2 days ago
  •  ...Hi We have an urgent role of Data & AI Security Engineer / Architect (Staff Augmentation). URGENT HIRE! Data & AI Security Engineer / Architect (Staff Augmentation) Hybrid: 3 days per week on site in Manhattan. On-call: 1 week every 2 months. Must... 
    Suggested
    Full time
    3 days per week

    Amtex Systems Inc

    Manhattan, KS
    16 hours ago
  • $74k - $111k

     ...Picture a Data Scientist role where Strategic Planning expertise is the floor, not the ceiling, and CloudTech Solutions in Manhattan, KS is building exactly that. You supply 3 years and Vertex AI; CloudTech Solutions supplies $74,000 - $111,000, a Manhattan home, and... 
    Suggested
    Flexible hours
    Shift work
    Night shift

    Energy Innovation: Policy and Technology LLC

    Manhattan, KS
    3 days ago
  •  ...across the United States, enabling us to build a team of exceptional talent wherever they are located. We're looking for a Data & AI Engineer to help accelerate adoption of AI and shape how Arizent uses data and AI across our business. Reporting directly our Senior... 
    Suggested
    Remote job
    Full time

    arizent

    Manhattan, KS
    2 days ago
  •  ...JD- Must-Have Skills: ~8+ years of backend engineering experience. ~ Strong hands-on experience with Java, Spring Boot, and Microservices...  .../CQL skills and experience handling large volumes of customer data. ~ Experience with agentic coding tools (Claude Code, OpenAI... 
    Suggested

    Samson Software Solutions, Inc.

    Manhattan, KS
    1 day ago
  • US Citizen or Green Card holders only/ No Corp to Corp or 3rd party agencies Java Microservices Developer – AWS Position Overview We are seeking an experienced Java Developer to support and enhance our existing desktop applications and backend microservices ...

    The Custom Group of Companies

    Manhattan, KS
    20 hours ago
  •  ...Role: AZURE Data Architect Cloud Environment: AZURE Location: Manhattan, NY (Hybrid 3 days a week to office) Role Summary...  ...line with client strategy • Partner with AI Architect and Data Engineers to enable ML and AI workloads • Review designs and code for... 
    Full time
    Work at office
    3 days per week

    CloudIngest

    Manhattan, KS
    4 days ago
  • Role: Java Architect Location: Manhattan NY - Hybrid Duration: Contract 12+ months Job Description: Architect end-to-end enterprise solutions across on-premises, off-premises, and cloud-native environments. Collaborate with Principal Architects and senior...
    Full time
    Contract work

    Global Business Ser. 4u

    Manhattan, KS
    2 days ago
  •  ...Description This is a full-time role for a Founding Machine Learning Engineer, located in Manhattan, NYC. The Founding ML Engineer will...  ...designs, and complement real-world datasets with synthetic data. •⁠ ⁠Collaborate with top optical engineers and researchers to... 
    Full time

    Photonium

    Manhattan, KS
    20 hours ago
  •  ...Data Entry Operator | Junior (Remote) Manhattan, KS, United States Job Openings Data Entry Operator | Junior (Remote) Important: You Will Receive An Email Within Next 2 Minutes After Applying, Check Your Inbox or Spam Folder For Next Steps. A Data Entry Clerk,... 
    Remote job

    Only Data Entry

    Manhattan, KS
    2 days ago
  •  ...circumstances. Relocation assistance is not available for this position. About the Role The Principal AI Engineer sits at the intersection of software engineering, data science, platform architecture, and AI governance. You will be the technical owner of how AI/ML... 
    Full time
    Work at office
    Remote work
    Relocation package

    Phizenix

    Manhattan, KS
    2 days ago
  • $200k - $250k

     ...Staff Platform Engineer (AWS / Kubernetes / Terraform) New York City – 4 Days Onsite | $200,000 – $250,000 Base + Equity Want to architect...  ...operate the platform behind mission-critical AI and financial data products, rather than own one narrow part of an established... 
    Full time
    Work at office

    IT Recruitment Solutions

    Manhattan, KS
    2 days ago
  •  ...principles. ~ Demonstrated ability to establish and enforce architecture standards, coding guidelines, technical quality gates, and engineering best practices. ~ Proven experience guiding enterprise solutions from requirements and architecture design through production... 
    Full time
    Contract work

    Seneca Resources

    Manhattan, KS
    1 day ago
  •  ...for a detail-oriented, results-driven, and proactive Business Analyst / Project Manager with 15+ years of experience in Healthcare, Data Processing, and Information Technology. The ideal candidate will have strong analytical and technical skills, excellent... 
    Contract work

    NLB Services

    Manhattan, KS
    2 days ago
  • $600 per week

    Manhattan Christian College is looking for a detail-oriented part-time Office Administrative Assistant in Manhattan, KS. The role involves data entry, managing communications, and clerical support for efficient operations. Candidates should have strong organizational and... 
    Part time
    For contractors
    Work at office

    Manhattan Christian College

    Manhattan, KS
    2 days ago
  •  ...opportunity for someone who enjoys digging into vulnerability data, determining what represents meaningful risk versus scanner noise...  ...in vulnerability management, exposure management, security engineering, or a related area. ~ Hands-on experience performing vulnerability... 
    Full time

    Optomi

    Manhattan, KS
    3 days ago
  •  ...Software Engineer | Manhattan, NYC – In Office | Competitive Base + Equity | ASAP Start We’re partnering with a seed-stage fintech building...  ...experienced engineers, building across backend services, APIs, data infrastructure and cloud systems. You’ll influence architecture,... 
    Full time
    Work at office
    Immediate start

    Albert Bow

    Manhattan, KS
    2 days ago
  •  ...fast-growing startup building creator tools is hiring a Full Stack Engineer to design, build, and scale core product features on a modern...  ...Strong systems design experience : architecting scalable services, data models, and APIs, and making smart tradeoffs as a product grows... 
    Full time

    arcadia

    Manhattan, KS
    20 hours ago
  • $165k - $250k

     ...intersection of real-time robotics control, distributed agent orchestration, and compiled neural inference. As one of our early engineers, you'll work on the core systems that translate camera input into a software representation of the physical world, orchestrate... 
    Work at office
    3 days per week

    Mbodi AI

    Manhattan, KS
    3 days ago
  • $75 - $85 per hour

     ...Intellibus designs and engineers technology platforms for established FinTech and financial-services firms. We build production-grade systems...  ...solve complex business problems through software engineering, data, and emerging technologies. We are looking for engineers who... 
    Full time

    Intellibus

    Manhattan, KS
    16 hours ago
  • $240k

     ...Staff Full Stack Engineer | AI Healthtech | NYC | Up to $240k + Equity The Company I'm working with a fast-growing Series B healthcare...  .... Their platform combines large-scale backend systems, data-heavy workflows and AI to help healthcare organisations improve... 
    Full time
    3 days per week

    Refactor.

    Manhattan, KS
    1 day ago
  • $200k - $250k

     ...Principal Software Engineer | New York, NY (Hybrid) | $200,000 to $250,000 base plus equity I am recruiting a Principal Software Engineer for a venture-backed healthcare company in New York City. They are moving from an outsourced engineering team to a small in-house... 
    Full time
    H1b
    Work at office
    Remote work
    3 days per week

    OmniTek Recruitment

    Manhattan, KS
    4 days ago
  • $90k - $120k

     ...Forward Deployed Engineer (AI / TypeScript) New York City, NY, Manhattan (Minimum 4 Days per Week in Office) $90,000–$120,000 + Equity Are you a Software, Solutions or DevOps Engineer who enjoys working directly with customers and taking technical projects from... 
    Full time
    Work at office

    Rise Technical

    Manhattan, KS
    4 days ago
  • $160 per hour

     ...AMBITIOUS FOUNDING iOS ENGINEER — Start Up NYC Some products you build. Some you help scale into something huge. Every so often, you...  ...Objective-C Experience working with REST APIs and asynchronous data Comfortable working in a fast-moving start-up environment... 
    Full time
    Work at office
    Night shift

    Initi8 Recruitment

    Manhattan, KS
    4 days ago
  • $350k

     ...UI Engineer sought to join a small, exceptionally fast-moving engineering team designing an AI-native consumer product which is backed by a very well-known technology group. There is a salary up to $350K on offer here, so we are only interested in exceptional candidates... 
    Full time
    Visa sponsorship

    IT Recruitment Solutions

    Manhattan, KS
    2 days ago
  • $130k - $200k

     ...Ambitious Full Stack Engineer (Backend Leaning) | Build From 0 → 1 | NYC The Opportunity Billions of interactions. A small, sharp...  ...scale problems. At billions of interactions, query performance, data modeling and system design have a direct effect on the business.... 
    Full time
    Internship
    Work at office

    Initi8 Recruitment

    Manhattan, KS
    4 days ago
  •  ...Expense Management & Cost Optimization ~ ServiceNow & Telecom Asset Reconciliation ~ Financial Analysis, Budgeting & Forecasting ~ Data Analysis, Reporting & Dashboards ~ Process Improvement & Stakeholder Coordination Required Qualifications ~10+ years of... 
    Full time

    Seneca Resources

    Manhattan, KS
    2 days ago
  • About the Role: Title: Senior Salesforce Developer Location: Manhattan, NY - 5 Days onsite Required Skills: ~8+ years of Salesforce Developer experience . ~ Hands-on experience with Apex triggers. ~ Hands-on experience with Lightning components. ~ Strong...
    Full time

    PTR Global

    Manhattan, KS
    2 days ago
  • $38 - $45 per hour

     ...risks within banking operations, ensuring processes are running smoothly and following established guidelines. Review financial data, business processes, and internal procedures to identify areas for improvement and potential issues. Assist with testing internal... 
    Full time
    Immediate start
    Remote work
    3 days per week

    Turn2Partners

    Manhattan, KS
    16 hours ago
  •  ...entertainment studio of the future. Looking for AI filmmakers, data analyst, product manager, producers. Join us! Description Tasks...  ...engage and convert. Must-have: A senior or staff-level engineer, or a founder or early engineer who has carried a production system... 
    Full time
    Trial period

    PRIMAL AI

    Manhattan, KS
    a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!