Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Databricks Data Engineer

Inficare

Job Title: Senior Databricks Data Engineer Location: Remote Job Type: Contract Experience: 7+ years Job Overview We are seeking an experienced Senior Databricks Data Engineer with strong expertise in designing, developing, and optimizing large-scale data engineering solutions on the Databricks platform. The ideal candidate will have hands-on experience building enterprise-grade data pipelines, processing high-volume datasets, and delivering scalable analytics solutions using PySpark, Spark SQL, Apache Spark, and AWS cloud technologies. Key Responsibilities Design, develop, and maintain scalable data engineering solutions using Databricks, PySpark, Spark SQL, and Apache Spark Build and optimize end-to-end ETL/ELT pipelines integrating Databricks with AWS S3, Snowflake, Apache Airflow, and AWS Glue Process and transform large-scale structured and semi-structured datasets for enterprise reporting, analytics, and regulatory requirements Develop reusable frameworks for data ingestion, cleansing, transformation, validation, reconciliation, enrichment, and business rule implementation Implement data quality checks, monitoring, and governance controls Perform performance tuning and optimization of Spark applications and Databricks workloads Collaborate with stakeholders, architects, and analytics teams to deliver scalable solutions Support advanced analytics initiatives including customer segmentation, campaign analytics, AML/regulatory reporting, and data validation Required Skills Databricks and Lakehouse Architecture PySpark, Spark SQL, Apache Spark AWS S3, AWS Glue Snowflake Apache Airflow Data modeling, data warehousing, and big data processing Structured and semi-structured data formats: JSON, Parquet, Avro, CSV Data quality frameworks and monitoring solutions Strong SQL and data analysis skills Preferred Skills Experience in AML, regulatory reporting, compliance, or financial data domains CI/CD and DevOps practices for data engineering Delta Lake, Databricks Workflows, Unity Catalog Agile/Scrum delivery methodologies Location & Work Model Fully remote position. Engagement Details Inficare

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Databricks Data Engineer in New York, NY vacancy
  • Senior Databricks Data Engineer (Azure Databricks | Lakehouse | ETL/ELT) Austin, Texas (Hybrid - 3 Days Remote | Onsite Every Monday & Thursday) Experience: Minimum 12+ Years Mandatory Requirements • Databricks Certified Data Engineer (Associate or Professional) • Azure... 
    Databricks
    Senior
    Local area
    Remote work

    Delan Associates Inc

    New York, NY
    1 day ago
  • $180k - $220k

     ...COMPENSATION RANGE IN THE $180,000-$220,000 ANNUAL RANGE.*** Data Engineer develops and maintains Microsoft Fabric Lakehouse solutions,...  ...enterprise data platforms leveraging OneLake, Data Factory, Databricks, and Azure services. Develop scalable data ingestion,... 
    Databricks
    Senior

    DBI Staffing

    New York, NY
    13 days ago
  • $10k

     ...find a relationship, for all. About the Role:   As a Senior Data Engineer at Hinge, you will create essential data processes and...  ...Dataflow, BigQuery). and CI/CD technologies (CircleCI), Spark, Databricks Factors such as scope and responsibilities of the position... 
    Databricks
    Senior
    Work experience placement

    Hinge

    New York, NY
    a month ago
  •  ...compensation.Job DescriptionSenior Analytics Engineer OverviewThe Senior Analytics Engineer will lead...  ...Provide hands-on technical expertise in data modeling, statistical methodologies,...  ...tools; familiarity with Databricks and CI/CD pipelines.Experience defining... 
    Databricks
    Senior
    Remote work

    Green Key Resources

    New York, NY
    3 days ago
  • $140k - $155k

     ...Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy...  ...seeking a highly skilled and experienced Senior Data Engineer to join our dynamic...  ...users. Python/SQL Server/Snowflake/Databricks application development and system... 
    Databricks
    Senior
    Full time
    Temporary work
    Flexible hours

    Synechron

    New York, NY
    4 days ago
  • Senior Data Engineer A data technology company is looking for a Senior Data Engineer to help shape the next generation of its small business...  ...the story of millions of U.S. small businesses using Databricks SQL, PySpark, and MLflow Build on top of modern data infrastructure... 
    Databricks
    Senior

    Mission Staffing

    New York, NY
    1 day ago
  • Job Description: Senior ML Data Engineer Feature Engineering ETL Qualifications 7 years in data engineering and at least 4 years focusing...  ...preparation for ML Proven experience managing pipelines on Databricks using Apache Spark with a strong understanding of the... 
    Databricks
    Senior
    Remote job

    TriOptus LLC

    New York, NY
    1 day ago
  •  ...65ROLE OVERVIEWThe Equities Alternative Data team is responsible for sourcing, integrating...  ...experienced, pragmatic, and eager data engineer to join the team. This individual will...  ...experience with ClickHouse, Snowflake, Databricks, Trino, DuckDB, or similar analytical... 
    Databricks
    Senior

    Balyasny Asset Management

    New York, NY
    1 day ago
  • $180k - $210k

     ...000 A rapidly growing Fintech in NYC is scaling its data team and hiring a Senior Analytics Engineer. Join a growing data team to build and own the core...  ...One MPP warehouse (BigQuery, Snowflake, Redshift, or Databricks). BigQuery is the actual stack, but the others are fine... 
    Databricks
    Senior
    Contract work

    ConsultNet

    New York, NY
    3 days ago
  • Job Description Insight Global is seeking a Senior Data Engineer for a long-term contract opportunity supporting a large healthcare client...  ...The environment spans Azure and GCP, with significant use of Databricks, Python, PySpark, Spark SQL, and related data engineering... 
    Databricks
    Senior
    Remote job
    Long term contract
    Full time

    Insight Global

    New York, NY
    1 day ago
  • $200k - $275k

     ...The Role You will be Doctronic's first dedicated data engineer, and you will own the plumbing end to end: how data moves from our production...  ..., training datasets, notebook environments (SageMaker, Databricks, Jupyter) Experience with BI tooling (Metabase or similar)... 
    Databricks
    Senior
    Full time

    doctronic

    New York, NY
    7 days ago
  • Required Skills & Experience - 6+ years of experience as a Data Engineer (Big data technology, open table formats) \n-Proficiency in PySpark...  ...Google Cloud Platform (GCP)\n-2+ years of experience with Databricks (Azure)\n-Exposure to AI / ML building blocks within GCP\n-... 
    Databricks
    Senior

    Insight Global

    New York, NY
    6 hours ago
  • About the job Senior Data Engineer - Databricks Job Overview: We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for development and optimization of data pipelines, implementing robust data checks, and ensuring the accuracy... 
    Databricks
    Senior

    Inizio Partners

    New York, NY
    1 day ago
  •  ...achieve greater financial freedom. We’re looking for a Senior Manager, Data Engineering to lead and grow the team responsible for the data...  ...pipelines using tools such as EMR, Glue, Delta, Iceberg, Databricks and orchestration tools. ~ Hands-on experience designing... 
    Databricks
    Senior
    Full time
    Work at office
    3 days per week

    Stash

    New York, NY
    2 days ago
  • You’ll build and maintain data pipelines and datasets that support reporting, visualization...  ...and reusable datasets within a Databricks lakehouse environment Ingesting, validating...  ...reviewing code and mentoring other data engineer Requirements 7+ years of experience in data... 
    Databricks
    Senior

    Bitful Consulting

    New York, NY
    1 day ago
  • $175.5k - $180k

     ...leading the implementation of scalable data architectures for cutting-edge AI and agentic...  ...spearhead the design of complex feature engineering workstreams, ensuring our data assets...  ...modern frameworks (Spark, LangChain, Databricks, Dask, Airflow, Dagster, Kedro, etc.)Ability... 
    Databricks
    Senior
    Apprenticeship
    Easy work

    McKinsey & Company

    New York, NY
    3 days ago
  •  ...ResponsibilitiesOur Product DE organization is looking for a Senior Data Engineer reporting to the Senior Data Engineering Manager. You will...  ...framework or similar scheduling tools.Experience with Databricks and its APIs.Experience with modern databases (Redshift, Dynamo... 
    Databricks
    Senior
    Work at office
    Local area

    Atlassian

    New York, NY
    3 days ago
  •  ...combines Strategy, Experience & Design, Engineering and Managed Services. We build digital...  ...Practical action. Endless possibilities.As a Senior Data Engineer, AI & Agents, you will prepare...  ...data platform. You will operate across Databricks and Snowflake, converting source tables... 
    Databricks
    Senior
    Contract work

    Appnovation

    New York, NY
    1 day ago
  • Azure Data Platform Engineer We are looking for an experienced and solution-oriented Azure Data Platform Engineer to develop, operate, and optimize...  ...data platform. In this role, you will focus on Azure, Databricks, data infrastructure, and CI/CD, supporting multi-tenant... 
    Databricks
    Senior
    Remote work

    Rhenus Group

    New York, NY
    1 day ago
  • Job Title Design and develop scalable Big Data applications on distributed platforms to...  ...relationships across Product and Engineering. Able to influence and communicate effectively...  ...Data platforms, including EMR, Airflow, Databricks (Data Engineering & Delta) Experience... 
    Databricks
    Senior
    Local area

    Kloud9

    New York, NY
    1 day ago
  • $57 - $62 per hour

    Pay Range: $57.00hr - $62.00hr Job Overview: Our client is looking for an experienced Data Engineer with strong healthcare clinical data knowledge and hands-on expertise in Databricks and Snowflake. The candidate will work closely with stakeholders, the Data Architect,... 
    Databricks
    Senior
    Remote job
    Work experience placement

    Cynet Systems

    New York, NY
    1 day ago
  •  ...Designation: Hybrid - 3 days per week Technology, Data, AI and Ventures:Within the Tech, Data,...  ...York Life you will join a team of data engineers focused on delivering clean, well-...  ....• Strong working knowledge of Databricks, including SQL, notebooks, and distributed... 
    Databricks
    Senior
    Local area
    3 days per week

    New York Life Insurance Company

    New York, NY
    1 day ago
  •  ...or Master's degree in Computer Science, Data Science, Machine Learning, Statistics, Mathematics...  ...best practices. Experience with Azure Databricks, Google Cloud, and modern data science...  ...in data science and machine learning engineering. Additional Skills (Skills that are a... 
    Databricks
    Senior

    3B Staffing LLC

    New York, NY
    1 day ago
  • $128.01k - $152.18k

     ...with confidence.Job DescriptionAI-First Data Strategy for P&C Insurance Carrier |...  ...Insurance Data SolutionsWe are seeking a Senior Data Engineer to spearhead our transition to a...  ...modern data platforms (e.g., Snowflake; Databricks, big data, analytics) relevant to P&C... 
    Databricks
    Senior
    Full time
    Work at office
    Local area

    Argo Group

    New York, NY
    1 day ago
  •  ...Job Description Job Description Role: Senior Data Engineer (Databricks) Location: NYC, NY (or), Seattle, WA (or), Irvine, CA (or), Los Angeles, CA (Hybrid) Project description We are seeking a seasoned professional whose role sits at the intersection of platform... 
    Databricks
    Senior
    For contractors

    PamTen Inc

    New York, NY
    24 days ago
  •  ...Global Inc wanted to let you know about the job opportunity for Senior Data Engineer (AI) position if interested please share your updated...  ...environments, is experienced with large-scale data processing using Databricks, and can operate effectively within established enterprise... 
    Databricks
    Senior
    Remote job
    Contract work

    Saxon Global

    New York, NY
    1 day ago
  • $176k - $179.5k

     ...will design and manage scalable data pipelines and secure...  ...scientists, machine learning engineers, and industry experts to develop...  ...is flexibility to hire at the Senior Data Engineer I/II or Principal...  ...commonly used data platforms (Databricks, Databricks Asset Bundles,... 
    Databricks
    Senior
    Apprenticeship
    Easy work
    Shift work

    McKinsey & Company

    New York, NY
    1 day ago
  • Data Engineer Must Have Technical/Functional Skills Hands-on experience in building ETL using Databricks SaaS infrastructure. Experience in developing data pipeline solutions to ingest and exploit new and existing datasources Expertise in leveraging SQL, programming language... 
    Databricks
    Senior
    Full time

    JConnect Infotech

    New York, NY
    1 day ago
  • Senior Data Engineer We are looking for a highly skilled Senior Data Engineer with strong expertise in PySpark, Python, SQL, and database technologies...  .... Experience with distributed data systems (Spark, Databricks, Hive, or similar). Exposure to AI/ML workflows, including... 
    Databricks
    Senior
    Full time
    Local area

    E-Solutions

    New York, NY
    1 day ago
  • Merkle Science Data Engineer Role Merkle Science provides blockchain transaction monitoring...  ...Build incremental, idempotent pipelines on Databricks over billions of rows and tens of...  ...AML. How We Work You'll join a small, senior team where everyone owns their work end... 
    Databricks
    Senior
    Flexible hours

    Merkle Science

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Databricks Data Engineer. Be the first to apply!