Senior Data Engineer (Databricks)
Robert Half
A leading infrastructure and transportation group is seeking a hands-on Senior Data Engineer to architect and build our next-generation Enterprise Reporting & Data Warehouse (ERDW.Next) on Databricks. Acting as the hands-on technical owner, you will drive target-state design, medallion architecture (Delta Lake), and legacy migrations off SQL Server/Synapse while remaining actively in the codebase. You will partner with our Enterprise Architect, Power BI team, business users, and offshore delivery partners across finance, construction, and safety domains.QUALIFIED CANDIDATES SHOULD HAVE EXPERIENCE WITH:Serving as a Databricks SMEERP integrations (strong plus)Python / PySparkPerformance tuning and optimizationDatabricks maintenance, including VACUUMData governance and best practicesSemantic modelingRESPONSIBILITIESArchitecture & Strategy: Design the ERDW.Next lakehouse (medallion/gold layer star schema) and govern data modeling, batch/streaming, and Delta Live Tables standards.Build & Migration: Write production-grade PySpark, Spark SQL, and Delta Live Tables pipelines orchestrated via Databricks Workflows. Re-engineer legacy SSIS/T-SQL/Synapse logic and ingest ERP data (JD Edwards, Anaplan) using CDC and Auto Loader.Platform Operations: Optimize cost/performance using Photon, Liquid Clustering, and OPTIMIZE. Manage CI/CD pipelines via Git and Databricks Asset Bundles while maintaining strict SLAs.Governance & AI: Implement Unity Catalog governance (entitlements, lineage, audit) and curate Databricks Genie Agents for natural-language analytics.Partner & Legacy Management: Support legacy platforms during transition and maintain code quality standards across offshore partner teams. Leverage agentic AI coding tools safely to accelerate delivery.
Vacancy posted 11 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer (Databricks) in Morristown, NJ vacancy
- We are looking for a Sr. Data Engineer We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines... ...cost-efficiency Build and maintain ETL/ELT processes using Databricks as the primary platform Monitor pipeline health, troubleshoot...DatabricksSenior
$124k - $280k
...Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced... ...current and future business needs. As a Senior Manager you lead large projects,... ...Snowflake Core, Snowflake Architect, Databricks Data Engineer Associate] is a plus-...DatabricksSeniorFull timeH1b- Job Title: Data Engineer Job ID: 2023-11994 Job Location: Morris Plains, NJ (remote to start) Job Travel Location(s): # Positions: 2... ...(S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch) Databricks (Delta lake, Notebooks, Pipelines, cluster management, Azure/...DatabricksWork experience placementRemote work
- ...client view, and market view to provide technically rigorous, commercially actionable insights. The role leverages AI-enabled approaches and modern tooling such as Databricks and Python to speed analyses while upholding actuarial controls. #J-18808-Ljbffr Guy CarpenterDatabricksSenior
- Job Summary The Lead Data Engineer will focus approximately 70% on data engineering and 30% on analytical responsibilities, combining deep Databricks and PySpark expertise with strong analytical capabilities and finance or payroll domain experience. The role will design...Databricks
- A leading provider of F&I partnership services is seeking a Senior Data Engineer for their Parsippany office. The successful candidate will lead the design and development of data architecture and pipelines to support data-driven initiatives. A Bachelor’s degree is required...SeniorWork at office
- Data Engineer Choosing Capgemini means choosing a company where you will be empowered to shape... .... Familiarity with Spark, Databricks, Snowflake, or similar data technologies... ...licenses, Relevant experience and skills, Seniority and performance, Market and business consideration...DatabricksPermanent employmentFull timeContract workLocal area
- ...Role Name: Senior Cloud Data Engineer Location: Whippany NJ Duration: 03 Months JOB DESCRIPTION: *Design and implement scalable, secure, and reliable data pipelines using cloud-native technologies (e.g., AWS, Azure, GCP). *Develop ETL/ELT processes...Senior
eTeam
Whippany, NJ4 days ago $125k - $145k
...positions are fully on-site in Parsippany, NJ. Job Summary The Data Engineer leads the design, development, and maintenance of scalable and... ...engineers, and drives innovation and best practices. The Senior Data Engineer collaborates cross‑functionally to align data solutions...SeniorFull timeLocal areaRemote work$124k - $280k
...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data... ...Azure Data Engineer Associate, Snowflake Core, Snowflake Databricks Data Engineer Associate] is a plus Proficient in Python...DatabricksSeniorH1bPwC
Florham Park, NJ4 days ago$77k - $202k
...Machine Learning Developer- Senior Associate, you will play a pivotal... ...role in transforming raw data into actionable insights, enabling... ..., algorithms, and software engineering to build and deploy AI and... ...Google Cloud, Microsoft Azure, Databricks, Snowflake, or related data...DatabricksSeniorFull timeH1bPwC
Florham Park, NJ5 days ago- ...Establish strong relationships with C-level and senior executives of clients and prospects... ...~ Bachelor’s degree, MBA a plus (Data Science Degree preferred) ~ Demonstrated... ...Visualization tools preferredExperience with Databricks, Google Vertex or Claude code preferred...DatabricksSeniorFull timeWeekend workAfternoon shift
Dun & Bradstreet
Florham Park, NJ21 days ago $157k - $210k
...CoreWeave plans, sources, builds, and delivers data center capacity for our customers. We partner closely with Supply Chain, Product Engineering, Data Center Operations, and the... ...analytical findings and recommendations to senior leadership in a clear, actionable format....SeniorPermanent employmentFull timeCasual workWork at officeCoreWeave
Livingston, NJ1 day ago$100.79k - $160.26k
...career. Let’s see what we can achieve. Together. Summary The Data Engineer, Solutions & Data role designs, builds, and operates data... ...using Azure data technologies (e.g., Azure Data Factory, Azure Databricks, Azure Event Hubs, SSIS) to ingest, process, and deliver data...DatabricksWork at officeRemote workVisa sponsorship- Senior Data Engineer Bigdata, Java, Spark, Kafka - Berkeley Heights NJ- ApexST / Client - ONSITE - LOCAL/Nearby Experience in Java Programming and in Big data technologies with hadoop, spark, kafka, AZURE Keylent IncSeniorLocal area
- Senior Data Migration Specialist is needed to lead Windchill data migration projects in a highly regulated environment. The role requires extensive hands-on experience with Windchill PLM, data models, workflows, and configurations. The candidate will work on data mapping...Senior
- ...reach with deep expertise. Our Digital & Data Analytics practice drives growth and... ...place. Job Details: Job Title: Senior AI Engineer Location: Summit, NJ (Hybrid 2 days... ...with a cloud data platform (Snowflake, Databricks, or similar), orchestration (Airflow or...DatabricksSeniorContract work2 days per week
Staffworxs Inc
Summit, NJ3 days ago - Location: 100 percent remote Position: senior data engineer Contract: 6 months extendable or perm I Must have: programming language in either java, GO, or scala, spark, apache flink, kafka, and AWS Core Responsibilities: Setting up streaming pipelines, integrating/patching...SeniorPermanent employmentContract workRemote work
- Lead Data Engineer Location: Hybrid 3 times a week in Roseland, NJ (Relocation candidates are welcome) It revolves around DATAbricks, AWS not AZURE Must haves: AWS Databricks Lead experience- this can be supplemented for staff as well Python Pyspark Contact Center Experience...DatabricksWork experience placementRelocation
- Senior Data Engineer Location: Columbus, Ohio- need local Onsite: 4 days a week Contract: 6 months extendable (could go perm) Interview process: 1 video interview then onsite panel interview Duties and Responsibilities: Architecting, creating and maintaining data pipelines...SeniorPermanent employmentContract workLocal area
$182k - $242k
...Nasdaq: CRWV) in March 2025. Learn more at What You’ll Do The Data Engineering Team builds and operates the foundational data infrastructure... ..., and actionable at scale. About The Role We’re seeking a Senior Data Engineer to design and build the foundational datasets that...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$210k - $330k
...come make a difference at Fiserv.Job TitleVP, Data & Analytics EngineeringAbout your role:As VP, Data & Analytics Engineering, you will lead Data & Analytics Engineering... ...cloud data platforms such as Snowflake, Databricks, Microsoft Fabric, Amazon Redshift, Google BigQuery...DatabricksFull timeWork at officeMonday to FridayFiserv
Berkeley Heights, NJ4 days ago- ...services group is seeking a Senior Power BI Developer to design... ...for the Enterprise Reporting & Data Warehouse (ERDW) platform. This... ...—turning complex data from Databricks and other sources into accurate... ...Strategy: Partner with Data Engineering to shape data from Databricks...DatabricksSenior
- ...regarded researchers, analysts, data scientists and strategists... ...including model design, feature engineering, validation, and deployment.... ...tools such as Azure ML, Databricks, and MLflow. Experience presenting... ...methods and findings to senior or executive audiences. Exposure...DatabricksFlexible hours
$119k - $218.3k
Position Summary Senior Consultant - Capital Markets Surveillance Technology & Implementation... ...knowledge, surveillance expertise, data analysis, and implementation experience... ...and market data using SQL, Python, Databricks, Informatica, or similar tools to support...DatabricksSenior$109.5k
...AbbVie, please visit us at Follow @abbvie on LinkedIn, ( Facebook, Instagram ( , X ( and YouTube. ( Job Description A team of data scientists with a unique blend of Business, Scientific, and Machine Learning expertise who seek to: Unleash the full potential of...SeniorLocal areaAbbVie
Florham Park, NJ5 days ago- ...AbbVie, please visit us at . Follow @abbvie on LinkedIn, Facebook , Instagram , X and YouTube. Job Description The Data Engineer will design and build scalable data-pipelines across initiatives such as agentic trail design, digital twins and other modeling...Full timeTemporary workLocal area
AbbVie Inc.
Florham Park, NJ5 days ago - Role : Data Engineer Location Madison , NJ (Hybrid) Job Summary Seeking an Associate Principal experienced in Python, Java, and Azure Data Factory to lead advanced data solutions. Job Description Design and implement data pipelines with Azure Data Factory Build scalable...
$169.32k - $211.65k
...As a Lead Data Scientist at Solstice, you will leverage deep expertise in data science to drive transformative analytics initiatives... ...as pandas, scikit-learn, TensorFlow/PyTorch; experience with Databricks or Azure Cloud ML services. ~ Strong grasp of statistical...DatabricksFull timeTemporary workWork experience placementWorldwideRelocation packageFlexible hoursSolstice Advanced Materials
Morris Plains, NJ2 days ago- Education Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field. Job Description We are looking for a motivated and detail-oriented Data Engineer to join our team. This is a great opportunity for recent graduates to gain hands‑on...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer (Databricks). Be the first to apply!
Related searches
- finance data engineer Morristown, NJ
- senior grant accountant Morristown, NJ
- senior tax Morristown, NJ
- senior consulting engineer Morristown, NJ
- senior dynamics crm developer Morristown, NJ
- senior brand strategist Morristown, NJ
- sr accountant Morristown, NJ
- senior medical science liaison Morristown, NJ
- senior property accountant Morristown, NJ
- senior software engineer remote Morristown, NJ