Databricks Engineer
United IT
Databricks Engineer
Design, develop, and deploy Databricks jobs to process and analyze large volumes of data.
Collaborate with data engineers and data scientists to understand data requirements and implement appropriate data processing pipelines.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
Demonstrated proficiency with Data Analytics, Data Insights
Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process
Leverage SQL, programming language (Python or similar) and/or ETL Tools (Azure Data Factory, Data Bricks, Talend and SnowSQL) to develop data pipeline solutions to ingest and exploit new and existing data sources.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Skills:
• 10+ years - Enterprise Data Management
• 10+ years - SQL Server based development of large datasets
• 5+ years with Data Warehouse Architecture, hands-on experience with Databricks platform. Extensive experience in PySpark coding. Snowflake experience is good to have
• 3+ years Python (numpy, pandas) coding experience
• 3+ years’ experience in Finance / Banking industry – some understanding of Securities and Banking products and their data footprints.
• Experience with Snowflake utilities such as SnowSQL and SnowPipe - good to have
• Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
• Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills
• Capable of discussing enterprise level services independent of technology stack
• Experience with Cloud based data architectures, messaging, and analytics
• Superior communication skills
• Cloud certification(s)
• Any experience with Regulatory Reporting is a Plus
Education
• Minimally a BA degree within an engineering and/or computer science discipline
- ...comContact Phone: (***) ***-****Company: HAN Staffing Job Title: Data Engineer - FullStory Experience Mandatory Location: Whippany, NJ (... ...platforms is required. Experience with tools like Snowflake , Databricks , or Tableau is a plus. Experience: 8+ years in Data...Databricks
- ...Email: ****@*****.*** Phone: (***) ***-****Company: HAN Staffing We are seeking a highly skilled and motivated Quality Engineer with expertise in AWS, artificial intelligence (AI), resiliency, and performance testing. The ideal candidate will possess a...Suggested
- Job ID: 21013505Reference Number: 23-02102Title: GCP/Databricks Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2023-12-21Company: HAN StaffingGCP/Databricks Data EngineerDatabricks
- ...architecture to roll-out)Solid experience in Azure / other public clouds (Azure preferred) and cloud-based data platforms such as Databricks and Snowflake - involving various data services, cost / performance trade-offs, architecture patterns / choices, etc. Experience...DatabricksFull timeWork at officeLocal area
- ...technical designs and ensure solutions meet business needsConfigure and administer Informatica MDM software and integration with AWS and Databricks and plan for capacity.Develop and enforce data standards, models, and governance policies for master dataMentor and guide...DatabricksLocal area
- ...Data Management SME (Sr role)Help modernize Allied World's data engineering capabilities by building state-of-the-art data marketplace,... ...cloud-based data platform capabilities i.e. AWS, Azure, Databricks, Snowflake, etc.,Strong experience in building and managing team...DatabricksLocal area3 days per week
- ...Python scripting and should have used various libraries.our ExpertiseSoftware engineer/developer focused on engineer solutions using PySpark and Python for financial reporting using Databricks and AzureExperience on working in Cloud environment preferably Azurecreating...Databricks
- ...Deepak KumarContact Email: ****@*****.*** Phone: (***) ***-****Company: HAN Staffing Job Title - Senior Data Engineer w/d Databricks and Python Experience (5)Location: Plano, TX and Wilmington, DE - 5 days onsite role, no hybridLong Term Contract roleJob Description...DatabricksContract work
- ...management and analysis solutions for Digital Pathology users worldwide. This includes but not limited to Indica lab's Halo, Amazon AWS, Databricks, Proscia's Concentriq. At least one year working in Agile environment e.g. familiar with User Stories vs Requirements Acts as...DatabricksWorldwide
- ...knowledge of Python frameworks and libraries, such as Django or Flask Experience with AWS cloud platforms including services like S3, Databricks, and Data Lake Storage Experience with continuous integration/continuous deployment (CI/CD) pipelines and tools Experience with...Databricks
- Job ID: 28136329Reference Number: 26-00448Title: AWS Engineer (API Integration)Location: Iselin, NJ, 08830Posted Date: 2026-05-06Contact: Deepak KumarContact Email: ****@*****.*** Phone: (***) ***-****Company: HAN Staffing We are looking for an experienced...
- ...Cloud Data Engineer This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for... ...and integrity. Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data. Experience...Databricks
$180k - $190k
...potential consistently garners them the Great Place to Work certification year after year.Databricks Architect Experience12-15 years of experience in Data Architecture, Data Engineering, Cloud Data Platforms, and AI/GenAI solutions, with proven experience designing and...Databricks- ...cloud platforms like Azure, AWS, or Google Cloud. Data Engineering : Strong understanding of data warehousing, data lakes, and... ...Data Platform: Strong experience with Cloud Data Platform like Databricks (preferred), Snowflake, Redshift, etc. Databricks Expertise...Databricks
- ...software design as it relates to Elasticsearch deployments or distributed computing / system architecture. Experience in systems engineering/administration experience with Elastic Stack clusters in elastic scaling cloud environments or on-premises implementations would...Work experience placement
- ...Athena, jupyter notebooks for querying file based systems. Experience in AWS services such as S3, EC2 Good to have - exposure in databricks platform, delta tables, unity catalog concepts, UI testing Knowledge of Machine learning models and their testing their output and...Databricks
- ...Phone: (***) ***-****Company: HAN Staffing Job Title: AWS Data Engineer (Python / PySpark) JD (Short): Seeking an AWS Data Engineer... ...optimizationSQL and data modelingPerformance tuning and troubleshootingGood to have: Experience with Databricks (Spark, Delta Lake, notebooks)Databricks
- ...****@*****.*** are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and... ...Experience with Hadoop ecosystem (Hive, HDFS).Experience with Databricks.Experience with Apache Kafka.Hands-on experience with Apache Airflow...Databricks
- Job ID: 24405778Reference Number: 24-01257Title: Mulesoft Engineer with Flex GatewayLocation: Iselin, NJ, 08830Posted Date: 2024-12-19Contact: Deepak KumarContact Email: ****@*****.*** Phone: (***) ***-****Company: HAN Staffing Job Title: Mulesoft Engineer...Flexible hours
- ...Contact: Deepak KumarContact Email: ****@*****.*** Phone: (***) ***-****Company: HAN Staffing As a Site Reliability Engineer at JPMorgan Chase within the Commercial & Investment Banking, you will solve complex and broad business problems with simple and straightforward...
- ...Job Title: Forward Deployed Engineer Location: Dallas, TX | Edison, NJ (Onsite Job) Employment Type: Contract Requirements(Job Description) Programming Fundamentals - Strong Python: OOP, async, typing, testing; production codebases Web / Frontend - JS/TS...Contract work
- ...Email: ****@*****.*** Phone: (***) ***-****Company: HAN Staffing Job Summary:We are seeking a highly skilled Sr. AWS Engineer to join our team. The ideal candidate will have hands-on experience designing, deploying, and managing cloud infrastructure on AWS...
- ...Experience Location : Whippany, NJ (Face to Face Interview) Duration : Contract Job Description: Need strong experience on python and Databricks Must have - Should be hands on in using python/spark, SQL for testing ETL/batch scripts. Should be hands on in analyzing and...DatabricksContract work
- ...Job Summary: \n We are seeking highly skilled Azure Data Engineer with strong expertise in SQL, Python, Datawarehouse, Cloud ETL... ...team \n \n Technical Skills: \n \n Strong expertise in Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture, Table...Databricks
- Job ID: 20213722Reference Number: 23-01199Title: Aws DevopsInfrastructure EngineerLocation: Iselin, NJ, 08830Posted Date: 2023-07-26Contact: Shyam MaramContact Email: ****@*****.*** Phone: (***) ***-****Company: HAN Staffing Aws Devops Infrastructure EngineerPA...For contractors
- ...questions, product prerequisites, product features, etc. Translate complex business requirements into Network solutions. Assist Pre Sales Engineers and Account Executives with designing Network solutions. Establish and maintain strong relationships with partners. Excellent...
$173.2k - $272.6k
...matter expertise on programming and reporting strategies, data engineering, and data flow across clinical data systems on more complex... ...managing cloud-based pipelines (e.g., Azure Data Factory, AWS Glue, Databricks).Demonstrated success in managing outsourced programming...DatabricksFull timeFor contractorsLocal areaFlexible hoursShift work- ...Role Databricks Architect Sr Data EngineerLocation Edison NJ Rmote Must Haves1 Candidate should have at 6 yrs of experience working on data workflow development in Azure stack with Databricks and ADF as Primary skill2 Strong understanding of Azure service components like...DatabricksWork experience placement
- ...scalable integrations to automate business processes using Boomi integrations. Qualifications 3 years of demonstrable experience with engineering complex Integration projects with SaaS & Business applications 2+ years of Hands-on and project experience in building Boomi...
$80k - $90k
...Forward Deployed Engineer Duration: Full Time Location: Milford, OH/Edison, NJ/Santa Clara, CA (Day 1 Onsite) Salary Range: $80,000-$90,000 Per Year Must Have Technical/Functional Must have hands-on programming experience in Python with strong coding and...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Engineer. Be the first to apply!




