Databricks Engineer
United IT
Databricks Engineer
Design, develop, and deploy Databricks jobs to process and analyze large volumes of data.
Collaborate with data engineers and data scientists to understand data requirements and implement appropriate data processing pipelines.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
Demonstrated proficiency with Data Analytics, Data Insights
Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process
Leverage SQL, programming language (Python or similar) and/or ETL Tools (Azure Data Factory, Data Bricks, Talend and SnowSQL) to develop data pipeline solutions to ingest and exploit new and existing data sources.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Skills:
• 10+ years - Enterprise Data Management
• 10+ years - SQL Server based development of large datasets
• 5+ years with Data Warehouse Architecture, hands-on experience with Databricks platform. Extensive experience in PySpark coding. Snowflake experience is good to have
• 3+ years Python (numpy, pandas) coding experience
• 3+ years’ experience in Finance / Banking industry – some understanding of Securities and Banking products and their data footprints.
• Experience with Snowflake utilities such as SnowSQL and SnowPipe - good to have
• Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
• Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills
• Capable of discussing enterprise level services independent of technology stack
• Experience with Cloud based data architectures, messaging, and analytics
• Superior communication skills
• Cloud certification(s)
• Any experience with Regulatory Reporting is a Plus
Education
• Minimally a BA degree within an engineering and/or computer science discipline
- ...comContact Phone: (***) ***-****Company: HAN Staffing Job Title: Data Engineer - FullStory Experience Mandatory Location: Whippany, NJ (... ...platforms is required. Experience with tools like Snowflake , Databricks , or Tableau is a plus. Experience: 8+ years in Data...Databricks
- ...Brillio in Edison, NJ seeks a Databricks Architect to design and deliver enterprise-scale data and AI platforms. You will lead architecture across data ingestion, processing, and analytics, aligning with business goals and governance. The ideal candidate brings 12–15...Databricks
Brillio 2
Edison, NJ5 days ago - ...Email: ****@*****.*** Phone: (***) ***-****Company: HAN Staffing We are seeking a highly skilled and motivated Quality Engineer with expertise in AWS, artificial intelligence (AI), resiliency, and performance testing. The ideal candidate will possess a...Suggested
- Job ID: 21013505Reference Number: 23-02102Title: GCP/Databricks Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2023-12-21Company: HAN StaffingGCP/Databricks Data EngineerDatabricks
- ...data platforms. This role requires extensive expertise in data architecture and hands-on experience with cloud technologies like Databricks and Google Cloud, focused on delivering enterprise-scale AI solutions. The ideal candidate will drive initiatives in data and AI...Databricks
Brillio 2
Edison, NJ1 day ago - ...and building smart operational frameworks for DataOps and MLOps. The ideal candidate has over 14 years of experience, with expertise in Databricks, Azure, and data governance. This role offers a dynamic environment focused on performance and scalability. #J-18808-LjbffrDatabricks
TechDoQuest
Edison, NJ4 days ago - ...architecture to roll-out)Solid experience in Azure / other public clouds (Azure preferred) and cloud-based data platforms such as Databricks and Snowflake - involving various data services, cost / performance trade-offs, architecture patterns / choices, etc. Experience...DatabricksFull timeWork at officeLocal area
- ...Data Management SME (Sr role)Help modernize Allied World's data engineering capabilities by building state-of-the-art data marketplace,... ...cloud-based data platform capabilities i.e. AWS, Azure, Databricks, Snowflake, etc.,Strong experience in building and managing team...DatabricksLocal area3 days per week
- ...technical designs and ensure solutions meet business needsConfigure and administer Informatica MDM software and integration with AWS and Databricks and plan for capacity.Develop and enforce data standards, models, and governance policies for master dataMentor and guide...DatabricksLocal area
- ...Deepak KumarContact Email: ****@*****.*** Phone: (***) ***-****Company: HAN Staffing Job Title - Senior Data Engineer w/d Databricks and Python Experience (5)Location: Plano, TX and Wilmington, DE - 5 days onsite role, no hybridLong Term Contract roleJob Description...DatabricksContract work
- ...Python scripting and should have used various libraries.our ExpertiseSoftware engineer/developer focused on engineer solutions using PySpark and Python for financial reporting using Databricks and AzureExperience on working in Cloud environment preferably Azurecreating...Databricks
- ...management and analysis solutions for Digital Pathology users worldwide. This includes but not limited to Indica lab's Halo, Amazon AWS, Databricks, Proscia's Concentriq. At least one year working in Agile environment e.g. familiar with User Stories vs Requirements Acts as...DatabricksWorldwide
- ...knowledge of Python frameworks and libraries, such as Django or Flask Experience with AWS cloud platforms including services like S3, Databricks, and Data Lake Storage Experience with continuous integration/continuous deployment (CI/CD) pipelines and tools Experience with...Databricks
- ...Data EngineerPrimary & Secondary Skill: We are looking for a highly skilled Data Engineer with strong experience in SQL, DBT, Python, Airflow, and Databricks. Job description:Strong proficiency in SQL and relational database concepts.Hands-on experience with DBT for data...Databricks
Omni Inclusive
Rahway, NJ5 days ago - Job ID: 28136329Reference Number: 26-00448Title: AWS Engineer (API Integration)Location: Iselin, NJ, 08830Posted Date: 2026-05-06Contact: Deepak KumarContact Email: ****@*****.*** Phone: (***) ***-****Company: HAN Staffing We are looking for an experienced...
- ...Job Description : This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing... ...integrity. Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data....Databricks
United IT Solutions
Iselin, NJ2 days ago $100k - $115k
DescriptionKforce has a client that is seeking a Data Engineer - Guidewire. This position is on-site once a month for 3-4 consecutive... ...initiatives* Build and optimize data solutions utilizing Azure Databricks, Azure Data Factory, Apache Spark, and Delta Lake technologies...Databricks- ...software design as it relates to Elasticsearch deployments or distributed computing / system architecture. Experience in systems engineering/administration experience with Elastic Stack clusters in elastic scaling cloud environments or on-premises implementations would...Work experience placement
- ...Athena, jupyter notebooks for querying file based systems. Experience in AWS services such as S3, EC2 Good to have - exposure in databricks platform, delta tables, unity catalog concepts, UI testing Knowledge of Machine learning models and their testing their output and...Databricks
- ...Phone: (***) ***-****Company: HAN Staffing Job Title: AWS Data Engineer (Python / PySpark) JD (Short): Seeking an AWS Data Engineer... ...optimizationSQL and data modelingPerformance tuning and troubleshootingGood to have: Experience with Databricks (Spark, Delta Lake, notebooks)Databricks
- ...native data platforms. Build cost-effective infrastructure in Databricks and orchestrate workflows using Databricks/ADF. Lead data... ...database architectures. Ability to work with Data Engineering teams, Data Management Team, BI and Analytics in a complex development...Databricks
TechDoQuest
Edison, NJ6 days ago - Mizuho in New Jersey is seeking a Data Engineer to design and build scalable data solutions for the enterprise using the modern data stack on Databricks. You will work on the Data Exchange and Abstraction Layer project to deliver reliable data products for reporting and...Databricks
- ...Contact: Deepak KumarContact Email: ****@*****.*** Phone: (***) ***-****Company: HAN Staffing As a Site Reliability Engineer at JPMorgan Chase within the Commercial & Investment Banking, you will solve complex and broad business problems with simple and straightforward...
- ...Experience Location : Whippany, NJ (Face to Face Interview) Duration : Contract Job Description: Need strong experience on python and Databricks Must have - Should be hands on in using python/spark, SQL for testing ETL/batch scripts. Should be hands on in analyzing and...DatabricksContract work
- Job ID: 24405778Reference Number: 24-01257Title: Mulesoft Engineer with Flex GatewayLocation: Iselin, NJ, 08830Posted Date: 2024-12-19Contact: Deepak KumarContact Email: ****@*****.*** Phone: (***) ***-****Company: HAN Staffing Job Title: Mulesoft Engineer...Flexible hours
- ...Title: Data Engineer Location: Hybrid 3 times a week too Iselin, NJ May Need to come onsite for final or an Apex Local office... ...3, CloudWatch) ETL/ELT Tools: AWS Glue, Python, PySpark, Databricks Programming Languages: Python, Java, Scala, SQL, HiveQL...DatabricksWork at officeLocal area
RIT Solutions, Inc.
Iselin, NJ4 days ago - ...modern data and AI platforms. The ideal candidate will bring deep expertise in Databricks or Google Cloud Platform, combined with hands-on Generative AI experience and strong data engineering fundamentals. You will define scalable data architectures, govern data...Databricks
- ...Email: ****@*****.*** Phone: (***) ***-****Company: HAN Staffing Job Summary:We are seeking a highly skilled Sr. AWS Engineer to join our team. The ideal candidate will have hands-on experience designing, deploying, and managing cloud infrastructure on AWS...
- ...NJ Job Summary: We are seeking highly skilled Azure Data Engineer with strong expertise in SQL, Python, Datawarehouse, Cloud ETL... ...: Build and maintain scalable ETL/ELT pipelines using Databricks. Leverage PySpark/Spark and SQL to transform and process large...Databricks
United IT
Iselin, NJ3 days ago - ...Description: Data Modeler / BI Developer (Qlik Sense, Power BI, DBT, Databricks) Role Overview We are seeking a highly skilled Data... ..., workflows, Delta Lakes). Solid understanding of data engineering principles , layered architectures, and ELT/ETL concepts....Databricks
Omni Inclusive
Rahway, NJ3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Engineer. Be the first to apply!
