Azure Data Engineer with Databricks Expertise
United IT
Azure Data Engineer With Databricks Expertise
Location: Iselin NJ, 6th Avenue NY (100% Day 1 onsite)
Must have: Databricks, Pyspark, Azure Cloud Services, Asset Bundle Technical Skills:
- Strong expertise in Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture, Table Triggers, Delta Live Pipelines, Databricks Runtime etc.)
- Proficiency in Azure Cloud Services.
- Solid understanding of Spark and PySpark for big data processing.
- Experience in relational databases.
- Knowledge on Databricks Asset Bundles and GitLab.
Key Responsibilities
- Data Pipeline Development:
- Build and maintain scalable ETL/ELT pipelines using Databricks.
- Leverage PySpark/Spark and SQL to transform and process large datasets.
- Integrate data from multiple sources including Azure Blob Storage, ADLS and other relational/non-relational systems.
- Collaboration & Analysis:
- Work closely with multiple teams to prepare data for dashboard and BI tools.
- Collaborate with cross-functional teams to understand business requirements and deliver tailored data solutions.
- Performance & Optimization:
- Optimize Databricks workloads for cost efficiency and performance.
- Monitor and troubleshoot data pipelines to ensure reliability and accuracy.
- Governance & Security:
- Implement and manage data security, access controls and governance standards using Unity Catalog.
- Ensure compliance with organizational and regulatory data policies.
- Deployment:
- Leverage Databricks Asset Bundles for seamless deployment of Databricks jobs, notebooks and configurations across environments.
- Manage version control for Databricks artifacts and collaborate with team to maintain development best practices.
Preferred Experience
- Familiarity with Databricks Runtimes and advanced configurations.
- Knowledge of streaming frameworks like Spark Streaming.
- Experience in developing real-time data solutions.
Certifications
- Azure Data Engineer Associate or Databricks certified Data Engineer Associate certification.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Azure Data Engineer with Databricks Expertise in Iselin, NJ vacancy
- ...Role : Azure Data Engineer with Databricks Expertise Location : Iselin NJ , 6th Avenue NY (100% Day 1 onsite) Must have : Databricks , Pyspark , Azure Cloud Services, Asset Bundle Technical Skills: • Strong expertise in Databricks (Delta Lake, Unity Catalog...Databricks
United IT Solutions
Iselin, NJ3 days ago - ...Azure Data Engineer Warren, New Jersey, United States Role & Responsibilities... ...rules in collaboration with governance teams.... ...underwriting, actuarial, billing). ~ Expertise in data modeling (... ...Microsoft Purview, Power BI, Databricks, or Azure Synapse. ~ Familiarity...Databricks
Inizio Partners
Warren, NJ12 hours ago - ...Data Engineer Location: Mississauga, ON / Montreal, QC / Iselin NJ... ...is for a Cloud Data engineer with a background in Python, Pyspark... ...along with business analyst expertise. Major Responsibilities:... ...and deploy Spark program in databricks environment to process and...Databricks
Sparktek
Iselin, NJ4 days ago - ...Cloud Data Engineer- Azure/Databricks/Snowflake Location - NYC, NY or Iselin, NJ 12+ months – hybrid 3 days in office / 2 days remote Key Requirements... ...SCD-related questions) MUST HAVE Hands-on experience with Databricks, ADF, and Snowflake platform setup and...DatabricksWork at officeRemote work
Saxon Global
Iselin, NJ4 days ago - ...looking for a highly skilled Data Engineer with strong experience in SQL, DBT, Python, Airflow, and Databricks. Job description: Strong... ...scripting and automation. Expertise in Airflow for workflow orchestration... ...with cloud platforms (AWS, Azure, or GCP) and data lakes ....Databricks
- ...Data Platform Engineer - Azure Admin Location: Iselin, NJ (Hybrid) Contract Skills: Data Platform... ...applications. Experienced working on Databricks workspaces, workload optimisation,... ...Bash, Python, Powershell). Experience with configuration management (e.g. Puppet...DatabricksContract work
United IT
Iselin, NJ4 days ago - ...in cloud platforms like Azure, AWS, or Google Cloud. Data Engineering : Strong understanding... ...Programming: Experience with programming languages like... ...Data Platform like Databricks (preferred), Snowflake,... ...Redshift, etc. Databricks Expertise : Deep understanding of...Databricks
3B Staffing LLC
Iselin, NJ4 days ago $106.9k - $176.5k
...shape your future with confidence. We... ...world. Technology – Data and Decision Science – Data Engineering – Senior We... ...Data Engineer with expertise in cloud data engineering... ..., specifically Databricks. The ideal... ...platforms (e.g., AWS, Azure, GCP). Collaborate...DatabricksSummer holidayFlexible hoursEY
Iselin, NJ12 hours ago$86.8k - $160.7k
...Remote position with the ability to travel to our NJ and NY... ...time. Position Summary : Data Engineer with previous experience in... ...of hands-on experience with Azure Databricks, Azure data factory including... ...required. ~ Proven expertise with Apache Spark, Delta Lakehouse...DatabricksWork experience placementWork at officeRemote workGREATER NEW YORK MUTUAL INSURANCE COMPANY
Edison, NJ2 days ago- A tech solutions company is seeking an Azure Databricks Engineer to provide expertise in data analytics and Databricks development. The role involves designing... .... Candidates should have over 5 years of experience with Azure Databricks and relational database technologies...DatabricksLocal areaRelocation
- Title Senior Data Engineer Location Iselin, NJ (Need Onsite day 1, Hybrid 3 days from... ...are seeking a skilled Data Engineer with expertise in Databricks, Snowflake, Python, Pyspark, SQL and... ...Preferred Qualifications Good Knowledge in Azure and Databricks in highly preferred....DatabricksContract workWork at office
- Senior Data Engineer with MDM Iselin, NJ (Onsite day 1, hybrid 3 days from office). Position... ...processing solutions using Kafka, Databricks, Snowflake, Azure Data Factory (ADF), and related... ...and domain-specific data standards. Expertise in Python, Pyspark, Kafka, microservices...DatabricksContract workWork at officeFlexible hours
- A global professional services firm is seeking a Manager of Data Engineering to lead in designing and implementing cloud analytics solutions utilizing Databricks. The ideal candidate will have expertise in data architecture and team management. Responsibilities include...Databricks
$125.5k - $230.2k
...shape your future with confidence. We... ...world. Technology – Data and Decision Science – Data Engineering – Manager We... ...a strong focus on Databricks. The ideal candidate... ...deep technical expertise in data architecture... ...platforms (e.g., AWS, Azure, GCP). Oversee...DatabricksSummer holidayFlexible hoursEY
Iselin, NJ12 hours ago- ...complex research data into **trusted, intuitive... ...to hire a **Data Engineer - R&D Dashboarding... ...collaboration with scientists, and... ...will have strong expertise in implementing data... ...cloud platforms (AWS, Azure, or Google Cloud)... ...frameworks (e.g. Databricks, Spark, dbt,...DatabricksFlexible hours
- ...consulting is seeking a Manager of Data Engineering to design and implement cloud analytics... ...projects while collaborating with clients to meet their business needs... ...candidate possesses strong technical expertise, particularly in Databricks, along with a proven track record...Databricks
EY
New Brunswick, NJ2 days ago - ...Data Engineer Location: Hybrid 3 times a week too Iselin, NJ May Need to come onsite for final... ...hands on data engineers that have work with Java(spring Boot), Spark, Hadoop, and... ...ETL/ELT Tools: AWS Glue, Python, PySpark, Databricks Programming Languages: Python, Java,...DatabricksWork at officeLocal area
RIT Solutions
Iselin, NJ4 days ago - ...consulting firm is seeking a skilled Senior Consultant Data Engineer to design and implement robust data solutions using Databricks and cloud platforms. You will lead end-to-end... ...competitive compensation and the chance to work with cutting-edge technologies. #J-18808-Ljbffr EYDatabricks
- Title: Tech Lead - Databricks Data Engineer Location: Edison, NJ (Onsite) About the job We are seeking a Tech Lead - Databricks Data Engineer with experience in designing and developing data pipelines using Azure Databricks, Data Factory, and Datalake. The role involves...Databricks
- Role Overview We are seeking an AI/ML Data Engineer with strong expertise in Power BI and dashboard... ...dashboard design). Experience with Databricks optimizations, Delta tables, and serverless... ...Knowledge of cloud platforms (AWS, Azure, GCP) and hybrid environments. Familiarity...DatabricksLocal area
- ...seeking a highly skilled Senior Consultant Data Engineer to design and implement data engineering solutions with cloud technologies like Databricks. The role involves creating scalable... ...in data engineering, including expertise in big data processing and cloud platforms...Databricks
- ...solutions provider is seeking a Senior Data Engineer specializing in Master Data Management (... ...comprehensive MDM solutions and collaborate with stakeholders to enhance data strategies.... ...skills in tools like Python, Kafka, and Databricks. A hybrid work model is available...Databricks
- A leading data solutions firm in New Jersey is seeking a Tech Lead - Databricks Data Engineer to design and develop data pipelines. Candidates... ...processing, and analytics, along with strong skills in SQL, Python,... ...hands-on experience with Azure services such as Databricks and...Databricks
- ...Azure Data Lake Engineer Location: Charlotte, NC/Edison, NJ Duration: Contract The individual will be responsible for designing and engineering... ...appropriate for applications, customer needs and consistent with the overall design of the organizations information systems...Contract work
Syntricate Technologies
Edison, NJ1 day ago - ...Azure Databricks Engineer Job Location: Berkeley Heights, NJ, Omaha, NE, or Frisco... ...concepts covered in Azure Data Engineer Associate, Azure... ...certifications. Provide expertise and ownership of Azure Databricks... ...team. Interacts effectively with clients and leadership, and...DatabricksLocal areaRelocation
Veracity
Berkeley Heights, NJ24 days ago $130k
...Need : Data Engineer Location : Warren, NJ (Hybrid from day 1)... ...engineering tools like Spark, Hadoop, Azure Data pipelines , Azure Data factory, Azure Data Lake Storage, Databricks, Delta Lake, Python, SQL Server, and experience with other cloud providers -AWS, GCP...DatabricksFull timeE-Solutions
Warren, NJ3 days ago- ...Senior Data Engineer-2 This contract position is based in the Iselin, NJ area and involves designing... ..., and upkeep of operating systems, along with leading technical discussions and mentoring developers. Required expertise includes backend development, database management...Contract work
Mitchell Martin
Iselin, NJ2 days ago - ...Data Engineer-1 Duration: 07 Months + Possible extension Location: Iselin, NJ & Charlotte,... ...experience in Python backend development. Expertise in Snowflake, PostgreSQL, and other DB... ...services, Scalr, Terraform. Experience with ETL frameworks and tool Experience with...
eTeam
Iselin, NJ4 days ago - ...documentation to guide system users and to assist with the ongoing operation, maintenance, and... .... Collaborates with system analysts, engineers, and programmers to design systems and... ...in Python backend development. ~ Expertise in PostgreSQL and other DB tools. ~...
Axelon
Iselin, NJ1 day ago - ...Senior Data Engineer-2 (Onsite) Primary Location: Iselin, New Jersey V-Soft... ...experience in Python backend development. Expertise in Snowflake, PostgreSQL, and other DB... ..., Scalr, Terraform. Experience with ETL frameworks and tool. Experience...Work experience placementCurrently hiringLocal area
V-Soft Consulting Group
Iselin, NJ2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineer with Databricks Expertise. Be the first to apply!
Related searches
- azure specialist Iselin, NJ
- cloud engineer azure Iselin, NJ
- azure developer Iselin, NJ
- junior big data engineer Iselin, NJ
- senior data engineer Iselin, NJ
- sr information security engineer Iselin, NJ
- senior data integration developer Iselin, NJ
- data developer Iselin, NJ
- data engineer Iselin, NJ
- entry level big data engineer Iselin, NJ