Azure Data Engineer with Databricks Expertise
United IT
Azure Data Engineer With Databricks ExpertiseLocation: Iselin NJ, 6th Avenue NY (100% Day 1 onsite)Must have: Databricks, Pyspark, Azure Cloud Services, Asset Bundle Technical Skills:Strong expertise in Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture, Table Triggers, Delta Live Pipelines, Databricks Runtime etc.)Proficiency in Azure Cloud Services.Solid understanding of Spark and PySpark for big data processing.Experience in relational databases.Knowledge on Databricks Asset Bundles and GitLab.Key ResponsibilitiesData Pipeline Development:Build and maintain scalable ETL/ELT pipelines using Databricks.Leverage PySpark/Spark and SQL to transform and process large datasets.Integrate data from multiple sources including Azure Blob Storage, ADLS and other relational/non-relational systems.Collaboration & Analysis:Work closely with multiple teams to prepare data for dashboard and BI tools.Collaborate with cross-functional teams to understand business requirements and deliver tailored data solutions.Performance & Optimization:Optimize Databricks workloads for cost efficiency and performance.Monitor and troubleshoot data pipelines to ensure reliability and accuracy.Governance & Security:Implement and manage data security, access controls and governance standards using Unity Catalog.Ensure compliance with organizational and regulatory data policies.Deployment:Leverage Databricks Asset Bundles for seamless deployment of Databricks jobs, notebooks and configurations across environments.Manage version control for Databricks artifacts and collaborate with team to maintain development best practices.Preferred ExperienceFamiliarity with Databricks Runtimes and advanced configurations.Knowledge of streaming frameworks like Spark Streaming.Experience in developing real-time data solutions.CertificationsAzure Data Engineer Associate or Databricks certified Data Engineer Associate certification. United IT
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Azure Data Engineer with Databricks Expertise in New York, NY vacancy
- Azure Data Engineer New York, NY - Hybrid 12 Months+Required technical skills:Databricks expertise: Report Writer, Delta Share, KafkaPython, Autosys/JIL, Azure Blob storage / Keyvault... ...Liquidity Order data flowsCollaborate with various stakeholders, including engineers...Databricks
- To support a growing data management practice, the remote Azure Data Engineer will design, develop, and... ...pipelines and collaborating with business stakeholders.... ...Azure Data Factory, Databricks, and Snowflake... ...Azure and Snowflake Proven expertise in building scalable data...DatabricksRemote work
- Azure/SQL Data Engineer/Analyst Location: Seattle, WA (Remote) Duration: 12+ Months... ...SQL & ETL skills. Strong expertise on T-SQL and working... ...Azure PaaS technologies - Databricks, ADLS / ADW / Synapse is a... ...big plus. Ability to deal with ambiguity and work in agile...DatabricksRemote job
- ...Azure Data EngineerLocation: New York, NYDuration: 12 monthsJob SummaryGood in Azure Data Factory ADF & Azure Databricks ADB AZ Data Engineer with credit background or experience in Capital Markets, Private Equity, Everest tool preferred. Strong in SQL Server and experience...Databricks
Keylent Inc
New York, NY1 day ago - Mandatory Skills: Ability to interpret, modify and write scripts and SQL queries Apps/.Net Developer Azure Cloud Data Engineer Azure Databricks Azure Data Factory Azure logic App Power BI Report Server Python RIT Solutions, Inc.Databricks
- Azure Data Engineer Key Qualifications: Required Tech Skills: Ability to intrepid, modify and write... ...Azure Cloud Data Engineer Azure Databricks Azure Data Factory PowerBi Report Server... ...Desired Tech Skills: 3+ years of experience with creating stored procedures in SQL .NET...Databricks
- Azure Data Engineer Location: Remote w/ 1 Monthly on-site meeting to Philadelphia, PA required (University City Section) Must... ...of a team, and should have strong experience with Azure Cloud, Azure Data Lake, Databricks, ADF (Azure Data Factory) and Python. Prior experience...DatabricksRemote work
$149k - $190k
...the architecture, engineering and construction industries... ...’s combination of expertise, experience and... ...As a Senior Data Engineer, you will... ...strong experience in Databricks, distributed data... ..., along with the ability to lead... ...data stacks (AWS, Azure, or GCP) Experience...DatabricksFull timeWork at officeRemote workSocotec
New York, NY19 days ago- ...Enterprise Data And Analytics Platform ArchitectCandidate... ...RequirementsExperience with software and cloud engineering and architecture in... ...solutions using Azure Data lake, Azure Databricks and PowerBIExperience creating... ...Azure services.Expertise with Python developmentExpertise...Databricks
Samprasoft
New York, NY1 day ago $100 - $130 per hour
A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-130/hrUS Citizens... ...Lakehouse or analogous architecturesDeep SQL expertise, data modeling, and experience with data governance in relational databasesExperience...DatabricksRemote work- ...Data EngineerTexture is revolutionizing the energy... .... You will work with both structured and unstructured... ...by data scientists, engineers, and other... ...Are Looking ForYou have expertise in data warehousing solutions... ...like BigQuery, Redshift, Databricks, or SnowflakeYou're...Databricks
Texture Energy
New York, NY1 day ago - ...We are currently seeking a "Data Engineer" for a Contract role with one of our clients in New York, NY. Please... ...from Kyriba into Snowflake and Databricks. Develop and own canonical data... ...production pipelines. Strong expertise in Databricks, Apache Spark (...DatabricksContract work
Artech
New York, NY4 days ago $175k - $250k
Data EngineerAbout MillenniumMillennium is a global... ...people are empowered with both independence and... ...opportunities to deepen expertise and accelerate... ...risk managers and other engineers to develop data intensive... ...ClickHouse, Spark, or Databricks, along with monitoring...DatabricksFlexible hours- ...Business Analytics, Engineering, Mathematics, or... ...professional experience in data engineering,... ...-grade pipelines, with strong skills in... ...as (AWS, GCP, Azure, Oracle) and modern... ...LakePractical experience with Databricks, AWS Glue, and... ...’ll sharpen your expertise by working on...DatabricksApprenticeshipEasy work
$190k - $220k
...craft and their customers. With teams in Denver, San Francisco... ...the interview process.The Data Engineering team builds tools and systems... ...Snowflake, Redshift, BigQuery, or Databricks.Experience implementing CI/... ...candidate experience and expertise and may vary from the...DatabricksFull timeWork at officeLocal area2 days per week3 days per week$128.01k - $152.18k
...and Farm Family partner with agents and brokers to... ...Job DescriptionAI-First Data Strategy for P&C Insurance... ...seeking a Senior Data Engineer to spearhead our... ...engineering, with proven expertise in technical development... ...platforms (e.g., Snowflake; Databricks, big data, analytics)...DatabricksFull timeWork at officeLocal area- ...Description: Job Title: Databricks Data Engineer We are seeking a... ...: Collaborate with business stakeholders to understand... ...for data engineering; SQL expertise required. Strong... ...Databricks with cloud platforms (Azure, AWS, or GCP) and data...Databricks
GCB Services LLC
New York, NY2 days ago $125k - $145k
...build a successful career with opportunities to learn... ...team runs a range of data and AI projects across... ...role that spans data engineering, AI product enablement... ....•Advanced SQL expertise, deep proficiency in writing... ...(e.g., Snowflake, Databricks, Delta Lake) alongside...DatabricksFull timeWork at officeFlexible hoursDay shift- ...Role Overview Data Engineers at Fractal design, build, and maintain... ...analytics platforms. Working with Snowflake, dbt, Airflow, and... ...requiring both deep technical expertise and strong communication... ...Snowflake, BigQuery, Redshift, Databricks) • 3+ years with...Databricks
TechWish
New York, NY1 day ago $137.4k - $161.7k
...Monroe is seeking a Senior Data Engineer to join our Data & AI... ...business intelligence. Working with technologies such as Databricks, Snowflake, and Microsoft... ...solutions using AWS, Azure, and GCP, integrating cloud... ...Platform (GCP), with expertise leveraging cloud-native data...DatabricksLocal areaImmediate startFlexible hours- ...Data Engineer Must Have Technical/Functional Skills Hands-on... ...experience in building ETL using Databricks SaaS infrastructure.... ...and existing datasources Expertise in leveraging SQL, programming... ...governance. · Collaborate with data architects, analysts, and...DatabricksFull time
JConnect Infotech
New York, NY4 days ago - ...real-time compensation dataset with deep expertise in AI and machine learning.... ..., Synopsys, Stripe, Databricks, and Waymo use Pave, transforming... ...Partners, and Craft Ventures.The Data Team @ PaveAs part of the... ...managers and software engineers to translate product needs into...DatabricksFlexible hours3 days per week
- ...Senior/Lead Data EngineerPosition Summary Seeking... ...hands-on Senior/Lead Data Engineer with 8+ years of experience... ...role requires strong expertise in Snowflake,... ...Python, CI/CD, and AWS or Databricks, with technical ownership... ...CI/CD using Jenkins, Azure DevOps, GitHub Actions...Databricks
Diverse Lynx
New York, NY1 day ago - ...Senior Data EngineerThis position requires a mandatory... ...Length: Until 12/31/26 with possible extension... ...experienced Senior Data Engineer to design, develop, and... ...data ecosystems using Databricks, Spark, Delta Lake, Snowflake... ...pipelines.Hands-on expertise with: Python, PySpark,...DatabricksContract work
Crossfire Consulting
New York, NY4 days ago - ...Experience & Design, Engineering and Managed Services.... ...possibilities.As a Senior Data Engineer, AI & Agents,... ..., partnering directly with business stakeholders... ...will operate across Databricks and Snowflake, converting... ...-on data engineering expertise, strong governance...DatabricksContract work
- ...to advance their careers and expertise with KPMG. Looking ahead, we... ...seeking a Senior Associate, Data Engineer for our Consulting practice.... ...large-scale data solutions in Databricks to support multiple use cases... ...and services, such as AWS, Azure, or GCP; hands-on technical...DatabricksLocal areaVisa sponsorship
- ...Data EngineerThe BlackRock Data Office (... ...will work closely with product managers,... ...stewards, platform engineers, software engineers... ...deepen technical expertise across modern data... ...(AWS), Microsoft Azure, OpenStack, Open Container... ...experience with Databricks, including...DatabricksWork at office
Hackajob
New York, NY2 days ago - ..., and employees. Your expertise fuels innovation, agility... ...a team of analytics engineers focused on delivering... ...structured, and reliable data to power various... ...consistency.• Partner with stakeholders to explore... ...working knowledge of Databricks, including SQL, notebooks...DatabricksLocal area3 days per week
$110k - $130k
...CLEARBROOK s enterprise data platform, responsible... ...deep hands on expertise in Snowflake, strong data engineering fundamentals, and the... ...ecosystem while coordinating with offshore teams. Snowflake... ...ML platforms (Databricks / SageMaker / Azure ML where applicable)...DatabricksTata Consultancy Services
New York, NY4 days ago$73.15k - $112.55k
...spanning 95 markets globally with US offices in New York... ...brands for our expertise across numerous categories... ..., and future-proofed data capabilities.... ...native technologies (AWS, Databricks) and SQL-based processing... ...with the data engineering team on performance tuning...DatabricksTemporary workFreelanceFlexible hoursDigitas
New York, NY4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineer with Databricks Expertise. Be the first to apply!
Related searches
- cloud engineer azure New York, NY
- azure developer New York, NY
- azure data engineer New York, NY
- microsoft azure architect New York, NY
- azure specialist New York, NY
- azure infrastructure engineer New York, NY
- devops engineer azure New York, NY
- data engineer contract New York, NY
- big data cloud engineer New York, NY
- staff data engineer New York, NY