Azure Databricks Lead
COVETUS
Only local candidates to NYC, NY & Charlotte, NC Only US Citizens and GC 1 In-Person Interview Key Responsibilities: Data Engineering Pipeline Development Design develop and optimize ETLELT pipelines using Azure Databricks PySpark Build scalable data ingestion workflows from various structured and unstructured sources Implement transformation logic data cleansing enrichment and validation frameworks Work with Delta Lake to build medallion architecture Bronze Silver Gold layers Develop reusable Databricks notebooks and jobs for production data workflows Azure Cloud Integration Build and orchestrate pipelines using Azure Data Factory ADF Integrate Databricks with other Azure servicesADLS Azure SQL Event Hub Key Vault Synapse Optimize compute environments clusters pools autoscaling Implement DevOps processes using Git CICD Azure DevOps Performance Quality Governance Optimize PySpark jobs for performance and cost efficiency Implement best practices for data governance security and access control Troubleshoot production issues and perform rootcause analysis Conduct code reviews ensuring coding standards and data quality Collaboration Documentation Work with Data Architects to define architecture and design patterns Prepare technical documents solution diagrams and runbooks Collaborate with business stakeholders to understand requirements and translate them into technical solutions Mandatory Skills: Azure Databricks notebooks jobs workflows Delta Lake PySpark dataframes Spark SQL optimization debugging Azure Data Factory ADF triggers pipelines integration runtime Data Lake Storage ADLS Gen2 folder structures Partitioning security CICD Git branching strategies Azure DevOps pipelines SQL Strong proficiency in writing optimized queries #J-18808-Ljbffr COVETUS
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Azure Databricks Lead in New York, NY vacancy
- ...Senior Azure Cloud Engineer Location: New York City (hybrid: 2-3 days in NYC) Duration: 6+Months Visa's: Any visa status is fine... ...candidates needed: Key skills: 8+ years of Azure, API Development, Databricks (other skills to be determined after conversation with manager)...DatabricksLocal areaRemote work
ShiftCode Analytics
New York, NY2 days ago - ...Learn more at: C3 AIForward Deployed Team Leads are senior technical leads who own a... ...CRM systems, and cloud environments (AWS, Azure, GCP).Enterprise readiness. Ensure the platform... ...: cloud data warehouses (Snowflake, Databricks, BigQuery, Redshift), REST/GraphQL APIs,...Databricks
- ...SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsRole:Azure Datalake and Data WarehouseLocation: New York City (Day 1... ...using tools such as Azure Data Factory (ADF), Synapse, or Databricks.Organize data storage in lakehouse or data lake formats for...DatabricksWork at office
- ...engineering and architecture in building enterprise data analytics platforms Experience in implementing solutions using Azure Data lake, Azure Databricks and PowerBI Experience with data ingestion and data pipelines Experience configuring and deploying Azure...Databricks
Samprasoft
New York, NY1 day ago - ...Science, AI, and Agentic projects/programs Lead multidisciplinary workshops and design... ...one or more of the following technologies: Databricks, Snowflake, Agentic Orchestration (... ...certifications for at least one of: AWS, GCP, Azure, Databricks Experience navigating regulatory...Databricks
EPAM Systems
New York, NYa month ago - iLink Digital seeks a Databricks Architect to design, build, and scale enterprise Lakehouse data platforms in a leading data-driven environment. You will drive architecture strategy... ...the deployment and optimization across Azure, AWS, and GCP Databricks, shaping data governance...Databricks
- A leading solutions provider for the insurance industry is seeking an experienced Azure Databricks Architect to design and develop modern data solutions. This role requires expertise in Azure and Databricks, with a focus on cloud-native architecture. Ideal candidates will...DatabricksPart time
- ...AmericasEmployment Type: C2CIndustry: Computer SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsRole:TRCS with Databricks or Azure Data lake experienceLocation: New York City (Day 1 Onsite) - NYC (1166 Ave of the Americas)Job Description:Primary skill:...DatabricksWork at office
- ...ideation to production, shaping strategy, leading multidisciplinary teams, and building... ...platforms Knowledge of technologies such as Databricks, Snowflake, or agentic orchestration... ...Services, Google Cloud Platform, Microsoft Azure, or Databricks Experience with...Databricks
EPAM Systems
New York, NY9 days ago - ...design and optimize ETL pipelines on cloud Databricks, with a focus on insurance data and real-time integration via Spark. You will lead data engineering projects, collaborate... ...familiarity with Airflow, Splunk, Kubernetes, and Azure DevOps. #J-18808-Ljbffr Inizio Partners...Databricks
$201.68k - $322.69k
...celebrate differences. We believe that belonging leads to better outcomes and a stronger... ...technologies, including but not limited to Databricks, Dremio, Snowflake, and tools for data... ...language models (LLMs) via AWS Bedrock, Azure OpenAI, or Mosaic AI.You have proven ability...DatabricksFull timeTemporary workLocal areaFlexible hours- ...Azure Solutions Architect Lumen Solutions Group Inc. is a technology consulting Services... ...skilled Azure Solutions Architect to lead the design, governance, and implementation... ...Azure SQL, Cosmos DB, Data Factory, Synapse, Databricks, Azure Functions, App Services, AKS,...DatabricksContract workRemote work
Lumen Solutions Group Inc.
New York, NY19 hours ago - Jobtailor is seeking a senior Data Engineer in Idaho to design and implement lake house architectures using Azure Databricks, Delta Lake and related cloud-native data services. You will build bronze, silver, and gold data layers, develop metadata, data dictionaries, and...Databricks
- Lead Cloud ArchitectCooley is seeking a Lead Cloud Architect to join the Innovation team.About Cooley: Cooley is a global law firm... ...SaaS platform built on AWS with hybrid connectivity to Azure and Databricks. This is a foundational leadership position that will have input...DatabricksFull timeWork at officeLocal areaImmediate startRemote workWork from homeWorldwideWeekend work
- ...in reshaping the future!As an Applied AI Modeling Lead, within our Business Modeling organization, you... ...Certified Machine Learning or Microsoft Certified: Azure AI Fundamentals preferred. Knowledge of working on Databricks, Snowflake.Chase is a leading financial services...Databricks
- ...Azure Data Engineer New York, NY - Hybrid 12 Months+ Required technical skills: Databricks expertise: Report Writer, Delta Share, Kafka Python, Autosys/JIL, Azure Blob storage / Keyvault understanding Data analysis, SQL ADF – Azure datafactory Nice...Databricks
Veterans Sourcing Group, LLC
New York, NY4 days ago - ...industry, particularly within investment banking operations. Cloud computing experience with Amazon Web Services, Azure, Docker, Kubernetes, Databricks, and Snowflake. Familiarity with inference‑time algorithms such as Chain of Thought and sampling, etc. Benefits We...Databricks
- ...drive organizational data integration efforts and modernize legacy workloads to Azure Databricks Lakehouse architectures. You will set data architecture standards, govern data assets, and lead a team of engineers and architects to deliver AI-ready data products for...Databricks
$142.3k - $195.7k
Become a part of our caring communityJob Description SummaryThe Lead Solutions Architect provides architecture leadership for... ...contracts and domain boundaries for provider data, EMR, and Snowflake/Databricks/Azure data platforms; ensure observability, lineage, and data...DatabricksFull timeTemporary workFor contractorsWork at officeRemote workWork from homeHome office- ...Integration, or Enterprise Data Warehouse projects. • Strong hands-on experience designing and implementing modern data platforms on Azure Databricks, leveraging Delta Lake, Delta Live Tables (DLT), and Medallion Architecture (Bronze, Silver, Gold) to build scalable and...Databricks
TechWish
New York, NY19 hours ago - Motion Recruitment Partners LLC is seeking a seasoned Project Manager to lead enterprise cloud data initiatives focusing on Microsoft Azure and Databricks platforms. This hybrid role in New York demands strong project management skills with a background in financial services...DatabricksContract workImmediate start
- Overview We are seeking an experienced Azure Databricks Architect to design and develop modern data solutions, focusing on cloud-native platforms... ...is an advantage. About ValueMomentum ValueMomentum is a leading solutions provider for the global property & casualty...DatabricksPart time
- ...at every stage of the payment lifecycle and our industry-leading solutions facilitate seamless transactions across... ...banking operations. Cloud computing: Amazon Web Service, Azure, Docker, Kubernetes, DataBricks, Snowflake. Familiarity with inference-time algorithms...Databricks
- ...Job description MUST HAVE: .Certifications: Azure certifications such as Azure Security Engineer Associate, or Azure Solutions Architect Expert are highly desirable. Azure Databricks Data Engineer Professional Certificate is required. Databricks Machine Learning...DatabricksLocal area3 days per week
3B Staffing LLC
New York, NY4 days ago - ...Job Title:- Azure Data Engineer Location:- Spring Texas (On-Site) Job Type:- Long... ...to be much higher level especially as a lead developer, need to be able to handle... ...# Python # PySpark # Github CI/CD # SQL # Databricks # Snowflake...DatabricksLong term contract
Kasmo Global
New York, NY4 days ago - ...services environment. This team is focused on building secure, scalable cloud infrastructure that enables application teams to use Azure and Databricks effectively. The environment combines hands-on technical support, infrastructure automation, platform governance, and close...DatabricksLong term contractRemote work
Axiom Path
New York, NY18 days ago $70 - $90 per hour
...Pay Rate: $70/hr - $90/hr on W2 Job Description The UKG WFM Pro Lead Analyst is responsible for leading integrations between UKG... ...development, integration design, and troubleshooting. Experience with Azure/Databricks or similar middleware/integration platforms. Ability to...DatabricksContract workRemote work- White & Case LLP in New York seeks an Azure Databricks Administrator to govern and operate the Databricks platform, ensuring security, cost-efficiency and production readiness across development, test and production environments. You will implement governance with Entra...Databricks
- RDQ427R371About the RoleWe're seeking a Partner Engineer to own the technical relationship between Databricks Product/Engineering and Microsoft Azure. You will be the primary technical liaison managing our cross product roadmap, driving engineering integrations, and ensuring...DatabricksWorldwide
- Role Summary The Lead Business Growth & Product Analyst will plan, design, develop, and launch efficient business, financial, and... ..., Firebase, and similar platforms. Hands‑on experience with Databricks and Azure is a plus. Knowledge of mobile‑app analytics, attribution,...Databricks
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Databricks Lead. Be the first to apply!
