Senior Data Engineer (Azure & Databricks)
Towards AI, Inc.
- Senior Data Engineer (Azure & Databricks)## SocotecPublished 16 Jun 2026### Share this jobNew York, NY, USAFull Time## Role Highlights### Languages usedSQLPython### Key skillsData EngineerData ArchitectData InfrastructureData GovernanceMachine LearningDistributed SystemsData ProcessingData ManagementData QualityMDMArchitectureSustainabilityTransformationModellingERPCRMAIBatchDataSetsReliabilitySecurityETLELTCloud### Tools, Libraries and FrameworksDataBricksAWSAzureGCPSAPFlowApache Spark## DescriptionThe role involves designing and building scalable data systems to support digital platforms and enterprise analytics. The individual will architect a modern data stack to enable the ingestion, transformation, and modeling of data across various enterprise systems. Responsibilities include developing data pipelines, maintaining data models, and leading master data management initiatives. The position requires collaboration with software engineers and platform teams to ensure the reliability and optimization of the data ecosystem. Furthermore, the role focuses on delivering high-quality datasets to support machine learning and advanced analytics applications.## Required Qualifications and SkillsThe role requires three to six years of hands-on experience with Databricks and a background in designing large enterprise data projects. Candidates must possess strong proficiency in Apache Spark, Delta Lake, Python, and SQL. Experience in building enterprise-scale ETL or ELT pipelines within complex data environments is necessary. No specific degree or professional qualification is explicitly mentioned as a requirement.## ApplyVisit full job listing
- J-18808-Ljbffr Towards AI, Inc.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer (Azure & Databricks) in New York, NY vacancy
- SOCOTEC US is seeking a Senior Data Engineer to design scalable data systems for our digital platforms. You will focus on building our Enterprise... ...strategies. The role requires strong experience with Databricks, Apache Spark, and cloud data platforms. Join a recognized...DatabricksSenior
- Fusemachines is seeking a Remote Senior Data Engineer to design and maintain data infrastructure. The ideal candidate should have strong expertise in Python, Azure, and Databricks, focusing on data quality and performance optimization. The role requires collaboration with...DatabricksSeniorRemote job
- ...services within the architecture, engineering and construction industries... ...®. Job Description As a Senior Data Engineer, you will design... ...requires strong experience in Databricks, distributed data processing... ...cloud data stacks (AWS, Azure, or GCP). Experience integrating...DatabricksSeniorFull time
- ...Job Title: Senior Azure Data Engineer Location: Philadelphia, PA (Hybrid Work) Position: Contract Required Skills: Azure Data Engineering: Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse Analytics, Azure Arc, DevOps Developing using Python/Scala and...DatabricksSeniorContract work
TWO95 International
New York, NY3 days ago - Laotop recherche un Senior Azure Data Engineer / Devops Engineer basé à New York. Le candidat idéal aura une solide expérience avec Azure Databricks, Pyspark, ADF et Synapse, ainsi qu'une connaissance avancée de Python, SQL et Power BI. Les missions incluront l'utilisation...DatabricksSenior
- ...Our client is a hedge fund in NYC looking for a talented Data Engineer to join their team. Qualified candidates will have 5-10+ years of... ...building data pipelines, ETL processes, and any exposure to Databricks would be a plus. Financial services experience is required, and...DatabricksSenior
The Cypress Group
New York, NY2 days ago - ...Disney Company in Santa Monica, New York, Seattle seeks a Sr Data Engineer to design, build, and optimize data pipelines for acquisition... ...reporting and marketing analytics. You will work across AWS, Databricks, Uni... Expand to meet the requirements of the position. You...DatabricksSenior
- Karsun Solutions, LLC is seeking a Senior Data Engineer to design, implement, and optimize scalable data pipelines and analytics workloads... ...with product owners and data analysts. You will work with Databricks, PySpark, Airflow, and AWS, employing CI/CD practices to deliver...DatabricksSenior
- ...CONSULTING SVC INC seeks an experienced Data Engineer / Support Analyst in New Jersey to... ...data, and develop ETL processes using Azure and Python. Ideal candidates have at least... ...services with strong technical skills in Databricks and Azure Data Factory. Excellent problem...DatabricksSenior
- ...Technologies LLC is seeking an experienced Data Engineer specializing in Retail and Supply Chain... ...years of experience, particularly with Databricks and Electronic Data Interchange (EDI). This role demands strong knowledge in Azure Databricks, Data Pipelines, and Delta...DatabricksSenior
- Argo Group is seeking a Senior Data Engineer to lead our AI-first data strategy tailored for property & casualty insurance. The role focuses... ...be adept in modern data platforms such as Snowflake and Databricks. Join us in redefining how data empowers the P&C insurance...DatabricksSenior
- Vivanti is a growing global tech consultancy. As a Data Engineer Senior Consultant, you design and build pipelines to ingest, transform and... ...with Python, Spark, Airflow and leading tools like Snowflake, Databricks, BigQuery, and more, while enjoying strong mentorship and a...DatabricksSenior
- A technology solutions company is seeking a Data Engineer with extensive experience in retail and supply chain. The ideal candidate... ...have a minimum of 8-10 years of experience and expertise in Databricks, Azure, and EDI. Proficiency in Delta Lake and Databricks SQL is required...DatabricksSeniorContract work
- Medium is seeking a Senior Data Engineer to oversee the Databricks pipelines for the Sugar Predict platform. You will drive production reliability and platform growth while collaborating with cross-functional teams, ensuring fast and clean data delivery. The ideal candidate...DatabricksSeniorRemote job
- ...entertainment and streaming company in New York to hire a Senior Data Engineer for a 6‑month onsite contract. You design, build, and deploy... ...streaming pipelines using Scala and Python in a modern stack with Databricks and Airflow. The role requires 5+ years of data engineering...DatabricksSeniorContract work
- ...consulting firm located in New York is looking for an experienced Senior Data Engineer to design and develop ETL/ELT pipelines for banking... ...years in the banking sector, with expertise in Snowflake, Databricks, and Python. The role entails optimizing data warehouses and...DatabricksSenior
- ...established industry player is seeking a skilled data engineer to design and maintain scalable data pipelines using Azure technologies. This role involves integrating data from various sources into the Azure Databricks platform, implementing ETL processes, and ensuring...DatabricksSenior
$220k - $230k
Galaxydigitalservices in New York is seeking a Senior Data Engineer with 8+ years of experience. This role involves setting the technical vision... ...are fluent in Python or Java and knowledgeable in AWS, Databricks/Spark, and Airflow. We offer a competitive salary range of...DatabricksSenior- Rearc is seeking a Senior Data Engineer in New York, New York. In this role, you'll engage directly with clients to tackle complex data challenges... ...standards for our data platforms. Your expertise in Databricks and strong code-building skills will be critical as you work...DatabricksSenior
- ...the streaming and entertainment company, is looking for a Senior Data Engineer to join the Product Performance Team. We are seeking a passionate... ...data and engineering tech stack, including Airflow, Spark, Databricks, Delta Lake, Snowflake, GitHub Actions, and Jenkins....DatabricksSenior
- Overview We are hiring a Data Engineer to join our Data Technologies team. This team partners with middle-and back-office application teams... ...with modern data engineering technologies such as Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and...DatabricksSenior
- SwiftCruit is seeking a Sr Data Engineer specializing in integrations. This role requires a blend of technical expertise in SQL, data migration... ...scalable data warehouse solutions and leading migrations to Databricks, ensuring data quality and alignment with client needs. Ideal...DatabricksSenior
- ...Tommy Hilfiger/Calvin Klein) in New York is hiring a software/ML engineer to drive enterprise AI initiatives. You will develop, validate... ...the model lifecycle. You'll work with AWS, Snowflake, and Databricks, implementing LLM/RAG approaches, APIs, and lightweight UI prototypes...DatabricksSenior
$160k - $180k
...with a B2B SaaS company building critical data infrastructure in the healthcare space. We are seeking a Lead/Senior Data Engineer to own the data platform from the ground up... ...tooling decisions (Redshift, Snowflake, Databricks, etc.) based on problem‑fit, not trend‑chasing...DatabricksSenior- KPMG Careers is seeking a Senior Associate, Data Engineer to join our Consulting practice. You will lead technical design, development, and implementation of large-scale data solutions on Databricks, addressing complex client needs. The ideal candidate should have at least...DatabricksSenior
- Karsun Solutions, LLC in Pennsylvania is looking for a Sr. AI Data Engineer to build scalable data platforms. The role focuses on leveraging Databricks for AI and machine learning workflows, requiring strong expertise in data engineering and MLOps. The ideal candidate has...DatabricksSenior
$85 - $91.5 per hour
...the job poster from Milestone Technologies, Inc. Seeking a Senior Data Engineer for the following role: Basic Qualifications 5+ years of relevant... ...with specific experience in Airflow, Snowflake and Databricks. 1+ years of experience in Python. Strong understanding of...DatabricksSeniorContract workWork experience placement- About the job Senior Data Engineer - Databricks We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for development and optimization of data pipelines, implementing robust data checks, and ensuring the accuracy and integrity...DatabricksSenior
$165k - $180k
Karsun Solutions, LLC is seeking a highly skilled Sr. AI Data Engineer to build scalable data platforms and enhance workflows incorporating... ...with AI/ML teams, requiring strong proficiency in Python, Databricks, and related technologies. The role offers a competitive salary...DatabricksSenior$165k - $180k
Karsun Solutions, LLC is seeking a Sr. AI Data Engineer to build scalable data platforms integrating Generative AI. The ideal candidate will have expertise in Databricks, along with a strong background in Python and MLOps practices. Key responsibilities include designing...DatabricksSenior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer (Azure & Databricks). Be the first to apply!
Related searches
- data engineer analytics New York, NY
- associate data engineer New York, NY
- junior data developer New York, NY
- data engineer manager New York, NY
- remote data engineer New York, NY
- junior data engineer remote New York, NY
- senior cloud data engineer New York, NY
- data platform engineer New York, NY
- data infrastructure engineer New York, NY
- aws data engineer New York, NY