Senior Data Engineer: Databricks, PySpark & Airflow
Karsun Solutions, LLC
Karsun Solutions, LLC is seeking a Senior Data Engineer to design, implement, and optimize scalable data pipelines and analytics workloads across cloud and legacy environments. The role emphasizes reliability, efficiency, and collaboration with product owners and data analysts. You will work with Databricks, PySpark, Airflow, and AWS, employing CI/CD practices to deliver repeatable data delivery and governance, while following established data patterns and security guidelines. #J-18808-Ljbffr Karsun Solutions, LLC
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer: Databricks, PySpark & Airflow in New York, NY vacancy
- Laotop recherche un Senior Azure Data Engineer / Devops Engineer basé à New York. Le candidat idéal aura une solide expérience avec Azure Databricks, Pyspark, ADF et Synapse, ainsi qu'une connaissance avancée de Python, SQL et Power BI. Les missions incluront l'utilisation...DatabricksSenior
- An established industry player is seeking a skilled data engineer to design and maintain scalable data pipelines using Azure technologies... ...integrating data from various sources into the Azure Databricks platform, implementing ETL processes, and ensuring data quality...DatabricksSenior
- ...proprietary AI Studio and AI Engines, the company helps... ...potential with AI. Senior Data Engineer Are you an... ...as AWS, GCP, Azure, Databricks, and Snowflake? We... ...performance tuning), and PySpark/Apache Spark. Data... ...using tools like dbt, Airflow, Dagster, or native...DatabricksSeniorH1bLocal area
Fusemachines
New York, NY3 days ago - ...Senior Analytics Engineer At Rockstar Games, we create world-class... ...about games and big data. This is a full-time,... ...engineering Python and PySpark. ~5+ years of hands... ...working in Databricks & Azure environment (... ...scheduling tools such as Airflow & Astronomer. ~ Experience...DatabricksSeniorFull timeWork at office
Rockstar Games
New York, NY4 days ago - Overview Job Title: Senior Data Engineer (Banking) Location: New York City, NY Position type... ...skills: Data engineer, Snowflake, Databricks, Python, PySpark, SQL, Banking Key Responsibilities... ...Experience with data orchestration tools (Airflow, Dagster). Familiarity with BI/...DatabricksSeniorContract work
$175k - $195k
As a data engineer on our core Data Platform team, you will help level... ...infrastructure. We use AWS and Databricks here Strong programming... ...open source frameworks such as Airflow, Kafka, Spark, Kubernetes,... ...Comfortable working with Spark/PySpark, Databases and Data...DatabricksSeniorWork at officeWork from home2 days per week- ...resumes for the following position: Senior Data Engineer Job Overview Design, build and... ...Analytics Services, Azure Databricks, Microsoft Purview, and Power Bl... ...Fluency with SQL, Python, and Spark/PySpark is required. Experience with Airflow and DBT. A period of over 4...DatabricksSenior
$150k - $170k
...successful track record in handling complex data pipelines for high transaction... ...with legacy systems. The Senior Data Engineer provides support to the Application... ...repeatability and rapid deployment, using Databricks, PySpark, and Airflow, out-of-the-box thinking, AWS...DatabricksSeniorWork experience placementH1bWork at officeLocal area$140k - $160k
...GolfPass. Job Description The Data Engineering team is seeking a Senior Data Engineer to help... ...pipelines leveraging Databricks Auto Loader, Structured Streaming... ..., and tools such as Airflow Collaborate with Data... ...source Spark) Expertise in PySpark, SQL, and Spark‑based...DatabricksSeniorWork at officeLocal area3 days per week$150k - $180k
...team at DriveWealth develops data products to support the... ...requirements. We are looking for a Senior Data Engineer to take ownership of... ...data pipelines (Databricks and/or Airflow) 2+ years of experience working... ...Languages: Python, SQL, Spark (PySpark, Spark SQL) Declarative...DatabricksSeniorFull timeWork at officeRemote workWorldwide2 days per week3 days per week$165k - $180k
...highly skilled and motivated Sr. AI Data Engineer with a proven track record in building... ...will have deep expertise in Databricks capabilities— including Delta Lake and... ...integrate open-source tools such as Python, PySpark, and Apache Airflow for distributed data processing and...DatabricksSeniorWork experience placementH1bWork at officeLocal area- ...Skills and Experience: Proven experience as a Data Engineer or in a similar role with a focus on Snowflake, Python, Pyspark, and SQL. Strong understanding of... ...: Good Knowledge in Azure and Databricks in highly preferred. Knowledge of Apache...DatabricksSenior
Saxon Global
New York, NY2 days ago - Medium is seeking a Senior Data Engineer to oversee the Databricks pipelines for the Sugar Predict platform. You will drive production reliability and platform... ...data engineering and strong expertise in Databricks, PySpark, and SQL. Competitive salary and excellent benefits...DatabricksSeniorRemote job
- ...entertainment and streaming company in New York to hire a Senior Data Engineer for a 6‑month onsite contract. You design, build, and... ...pipelines using Scala and Python in a modern stack with Databricks and Airflow. The role requires 5+ years of data engineering, production...DatabricksSeniorContract work
$180k - $295k
...of learnings in the space. We are seeking an experienced Senior Data Engineer to join our team and help shape the trajectory of these... ...the story of millions of U.S. small businesses (we use Databricks SQL, PySpark, and MLFlow). You'll be building on top of our innovative...DatabricksSeniorEnigma
New York, NY16 hours ago$220k - $230k
Galaxydigitalservices in New York is seeking a Senior Data Engineer with 8+ years of experience. This role involves setting the technical... ...fluent in Python or Java and knowledgeable in AWS, Databricks/Spark, and Airflow. We offer a competitive salary range of $220,000 — $23...DatabricksSenior- ...streaming and entertainment company, is looking for a Senior Data Engineer to join the Product Performance Team. We are seeking a... ...with a modern data and engineering tech stack, including Airflow, Spark, Databricks, Delta Lake, Snowflake, GitHub Actions, and Jenkins. Collaborating...DatabricksSenior
$160k - $180k
...SaaS company building critical data infrastructure in the... ...space. We are seeking a Lead/Senior Data Engineer to own the data platform from... ...decisions (Redshift, Snowflake, Databricks, etc.) based on problem‑fit,... ...; experience with Airflow, Prefect, or equivalent orchestration...DatabricksSenior$85 - $91.5 per hour
...job poster from Milestone Technologies, Inc. Seeking a Senior Data Engineer for the following role: Basic Qualifications 5+ years... ...engineering experience with specific experience in Airflow, Snowflake and Databricks. 1+ years of experience in Python. Strong understanding...DatabricksSeniorContract workWork experience placement$100k - $150k
...Job Role- Senior Data Integration Engineer(FiveTran) Job Location - Lebanon, NJ/New York, NY(Day 1 Onsite... ...cloud data platforms such as: ~ Databricks ~ Amazon Redshift ~... ...Qualifications Experience with dbt, Airflow, or other orchestration tools Exposure...DatabricksSeniorFull timeDiverse Lynx
New York, NY16 hours ago- ...LLC in Pennsylvania is looking for a Sr. AI Data Engineer to build scalable data platforms. The role focuses on leveraging Databricks for AI and machine learning workflows,... ...source frameworks, specifically Python and PySpark, and a proven ability to integrate Generative...DatabricksSenior
- About the job Senior Data Engineer - Databricks We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible... ...Technology, or related field. Strong proficiency in PySpark, Python, SQL. Strong experience in data modeling, ETL/ELT...DatabricksSenior
- ...updated resume and below details. Title: Data Engineer Location: New York, NY (... ...Hands-on experience in building ETL using Databricks SaaS infrastructure. Experience in... ...using Databricks and Apache Spark (PySpark and Scala). Build data ingestion workflows...DatabricksSeniorFull timeImmediate startRelocation
3B Staffing LLC
New York, NY3 days ago - Overview Senior Data Engineer with CI/ CD - Finance (Regulatory) - New York, NY. Onsite day 1 required... ...data pipelines using Snowflake, Pyspark, and SQL. Write optimized and complex... ...Qualifications Good knowledge in Azure and Databricks is highly preferred. Knowledge of...DatabricksSeniorContract workWork at office
$160k - $190k
...Senior Data Engineer Los Angeles; New York; Remote; San Francisco EDO is the TV outcomes company... ...a modern tech stack centered on AWS, Airflow, DBT, and Snowflake. What We Are... ...platforms like LiveRamp, Snowflake or Databricks. Exposure to identity/entity...DatabricksSeniorFull timeWork experience placementWork at officeImmediate startRemote workFlexible hoursEDO
New York, NY9 hours ago- Capgemini is seeking a Data Engineer (PySpark) to design and build scalable data pipelines using Databricks, Spark, and Scala in the New York area. You will architect data lake house solutions and deliver robust data services with cross‑functional teams. Responsibilities...Databricks
- ...DESCRIPTION Elevate and drive innovation, data engineering solutions, and serve as a decision... ...Experience data products. As a Senior Lead Software Engineering at... ...automation Key Technical Skills : Databricks, DBX, PySpark, Spark, Terraform, Kafka, Python/Scala...DatabricksSeniorWork at office
J.P. Morgan
New York, NY14 days ago $138k - $181.65k
...opening with your name on it We are looking for a Senior Data Engineer to design and build scalable, reliable, and high-... ...Hands-on experience with modern data tools such as Airflow, Spark, dbt, Kafka, or Databricks. ~ Deep understanding of data modeling, data...DatabricksSeniorTemporary workLocal areaWorldwideFanDuel
New York, NY4 days ago$102.6k - $153.9k
...seller and buyer clients. The Data & Analytics team at Compass... ...science use cases. As an Analytics Engineer on the Data & Analytics team,... ...based data lakehouses (e.g., Databricks, Redshift). Strong... ...programming language (Python, PySpark, R, Scala, etc.). Growth mindset...DatabricksSeniorMinimum wageFlexible hoursCompass
New York, NY11 hours ago$106.9k - $176.5k
...better working world. Senior Consultant – Financial Services - Data & Analytics – Data Architecture and Engineering EY is the only... ..., Azure, Google Platform, Databricks, Snowflake) Big Data applications... ...management tools (Airflow, etc.) Dev Ops (GitHub,...DatabricksSeniorWork experience placementSummer holidayFlexible hoursEY
New York, NY16 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer: Databricks, PySpark & Airflow. Be the first to apply!
Related searches
- data engineer analytics New York, NY
- associate data engineer New York, NY
- junior data developer New York, NY
- data engineer manager New York, NY
- remote data engineer New York, NY
- junior data engineer remote New York, NY
- senior cloud data engineer New York, NY
- data platform engineer New York, NY
- data infrastructure engineer New York, NY
- aws data engineer New York, NY