Senior Data Engineer Databricks & PySpark Pipelines
$120kHertz
Hertz is seeking a skilled Data Engineer to enhance our data analytics and fleet management capabilities. You will design and optimize data pipelines using tools like PySpark and Databricks while mentoring junior engineers. Candidates should possess a Bachelor's degree in Computer Science and a minimum of 8 years experience in data engineering. This role offers a starting salary of $120K and various employee benefits including PTO, 401(k) matching, and rental discounts. #J-18808-Ljbffr
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer Databricks & PySpark Pipelines in New York, NY vacancy
- Beacon Hill Staffing Group, LLC is seeking a Senior Data Engineer to work remotely on a temporary contract... ...role involves migrating data assets to Databricks Unity Catalog, optimizing pipelines, and building scalable PySpark-based data solutions. The ideal candidate...DatabricksPipelineSeniorRemote jobContract workTemporary work
- ...established industry player is seeking a skilled data engineer to design and maintain scalable data pipelines using Azure technologies. This role involves integrating data from various sources into the Azure Databricks platform, implementing ETL processes, and ensuring...DatabricksPipelineSenior
- ...Taskus India is looking for a Senior Data Engineer to support their data... ...involves building resilient pipelines, optimizing SQL queries, and... ...expertise in Python, SQL, and PySpark with at least 5 years in... ...with modern data stacks like Databricks or Snowflake is essential....DatabricksPipelineSenior
Taskus India
New York, NY1 day ago - ...Synoptek is seeking an experienced Data Engineer in the United States to design and manage scalable ETL/ELT pipelines leveraging Medallion... ...role requires strong expertise in Databricks, Delta Lake, and extensive experience with PySpark and SQL to build robust data ingestion...DatabricksPipelineSenior
Synoptek
New York, NY2 days ago - ...About the job Senior Data Engineer - Databricks Job Overview: We are seeking a skilled Data... ...development and optimization of data pipelines, implementing robust data checks, and... ...field. ~ Strong proficiency in PySpark, Python, SQL. ~ Strong experience...DatabricksPipelineSenior
Inizio Partners
New York, NY1 day ago $160k - $210k
...Overview Join to apply for the Senior Data Engineer role at Enigma Technologies, Inc. This... ...source data, through scalable data pipelines and models to the customer interface... ...millions of U.S. small businesses (we use Databricks SQL, PySpark, and MLFlow). You\'ll be building...DatabricksPipelineSeniorEnigma Technologies
New York, NY4 days ago- Senior Data Engineer - Media Org (Hybrid NYC or LA) I’m working on a Senior Data Engineer... ...batch and real-time data pipelines, working heavily within a Databricks environment, helping shape modern... ...Technical Requirements Strong PySpark and SQL expertise Experience with...DatabricksPipelineSeniorFull time
- ...for the following position: Senior Data Engineer Job Overview Design, build... ...modular and scalable data pipelines and data infrastructure leveraging... ...Analytics Services, Azure Databricks, Microsoft Purview, and... ...SQL, Python, and Spark/PySpark is required. Experience with...DatabricksPipelineSenior
Cpus Engineering Staffing Solutions Inc.
New York, NY4 days ago - Overview Senior Data Engineer with CI/ CD - Finance (Regulatory) - New York, NY. Onsite... ...maintain scalable and efficient data pipelines using Snowflake, Pyspark, and SQL. Write optimized and... ...Good knowledge in Azure and Databricks is highly preferred. Knowledge of...DatabricksPipelineSeniorContract workWork at office
- ...into a single, unified data platform to power... ...AI initiatives. As a Senior Data Engineer , you will play a critical... ...data platform on Databricks and AWS, following Medallion... ...and ETL/ELT pipelines from core business systems... ...in Python (PySpark, scripting, API integrations...DatabricksPipelineSeniorFull time
Level Access
New York, NY1 day ago $175k - $195k
...As a data engineer on our core Data Platform team, you will help level... ...engineering experience building data pipelines, and maintaining and scaling... .... We use AWS and Databricks here Strong programming skills... ...Comfortable working with Spark/PySpark, Databases and Data...DatabricksPipelineSeniorWork at officeWork from home2 days per weekTatari
New York, NY4 days ago$77.92k - $125.73k
...Position Summary The Senior Data Engineer focuses on the development of analytics... ...models and data ingestion pipelines related to three core data... ...skills in SQL, Python, and Databricks in the areas of... ...using data-focused packages (PySpark, Pandas, or similar). Three...DatabricksPipelineSeniorLocal areaFlexible hoursProgressive Data Jobs
New York, NY3 days ago$140k - $160k
...Job Description The Data Engineering team is seeking a Senior Data Engineer to help design,... ...Lake, including medallion pipeline patterns (Bronze/Silver/Gold... ...pipelines leveraging Databricks Auto Loader, Structured Streaming... ...Spark). Expertise in PySpark, SQL, and Spark‑based...DatabricksPipelineSeniorWork at office3 days per weekJobr
New York, NY2 days ago- ...Teams + 1 In-person interview Senior Data Engineer Job Responsibilities and... ...operations and resolve pipeline issues as a senior Data Engineer... ...data pipelines using PySpark within the Medallion Lakehouse architecture on Databricks, supporting credit risk analytics...DatabricksPipelineSeniorContract work
Compu-Vision Consulting
New York, NY3 days ago $100k - $143k
...join a team of analytics engineers focused on delivering... ..., and reliable data to power various business... ...and maintain dbt data pipelines to deliver clean, reliable... ...and processing using PySpark and AWS Glue. Apply... ...working knowledge of Databricks, including SQL, notebooks...DatabricksPipelineSeniorLocal area3 days per weekNew York Life
New York, NY3 days ago- ...Lead Data Engineer - Palantir & PySpark (Lead Data engineer role where experience should be on both hands... ...Design, develop, and maintain data pipelines and ETL workflows using PySpark, SQL... ...services (e.g., S3, Snowflake, Databricks). Should be familiar with...DatabricksPipelineRemote work
VBeyond
Jersey City, NJ3 days ago - ...proprietary AI Studio and AI Engines, the company helps... ...potential with AI. Senior Data Engineer Are you an... ...real-time and batch pipelines, and developing cloud-... ...as AWS, GCP, Azure, Databricks, and Snowflake? We are... ...tuning), and PySpark/Apache Spark. Data...DatabricksPipelineSeniorH1bLocal area
Fusemachines
New York, NY1 day ago - Optomi, is seeking a Software Engineer to join a high-impact Data Engineering team... ...developing data ingestion pipelines, ETL frameworks, and large... ...experience with AWS Glue and PySpark, a solid foundation in... ...with Redshift, Snowflake, Databricks, or modern cloud data warehouse...DatabricksPipelineSenior
- ...We’re looking for a Senior Data Engineer to design, build, and optimize our... ...leader, owning end-to-end data pipelines and modeling, and setting... .... You’ll work heavily with Databricks, Spark, SQL, and Python ,... ...for data engineering (e.g., PySpark, data processing libraries,...DatabricksPipelineSeniorFull timeLocal areaRemote workWork visa
Quilt Software
New York, NY2 days ago $140k - $155k
...Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of... ...markets. Looking for Senior Data engineer with... ...development involving Python, Pyspark, SQL, Snowflake, and Databricks platforms. Implement... ...robust data pipelines. Hands‑on experience with...DatabricksPipelineSeniorTemporary workFlexible hoursSynechron
New York, NY3 days ago$120.8k - $217.4k
...Acuity Brands is seeking a Senior Data Engineer to join its Atrius Analytics... ...scalable data engineering pipelines for ingesting, transforming... ...Apache Flink, Apache Spark, and Databricks. Build and maintain time‑... ...such as Python, Java, PySpark, Scala, and R. Qualifications...DatabricksPipelineSenior- ...real‑time streaming data solutions that enable... ...telemetry data. While the Senior Data Engineer will support batch... ...microservices, and pipelines that feed both operational... ...on Azure and Databricks, with primary focus on... ...Databricks pipelines using PySpark, Spark SQL, and Delta...DatabricksPipelineSeniorTemporary workWork at officeRemote workVisa sponsorship
Medical Guardian
New York, NY3 days ago - ...Description - We are seeking a senior Counterparty Credit Risk (CCR) Data Integration Engineer to assume end-to-end... ...observable data integration pipelines across CCR technology... ...of hands-on experience with Databricks and PySpark for large scale ETL and data...DatabricksPipelineSeniorPermanent employmentTemporary workFixed term contract
Compu-Vision Consulting
New York, NY2 days ago - ...Optomi is seeking a Software Engineer to join a high-impact Data Engineering team responsible for building scalable,... ...you will design and develop data ingestion pipelines and ETL frameworks using AWS services like Glue, PySpark, and EMR. The ideal candidate should have...PipelineSenior
Optomi
New York, NY3 days ago - ...seeking energetic and passionate Senior Data Engineer to design and execute our... ...deployment of optimal data pipelines taking advantage of leading... ...processes using Python, PySpark, and data integration tools... ...with Redshift, Snowflake, Databricks SQL, Oracle, Postgres, MySQL...DatabricksPipelineSeniorLocal area3 days per week
New York Life
New York, NY3 days ago $150k - $180k
...team at DriveWealth develops data products to support the... ...requirements. We are looking for a Senior Data Engineer to take ownership of... ...), and orchestrating data pipelines (Databricks and/or Airflow) ~2+... ...Languages: Python, SQL, Spark (PySpark, Spark SQL) ~...DatabricksPipelineSeniorFull timeWork at officeWorldwideDriveWealth
New York, NY4 days ago- ...lookout for a skilled Senior Analytics Engineer with strong software... ...about games and big data. This is a full-time... ...develop innovative data pipelines, data products, data... ...Python and PySpark. 5+ years of hands-on... ...Experience working in Databricks & Azure environment (...DatabricksPipelineSeniorFull timeWork at office
- ...Programmers.io is looking for a Data Engineer in Jersey City, NJ. This hybrid role requires a candidate with extensive experience (10+ years) in Python and PySpark, strong skills in building scalable data pipelines, and a solid grasp of KYC/AML domains. The ideal candidate...PipelineSenior
programmers.io
Jersey City, NJ4 days ago $175.5k - $180k
..., and optimize modern data platforms that power advanced... ...to architect scalable pipelines, manage secure and... ..., Machine Learning Engineers, Designers, and domain... ...strong skills in SQL and PySpark Hands‑on experience... ...Practical experience with Databricks, AWS Glue, and...DatabricksPipelineSeniorHourly payApprenticeshipWork at officeEasy workMcKinsey & Company
New York, NY2 days ago$156.8k - $235.2k
...Overview We are hiring a Senior Lead Data Engineer to build and scale the... ...You will design and operate pipelines processing billions of daily... ...pipelines (Spark, Flink, Databricks, Airflow) producing ML... ...Deep experience with Spark (PySpark/Scala), Databricks, Airflow...DatabricksPipelineSeniorParamount
New York, NY4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer Databricks & PySpark Pipelines. Be the first to apply!
Related searches
- staff data engineer New York, NY
- data engineering intern summer New York, NY
- senior data integration developer New York, NY
- data engineer graduate New York, NY
- data engineer contract New York, NY
- data science developer New York, NY
- senior data center engineer New York, NY
- software data engineer New York, NY
- hadoop big data developer New York, NY
- data developer New York, NY