Data Engineer - Databricks on AWS & Spark
VySystems
A data solutions company in Georgia is seeking a qualified candidate with strong expertise in Databricks Lakehouse architecture and advanced experience with PySpark and Spark SQL. Ideal applicants will possess a deep knowledge of AWS services and data orchestration tools like Airflow. Strong communication and collaboration skills are essential to convey complex concepts effectively and to work across teams. This role offers an opportunity to significantly impact data platform development and operations. #J-18808-Ljbffr VySystems
Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the Data Engineer - Databricks on AWS & Spark in New York, NY vacancy
- ...Reference Number: 25-00661Title: DATA ENGINEERPosted Date: 2025-... ...:Proficiency in data engineering programming languages (... ...frameworks (pspareferably Spark, alternatively Flink or Storm... ...platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), atleast...DatabricksAmazon Web Service
$100 - $130 per hour
A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay... ...and managing Cloud databases such as AWS RDS, DynamoDB, DocumentDB or analogous... ...experience is a plus Experience using Spark, Kafka, Hadoop, or similar distributed...DatabricksAmazon Web ServiceRemote work$197.3k - $225.1k
...Overview Lead Data Engineer (Python, AWS, Spark, SQL, Snowflake, Databricks, & GenAI) (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive...DatabricksAmazon Web ServiceFull timePart timeInternshipH1bLocal area- ...Data EngineerDesign, build, and optimize scalable... ...Kyriba into Snowflake and Databricks. Develop and own... ...pipelines and feature engineering built on top of treasury... ...in Databricks, Apache Spark (PySpark/SQL).Proven experience... ...-on experience with AWS services — including S3...DatabricksAmazon Web Service
TPI Global
New York, NY1 day ago - ...datateknologier? Vi ser nå etter flere Data Engineers som ønsker å bli en del av vå... ..., medtjenestersom Databricks,Fabric/Synapse, ellerSnowflake... ...Skybasert arkitektur i Azure, AWS eller Google Cloud,og gjerne... ...Big Data rammeverk som Apache Spark, BigQuery, Apache Flinkeller...DatabricksAmazon Web Service
Sopra Steria
New York, NY2 days ago $197.3k - $225.1k
...Overview Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery...DatabricksAmazon Web ServiceFull timePart timeInternshipH1bLocal area- ...Science, Business Analytics, Engineering, Mathematics, or... ...professional experience in data engineering, software... ...platforms such as (AWS, GCP, Azure, Oracle) and... ...LakePractical experience with Databricks, AWS Glue, and... ...distributed systems such as (Spark, Dask, Flink) and...DatabricksAmazon Web ServiceApprenticeshipEasy work
- Qualifications Strong expertise in Databricks Lakehouse architecture on AWS. Advanced hands-on experience with PySpark, Spark SQL, Delta Lake, and performance tuning. Experience... ...Strong knowledge of AWS services used in data platforms Familiarity with data reconciliation...DatabricksAmazon Web Service
- ...We are looking for a skilled Data Engineer to design, build, and maintain... ...have experience with Python, Databricks, S3, and modern data... ...temporal datasets stored in AWS S3. Collaborate with data... ...experience with Databricks and Spark for large-scale data processing...DatabricksAmazon Web ServiceFull timeWork at officeRemote work
Urban SDK
New York, NY2 days ago $110k - $130k
...At The New York Times, data powers decisions across... ...'re looking for a Data Engineer to help us build them.... ...hybrid cloud architecture (AWS and GCP) and contribute... ....Administer and tune Spark computeresources (e.g.,... ...(BigQuery, Snowflake, DataBricks)Familiarity with foundational...DatabricksAmazon Web ServiceFull timeLocal areaFlexible hours- ...Graph Data EngineerLocal only. Must be able to work 4 days on... ...Position Overview:The graph data engineer is responsible for... ...engineering applications within AWS.Ability to work in an Agile... ...including Integration and UI development. Experience with Spark and Databricks....DatabricksAmazon Web Service
Anveta
New York, NY3 days ago - ...leading hedge fund is seeking a Senior Data Engineer to build and evolve the data... ...data lake infrastructure, leveraging AWS and Databricks to manage large-scale structured and unstructured... ...such as AWS, Snowflake, Databricks, Spark, Kafka or similar is advantageous. Why...DatabricksAmazon Web Service
Goldman Lloyds
New York, NY2 days ago $116.2k - $229.1k
...Join Deloitte’s AI & Engineering practice and help organizations... ...platforms, modernize data environments, and... ...through innovation. As a Databricks Engineer in our AI & Data... ...such as Azure DevOps, AWS Code Pipeline, Jenkins,... ...architecture, Apache Spark, Delta Lake, cloud-native...DatabricksAmazon Web ServiceLocal areaVisa sponsorship- ...Data EngineerMust Have Technical/Functional SkillsHands-on experience in building ETL using Databricks SaaS infrastructure.Experience in developing data pipeline... ...standards.Expertise in AWS Compute (EC2, EMR), AWS... ...using Databricks and Apache Spark (PySpark and Scala).Build...DatabricksAmazon Web ServiceFull time
JConnect Infotech
New York, NY3 days ago $110k - $190k
Senior Data Management Professional - Data Engineering - Entities Location New York Business... ...data tooling such as Spark, Airflow, Kafka, or equivalent... ....• Experience working in AWS and/or Azure for cloud-... ..., ADLS, Data Factory, or Databricks.• Experience implementing...DatabricksAmazon Web ServiceTemporary workFor contractorsWork experience placement$137.4k - $161.7k
...West Monroe is seeking a Senior Data Engineer to join our Data & AI... ...Working with technologies such as Databricks, Snowflake, and Microsoft Fabric... ...cloud data solutions using AWS, Azure, and GCP, integrating... ...-native data pipelines using Spark, SQL, Python, and modern orchestration...DatabricksAmazon Web ServiceLocal areaImmediate startFlexible hours$73.15k - $112.55k
...multicultural, and future-proofed data capabilities.... ...cloud-native technologies (AWS, Databricks) and SQL-based processing. Design... .... Collaborate with the data engineering team on performance tuning,... ...Working knowledge of Databricks (Spark, notebooks, jobs, Delta tables...DatabricksAmazon Web ServiceFlexible hoursDigitas
New York, NY1 day ago- ...Big Data EngineerWe are seeking a highly skilled Big Data Engineer to design, develop, and maintain scalable... ...Technologies: Hadoop, Spark, Hive, HBase, KafkaData... ...: Informatica, Talend, AWS Glue, Azure Data FactoryCloud... ...architectures using Databricks, Delta Lake, or Apache...DatabricksAmazon Web ServiceRemote work
Ova Technologies
New York, NY3 days ago $215.2k - $244.7k
...clients developing Big Data strategy and roadmaps,... ...platform selection advice for Databricks, Snowflake, and/or... ...toolsets such as Spark on Scala, Storm, Flume,... ...Models (LLMs), prompt engineering, embeddings, vector databases... ...cloud platforms such as AWS, Azure, GCP etc....DatabricksAmazon Web ServiceLocal areaImmediate startFlexible hours- ...Data Engineering-Big Data EngineeringAs a technical lead, you will guide engineering... ...leveraging Snowflake, AWS, Apache Airflow and modern... ...experience working with Snowflake, Databricks, or similar cloud-native data... ...Data technologies including Spark, Hadoop, Hive, HBase, Kafka,...DatabricksAmazon Web Service
EXL
New York, NY3 days ago - ...Job Title : Senior Data/Software Engineer Job Location - Address : New York, United States... ...Cluster : Data-Talend with Big Query, DBT, Spark, GCP data services, cloud storage,... ...with cloud data platforms (e.g., GCP, AWS, Databricks, BigQuery), familiarity with BI/visualization...DatabricksAmazon Web Service
Tek Leaders Inc
New York, NY12 days ago - ...Data Engineering Manager Location: Toronto, Ontario, Canada (Hybrid/Onsite as required... ...development, and optimization of our Databricks and AWS-based data ecosystem. In this role, you... ...with deep expertise in Databricks, Spark, and modern cloud data frameworks....DatabricksAmazon Web ServiceFull time
Perennial Resources International
New York, NY3 days ago - ...Lead Data EngineerLocations: Richmond - VA / McLean - VA / Plano... ...deployment of scalable data engineering solutions that deliver... ...using cloud technologies like AWS.Develop and maintain efficient... ...such as AWS Glue, Spark, and Databricks.Optimize database performance...DatabricksAmazon Web ServiceWork at office
InterSources
New York, NY4 days ago - ...Commerce Orchestration Engine helping enterprise retailers... ...We are hiring a Lead Data Engineer to drive... .... Work across multiple Databricks instances as part of a... ...complexity. Implement complex Spark and Databricks... ...with sources in Azure, AWS, GCP, and others Why Logicbroker...DatabricksAmazon Web ServiceFor contractorsWork at officeRemote work
Logicbroker
New York, NY2 days ago - ...Sr Data EngineerTechnology is at the heart of Disney's past, present... ...is a global organization of engineers, product developers,... ...cases. You will work across AWS, Databricks, Unity Catalog, Snowflake and... ...experience with PySpark and/or Spark SQL in production.Strong understanding...DatabricksAmazon Web Service
Walt Disney Company
New York, NY1 day ago $73k - $98k
...employees. Role Description We are seeking a Databricks Engineer with AWS expertise to build, optimize, and maintain our enterprise data Lakehouse infrastructure. In this role, you... ...control. Performance Optimization: Tune Spark clusters, optimize Delta Lake storage (e.g....DatabricksAmazon Web ServiceWork at officeLocal areaWork from homeWorldwideSMBC Group
New York, NY1 day ago$186k - $223k
...Senior Data EngineerHinge is the dating app designed to be deleted... ...the Role:As a Senior Data Engineer at Hinge, you will create essential... ...Kafka, Airflow, dbt, Looker, AWS technologies (S3, Redshift),... .../CD technologies (CircleCI). Spark/Databricks a plus!$186,000 - $223,000 a...DatabricksAmazon Web ServiceWork experience placementMatch Group
New York, NY1 day ago- ...Senior Data Automation EngineerBloomberg runs on data... ...Senior Data Automation Engineer who operates at the... ...modern data tooling such as Spark, Airflow, Kafka, or... ....Experience working in AWS and/or Azure for cloud-... ...ADLS, Data Factory, or Databricks.Experience implementing...DatabricksAmazon Web ServiceWork experience placement
Bloomberg
New York, NY17 hours ago - ...seeking a highly motivated Engineering Consultant with experience in... ...Sciences domain to work on data and analytics-driven initiatives... ...with cloud platforms (AWS, Azure, or GCP) and modern data... ...tools such as Python, SQL, Spark, Databricks, Snowflake, or similar technologies...DatabricksAmazon Web Service
- ...a scalable analytics platform to empower data stakeholders across the company. As a Data Engineer, you will design fault-tolerant cloud data... ...infra with business goals. You will work with Databricks, Spark, Kafka, Airflow, and AWS/GCP/Azure, applying IaC practices and...DatabricksAmazon Web Service
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Databricks on AWS & Spark. Be the first to apply!
Related searches
- bi data engineer New York, NY
- data engineer analytics New York, NY
- principal data engineer New York, NY
- senior cloud data engineer New York, NY
- data center engineer New York, NY
- staff data engineer New York, NY
- director data engineering New York, NY
- data engineer graduate New York, NY
- big data devops engineer New York, NY
- azure data engineer New York, NY