Data Engineer - Databricks on AWS & Spark
VySystems
A data solutions company in Georgia is seeking a qualified candidate with strong expertise in Databricks Lakehouse architecture and advanced experience with PySpark and Spark SQL. Ideal applicants will possess a deep knowledge of AWS services and data orchestration tools like Airflow. Strong communication and collaboration skills are essential to convey complex concepts effectively and to work across teams. This role offers an opportunity to significantly impact data platform development and operations. #J-18808-Ljbffr VySystems
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - Databricks on AWS & Spark in New York, NY vacancy
- ...Reference Number: 25-00661Title: DATA ENGINEERPosted Date: 2025-... ...:Proficiency in data engineering programming languages (... ...frameworks (pspareferably Spark, alternatively Flink or Storm... ...platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), atleast...DatabricksAmazon Web Service
$100 - $130 per hour
A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay... ...and managing Cloud databases such as AWS RDS, DynamoDB, DocumentDB or analogous... ...experience is a plus Experience using Spark, Kafka, Hadoop, or similar distributed...DatabricksAmazon Web ServiceRemote work- ...Science, Business Analytics, Engineering, Mathematics, or... ...professional experience in data engineering, software... ...platforms such as (AWS, GCP, Azure, Oracle) and... ...LakePractical experience with Databricks, AWS Glue, and... ...distributed systems such as (Spark, Dask, Flink) and...DatabricksAmazon Web ServiceApprenticeshipEasy work
$100k - $140k
...bonusesResponsibilitiesWe are hiring a hands-on senior level Data Engineer to build trustworthy, well governed... ...platforms (e.g., Microsoft Fabric, Databricks, Snowflake, AWS)Experience building data solutions in... ...processing frameworks (e.g., Spark)Knowledge of data warehousing...DatabricksAmazon Web ServiceWork at officeRemote workWeekend work3 days per week$197.3k - $225.1k
...Overview Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery...DatabricksAmazon Web ServiceFull timePart timeInternshipH1bLocal area$110k - $130k
...At The New York Times, data powers decisions across... ...'re looking for a Data Engineer to help us build them.... ...hybrid cloud architecture (AWS and GCP) and contribute... ....Administer and tune Spark computeresources (e.g.,... ...(BigQuery, Snowflake, DataBricks)Familiarity with foundational...DatabricksAmazon Web ServiceFull timeLocal areaFlexible hours- Qualifications Strong expertise in Databricks Lakehouse architecture on AWS. Advanced hands-on experience with PySpark, Spark SQL, Delta Lake, and performance tuning. Experience... ...Strong knowledge of AWS services used in data platforms Familiarity with data reconciliation...DatabricksAmazon Web Service
- ...energetic and passionate Senior Data Engineer to design and execute our... ...technologies and platforms including AWS and Azure cloud, APIs, and AI... ...and debug code in PySpark/Spark/Python. Strong SQL and query... ...with Redshift, Snowflake, Databricks SQL, Oracle, Postgres, MySQL,...DatabricksAmazon Web ServiceLocal area3 days per week
$137.4k - $161.7k
...West Monroe is seeking a Senior Data Engineer to join our Data & AI... ...Working with technologies such as Databricks, Snowflake, and Microsoft Fabric... ...cloud data solutions using AWS, Azure, and GCP, integrating... ...-native data pipelines using Spark, SQL, Python, and modern orchestration...DatabricksAmazon Web ServiceLocal areaImmediate startFlexible hours- ...Data Engineer Location - New York, NY Onsite Experience – 10 To 1... ...experience in building ETL using Databricks SaaS infrastructure. •... ...standards. • Expertise in AWS Compute (EC2, EMR), AWS Storage... ...using Databricks and Apache Spark (PySpark and Scala). • Build...DatabricksAmazon Web ServicePermanent employmentFull time
AceStack LLC
New York, NY2 days ago $150k - $160k
...$160K/Annum Job Description: Data Engineering Skilled in building scalable cloud data... ...manufacturing and IoT data using Spark, Kafka, Airflow, and Delta Lake.... ...medallion/ Lakehouse architectures on Databricks, Snowflake, AWS, or Azure. Must have skills: ~...DatabricksAmazon Web ServiceApTask
New York, NY2 days ago- ...We are seeking a talented Data Engineer with strong communication skills, passion for solving... ...teams on cloud platforms (e.g. AWS, Azure, GCP). · Ensure data accuracy... ...with cloud Data Warehouse solutions - Databricks, Apache Spark · Experience working with data...DatabricksAmazon Web ServiceLocal area
Cornerstone OnDemand
New York, NY2 days ago - ...Data Engineering Manager Location: Toronto, Ontario, Canada (Hybrid/Onsite as required... ...development, and optimization of our Databricks and AWS-based data ecosystem. In this role, you... ...with deep expertise in Databricks, Spark, and modern cloud data frameworks....DatabricksAmazon Web ServiceFull time
Perennial Resources International
New York, NY2 days ago $215.2k - $244.7k
...clients developing Big Data strategy and roadmaps,... ...platform selection advice for Databricks, Snowflake, and/or... ...toolsets such as Spark on Scala, Storm, Flume,... ...Models (LLMs), prompt engineering, embeddings, vector databases... ...cloud platforms such as AWS, Azure, GCP etc....DatabricksAmazon Web ServiceLocal areaImmediate startFlexible hours- ...develop, and optimize scalable ETL/ELT pipelines using Databricks and Apache Spark (PySpark/Scala). Build robust data ingestion workflows from structured and semi-... ...Python: Strong programming and querying skills. AWS Services: EC2, EMR, S3, EBS, RDS, DynamoDB, Glue,...DatabricksAmazon Web Service
$140k - $180k
...Data Engineer, Data Platform About the Role We are building out... ...architecture across Snowflake and Databricks, as well as building and... ...working with public clouds (e.g., AWS, GCP) Additional Job... ...K5 Global, NewView Capital, Spark Capital, Sutter Hill Ventures...DatabricksAmazon Web ServiceFull timeWork at officeFlexible hoursSigma Computing
New York, NY3 days ago$73k - $98k
...employees. Role Description We are seeking a Databricks Engineer with AWS expertise to build, optimize, and maintain our enterprise data Lakehouse infrastructure. In this role, you... ...control. Performance Optimization: Tune Spark clusters, optimize Delta Lake storage (e.g....DatabricksAmazon Web ServiceWork at officeLocal areaWork from homeWorldwideSMBC
New York, NY3 days ago- ...datateknologier? Vi ser nå etter flere Data Engineers som ønsker å bli en del av vå... ..., medtjenestersom Databricks,Fabric/Synapse, ellerSnowflake... ...Skybasert arkitektur i Azure, AWS eller Google Cloud,og gjerne... ...Big Data rammeverk som Apache Spark, BigQuery, Apache Flinkeller...DatabricksAmazon Web Service
$160k - $200k
As a Senior Data Engineer at Rearc, you'll be the technical anchor on complex... ..., hands‑on expertise with Databricks and the broader modern data... ...platforms Expert‑level in Apache Spark, including runtime internals,... ...two major cloud platforms (AWS, Azure, GCP) with genuine...DatabricksAmazon Web ServiceWork experience placement$112.29k - $179.71k
...across communication, media, data and technology to ensure... ...professionals.OverviewAs a Data Engineer, you will develop and... ...required. • Understanding of Spark required.• Experience Dagster... ...and or Airflow is required.• AWS and Databricks Certifications a bonus• Comfortable...DatabricksAmazon Web ServiceTemporary workFreelanceFlexible hours- ...by connecting real-time data with world-class... ...performing Director, Data Engineering who will be responsible... ...pipelines in Snowflake and Databricks using Delta Lake and... ...tools such as Python and AWS GlueDesign, Build, Test... ...Databricks and Apache Spark (PySpark).Experience with...DatabricksAmazon Web ServiceTemporary workFreelanceFlexible hours
$126k - $180k
...least 5 years of experience in data engineering or a closely related field.... ...scale data warehouses such as Databricks, BigQuery, or Snowflake.... ...as Kafka, Kinesis, Flink, or Spark Streaming, plus familiarity with... ...and optimizing Databricks on AWS. Responsibilities: We design...DatabricksAmazon Web ServiceFull timeContract workWork at officeRemote workFlexible hoursGemini
New York, NY1 day ago- ...seeking a highly motivated Engineering Consultant with experience in... ...Sciences domain to work on data and analytics-driven initiatives... ...with cloud platforms (AWS, Azure, or GCP) and modern data... ...tools such as Python, SQL, Spark, Databricks, Snowflake, or similar technologies...DatabricksAmazon Web Service
- ...complex cloud ecosystems. You’ll ensure data integrity, high availability, and secure access while partnering with engineering and analytics teams to support... ...data platforms and services such as AWS including Databricks and Apache Spark to support data processing and...DatabricksAmazon Web Service
$145k - $165k
...The Team We are looking for a Data Engineer who thrives on solving data problems... ...and SQL ~ Familiarity with Spark (PySpark and SparkSQL) and distributed... ...Airflow, DBT) ~ Familiarity with Databricks and cloud platforms (AWS preferred) ~ Familiarity with infrastructure...DatabricksAmazon Web ServiceFull timeWork at officeRemote workWorldwide2 days per week3 days per weekDriveWealth
New York, NY3 days ago- We are looking for a skilled Data Engineer to design, build, and maintain... ...have experience with Python, Databricks, S3, and modern data... ...temporal datasets stored in AWS S3. Collaborate with data scientists... ...experience with Databricks and Spark for large-scale data processing...DatabricksAmazon Web ServiceFull timeWork at officeRemote work
$125.5k - $230.2k
...Manager - Financial Services - Data and Analytics - Data Architecture and Engineering EY is the only professional... ...as:Cloud Data Platforms (AWS, Azure, Google Platform, Databricks, Snowflake)Big Data applications... ...Platform and Applications (Spark streaming, Kafka, Storm, etc...DatabricksAmazon Web ServiceWork experience placementSummer holidayFlexible hours- ...Your role: Join our team as a Senior Data Engineer building and operating the Alter Domus data platform, a Databricks lakehouse on AWS that hydrates data from our fund... ...Databricks-native orchestration. Tune Spark and SQL workloads for performance and cost...DatabricksAmazon Web ServiceLocal areaFlexible hoursShift work
Alter Domus
New York, NY2 days ago - ...The RoleWe are seeking a Director of Data Platform & Engineering to lead the evolution of Blink’s... ...time and batch data platform, built on AWS and Databricks. This role owns the strategy, execution... ..., and observability across Spark, SQL, and streaming workloadsPeople...DatabricksAmazon Web ServiceTemporary work
$175k - $195k
As a data engineer on our core Data Platform team, you will help level up Tatari’s data platform... ...cloud based infrastructure. We use AWS and Databricks here Strong programming skills in... ...source frameworks such as Airflow, Kafka, Spark, Kubernetes, etc. Comfortable working...DatabricksAmazon Web ServiceWork at officeWork from home2 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Databricks on AWS & Spark. Be the first to apply!
Related searches
- data platform engineer New York, NY
- aws data engineer New York, NY
- azure data engineer New York, NY
- data engineer graduate New York, NY
- big data devops engineer New York, NY
- big data developer New York, NY
- software data engineer New York, NY
- data center engineer New York, NY
- big data cloud engineer New York, NY
- director data engineering New York, NY