Data Engineer - Databricks on AWS & Spark
VySystems
A data solutions company in Georgia is seeking a qualified candidate with strong expertise in Databricks Lakehouse architecture and advanced experience with PySpark and Spark SQL. Ideal applicants will possess a deep knowledge of AWS services and data orchestration tools like Airflow. Strong communication and collaboration skills are essential to convey complex concepts effectively and to work across teams. This role offers an opportunity to significantly impact data platform development and operations. #J-18808-Ljbffr VySystems
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - Databricks on AWS & Spark in New York, NY vacancy
- Qualifications Strong expertise in Databricks Lakehouse architecture on AWS. Advanced hands-on experience with PySpark, Spark SQL, Delta Lake, and performance tuning. Experience... ...Strong knowledge of AWS services used in data platforms Familiarity with data reconciliation...DatabricksAmazon Web Service
- ...We are looking for a skilled Data Engineer to design, build, and maintain... ...have experience with Python, Databricks, S3, and modern data... ...temporal datasets stored in AWS S3. Collaborate with data scientists... ...experience with Databricks and Spark for large-scale data processing...DatabricksAmazon Web ServiceFull timeWork at officeRemote work
Urban SDK
New York, NY11 hours ago $75 - $85 per hour
...company, is looking for a Senior Data Engineer to support their Product... ...and Python, primarily through Databricks and Airflow. The right candidate... ...production experience with Spark and Kafka, hands‑on Airflow... ...expertise. Basic understanding of AWS or another cloud provider (S3...DatabricksAmazon Web ServiceHourly payContract workLocal areaKellyMitchell Group
New York, NY2 days ago$160k - $200k
As a Senior Data Engineer at Rearc, you'll be the technical anchor on complex... ..., hands‑on expertise with Databricks and the broader modern data... ...platforms Expert‑level in Apache Spark, including runtime internals,... ...two major cloud platforms (AWS, Azure, GCP) with genuine...DatabricksAmazon Web ServiceWork experience placement- Overview Job Title: Senior Data Engineer (Banking) Location: New York City... ...: Data engineer, Snowflake, Databricks, Python, PySpark, SQL,... ...and Databricks (Delta Lake, Spark optimization). Proficiency in... ...Experience with cloud platforms (AWS/Azure) and CI/CD tools (Jenkins...DatabricksAmazon Web ServiceContract work
- ...experience with Apache Spark (Batch and/or Streaming... ...Experience with SQL and data transformation logic.... ...Understanding of software engineering best practices (version... ...platforms such as AWS, Azure, or Google Cloud... ...Experience with Delta Lake, Databricks, or Snowflake....DatabricksAmazon Web Service
- We are seeking a skilled Data Engineer to support our organization’s generative... ...engineering workflows using Spark and Delta Lake to prepare... ...using Delta Lake and Databricks SQL warehouses to support AI... ...Familiarity with cloud platforms (AWS, GCP, or Azure) and their data...DatabricksAmazon Web Service
- 10+ years of hands‑on data engineering experience, including technical leadership... ...hands‑on expertise with the Databricks Lakehouse Platform, including... ...data processing using Apache Spark (PySpark and Spark SQL) or... ...one major cloud platform (AWS, Azure, or GCP) and its core...DatabricksAmazon Web Service
- ...Overview: We are seeking a skilled Data Engineer to join our dynamic team.... ...-based data solutions using AWS, Azure, or GCP. Ensure data... ..., S3, Kinesis, Athena Azure: Databricks, Data Factory, Azure SQL Database... ...big data tools like Hadoop, Spark, or Airflow. Experience with...DatabricksAmazon Web ServiceRemote jobContract workFlexible hours
- We are hiring a Data Engineer on behalf of one of our prestigious Fortune 500 Healthcare clients... ...with cloud platforms such as AWS, Azure, or GCP. Experience with big data technologies like Spark, Hadoop, or Databricks is preferred. Knowledge of data warehousing...DatabricksAmazon Web ServiceVisa sponsorship
$175k - $195k
As a data engineer on our core Data Platform team, you will help level up Tatari’s data platform... ...cloud based infrastructure. We use AWS and Databricks here Strong programming skills in... ...source frameworks such as Airflow, Kafka, Spark, Kubernetes, etc. Comfortable working...DatabricksAmazon Web ServiceWork at officeWork from home2 days per week- ...providers, and researchers through data-driven solutions. Their mission... ...tuning, and best practices in data engineering. Technologies Python Databricks Hive AWS EMR S3 Oracle SQL DataStage... ...data processing pipelines using Spark, Hive, and Python Collaborate with...DatabricksAmazon Web ServiceRemote workFlexible hours
$138k - $181.65k
...We are looking for a Senior Data Engineer to design and build scalable,... ...and assets using tools like Spark, dbt or similar frameworks Collaborate... ..., Spark, dbt, Kafka, or Databricks. Deep understanding of data... ...‑based data platforms (e.g., AWS, GCP, Azure). Strong problem‑...DatabricksAmazon Web ServiceTemporary workLocal areaWorldwideSenior AI Software EngineerFanDuel
New York, NY1 day ago$241k - $338k
...compute capacity, AI research and engineering, and state‑of‑the‑art... ...Opportunity The role is part of the Data Engineering team, which... ...computing frameworks like Databricks, Spark, or Ray for large‑scale data... ...with cloud infrastructure (AWS preferred) and HPC environments...DatabricksAmazon Web ServiceWorldwideRelocation package$250k
Senior Consultant, Data Engineering & Analytics Join to apply for the Senior... ...‑in‑class tools (Snowflake, Databricks, dbt, Dagster, cloud infrastructure... ...‑grade code (Python/Spark) for data transformation and... ...least one major cloud platform (AWS, GCP, or Azure) and associated...DatabricksAmazon Web ServiceFull time$220k - $230k
...leader in digital assets and data center infrastructure,... ...processing systems Work within the Databricks and Spark ecosystem to support large-... ...-native data solutions on AWS Leverage dbt for transformation... ...best practices in software engineering Mentor and develop other...DatabricksAmazon Web ServiceLocal areaFlexible hours(Brand Shop) Ttl Trading Private Limited- Thoppumpady
New York, NY3 days ago$155k - $185k
...enterprises by fusing ERP and CRM data into actionable insights. As a Senior Data Engineer, you will own the Databricks pipelines that make this... ...scale across both Azure and AWS environments. Own the Delta... ...on Databricks or the Apache Spark ecosystem across Azure and/or...DatabricksAmazon Web ServiceRemote work$112k - $150.1k
Data Engineer II Job ID 10153088 Location Seattle, Washington, United States... .... Experience working with Databricks or an equivalent large‑scale... ...public cloud provider (e.g., AWS, Microsoft Azure, Google... ...processing frameworks, such as Apache Spark. Demonstrated knowledge of...DatabricksAmazon Web ServiceWork experience placementWorldwide- ...to us to help bring their data, AI, cloud and digital solutions... .... All the shiny tech : Databricks, Snowflake, Azure, GCP, AWS. You’ll use it, play with... ..., let’s talk. As a Data Engineer (Senior Consultant) You’re... ...You will work with: Python, Spark, Airflow Snowflake,...DatabricksAmazon Web ServiceWeekly payWork from home
- .... in New York is seeking an Intermediate Data Engineer to design and manage scalable ETL pipelines... .... The role involves working with AWS services and optimizing data processes within... ...pipelines, and proficiency in PySpark and Apache Spark. This position will require onsite work...Amazon Web Service
- ...insider threats and social engineering by simulating multi-... ...with comprehensive data and automatically deliver... ...distributed technology in Cloud, Spark, Flink, Redis, Kafka,... ..., BigQuery, Redshift, Databricks, Terraform or... ...cloud infra (preferably AWS). Bachelor’s degree in...DatabricksAmazon Web ServiceFull timeWork at officeRemote work
$160k - $175k
...Velir acquired Brooklyn Data Company, a premier data... ...Data & Analytics Engineer will play a crucial role... ...with a strong emphasis on Databricks as the primary platform... ...cloud platforms such as AWS, Azure, or Google Cloud... ...streaming solutions such as Spark Streaming or Kafka is...DatabricksAmazon Web ServiceRemote work$70 - $85 per hour
Lead Data Engineer Location: Remote Duration: 6+ months Compensation: $70.00 - 85.00/hr Work... ...scalable data pipelines using Apache Spark on Databricks. Build and manage Delta Lake... ...and cost-efficiency in cloud platforms (AWS, Azure, or GCP). Ensure data quality,...DatabricksAmazon Web ServiceContract workLocal areaRemote workFlexible hours$106.9k - $176.5k
...Consultant - Financial Services - Data & Analytics - Data Architecture and Engineering. Join EY to solve complex data... ...: Cloud platforms - AWS, Azure, GCP, Databricks, Snowflake Big data & distributed processing - Hadoop, Spark ecosystem Integration tools -...DatabricksAmazon Web ServiceWork at officeFlexible hours- ...energetic and passionate Senior Data Engineer to design and execute our... ...technologies and platforms including AWS and Azure cloud, APIs, and AI... ...and debug code in PySpark/Spark/Python. Strong SQL and query... ...with Redshift, Snowflake, Databricks SQL, Oracle, Postgres, MySQL,...DatabricksAmazon Web ServiceLocal area3 days per week
- A leading data solutions company in New York is seeking a Mid-Senior level Data Engineer. The role involves designing and optimizing high-performance Spark-based data pipelines using Python/PySpark. Candidates... ...have strong experience with AWS services and data warehousing...Amazon Web ServiceFull time
$130k - $150k
..., digital, cloud & DevOps, data, and software engineering. With over 20 years of experience... ...patterns, primarily in Databricks. Build and maintain data... ...an application developer. AWS Certified Cloud Practitioner... ...including experience with PySpark/Spark for data engineering and...DatabricksAmazon Web ServiceTemporary workWork experience placementFlexible hours$135.38k - $216.68k
...Leadership Role in Data Engineering At Razorfish, we're leaders in what's next. Since the... ...data technologies in GCP with Azure, AWS, or Databricks also desired. ~ Experience building,... ...Experience with ML and/or AI services (i.e. Spark, AWS ML, Tensorflow, etc.) a plus. ~...DatabricksAmazon Web ServiceTemporary workFreelanceWork at officeLocal areaFlexible hoursMSLGROUP
New York, NY1 day ago- The Cypress Group is seeking a Data Engineer to join our expanding Data Engineering team in New York City. This... ...will write efficient code in Python, Scala, or Spark / PySpark, develop and optimize ETL processes with AWS and SQL, and leverage Parquet and Snowflake to boost...Amazon Web Service
$141.9k - $190.3k
Sr Data Engineer Apply Now Apply Later Job ID 10147075 Location Santa Monica, California, United... ...use cases. You will work across AWS, Databricks, Unity Catalog, Snowflake and Airflow to... ...Hands‑on experience with PySpark and/or Spark SQL in production. Strong understanding...DatabricksAmazon Web ServiceLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Databricks on AWS & Spark. Be the first to apply!
Related searches
- data engineer analytics New York, NY
- associate data engineer New York, NY
- junior data developer New York, NY
- data engineer manager New York, NY
- remote data engineer New York, NY
- junior data engineer remote New York, NY
- senior cloud data engineer New York, NY
- data platform engineer New York, NY
- data infrastructure engineer New York, NY
- aws data engineer New York, NY