Data Engineer - Databricks on AWS & Spark
VySystems
A data solutions company in Georgia is seeking a qualified candidate with strong expertise in Databricks Lakehouse architecture and advanced experience with PySpark and Spark SQL. Ideal applicants will possess a deep knowledge of AWS services and data orchestration tools like Airflow. Strong communication and collaboration skills are essential to convey complex concepts effectively and to work across teams. This role offers an opportunity to significantly impact data platform development and operations. #J-18808-Ljbffr VySystems
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - Databricks on AWS & Spark in New York, NY vacancy
$215.2k - $245.6k
Data Engineer 4 (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At...DatabricksAmazon Web ServiceFull timePart timeInternshipH1bLocal area- Qualifications Strong expertise in Databricks Lakehouse architecture on AWS. Advanced hands-on experience with PySpark, Spark SQL, Delta Lake, and performance tuning. Experience... ...Strong knowledge of AWS services used in data platforms Familiarity with data reconciliation...DatabricksAmazon Web Service
- ...Build What Matters at RevStar Role Title: Data & AI Engineer (Databricks Specialist) Reports To: Data & AI Practice... ...optimize scalable ETL/ELT pipelines using Apache Spark and Delta Lake across multi-cloud environments (AWS, Azure, GCP). Implement robust Lakehouse...DatabricksAmazon Web ServiceRemote jobFull time
Revstar
New York, NY18 days ago $35 per hour
...of Sales Executives, Software Engineers, Data Analysts, Ad Operations,... ...Google BigQuery, Snowflake, Databricks) to support data processing and... ...technologies such as Google BigQuery, AWS Redshift or Databricks... ...Familiarity with PySpark, Spark or other distributed data processing...DatabricksAmazon Web ServiceInternshipLocal area- Data Engineer Remote 6 Months Video • B.S Computer Science or related degree • 4+ years' experience... ..., SQL, and tools like NIFI, Attunity, Spark (Databricks/Qubole), etc. • Hands-on experience... ..., Jenkins) • Hands-on experience with AWS (SQS, S3, Kinesys, Firehose, MKS,...DatabricksAmazon Web ServiceRemote work
$90 - $130 per hour
...card *** Overview: We are seeking a Data Platform Engineer who can build the data infrastructure... ...role with a strong emphasis on Apache Spark, Databricks, and distributed data processing. You... ...Demonstrated experience working with AWS, Azure, or GCP in production data...DatabricksAmazon Web ServiceRemote work- To support data management initiatives, the full-time remote Data Engineer - AI will create and maintain Spark and SQL scripts, optimize data queries,... ...and cloud platforms (e.g., AWS, Azure) 3+ years of... ...orchestration tools like Airflow or Databricks Workflows 3+ years of...DatabricksAmazon Web ServiceFull timeRemote work
$10k
...all. About The Role As a Senior Data Engineer at Hinge, you will create essential data... ...Terraform, Kafka, Airflow, dbt, Looker, AWS technologies (S3, Redshift), GCP... ...BigQuery). and CI/CD technologies (CircleCI), Spark, Databricks As a Member Of Our Team, You’ll...DatabricksAmazon Web ServiceWork experience placementHinge
New York, NY3 hours ago- ...seeking a highly motivated Engineering Consultant with experience in... ...Sciences domain to work on data and analytics-driven initiatives... ...with cloud platforms (AWS, Azure, or GCP) and modern data... ...tools such as Python, SQL, Spark, Databricks, Snowflake, or similar technologies...DatabricksAmazon Web Service
- ...a scalable analytics platform to empower data stakeholders across the company. As a Data Engineer, you will design fault-tolerant cloud data... ...infra with business goals. You will work with Databricks, Spark, Kafka, Airflow, and AWS/GCP/Azure, applying IaC practices and...DatabricksAmazon Web Service
- ...consultants bring deep expertise in Data Science, Machine Learning... ...seeking an experienced Data Engineer to join our data team. In... ...and data infrastructure on AWS cloud. You will collaborate... ...transformation workflows using Databricks, Apache Spark, and SQL. Develop and...DatabricksAmazon Web ServiceLocal area
- Graph Data Engineer Local only. Must be able to work 4 days on site. NYC, NY. Long Term Consulting... ...data engineering applications within AWS. Ability to work in an Agile... ...lifecycle including Integration and UI development. Experience with Spark and Databricks. AnvetaDatabricksAmazon Web ServiceLocal area
$150k - $200k
...Senior Data EngineerGibson Dunn is a leading global law... ...the US, the Senior Data Engineer will be responsible for designing... ...data platforms (e.g., AWS, Azure, Google Cloud, Snowflake, Databricks, or comparable).... ...frameworks (e.g., Apache Spark).Familiarity with pipeline...DatabricksAmazon Web ServiceLocal areaFlexible hoursGibson Dunn
New York, NY2 days ago- ...Development (Spring Boot, REST APIs, SQL, AWS) DevOps & Cloud Engineering (Docker, Jenkins, Kubernetes, Terraform, Azure/AWS/GCP) Data Science & Machine Learning (Python,... ...business KPIs) Data Engineering (Apache Spark, Databricks, ETL, Airflow, cloud data lakes and warehouses...DatabricksAmazon Web ServiceRemote job
$175k - $195k
As a data engineer on our core Data Platform team, you will help level up Tatari’s data platform... ...cloud based infrastructure. We use AWS and Databricks here Strong programming skills in... ...source frameworks such as Airflow, Kafka, Spark, Kubernetes, etc. Comfortable working...DatabricksAmazon Web ServiceWork at officeWork from home2 days per week- ...more sustainable, more inclusive world.Job DescriptionGCP/AWS/Databricks/Snowflake DBT Data Engineer to design, build, and optimize scalable data pipelines... ...• Familiarity with distributed processing frameworks (Spark, Hadoop)• Experience with CI/CD pipelines and version...DatabricksAmazon Web ServiceFull timeLocal area
Capgemini
New York, NY9 hours ago - Data Engineer Simulmedia is looking for an experienced and dynamic Data Engineer with a curious... ...workloads on our lakehouse platform (Databricks / Spark / Delta) and our data warehouse (... ...-side code bases Working knowledge of AWS (S3, IAM, ECS or similar compute) and...DatabricksAmazon Web ServiceWork experience placementRemote work
- Launch Your Data Career with Proof, Not Promises-At SynergisticIT... ...Science, Analytics, or Engineering , it's time to stop... ...Engineering Track: Python/Java, Spark, Airflow, Databricks ETL architecture, Snowflake... ...and cloud data platforms (AWS, Azure) Why Candidates Choose...DatabricksAmazon Web Service
- ...Description We're looking for a Senior Data Engineer to design and implement AI features... ...implement MLOps/LLMOps practices across AWS, Azure, and GCP. You'll own technical... ...databases, and modern frameworks (Spark, LangChain, Databricks, Airflow, and similar). Implement MLOps...DatabricksAmazon Web Service
- Senior Data Engineer Newport Beach, CA (Remote, prefer PST, CST over EST... ...and in Cloud (i.e. Azure or AWS) to build solution for future... ...Azure data factory V2, Azure Databricks, SQLDW or Snowflake, Azure analysis... ...NOT want Big Data, Hadoop, Spark, Python engineers. Software...DatabricksAmazon Web ServiceContract workWork experience placementRemote workFlexible hours
$111.8k
Overview Lead Data Engineer | Build the Future of Data at GATX Remote (Chicago-area preferred... ...do more than just build pipelines on Databricks and AWS. You will help shape enterprise... ...hands-on experience with Databricks (Spark, Delta Lake, Unity Catalog) and AWS (S...DatabricksAmazon Web ServiceTemporary workWork at officeRemote work- ...to insights from their data. We do this in three ways... ...'re looking for a Data Engineer to join our growing... ...such as Microsoft Fabric, Databricks, and Snowflake, meeting... ...optimization (Azure, AWS, GCP) Technical documentation... ...Tools: dbt required; Spark experience a plus...DatabricksAmazon Web ServiceRemote workFlexible hours
- ...Commerce Orchestration Engine helping enterprise retailers... ...We are hiring aLead Data Engineerto drive... .... Work across multiple Databricks instances as part of a... ...complexity. Implement complex Spark and Databricks... ...with sources in Azure, AWS, GCP, and others Why Logicbroker...DatabricksAmazon Web ServiceFor contractorsWork at officeRemote work
$112k - $179k
Responsibilities The Databricks Data Engineer will be responsible for the hands-on build-out of a Government... ...Strong proficiency in PySpark, Spark SQL, and Python for large-scale data processing... ...with cloud platforms (Azure/AWS) and infrastructure-as-code practices Understanding...DatabricksAmazon Web ServiceContract workRemote workShift work- Job Title: Big Data Engineer Job Summary: We are seeking a highly skilled... ...Data Technologies: Hadoop, Spark, Hive, HBase, Kafka Data... ...Tools: Informatica, Talend, AWS Glue, Azure Data Factory Cloud... ...Azure Data Engineer Associate Databricks Certified Data Engineer Experience...DatabricksAmazon Web ServiceFull timeRemote work
- Senior Data Engineer For over four decades, PAR Technology Corporation has been a leader in... ...concepts and practices Big Data Technologies: Spark, Databricks, Structured Streaming Databases:... ...Observability: DataDog Cloud Platforms: AWS or Azure and their data solutions Data...DatabricksAmazon Web ServiceRemote workWorldwide
- Azure - Data Factory, Databricks, Synapse, ADLS Senior Data Engineer - 8+ Years Experience Job Type: Full-Time Work Model: Hybrid... ...technologies such as Apache Spark/PySpark. Develop data models and... ...with cloud data platforms such as AWS, Azure, or GCP. Implement CI/CD and...DatabricksAmazon Web ServiceFull timeWork at officeRemote work
$140k - $180k
We are building out our Data Platform team at Sigma,... .... As a Data Platform Engineer, you will be responsible... ...architecture across Snowflake and Databricks, as well as building... ...public clouds (e.g., AWS, GCP) Additional Job... ..., NewView Capital, Spark Capital, Sutter Hill Ventures...DatabricksAmazon Web ServiceFull timeWork at officeFlexible hours$85 per hour
Data Engineer Job Location - NY, NY Rate: $85/hr Contract Interview: In-person We are seeking an experienced... ...reliable, high-performance data ecosystems leveraging Databricks, Spark, Delta Lake, Snowflake, Kafka, and AWS, while also contributing to the adoption of...DatabricksAmazon Web ServiceContract work$70k - $95k
...and optimize scalable data pipelines and architectures... ...data pipelines using AWS services Develop and... ...degree in Computer Science, Engineering, or a related field 3-... ...processing frameworks: Spark , Hadoop Experience... ...AWS , GCP Databricks , Snowflake dbt , SQL...DatabricksAmazon Web ServiceLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Databricks on AWS & Spark. Be the first to apply!
Related searches
- senior data center engineer New York, NY
- senior cloud data engineer New York, NY
- senior data integration developer New York, NY
- data developer New York, NY
- data engineer New York, NY
- big data cloud engineer New York, NY
- data platform engineer New York, NY
- data engineering intern summer New York, NY
- data engineer analytics New York, NY
- data engineer manager New York, NY