Cloud Data Engineer (AWS / Databricks)
Purple Drive
Overview: Key Responsibilities:
- Design, build, and optimize scalable data pipelines and frameworks on AWS leveraging EMR, EKS, S3, and related services .
- Develop, deploy, and manage Databricks (DBX) workflows for big data processing, analytics, and machine learning.
- Implement infrastructure as code (IaC) solutions using Terraform for automated provisioning and environment consistency.
- Write efficient, reusable, and optimized code in Scala, Python, and Java for data transformation, streaming, and integration.
- Collaborate with architects, data scientists, and business stakeholders to translate requirements into technical solutions.
- Ensure performance tuning, scalability, and cost optimization across cloud-based data platforms.
- Enforce best practices in security, CI/CD, testing, and DevOps integration for cloud-native applications.
- 7-10 years of hands-on experience in data engineering and cloud frameworks .
- Proven expertise with AWS big data services (EMR, EKS, S3, Lambda, Glue).
- Strong development skills in Scala, Python, and Java .
- Deep knowledge of Databricks (DBX) for batch and streaming workloads.
- Solid experience with Terraform for infrastructure automation.
- Familiarity with CI/CD, containerization (Docker, Kubernetes), and Agile methodologies.
- Exposure to machine learning workflows on Databricks.
- Knowledge of Airflow or other orchestration tools .
- Experience with data lakehouse architectures .
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Cloud Data Engineer (AWS / Databricks) in Plano, TX vacancy
- ...Data Platform Engineer As a Data Platform Engineer, you will be responsible... ...maintenance of our high-scale, cloud-based data platform,... ...pipelines using PySpark and the Databricks Unified Analytics Platform—leveraging... ...data engineering and AWS cloud infrastructure practices...DatabricksAmazon Web Service
$106k - $124k
...Innova Solutions is hiring a Senior Azure Data Engineer Position type: Permanent... ...will have: Hands on experience with Databricks and implementing medallion architecture... ...) in the United States (NMSDC, 2024) AWS Advanced Tier Services Partner with 100+...DatabricksAmazon Web ServicePermanent employmentFull timeTemporary workWork experience placementImmediate startWorldwideFlexible hours- ...Lead Software Engineer We have an opportunity to impact your... ...Commercial & Investment Banking – Data Analytics – Payments... ...operating data pipelines on Databricks using orchestration tools... ...Airflow Proficiency with cloud data services (AWS S3, Glue, Redshift, Athena,...DatabricksAmazon Web Service
- ...o Design and implement scalable data pipelines using Databricks or AWS services such as Glue, Redshift, S3, Lambda, EMR, Athena Develop and maintain... ...o Stay updated with the latest developments in AWS Data engineering technologies and best practices. Job RequirementsDatabricksAmazon Web Service
- ...experience designing and implementing data pipelines in a cloud environment is required. ~5+ years... .../developing data solutions in the AWS cloud is required. ~2+ years of experience... .../implementing data pipelines using Databricks or similar cloud database. ~...DatabricksAmazon Web ServiceWork experience placement
- ...Senior Data Engineer Location: Remote - Candidate need to come to office... ...efficient ETL pipelines using Databricks workflows or other... ...using spark Fundamental AWS services (S3, SQS) or similar services for other clouds Terraform and GitLab CICD...DatabricksAmazon Web ServiceFull timeContract workWork at officeRemote work
- ...Title: Data AI Engineer with Vector Databases Location: Plano, TX Job Description:... ...search # Build secure data solutions on AWS, ensuring data quality and compliance... ...# Experience with data platforms like Databricks or Snowflake # AWS services: S3, Glue...DatabricksAmazon Web Service
- ...manufacturing through advanced Data Analytics, AI/ML, and... ...on scalable, high-impact engineering challenges across cloud, data, and intelligent automation... ...technologies such as Databricks, Snowflake, PySpark, SQL,... ...with cloud platforms such as AWS, Azure, or GCP...DatabricksAmazon Web Service
- ...client is currently seeking a Data Engineer with strong experience in... ...modeling, data warehousing, and cloud-based data platforms. The ideal... ...hands-on experience with AWS services and a strong foundation... ...with Snowflake and Databricks Nice to Have Experience...DatabricksAmazon Web Service
$130k - $155k
...Insight Global is seeking a Data Engineer to sit hybrid in Frisco, Texas at a cybersecurity... ...code - Experience with Snowflake, Databricks, Apache Spark, Kafka, Airflow) -... ...automate data workflows - Experience with cloud platforms (AWS, Azure, GCP) and their native data...DatabricksAmazon Web Service- ...client in their search for a Data Engineer in Plano, TX. Responsibilities... ...initiatives , including cloud migration, big data... ...Required # # Experience on AWS technologies like S3, AWS Glue... ...with Snowflake and Databricks # Good to have - #...DatabricksAmazon Web ServiceWork experience placement
- ...AWS Cloud Engineer Location: Seattle, WA/St. Louis, MO/Plano, TX/Dallas, TX/Houston, TX Duration... ...: Full Time Job Description: AWS data services (S3, Glue, Redshift, Athena,... ...optimize ETL/ELT pipelines using AWS & Databricks services such as Unity Catalog, Pyspark...DatabricksAmazon Web ServiceFull time
- ...backed out at last moment DATA ENGINEER Location: Plano, TX... .... Debugging APIs, cloud services, and data lake technologies... ...deploying applications in AWS API development experience... ...and SQL Experience with Databricks or EMR Experience with...DatabricksAmazon Web ServicePermanent employmentContract workImmediate startRemote work
$120k
...Title: Python PySpark/ Data Engineer Location: Plano, TX... ...implementing data pipelines in a cloud environment is required.... ...developing data solutions in the AWS cloud is required. ~2+ years... ...implementing data pipelines using Databricks or similar cloud database....DatabricksAmazon Web ServiceWork experience placementH1bLocal areaRelocation- ...We are seeking a Senior Data Engineer with strong expertise in Snowflake, Databricks, dbt, Azure, and streaming technologies to... ...Azure Data Factory. Streaming & Cloud Build real-time pipelines... ...Functions, and Key Vault. Exposure to AWS services is a plus. Data...DatabricksAmazon Web ServiceWorldwide
- ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago -... ...real-time processing of data using cloud technologies like AWS. Develop and maintain efficient data... ...such as AWS Glue, Spark, and Databricks. Optimize database performance and...DatabricksAmazon Web ServiceLong term contractWork at office
$140k - $170k
We are seeking a Lead Data Engineer to lead our Data Architecture and Data... ...platforms such as Snowflake, AWS, Python, Airbyte/Fivetran,... ...warehouses (e.g., Snowflake, Databricks, and Redshift) Proficiency in... ...techniques Experience with AWS cloud platform Deep understanding...DatabricksAmazon Web ServiceFull time- ...Shutterfly is looking for a Principal Data Engineer to join their team! As part of... ...Warehouse at Shutterfly on AWS, supporting the breadth and... ..., SageMaker) or equivalent cloud platforms (GCP, Azure) Hands-on experience with Databricks and modern lakehouse architectures...DatabricksAmazon Web Service
- ...your career with us. As a Data Engineer III, you’ll play a senior technical... ...Certifications: ~ Azure/AWS certifications or data... ...Lake, Synapse Analytics, and Databricks. Strong programming skills... ...Continuous learner—keeps up with cloud/data engineering best practices...DatabricksAmazon Web ServiceTemporary workH1bImmediate start
- ...Senior Data Analyst Genesis10 is currently seeking... ...Spark, and PySpark in Databricks. Develop batch and... ...follow enterprise data engineering best practices for performance... ...Lake Storage (ADLS) or AWS S3. Develop scalable... ...Iceberg, Delta Lake, cloud data lakes (ADLS/S3),...DatabricksAmazon Web ServiceHourly payPermanent employmentContract work
$110k - $140k
...Senior Consultant - Data Engineer Plano, TX Are you driven by the... ...variety of source systems into cloud-based data lakes and... ...Azure Data Services (preferred), AWS, or Google Cloud Platform... ...architectures Familiarity with Databricks on Azure Benefits and Other...DatabricksAmazon Web ServiceVisa sponsorship2 days per week3 days per week- ...Role Overview: As a Data Engineer at McAfee, you will be a key member... ...scalable solutions that span from cloud-based architectures to... ...and tools (e.g., Snowflake, Databricks, Apache Spark, Kafka, Airflow... ...Experience with cloud platforms (AWS, Azure, GCP) and their native...DatabricksAmazon Web ServiceLocal areaRelocationFlexible hours
$200k - $220k
...Insight Global is seeking a Lead AI Data Engineer to sit hybrid at a Cybersecurity client in... ...orchestration, monitoring, error handling) - Databricks & Delta Lake (Jobs, Unity Catalog,... ...Production observability & troubleshooting - AWS (S3, Lambda, Glue, Kinesis, OpenSearch,...DatabricksAmazon Web Service- ...Data Engineer - Azure We have an opportunity with our partner for the client in the Telecommunication... ...+ Near Real-time) –4+ Yrs of Exp – Databricks / Spark + Delta Lake – 4+Yrs of Exp -... ...+ Testing + Workflow) –4+ Yrs of Exp – Cloud Platform (Azure + Snowflake) –4+Yrs of...DatabricksContract workLocal area
- ...Big Data Platform Engineer Installation, configuration, setup, and maintenance of the Big Data... ...big data projects on-premises and on cloud. Good experience and exposure of Hadoop... ...technologies like Data Factory, Azure Databricks, ADLS, Synapse, Event Hub etc. with...Databricks
- ...Ascentt is building cutting-edge data analytics & AI/ML solutions... ...GenAI. Our team solves hard engineering problems at scale, with real-... ...): • Seeking a AWS Cloud Engineer to design, deploy, and... ...scalable solutions. Experience in Databricks, Sagemaker, MLOps is essential...DatabricksAmazon Web Service
- ...Data Engineer (Azure | Databricks | Snowflake) Needed for Azure-native third party data enrichment platform using Databricks/Spark + Snowflake; focus on reliable governed pipelines, strong Spark troubleshooting, privacy/governance, and cost-aware engineering. You...Databricks
- ...looking for a passionate certified Data Engineer. The successful candidate... ..., ETL Secondary: Databricks Nice to have: Informatica/... ...oriented programming Skilled in AWS Compute such as EC2, Lambda,... ...or Informatica Skilled in cloud technologies and cloud computing...DatabricksAmazon Web ServiceWork experience placement
$109.3k - $180.2k
...Target Openings 1 What Is the Opportunity? Travelers Data Engineering team constructs pipelines that contextualize and provide... ...on ETL experience with PySpark ~ Experience working with Cloud platform (AWS, Azure, Google, etc. - preferable AWS) and Cloud platform...DatabricksAmazon Web ServiceWork experience placementH1bLocal areaImmediate start$100k - $120k
...seeking a System Administrator specializing in AWS EMR. This role involves designing, configuring, and maintaining big data environments on AWS while ensuring optimal... ...highlighting the strategic importance of this role in managing cloud resources efficiently. #J-18808-LjbffrAmazon Web Service
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Cloud Data Engineer (AWS / Databricks). Be the first to apply!
Related searches
- aws cloud infrastructure engineer Plano, TX
- remote cloud architect Plano, TX
- senior cloud engineer Plano, TX
- cloud architect Plano, TX
- cloud engineering manager Plano, TX
- cloud engineer remote Plano, TX
- principal cloud engineer Plano, TX
- senior principal cloud computing engineer Plano, TX
- cloud operations engineer Plano, TX
- software engineer - cloud services Plano, TX



