AWS Data Engineer

Qode

Job Brief

As an AWS Data Engineer, your role will be to design, develop, and maintain scalable data pipelines on AWS. You will work closely with technical analysts, client stakeholders, data scientists, and other team members to ensure data quality and integrity while optimizing data storage solutions for performance and cost-efficiency. This role requires leveraging AWS native technologies and Databricks for data transformations and scalable data processing.

Responsibilities
• Lead and support the delivery of data platform modernization projects.
• Design and develop robust and scalable data pipelines leveraging AWS native services.
• Optimize ETL processes, ensuring efficient data transformation.
• Migrate workflows from on-premise to AWS cloud, ensuring data quality and consistency.
• Design automations and integrations to resolve data inconsistencies and quality issues
• Perform system testing and validation to ensure successful integration and functionality.
• Implement security and compliance controls in the cloud environment.
• Ensure data quality pre- and post-migration through validation checks and addressing issues regarding completeness, consistency, and accuracy of data sets.
• Collaborate with data architects and lead developers to identify and document manual data movement workflows and design automation strategies.

Skills and Requirements
• 10+ years' experience with a core data engineering skillset leveraging AWS native technologies (AWS Glue, Python, Snowflake, S3, Redshift).
• Experience in the design and development of robust and scalable data pipelines leveraging AWS native services.
• Proficiency in leveraging Snowflake for data transformations, optimization of ETL pipelines, and scalable data processing.
• Experience with streaming and batch data pipeline/engineering architectures.
• Familiarity with DataOps concepts and tooling for source control and setting up CI/CD pipelines on AWS.
• Hands-on experience with Databricks and a willingness to grow capabilities.
• Experience with data engineering and storage solutions (AWS Glue, EMR, Lambda, Redshift, S3).
• Strong problem-solving and analytical skills.
• Knowledge of Dataiku is needed
• Graduate/Post-Graduate degree in Computer Science or a related field.
• AWS S3 (data storage, export, recall)
• Athena (querying data lakes)
• Data pipelines (batch & near-real-time)
• Integration with external systems (FHIR)
• Secure data handling (KMS, Macie)
• Cloud-native analytics
• Multi-account, multi-region data architecture
• BI integrations: Power BI, Tableau, QuickSight

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the AWS Data Engineer in United States vacancy

Data Center Chief Engineer
$96k - $166.3k
Join our dynamic Data Center Engineering Operations Team and become a critical architect of the infrastructure that powers global cloud computing... ...operations within a given data center and to support AWS. AWS Infrastructure Services owns the design, planning, delivery...
Amazon Web Service
H1b
Work at office
Worldwide
Relocation
Relocation package
Flexible hours
Amazon Data Services, Inc. - A19
Wink, TX
7 hours ago
Senior Python Data Engineer #3606832
...supporting a leading financial services environment where data-driven systems, scalable applications, and reliable engineering practices are critical to business operations.... ...-on experience with cloud data tools such as AWS Glue, Azure Data Factory, or comparable platforms...
Amazon Web Service
Axiom Path
Charlotte, NC
18 days ago
Senior Databricks Data Engineer (AWS)
...on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Databricks Data Engineer (AWS) based in the United States. This role offers the opportunity to contribute to a large-scale federal data modernization program...
Amazon Web Service
Remote job
Full time
jobgether
United States
4 days ago
Data Engineer - Reference Genome
Job Title Job Description - Should be able to create data management pipeline in Airflow - Should have good working knowledge of AWS - Should have domain knowledge of Genomics versioning, bioinformatics, and life sciences
Amazon Web Service
Damco
Harrisburg, PA
1 day ago
Senior Data/ML Engineer (AWS)
...is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data/ML Engineer (AWS) based in Austria. This role sits at the intersection of advanced data engineering and applied machine learning, focusing...
Amazon Web Service
Remote job
Full time
Flexible hours
jobgether
United States
2 days ago
Data Engineer (Telecom Domain)Only w2
...Job Title: Data Engineer (Telecom Domain)Only w2 Location: Dallas, TX (Onsite/Only Locals) Experience Required: 5+ Years JD: Must... ...experience with Python, SQL, Spark, Delta Lake, DataOps, and Cloud (AWS/Azure/GCP) is required. If I missed your call ! Please...
Amazon Web Service
Local area
Astir IT Solutions, Inc.
Dallas, TX
23 hours ago
Data engineer
...Looking for 2 to 4 years of professional experience as a Data engineer Chicago, IL. Skills required: SAAS, SQL, Snowflake... ...Integration: Understanding of cloud platforms, particularly AWS, and experience integrating Snowflake with cloud storage solutions...
Amazon Web Service
Apex Informatics
Chicago, IL
2 days ago
Big Data/Machine Learning Engineer
...aresupported in ECS stack on serverless architecture - so must have experience with Fargate , dynamodb AWS - S3 , DynamoDB , fargate - must have Data pipelines executed in data bricks Must have CI/CD Will be actively involved in Automation Billions...
Amazon Web Service
Exaways Corporation
McLean, VA
3 days ago
Data Engineer
...Job Title Need to have analytical skill, SQL, Python/ Pyspark, Snowflake and AWS proficiency. In addition, candidate should be able to handle pressure, constantly prioritize, be able to learn new skills as needed and be a good team player. Candidate must be able to...
Amazon Web Service
Sparktek
Owings Mills, MD
2 days ago
Data Engineer
...over 100 million households. They are currently expanding their Data Engineering team based in New York City, NY. This role is hybrid on-site... ...experience with a combination of the following: Python, Scala, SQL, AWS, EMR, EKS, Athena, Hadoop, ClickHouse, Spark, etc. The Data...
Amazon Web Service
Immediate start
The Cypress Group
New York, NY
23 hours ago
Data Engineer with Reltio MDM
...Hi , Hope you are doing well. We are looking for Data Engineer with Reltio MDM - Remote (Richmond, VA ) - Contract with one of our... ...Governance Quality Performance Optimization Familiarity with AWS database technologies Dimensional modelling in a data warehouse...
Amazon Web Service
Contract work
Remote work
Softcom Systems Inc
Richmond, VA
3 days ago
Data Engineer - Intuit
...Client: Intuit Title: Data Engineer Location : Mountain View, CA [Hybrid] Overall Skills : • 10+ years of overall experience in... ...• Solid understanding of Spark, including performance tuning. • Solid understanding of the AWS Platform • Experience in Python
Amazon Web Service
Maintec Technologies
Mountain View, CA
3 days ago
Data Engineer
• 10+ years of overall experience in data management space and at least 5 years of working in large data sets in a data lake environment... ...including performance tuning. • Solid understanding of the AWS Platform • Experience in Python Non Technical Skills:...
Amazon Web Service
Exaways Corporation
Mountain View, CA
3 days ago
Data Engineer
...o Design and implement scalable data pipelines using Databricks or AWS services such as Glue, Redshift, S3, Lambda, EMR, Athena Develop and maintain... ...o Stay updated with the latest developments in AWS Data engineering technologies and best practices. Job Requirements
Amazon Web Service
Seven Seven Software
Plano, TX
1 day ago
Data Engineer
...Good to have Scala • Proven experience (6+ years) as a data engineer and data scientist, preferably in a fast-paced technology or analytics... .../ ETL Development background needed. Cloud Technologies - AWS S3, AWS Athena SQL - Hive,Teradata,Spark SQL...
Amazon Web Service
United IT Solutions
Philadelphia, PA
17 days ago
Senior Data Engineer
...Senior Data Engineer- Jersey city, NJ Must have: Spark, Scala, Java, AWS (EMR) Nice to have: Python, S3 EC2, EKS, Hadoop, Impala, Hive, Airflow Domain knowledge a plus Data set size is 500m-1b rows per batch His resume review focuses...
Amazon Web Service
Apex Informatics
Jersey City, NJ
2 days ago
Data Engineer
...Job Title Data Engineer Job Description Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring... ...focused on building scalable Generative AI architectures within the AWS ecosystem. You will architect the data foundations that power...
Amazon Web Service
Remote work
Tiger Analytics
United States
4 days ago
Data Scientist / AI/ML Engineer (Imagery) VAWFH 1652
...required in Operations Research, Industrial Engineering, Applied Mathematics, Statistics, Physics... ...large datasets with preprocessing data skills, data cleansing, and conducting data... ...(e.g., TensorFlow Developer Certificate, AWS Certified Machine Learning Specialty, IBM...
Amazon Web Service
Full time
Shift work
Global InfoTek Inc
Reston, VA
a month ago
Data Engineer
...Job Requirement: - Need Strong Senior Data Engineer with Scala, Spark on regular cluster and Spark on AWS, Unix and Oracle. - Very good communication as the position needs to interact with the business on a regular basis. - Optional to have some experience in Java...
Amazon Web Service
Info Way Solutions
Austin, TX
23 hours ago
Sr.Data Engineer with Redshift ED's Glue
...Sr. Data Engineer With Redshift Ed's Glue Alameda, California, United States Job Description Data Transformation and ETL - Experience of Qlik Compose, AWS Glue ideal Development Experience in the Amazon Cloud Environment AWS (S3, AWS Glue, Amazon Redshift...
Amazon Web Service
RxCloud
Alameda, CA
23 hours ago
Senior PySpark Data Engineer
...Description Roles & Responsibilities Job Title: Senior PySpark Data Engineer Job Description: As a Data Engineer, you will be... ...based data pipelines • Migrate On Prem workloads into Cloud(AWS, Databricks, Snowflake) based on use cases. • Collaborate with...
Amazon Web Service
Work experience placement
Covetus
Irving, TX
23 hours ago
Data Engineer
...Hey! Do you have any Capital One former Data Engineer for this role at Capital One? They must work hybrid in Richmond or McLean, VA... ...BAU Must have techs: Scala data pipelines Spark engine AWS SQL Nice to have Java experience AWS Glue Must sit onsite...
Amazon Web Service
Remote work
Concord IT Systems
Richmond, VA
1 day ago
Kubernetes Data Engineer
...Backend Data Engineer MC Lean, VA Long Term Contract * Manage/Administer Kubernetes *Develop Apps on Kubernetes using Python or Golang. * Supporting Batch AWS EMR, Pyspark * Strong in Pyspark, AWS Services, Dynamo DB, ELB, EC2, Lambda * 6-8 years' experience...
Amazon Web Service
Long term contract
Maintec Technologies
McLean, VA
1 day ago
AWS Data Engineer
...Role: AWS Data Engineer. Location: Washington DC(Day one onsite) Only 10 Years JOB DECSRIPTION • Develop and Maintain Data pipelines using AWS Glue and Python. • ETL/ELT • AWS Postgres • Strong query writing SQL/PLSQL skills • Understating of AWS...
Amazon Web Service
Concord IT Systems
Washington DC
1 day ago
Data Engineer - Healthcare
...Senior Data Engineer - Healthcare (Remote | EST Preferred) Salary: US Citizens Only Seeking a Senior Data Engineer (5-8... ...knowledge ( HIPAA, SOC 2 ; HITRUST preferred) Strong Python and AWS experience Ability to take technical ownership in a fast-...
Amazon Web Service
Remote work
Texas State Library and Archives Commision
United States
23 hours ago
Data Engineer
...experience in building, operating, and optimizing data pipelines. Additionally, candidates with application engineering experience should have proficiency in building... ...skills in PySpark, Python, and SQL Databricks AWS Experience building, operating, and optimizing...
Amazon Web Service
Optomi
Jersey City, NJ
23 hours ago
Lead AWS Data Engineer with DynamoDB
Lead AWS Data Engineer With DynamoDB Looking for a Lead AWS Data Engineer with DynamoDB experience. Candidates need to have 12+ years of experience. Position is in Miami, FL for a long term contract with M/Florida Power.
Amazon Web Service
Long term contract
Damco
Miami, FL
3 days ago
AWS Data Engineer
...Required Qualifications: ~6+ years of hands-on data engineering experience building and supporting production data pipelines. ~... ...scripting experience with Python and PostgreSQL ~ Experience on AWS (e.g., S3, Glue, Redshift, Lambda, CloudWatch, Airflow). ~...
Amazon Web Service
Spruce Infotech
Jersey City, NJ
1 day ago
Data Engineer
...JVM (Java, Scala, Kotlin) ~ SQL ~ Git Preferred Qualifications ~ Apache Spark Databricks ~ ClickHouse OLAP ~ Kafka AWS (Kinesis, SQS) ~ Grafana, Prometheus, Loki ~ Docker / Kubernetes ~··IoT ~ AI (Cursor, Claude Code, Codex ) Interview...
Amazon Web Service
Remote work
42dot
United States
3 days ago
Sr. Data Engineer
...Sr. Data Engineer - MS Fabric, ETL/ELT, Data Modelling, and Cloud Platforms Location: Lansing, MI (Onsite-Hybrid) Duration: Long term... ...Mandatory experience in at least one Cloud platform (Azure / AWS / GCP). Proven data orchestration experience. Ability to...
Amazon Web Service
Long term contract
3Core Systems
Lansing, MI
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AWS Data Engineer. Be the first to apply!