Data Engineer with AWS & Python
Cloud BC Labs
Position : Data Engineer with AWS & Python
Location : Mclean, VA (Onsite)
Term : W2 Role
Job Summary:
We are looking for an experienced Data Engineer with strong AWS and Python expertise to design, develop, and maintain scalable data pipelines and cloud-based data solutions. The ideal candidate will have hands-on experience with AWS data services, Python programming, ETL/ELT development, data integration, and modern data engineering practices.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows using Python and AWS services.
- Build and optimize data ingestion and transformation pipelines for structured and unstructured data.
- Develop reusable Python scripts and applications for data processing, automation, and integration.
- Work with AWS services such as S3, Glue, Lambda, Redshift, EMR, Athena, Kinesis, and CloudWatch.
- Implement data processing solutions using PySpark and distributed computing frameworks.
- Develop data models and optimize data storage and retrieval processes.
- Perform data quality checks, validation, reconciliation, and error handling.
- Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
- Integrate data from APIs, databases, files, and other enterprise data sources.
- Implement monitoring, logging, and alerting for data pipelines.
- Collaborate with Data Scientists, Data Analysts, Architects, and business stakeholders.
- Follow best practices for CI/CD, version control, testing, security, and documentation.
- Troubleshoot production data issues and provide timely resolution.
Required Skills / Must Have
- 5+ years of experience in Data Engineering or a related field.
- Strong hands-on experience with Python for data engineering and automation.
- Strong experience with AWS cloud services, particularly:
- Amazon S3
- AWS Glue
- AWS Lambda
- Amazon Redshift
- Amazon Athena
- Strong knowledge of SQL and relational databases.
- Experience developing ETL/ELT data pipelines.
- Experience with PySpark/Spark and distributed data processing.
- Strong understanding of data warehousing and data lake concepts.
- Experience with Git and CI/CD pipelines.
- Strong troubleshooting and analytical skills.
Preferred / Nice to Have
- Experience with AWS EMR, Kinesis, Step Functions, or MWAA/Airflow.
- Experience with Terraform or CloudFormation.
- Knowledge of Databricks, Snowflake, or Delta Lake.
- Experience working with streaming data pipelines.
- Knowledge of Docker/Kubernetes.
- Experience with REST APIs and third-party data integrations.
- Knowledge of AWS IAM, encryption, and cloud security best practices.
- Experience with Agile/Scrum methodology.
Education
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- Equivalent professional experience may be considered.
Cloud BC Labs Inc is a digital transformation organization aimed at creating seamless solutions for clients to effectively manage their business operations. The company specializes in Business and Management Consulting, AI/ML, Data Analytics & Visualization, Cloud Data Warehouse Migration, Snowflake Implementation, Informatica Implementation & Upgrade, Staffing Services and Data Management Solutions
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Data Engineer with AWS & Python in McLean, VA vacancy
- ...talented Team.Job Title: Senior Data EngineerLocation: McLean, VA (Remote)Summary: Our Data Engineering team is dedicated to... ...client data and applications with client infrastructure. We achieve... ...Design complex ETL workflows, AWS, Python, SQL, Data Engineering. Ampcus...Amazon Web ServicePythonRemote work
- ...motivated candidate to join our talented Team. Job Title: Data Engineer. Location: McLean, VA. Overview:We are seeking a... ..., cloud services, and big data technologies, with a strong focus on AWS services, Python programming, and data processing frameworks. Responsibilities...Amazon Web ServicePythonLocal areaRemote work
- ...Python Data Engineer 5+ years of relevant experience Hadoop and AWS experience required Looking for a Python data engineer with experience in XML and JSON This is not a machine learning position but should have standard libraries experience - NumPy, Pandas,...Amazon Web ServicePython
Samprasoft
McLean, VA12 hours ago - ...yearRole is focused on hands-on building of data pipelinesCode written in java/spark (... ...if not Java, must be strong in Scala or Python)AWS experience preferredRequired Skills:... ...be strong in Core Java (this is a data engineering position, but the teams Spark code is written...Amazon Web ServicePythonHourly payLive in
Software Technology Inc
McLean, VA23 hours ago - DescriptionSAIC is seeking an experienced Data Engineer. Work directly with customers in a technical role to help... ...writing scripts using Linux shell, Python, or similar scripting language.·... ...with Cloud technologies such as Azure, AWS, or GCP.· Experience working with Linux...Amazon Web ServicePython
- ...Data EngineerLocation: McLean, VA (Tuesday and Wednesday onsite)Duration: 6+ Months contract (with possible conversion)Job Description:Cleanse, manipulate... ...Hadoop platform.Develop Python, Py Spark, Spark scripts... ...Hands on experience with GIT, AWS, Kubernetes, Docker etc....Amazon Web ServicePythonContract work
Samprasoft
McLean, VA21 hours ago $158.6k - $181k
...Capital One is seeking a Senior Data Engineer in McLean, VA, responsible for building and supporting data solutions. Candidates should have strong knowledge in Python, SQL, and experience with cloud platforms like AWS and Azure. The salary range for this position is $1...Amazon Web ServicePythonkozmetickesluzby.vecnakraska.sk - Jobboard
McLean, VA12 hours ago- ...Possible ExtensionRequired Skills:Experience with Snowflake admin.Be able to identify the... ...failover scenarios.Good-to-have:Experience with Python programming skill.Experience with Keychain... ...and Active DirectoryExperience with AWS (S3, Route53, Lambda, CloudWatch)Experience...Amazon Web ServicePython
Software Technology Inc
McLean, VA23 hours ago $110k - $160k
OverviewWe are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade... ...data warehouse solutions in cloud (Preferably AWS. Alternatively Azure, GCP).Key must have skill sets - Python, SQL, Databricks, AWS Data ServicesSupport...Amazon Web ServicePython- ...Big Data EngineerLocation: Arlington, VA (3 Days onsite... ...pipelines end-to-end with a strong focus on data... ...proficiency in using Python or Scala, Spark, Hadoop... ...data ingestion, feature engineering, modeling, tuning, evaluating... ...(Databricks or AWS ecosystem) is a plus but...Amazon Web ServicePython3 days per week
Futran Tech Solutions Pvt. Ltd.
Arlington, VA12 hours ago - ...Senior Data EngineerLocation: McLean, VABuild modern... ...looking for a Senior Data Engineer to design, build, and... ...use your advanced SQL and Python expertise to develop robust... ...and optimizationPartner with cross-functional teams... ...cloud platforms such as AWS, Azure, or...Amazon Web ServicePython
Suncap Technology
McLean, VA22 hours ago - ...assessment interview (for candidates who pass job-fit) Must haves: Python Mlops Kubernetes Spark Aws Job Description: Data Machine Learning Engineer Must haves: - Python - AWS - Kubernetes - Kubeflow (or equivalent...Amazon Web ServicePythonWork at office
1 point system
McLean, VA3 days ago $125k - $165k
...landscape, an organization’s data has never been a more... ...experts work with our clients to support their... ...for seasoned Senior Data Engineer to work with our team and... ...solutions in cloud (Preferably AWS. Alternatively Azure,... ...must have skill sets - Python, AWSSupport an Agile software...Amazon Web ServicePython$125k - $160k
...landscape, an organization’s data has never been a more... ...experts work with our clients to support their... ...looking for seasoned Data Engineer to work with our team and... ...solutions in cloud (Preferably AWS. Alternatively Azure,... ..., SQL, PySpark/Python, AWS Support an Agile software...Amazon Web ServicePython- ...Data EngineerRemote Rate: $60-$70/Hr. on W2 (Without... ...enterprise data engineering, data migration, or large... ...for Global Enterprises, with full ownership of technical... ...proficiency in Python and SQL; working experience... ...modern ETL/ELT platforms: AWS Glue, Azure Data Factory...Amazon Web ServicePythonWork experience placement
RIT Solutions
Arlington, VA23 hours ago - OverviewVTG is seeking a Data & Software Engineer works with a small team to build complex data flows for a custom... ...candidate will have advanced Python programming skills, familiarity with... ...applications in cloud environments like AWS.Working with MySQL and PostgreSQL including...Amazon Web ServicePython
$152k - $205.6k
...the talents of science, engineering, and UX to build and deliver... ...worldwide.As a Data Engineer on PXTCS, you'll work side by side with economists, data scientists... ...pipelines using native AWS services (Glue, EMR, Lambda... ...programming language, such as Python, Java, Scala, or NodeJS-...Amazon Web ServicePythonLocal areaWorldwideFlexible hours- ...Data EngineerLocation: Hybrid Onsite (3 days onsite... ...to apply advanced Data Engineering and Machine learning skills... ...platform.Develop Python, PySpark, Spark scripts... ...analysis. Familiarity with Hadoop cluster environment... ...working in Cloud platforms AWS. Kubernetes experience...Amazon Web ServicePythonWork experience placement
Samprasoft
McLean, VA22 hours ago - ...mission is to co-create success with our customers, partners, and... ...community. We are hiring a talented data engineer to join our team. If you're... ...of experience working with Python in a production environment3+... ...processingStrong experience working with AWS services (especially S3, Glue,...Amazon Web ServicePythonRemote work
CirrusLabs
McLean, VA22 hours ago $132.1k - $178.8k
...Accounting organization with process automation/... ...accurate and timely financial data. The team supports the... ...stakeholders and other engineering teams to identify and... ...right solutions using AWS and similar technologies... ...scale solutions using Python, React, JavaScript, Typescript...Amazon Web ServicePythonFlexible hours$62k - $141k
Data EngineerThe Opportunity: Ever-expanding technology... ...ever before. As a data engineer, you know that... ...meaningful.Here, you’ll work with a multi-disciplinary team... ...programming languages, including Python 2+ years of experience... ...(SaaS), including AWS EMR, Redshift, SageMaker...Amazon Web ServicePythonFull timeContract workPart timeWork at officeLocal areaRemote work- ...is seeking an experienced Lead Data Engineer to join a cross-functional... ...focusing on mission tracking with AI/ML enhancements. The role centers... ...will have 6+ years in Python/Go, PostgreSQL, Elasticsearch,... ...native tech like Kubernetes and AWS. #J-18808-Ljbffr Trusted Concepts...Amazon Web ServicePython
- ...careers and expertise with KPMG. Looking ahead, we... ...variety of modern big data tools / approaches to solve... ..., Terraform, Airflow, AWS, Azure, GCP, etc.)... ...stakeholders)Develop data engineering designs that positively... ...universityExperience with Python and SQL required (...Amazon Web ServicePythonLocal area
- ...Role Imagineeer is seeking a Data Engineer to support the design, development... ...engineering activities align with federal cybersecurity, privacy... ...IL4/IL5 cloud environments (AWS GovCloud, Azure Government, or... ...Strong experience with SQL and Python Experience building pipelines...Amazon Web ServicePythonLocal areaWork from homeFlexible hours
IMAGINEEER LLC
Arlington, VA2 days ago - GDIT in Falls Church, VA is seeking a Data Engineer to design, build, and operate scalable data pipelines... ...and 2+ years' experience, proficiency in Python or Java, SQL/NoSQL, and cloud platforms (Azure preferred, OCI or AWS). #J-18808-Ljbffr General Dynamics Information...Amazon Web ServicePython
- ...Overview We are seeking a skilled Data Engineer with at least 5 years of experience designing, building, and... .... Experience with cloud data platforms (AWS, Azure, or GCP). Proficiency in programming languages such as Python, Scala, or Java. Experience with data warehousing...Amazon Web ServicePython
VTG Defense
McLean, VA2 days ago - ...Data EngineerLocation: McLean, VADuration: 12+ Months (Possible extension... ...optimize ETL pipelines using Python, PySpark, and Spark. Develop... ...leveraging Databricks, AWS Glue, EMR, and S3. Collaborate with cross-functional engineering and analytics teams to implement...Amazon Web ServicePythonFor contractors
InterSources
McLean, VA21 hours ago - ...Federal Solutions Inc. is seeking a Data Engineer to design, build, and maintain... ...an Active TS SCI clearance with CI Poly, has 3+ years in data engineering, and is proficient in Python/Java/Scala, SQL, and cloud platforms such as AWS, Azure, or Google Cloud. #J-188...Amazon Web ServicePython
- ...Job Number: R0229283 Data Engineer The Opportunity Ever-expanding technology... ...meaningful. Here, you'll work with a multi-disciplinary team of... ...programming languages, including Python Experience with deploying... ...as a service (SaaS), including AWS EMR, Redshift, SageMaker, Azure...Amazon Web ServicePython
Phase2 Technology
McLean, VA22 hours ago - ...Senior Data EngineerCornerstone Defense is the Employer... ...Job Responsibilities:Work with AI team members to... ...day support of deploying Python-native ML pipelines and perform data engineering tasks to enable AI/ML capabilities... ...solutions in classified AWS cloud environments up to...Amazon Web ServicePython
Cornerstone Defense
McLean, VA22 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer with AWS & Python. Be the first to apply!
Related searches
- data engineer analytics McLean, VA
- senior cloud data engineer McLean, VA
- data center engineer McLean, VA
- big data devops engineer McLean, VA
- sr data engineer McLean, VA
- data engineer McLean, VA
- sr information security engineer McLean, VA
- data visualization developer McLean, VA
- data engineer contract McLean, VA
- junior data engineer remote McLean, VA