Data automation Engineer
$45 - $48 per hourThe Computer Merchant
JOB TITLE: DATA AUTOMATION ENGINEER
JOB LOCATION: WASHINGTON, DC (REMOTE)
WAGE RANGE*: $45.00-48.00 PER HOUR
JOB NUMBER: SAIJP00038724 REQUIRED EXPERIENCE: BS degree in Computer Science or related field and 2+ years of experience in relevant field
• 2+ years of experience with more than one of the follow scripting languages: SQL, T-SQL, MDX/DAX, Python, and
PySpark.
• Experience designing and building ETL/data engineering solutions, schedule and monitor utilizing various cloud
services such as Azure Data Lake Services, Azure Synapse Analytics, Azure Data Factory, Integration Runtime.
• Experience working with Microsoft database and business intelligence tools, including SQL Server, including
stored procedures, SSIS, SSRS, SSAS (cubes), and Power BI.
• Experience with data automation using Azure/AWS CLI tools with Bash or PowerShell scripting.
• Familiarity with Azure DevOps Repos or GitHub and pipeline versioning/release management.
• Demonstrated experience in supporting production, testing, integration, and development environments.
• Open mindset, ability to quickly adapt new technologies to solve customer problems.
• Experience in Agile projects, working with a multi functional team.
• Must be detail oriented, and able to support multiple projects and tasks.
• Demonstrate continuous learning to increase relevant skills.
• US Citizenship and ability to successfully obtain a government-issued Public Trust clearance.
Not required, but additional education, certifications, and/or experience are a plus:
• Experience and/or certifications in Generative AI development, Generative AI for Data Analytics, and solution
delivery. JOB DESCRIPTION Data Automation Engineer to work with a team of subject matter
experts and developers to design and implement innovative data automation solutions for Azure cloud-based data lake,
SQL, and NoSQL platform. As a data automation engineer, you will translate business requirements to data engineering
and AI based solutions to support an enterprise scale Microsoft Azure based data analytics and reporting platform. Our
ideal candidate is mission focused and delivery oriented and applies critical thinking to create innovative functions and
solve technical issues. Utilize Microsoft Azure services including Azure Data Factory, Synapse Pipelines, Apache Spark Notebooks,
Python, SQL, stored procedures to develop high performing data pipelines.
• Continuously improve and optimize the automation toolset for reliability, scalability, and adaptability.
• Research and implement cutting-edge AI/ML and GenAI tools to rapidly develop intelligent applications, scripts,
and ETL pipelines that automate data processes, and proactively eliminate workflow bottlenecks. Work closely with implementation specialists, engineering teams, and customer to understand data driven
needs and build solutions that address real operational challenges.
• Work closely with client personnel and team members to understand data requirements and develop
appropriate data solutions.
• Identify, create, prepare data required for advanced analytics, visualization, reporting, and AI/ML.
• Implement data migration, data integrity, data quality, metadata management, and data security functions to
optimize data pipelines.
• Monitor and troubleshoot data related issues to maintain high availability and performance.
• Assist in ETL performance testing for data pipelines by executing test runs and validating data load performance
against expected benchmarks.
• Support baseline performance analysis by comparing new pipeline performance with legacy system metrics
(e.g., load time, throughput, latency).
• Help monitor pipeline execution metrics such as run time, data volume processed, and resource utilization to
identify bottlenecks.
• Participate in performance test execution for Azure-based pipelines (ADF, Synapse, Databricks) in non-
production environments.
• Assist in identifying performance issues and contribute to tuning efforts (e.g., query optimization, partitioning,
indexing basics).
• Validate data consistency and completeness after performance test runs to ensure no data loss during high-
volume processing.
• Collaborate with DevOps and infrastructure teams to understand how compute, memory, and scaling impact
pipeline performance.
• Follow defined performance testing processes, checklists, and guidelines established by senior team members.
• Document test results, issues, and observations clearly for team review and tracking.
• Actively support Agile DevOps process, including Program Increment planning.
• Actively engage in continuous learning to increase relevant skills.
• Maintain strict versioning and configuration control to ensure integrity of data. Equal opportunity employer as to all protected groups, including protected veterans and individuals with disabilities * While an hourly range is posted for this position, an eventual hourly rate is determined by a comprehensive salary analysis which considers multiple factors including but not limited to: job-related knowledge, skills and qualifications, education and experience as compared to others in the organization doing substantially similar work, if applicable, and market and business considerations. Benefits offered include medical, dental and vision benefits; dependent care flexible spending account; 401(k) plan; voluntary life/short term disability/whole life/term life/accident and critical illness coverage; employee assistance program; sick leave in accordance with regulation. Benefits may be subject to generally applicable eligibility, waiting period, contribution, and other requirements and conditions. Benefits offered are in accordance with applicable federal, state, and local laws and subject to change at TCM's discretion. #Dice
JOB LOCATION: WASHINGTON, DC (REMOTE)
WAGE RANGE*: $45.00-48.00 PER HOUR
JOB NUMBER: SAIJP00038724 REQUIRED EXPERIENCE: BS degree in Computer Science or related field and 2+ years of experience in relevant field
• 2+ years of experience with more than one of the follow scripting languages: SQL, T-SQL, MDX/DAX, Python, and
PySpark.
• Experience designing and building ETL/data engineering solutions, schedule and monitor utilizing various cloud
services such as Azure Data Lake Services, Azure Synapse Analytics, Azure Data Factory, Integration Runtime.
• Experience working with Microsoft database and business intelligence tools, including SQL Server, including
stored procedures, SSIS, SSRS, SSAS (cubes), and Power BI.
• Experience with data automation using Azure/AWS CLI tools with Bash or PowerShell scripting.
• Familiarity with Azure DevOps Repos or GitHub and pipeline versioning/release management.
• Demonstrated experience in supporting production, testing, integration, and development environments.
• Open mindset, ability to quickly adapt new technologies to solve customer problems.
• Experience in Agile projects, working with a multi functional team.
• Must be detail oriented, and able to support multiple projects and tasks.
• Demonstrate continuous learning to increase relevant skills.
• US Citizenship and ability to successfully obtain a government-issued Public Trust clearance.
Not required, but additional education, certifications, and/or experience are a plus:
• Experience and/or certifications in Generative AI development, Generative AI for Data Analytics, and solution
delivery. JOB DESCRIPTION Data Automation Engineer to work with a team of subject matter
experts and developers to design and implement innovative data automation solutions for Azure cloud-based data lake,
SQL, and NoSQL platform. As a data automation engineer, you will translate business requirements to data engineering
and AI based solutions to support an enterprise scale Microsoft Azure based data analytics and reporting platform. Our
ideal candidate is mission focused and delivery oriented and applies critical thinking to create innovative functions and
solve technical issues. Utilize Microsoft Azure services including Azure Data Factory, Synapse Pipelines, Apache Spark Notebooks,
Python, SQL, stored procedures to develop high performing data pipelines.
• Continuously improve and optimize the automation toolset for reliability, scalability, and adaptability.
• Research and implement cutting-edge AI/ML and GenAI tools to rapidly develop intelligent applications, scripts,
and ETL pipelines that automate data processes, and proactively eliminate workflow bottlenecks. Work closely with implementation specialists, engineering teams, and customer to understand data driven
needs and build solutions that address real operational challenges.
• Work closely with client personnel and team members to understand data requirements and develop
appropriate data solutions.
• Identify, create, prepare data required for advanced analytics, visualization, reporting, and AI/ML.
• Implement data migration, data integrity, data quality, metadata management, and data security functions to
optimize data pipelines.
• Monitor and troubleshoot data related issues to maintain high availability and performance.
• Assist in ETL performance testing for data pipelines by executing test runs and validating data load performance
against expected benchmarks.
• Support baseline performance analysis by comparing new pipeline performance with legacy system metrics
(e.g., load time, throughput, latency).
• Help monitor pipeline execution metrics such as run time, data volume processed, and resource utilization to
identify bottlenecks.
• Participate in performance test execution for Azure-based pipelines (ADF, Synapse, Databricks) in non-
production environments.
• Assist in identifying performance issues and contribute to tuning efforts (e.g., query optimization, partitioning,
indexing basics).
• Validate data consistency and completeness after performance test runs to ensure no data loss during high-
volume processing.
• Collaborate with DevOps and infrastructure teams to understand how compute, memory, and scaling impact
pipeline performance.
• Follow defined performance testing processes, checklists, and guidelines established by senior team members.
• Document test results, issues, and observations clearly for team review and tracking.
• Actively support Agile DevOps process, including Program Increment planning.
• Actively engage in continuous learning to increase relevant skills.
• Maintain strict versioning and configuration control to ensure integrity of data. Equal opportunity employer as to all protected groups, including protected veterans and individuals with disabilities * While an hourly range is posted for this position, an eventual hourly rate is determined by a comprehensive salary analysis which considers multiple factors including but not limited to: job-related knowledge, skills and qualifications, education and experience as compared to others in the organization doing substantially similar work, if applicable, and market and business considerations. Benefits offered include medical, dental and vision benefits; dependent care flexible spending account; 401(k) plan; voluntary life/short term disability/whole life/term life/accident and critical illness coverage; employee assistance program; sick leave in accordance with regulation. Benefits may be subject to generally applicable eligibility, waiting period, contribution, and other requirements and conditions. Benefits offered are in accordance with applicable federal, state, and local laws and subject to change at TCM's discretion. #Dice
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data automation Engineer in Washington DC vacancy
$105.1k - $231.1k
...CACI International Inc is seeking an Automation Data Integration Engineer in Washington, D.C. to support FEMA’s Chief Information Security Officer. Responsibilities include designing cybersecurity automations and managing data pipelines to ensure the integrity of data...Suggested$86.4k - $176.2k
...extraction, and processing Assist in automating workflows using PowerShell and Microsoft... ...and document structures Contribute to data migration activities from file shares to... ...efforts Collaborate with senior engineers on integrating AI services (e.g., Azure...SuggestedLive inWork at officeLocal area- ...Data Automation Engineer Department - Information Technology Location - Remote w/ quarterly travel to DC 6-month contract, with possible extension Public Trust Required About Our Client Our client is a long-standing organization that supports...SuggestedContract workRemote work
$78k - $100k
Alpha Omega, located in Arlington, VA, is seeking a Junior Database and Automation Engineer who will be responsible for transforming raw data into actionable insights and automating workflows across the organization. This role involves designing and developing Power BI...Suggested- ## Data Automation EngineerApplylocations: Arlington, VAtime type: Full timeposted on: Posted Yesterdayjob requisition id: JR101677Nightwing... ...of services. Nightwing is seeking a Data Automation Engineer to support this critical customer mission.The Data Automation...SuggestedContract workImmediate start
$105.1k - $231.1k
Job ID326927Job Title: Automation Data Integration EngineerJob Category: Information TechnologyTime Type: Full timeMinimum Clearance Required... ...:CACI is searching for an Automation Data Integration Engineer to join our team of highly qualified and dedicated individuals...Contract workWork experience placementWork at officeLocal areaMonday to FridayFlexible hours- ...Njoyn in Washington, D.C. is seeking a Technical Analyst - Application Engineer to support a critical U.S. Department of Justice program. In this permanent full-time position, you will design automation solutions, develop reporting and analytics, and support financial...Permanent employmentFull time
- CACI International Inc. is looking for an Automation Data Integration Engineer to support FEMA's OCISO in Washington, D.C. You will design and maintain cybersecurity automations and data pipelines while ensuring compliance and security for FEMA's systems. The role requires...Flexible hours
- Nightwing Group is seeking a Data Automation Engineer to develop and implement automation solutions in Arlington, VA. This role is crucial in supporting technology integration activities, enhancing data pipeline development, and automating analysis workflows. Ideally,...
- ...Leidos LLC is seeking an experienced Senior Test Automation Engineer in Alexandria, Virginia, to enhance enterprise data and analytics products. The role involves maintaining test frameworks, implementing automated testing within CI/CD pipelines, and working with engineers...
- ...COMFORT SYSTEMS in Alexandria, Virginia is seeking a Senior Test Automation Engineer to support enterprise data and analytics programs. You will design, develop, and maintain automated test frameworks, implement CI/CD practices, and collaborate with a wide range of stakeholders...
- A consulting firm in Virginia is seeking a talented back-end developer with over 5 years of experience in relational databases and SQL. The ideal candidate will contribute to solution development by building scalable ETL pipelines and collaborating with a dynamic development...
$124.09k - $149.5k
General Dynamics - IT is looking for a Data Engineer in Washington, DC to provide system and data engineering support throughout the reporting... ...for extracting, cleaning, and transforming data, using automation and scripting tools. The ideal candidate requires a BS/BA in...$86.8k - $198k
Phase2 Technology is seeking a Cyber Automation Engineer to oversee the installation and integration of the CAASM platform. The role encompasses extensive collaboration with clients and internal teams to manage asset inventory solutions. Candidates should possess over four...$107k - $134k
...technology company in the United States is seeking an Infrastructure Engineer to optimize critical data center operations. Responsibilities include building and maintaining servers, developing automation scripts, and ensuring system health. The ideal candidate will have...$78k - $100k
...Alpha Omega Integration is seeking a Junior Database and Automation Engineer in Arlington, VA. The role involves designing Power BI dashboards, automating workflows using Power Automate, and analyzing data from various sources to support decision-making. Applicants should...$86.8k - $198k
Booz Allen Hamilton is hiring a Cyber Intelligence Automation Engineer in Arlington, VA to lead data engineering efforts on critical missions. The ideal candidate has significant experience in cybersecurity, specifically with SIEM and SOAR platforms, and holds a TS/SCI...- ...highly skilled and self-directed Senior QA Engineer/SDET to drive comprehensive quality engineering for our Enterprise Data & Analytics Platform. Reporting into the Sr.... ..., this role will own and implement advanced automated testing strategies across the entire data lifecycle...Full time
$92.3k - $166.85k
...This Department of War enterprise data and analytics program delivers mission‑critical capabilities that enable leaders across... ...Digital Modernization sector is seeking an experienced Senior Test Automation Engineer to support the delivery, enhancement, and adoption of...- ...Computer Forensics, Software Assurance, Software Testing, Test Automation, Section 508 and WCAG Accessibility Assessment, Localization Testing... ..., and related support services like Test Automation and Test Data Management. These services ensure IRS applications and systems...Full timeFor contractorsLocal area
- ...About the job Test Automation Engineer Test Automation Engineer, Woodlawn, MD Long-term Contract (Potential to Hire) Must be able to work on-site in Woodlawn, MD 5 days a week Must be able to obtain a Public Trust Clearance. NO THIRD PARTY...Long term contractPermanent employmentContract workH1bVisa sponsorship
$92.3k - $166.85k
...Description This Department of War enterprise data and analytics program delivers mission-critical capabilities that enable... ...Modernization sector is seeking an experienced Senior Test Automation Engineer to support the delivery, enhancement, and adoption of enterprise...Local areaImmediate start$90k - $138k
...honoree, is seeking a highly skilled and experienced Senior Test Automation Engineer to join our dynamic development team supporting our client... ...Postman, Katalon, or RestAssured Solid SQL knowledge for data validation and test setup Strong analytical and...Full timeRemote workFlexible hoursNight shift- ...CGI Njoyn is seeking a Test Automation Developer specialized in ETL/API/Rules in Arlington, Virginia. This role involves designing, developing... ...and maintaining automated test solutions to ensure quality in data pipelines and APIs, leveraging cutting-edge technologies. Ideal...
- ...Summary IT Specialist (APPSW) Test Automation Engineer position(s) are being filled through the Office of Personnel Management's delegated Direct Hire Authority, open to all U.S. citizens. Selections made under this bulletin will be processed as new appointments to...Full timePart timeWork at officeRelocation
- ...culture. Position Overview SFI is seeking a hands-on Test Automation Engineer to support a complex PeopleSoft HCM environment within a... ..., object repositories, parameterized components, and data-driven scripts Develop supporting scripts to enhance automation...Full timeContract work
- ...Data Operations Engineer Washington, District of Columbia, United States About the Job Education / Qualifications / Experience... ...Strong technical background with a mix of development and automation skills Outstanding attention to detail and consistently...Work experience placement
- ...collaborates with cross functional teams - Facilities, TDA, IOC, Security, Ops Admin, CSM, Sales, Accounts, Training & Development and other Data Center Operations team Projects Supports fulfillment of projects that follow standard operating procedures; if projects...Local areaFlexible hoursShift work
$86.6k - $181.8k
...Job Title: Data Engineer (Power BI) Job Category: Information Technology Time Type: Full time Minimum Clearance Required to Start: TS/SCI Employee Type: Regular Percentage of Travel Required: None Type of Travel: None The Opportunity: The Office...Full timeContract workTemporary workWork experience placementLive inWork at officeRemote workFlexible hours$120k - $140k
...A boutique asset management firm in Bethesda, MD is seeking a Machine Learning Data Engineer to design and maintain scalable data infrastructure. The ideal candidate will have a Bachelor’s degree in Computer Science or related field, with over 4 years of experience in...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data automation Engineer. Be the first to apply!
Related searches
- senior data center engineer Washington DC
- data engineer manager Washington DC
- data science developer Washington DC
- junior data developer Washington DC
- etl data engineer Washington DC
- entry level big data engineer Washington DC
- data engineer Washington DC
- big data cloud engineer Washington DC
- junior big data engineer Washington DC
- remote data engineer Washington DC

