Test Automation Engineer

Job Description

Job Description

Overview

The Work

The Test Automation Engineer is responsible for designing, developing, and executing automated and manual tests to ensure the quality and performance of complex, large‑scale, and immersive systems. This role leads the planning and implementation of test automation frameworks, tools, and strategies; performs application testing; validates defects; isolates issues; and provides detailed analysis and reporting of test results in the designated ticketing and reporting systems. The Test Automation Engineer also supports configuration management, change management, and release management activities across multiple software and hardware baselines.

This position aligns with Cayuse’s core values of Innovation, Excellence, Collaboration, Adaptability, and Integrity by fostering technical solutions that meet customer needs, promoting teamwork, and prioritizing quality in deliverables.

Responsibilities

Key Responsibilities

• Design, implement, and execute comprehensive test and evaluation procedures to ensure all system, functional, performance, security, and integration requirements are met.
• Create, maintain, and execute automated test scripts and test automation architectures for application products and large‑scale, high‑performance immersive systems.
• Develop, document, and run system and integration test cases, including positive, negative, regression, end‑to‑end, and user acceptance test scenarios.
• Analyze test cases for completeness and coverage; refine test conditions and acceptance criteria in collaboration with business analysts, developers, and stakeholders.
• Conduct integration activities involving developed application software, ensuring compatibility and interoperability across components, services, and environments.
• Evaluate, recommend, and implement automated test tools, frameworks, and strategies (e.g., UI, API, performance, security, and continuous testing tools) that align with enterprise standards and project needs.
• Develop and maintain scalable, reusable automated test suites integrated into CI/CD pipelines to support frequent and reliable build validation.
• Continuously upgrade and optimize automated test scripts for reliability, maintainability, and execution speed.
• Establish and enforce best practices for test data management and environment configuration within automated test solutions.
• Execute automated and manual test runs, capture detailed results, and enter findings into the designated ticketing system in a timely and accurate manner.
• Validate defects and issues, perform root-cause analysis, and collaborate with development and operations teams to support remediation.
• Identify, document, and track problems and issues through resolution, providing specific guidance on root-cause and recommended corrective actions.
• Prepare, maintain, and deliver clear and concise test status reports, defect metrics, trend analyses, and risk assessments to project leadership and stakeholders.
• Direct and/or participate in all phases of risk management assessments related to software/hardware development, with emphasis on test design, coverage, and test tool selection.
• Provide subject matter expertise in testing methodologies, automation approaches, and quality standards for complex to highly complex software/hardware applications.
• Support the presentation, formal review, and audit of test results, including preparation of briefings and decision-support materials for technical and non-technical audiences.
• Design, plan, execute, and document System(s) test events, including the creation of System(s) test reports that meet government and organizational standards.
• Review government-developed test plans and test reports for technical correctness, effectiveness, completeness, and compliance with applicable standards and requirements.
• Observe, support, and evaluate the execution of customer acceptance test activities; provide feedback and recommendations to improve test coverage and acceptance criteria.
• Analyze requirements for each test event and assist in the scheduling and coordination of System(s) non-operational environment test assets.
• Perform configuration management, change management, and release management activities in coordination with project and operations teams.
• Maintain and provide controls for multiple test software and hardware baselines, ensuring consistency and traceability across environments and test cycles.
• Ensure that all test artifacts (plans, procedures, scripts, data, and reports) are version-controlled and aligned with configuration management policies.
• Other duties as assigned.

Qualifications

Qualifications – Here’s What You Need

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related technical discipline (required).
• Minimum of 8 years of progressive experience in software testing and quality assurance, including at least several years focused on test automation engineering.
• Demonstrated experience designing, developing, and maintaining automated test frameworks and scripts for complex, distributed, or large‑scale systems.
• Hands-on experience with one or more test automation tools and frameworks (e.g., Selenium, Cypress, Playwright, JUnit/TestNG, Cucumber, REST/API testing tools, performance/load testing tools).
• Strong understanding of software development life cycle (SDLC), Agile and/or DevSecOps practices, and CI/CD pipeline integration for automated testing.
• Proven ability to analyze requirements and user stories, derive test conditions, and design comprehensive test cases and test data sets.
• Experience with defect tracking and ticketing systems (e.g., Jira, Azure DevOps, ServiceNow, or similar), including documenting and managing defects through closure.
• Familiarity with configuration management, change management, and release management processes and tools.
• Top Secret Clearance is required.
• Must be able to pass a background check. May require additional background checks as required by projects and/or clients at any time during employment.

Minimum Skills Required:

• Proficient in Microsoft and Adobe toolsets, including Excel, Word, PowerPoint, Acrobat, etc.
• Strong understanding of software development best practices.
• Ability to recommend and implement software upgrades.
• Experience in software maintenance and testing to ensure continued functionality.
• Excellent problem-solving and debugging skills.
• Strong communication and collaboration skills.
• Knowledge of database management and integration.
• Understanding of web security best practices.
• Ability to document processes and code for future maintenance and upgrades.

Our Commitment to you / overview of benefits

• Medical, Dental and Vision Insurance; Wellness Program.
• Flexible Spending Accounts (Healthcare, Dependent Care, Commuter).
• Short-Term and Long-Term Disability options.
• Basic Life and AD&D Insurance (Company Provided).
• Voluntary Life and AD&D options.
• 401(k) Retirement Savings Plan with matching after one year.
• Paid Time Off.

Reports to: Program Manager

Working Conditions

• Professional office environment.
• Ability to work on site in Washington, DC.
• Must be physically and mentally able to perform duties extended periods of time.
• Ability to use a computer and other office productivity tools with sufficient speed to meet the demands of this position.
• Must be able to establish a productive and professional workspace.
• Must be able to sit for long periods of time looking at computer screen.
• May be asked to work a flexible schedule which may include holidays.
• May be asked to travel for business or professional development purposes.
• May be asked to work hours outside of normal business hours.

Other Duties: Please note this job description is not designed to cover or contain a comprehensive list of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.

Cayuse is an Equal Opportunity Employer. All employment decisions are based on merit, qualifications, skills, and abilities. All qualified applicants will receive consideration for employment in accordance with any applicable federal, state, or local law.