Senior Automation Engineer

Responsibilities

• Develop test plans, test cases, acceptance criteria, traceability matrices, defect reports, and quality assessments.
• Design positive, negative, boundary, edge-case, functional, integration, system, regression, performance, and user acceptance tests.
• Validate C-CDA XML documents, clinical data extraction, source traceability, and AI-generated patient summaries.
• Develop and maintain automated tests for document ingestion, AI summarization, APIs, user interfaces, CDS workflows, and patient-context launch scenarios.
• Build automated validation frameworks and assess AI outputs for clinical completeness, consistency, usability, accuracy, reliability, omissions, inaccuracies, hallucinations, and guardrail effectiveness.
• Support CI/CD quality gates, continuous testing, defect triage, root-cause analysis, and release readiness.
• Collaborate with software engineers, solution architects, clinicians, product owners, cybersecurity teams, and government stakeholders.
• Use AI-assisted tools for test generation, automation, regression testing, defect analysis, quality assurance, synthetic test data, and coverage analysis.

Requirements

• Bachelor’s degree in Computer Science, Information Technology, Health Informatics, Engineering, or a related technical discipline, or equivalent experience.
• At least 5 years of experience testing healthcare software applications.
• Strong knowledge of C-CDA standards and experience reading, validating, and troubleshooting XML-based healthcare data.
• Experience with healthcare interoperability, clinical data exchange, Clinical Decision Support applications, and workflows.
• Familiarity with SMART on FHIR, CDS Hooks, REST APIs, test automation frameworks, API testing tools, and defect management platforms.
• Experience developing automated testing solutions in Agile and DevSecOps environments.
• Experience with AI-assisted testing, Generative AI, LLMs, AI-generated output validation, prompt engineering, and AI evaluation methodologies.
• Additional qualifications include VA healthcare systems experience, USCDI, SNOMED CT, LOINC, RxNorm, ICD, AI/ML healthcare solutions, accessibility and usability testing, cloud-native environments, and federal healthcare modernization.
• Experience with GitHub Copilot, Microsoft Copilot, Testim, Functionize, Mabl, or similar AI-powered testing platforms is preferred.
• U.S. citizenship is required; candidates must pass a background check and be able to obtain and maintain a Government/Public Trust clearance when required.

Benefits

• Medical, dental, and vision coverage.
• 401(k) with employer match.
• Paid time off and federal holidays.
• Corporate laptop.
• Training opportunities.
• 100% remote opportunity; candidates must reside within the continental United States.