Automation Testing Engineer

Senior Automation Testing Engineer

We are seeking a Senior Automation Testing Leader / Senior Automation Testing Engineer to own and build the quality engineering and test automation function for an AI-powered healthcare technology platform.

In this role, quality directly impacts patient access to healthcare. A broken call flow can prevent a patient from reaching their physician, making quality assurance an important part of the overall patient experience.

This is not a traditional manual QA position. The role is focused on test automation, framework design, automation strategy, scalable QA processes, AI-assisted testing techniques, and building a future QA organization.

What You'll Do

Automation Strategy & Leadership

• Own the overall quality engineering vision and automation strategy for an AI-powered voice platform.
• Design, build, and maintain a scalable automated testing infrastructure from the ground up.
• Establish testing standards, best practices, and quality metrics across engineering teams.
• Recruit, mentor, and eventually lead future QA and automation testing team members.
• Help drive a culture of quality throughout the organization.

Testing Architecture & Framework Development

• Design and implement automated testing frameworks covering unit testing, integration testing, end-to-end testing, regression testing, and load/performance testing.
• Build reusable test harnesses and tooling that enable engineers to efficiently create and execute tests.
• Develop simulation frameworks for real-time voice and conversational AI workflows.
• Create testing methodologies that can scale with rapid product growth.

AI & Voice Platform Testing

• Build simulation and regression frameworks for conversational AI scenarios.
• Develop testing approaches for real-time voice interactions and telephony workflows.
• Leverage AI-assisted testing techniques to improve coverage and efficiency.
• Validate agent behaviors, routing logic, integrations, and patient call flows before production deployment.

Platform & Integration Quality

• Partner with platform, provisioning, and integrations teams to ensure comprehensive coverage across system boundaries.
• Test APIs, backend services, event-driven systems, and third-party integrations.
• Own test environments and CI/CD integration for automated execution.
• Investigate production issues and lead root-cause analysis efforts.

Compliance & Reliability

• Develop testing approaches that support HIPAA and healthcare compliance requirements.
• Help ensure platform reliability, scalability, and quality standards are consistently maintained.
• Drive preventive quality initiatives that reduce production defects and customer-impacting issues.

Required Qualifications

• 10+ years of experience in software quality engineering with a strong emphasis on automation.
• Proven track record designing and owning automation frameworks from the ground up.
• Expertise in automated testing architecture and test harness design.
• Strong experience building scalable QA processes and automation strategies.
• Experience leveraging AI-assisted testing methodologies.
• Proficiency with Python, TypeScript, or similar programming languages.
• Strong scripting, tooling, and automation development skills.
• Experience integrating automated testing into CI/CD pipelines.
• Hands-on experience with GitHub Actions, Jenkins, or similar tools.
• Deep understanding of unit testing, integration testing, end-to-end testing, regression testing, and performance testing.
• Experience testing APIs, backend services, and distributed/event-driven architectures.
• Strong debugging and analytical skills.
• Demonstrated ability to elevate quality standards across engineering organizations.
• Startup mentality with a willingness to build processes, frameworks, and teams from scratch.
• Ability to operate as both an individual contributor and future people leader.

Preferred Qualifications

• Experience testing real-time systems.
• Experience with telephony platforms, call routing systems, or voice technologies.
• Experience testing conversational AI or AI-powered applications.
• Load and performance testing experience in high-throughput environments.
• HIPAA-regulated healthcare experience.
• Experience in compliance-heavy environments.
• Contract testing experience.
• Service virtualization experience.
• Previous experience building or leading QA organizations.

Ideal Candidate

• Can design testing frameworks from the ground up.
• Can build and execute an automation-first quality strategy.
• Understand how to leverage AI to improve testing effectiveness and efficiency.
• Can create scalable quality processes that grow with the business.
• Can build sophisticated test harnesses and simulation environments.
• Thrives in a fast-paced startup-style environment.
• Operates as a strategic quality leader rather than a traditional manual tester.

Benefits include medical, dental, vision, discretionary bonuses, and participation in the company’s 401(k) retirement plan.