Automation Testing Engineer

Senior Automation Testing Engineer Overview We are seeking a Senior Automation Testing Leader / Senior Automation Testing Engineer to own and build the quality engineering and test automation function for an AI-powered healthcare technology platform. In this role, quality directly impacts patient access to healthcare. A broken call flow can prevent a patient from reaching their physician, making quality assurance an important part of the overall patient experience. This is not a traditional manual QA position. The role is focused on test automation, framework design, automation strategy, scalable QA processes, AI-assisted testing techniques, and building a future QA organization. What You'll Do Automation Strategy & Leadership Own the overall quality engineering vision and automation strategy for an AI-powered voice platform. Design, build, and maintain scalable automated testing infrastructure from the ground up. Establish testing standards, best practices, and quality metrics across engineering teams. Recruit, mentor, and eventually lead future QA and automation testing team members. Help drive a culture of quality throughout the organization. Testing Architecture & Framework Development Design and implement automated testing frameworks covering unit testing, integration testing, end-to-end testing, regression testing, and load/performance testing. Build reusable test harnesses and tooling that enable engineers to efficiently create and execute tests. Develop simulation frameworks for real-time voice and conversational AI workflows. Create testing methodologies that can scale with rapid product growth. AI & Voice Platform Testing Build simulation and regression frameworks for conversational AI scenarios. Develop testing approaches for real-time voice interactions and telephony workflows. Leverage AI-assisted testing techniques to improve coverage and efficiency. Validate agent behaviors, routing logic, integrations, and patient call flows before production deployment. Platform & Integration Quality Partner with platform, provisioning, and integrations teams to ensure comprehensive coverage across system boundaries. Test APIs, backend services, event-driven systems, and third-party integrations. Own test environments and CI/CD integration for automated execution. Investigate production issues and lead root cause analysis efforts. Compliance & Reliability Develop testing approaches that support HIPAA and healthcare compliance requirements. Help ensure platform reliability, scalability, and quality standards are consistently maintained. Drive preventative quality initiatives that reduce production defects and customer-impacting issues. Required Qualifications 10 years of experience in software quality engineering with a strong emphasis on automation. Proven track record designing and owning automation frameworks from the ground up. Expertise in automated testing architecture and test harness design. Strong experience building scalable QA processes and automation strategies. Experience leveraging AI-assisted testing methodologies. Proficiency with Python, TypeScript, or similar programming languages. Strong scripting, tooling, and automation development skills. Experience integrating automated testing into CI/CD pipelines. Hands-on experience with GitHub Actions, Jenkins, or similar tools. Deep understanding of unit testing, integration testing, end-to-end testing, regression testing, and performance testing. Experience testing APIs, backend services, and distributed/event-driven architectures. Strong debugging and analytical skills. Demonstrated ability to elevate quality standards across engineering organizations. Startup mentality with a willingness to build processes, frameworks, and teams from scratch. Ability to operate as both an individual contributor and future people leader. Preferred Qualifications Experience testing real-time systems. Experience with telephony platforms, call routing systems, or voice technologies. Experience testing conversational AI or AI-powered applications. Load and performance testing experience in high-throughput environments. HIPAA-regulated healthcare experience. Experience in compliance-heavy environments. Contract testing experience. Service virtualization experience. Previous experience building or leading QA organizations. Ideal Candidate Can design testing frameworks from the ground up. Can build and execute an automation-first quality strategy. Understands how to leverage AI to improve testing effectiveness and efficiency. Can create scalable quality processes that grow with the business. Can build sophisticated test harnesses and simulation environments. Thrives in a fast-paced startup-style environment. Operates as a strategic quality leader rather than a traditional manual tester. Determining compensation for this role (and others) at Vaco/Highspring depends upon a wide array of factors including but not limited to the individual’s skill sets, experience and training, licensure and certifications, office location and other geographic considerations, as well as other business and organizational needs. With that said, as required by local law in geographies that require salary range disclosure, Vaco/Highspring notes the salary range for the role is noted in this job posting. The individual may also be eligible for discretionary bonuses, and can participate in medical, dental, and vision benefits as well as the company’s 401(k) retirement plan. Additional disclaimer: Unless otherwise noted in the job description, the position Vaco/Highspring is filing for is occupied. Please note, however, that Vaco/Highspring is regularly asked to provide talent to other organizations. By submitting to this position, you are agreeing to be included in our talent pool for future hiring for similarly qualified positions. Submissions to this position are subject to the use of AI to perform preliminary candidate screenings, focused on ensuring minimum job requirements noted in the position are satisfied. Further assessment of candidates beyond this initial phase within Vaco/Highspring will be otherwise assessed by recruiters and hiring managers. Vaco/Highspring does not have knowledge of the tools used by its clients in making final hiring decisions and cannot opine on their use of AI products. EEO Notice Vaco by Highspring is an Equal Opportunity Employer and does not discriminate against any employee or applicant for employment because of race (including but not limited to traits historically associated with race such as hair texture and hair style), color, sex (includes pregnancy or related conditions), religion or creed, national origin, citizenship, age, disability, status as a veteran, union membership, ethnicity, gender, gender identity, gender expression, sexual orientation, marital status, political affiliation, or any other protected characteristics as required by federal, state or local law. Vaco by Highspring and its parents, affiliates, and subsidiaries are committed to the full inclusion of all qualified individuals. As part of this commitment, Vaco by Highspring and its parents, affiliates, and subsidiaries will ensure that persons with disabilities are provided reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please contact View email address on click.appcast.io . Vaco by Highspring also wants all applicants to know their rights that workplace discrimination is illegal. Representation Notice By submitting to this position, you agree that you will be giving Vaco by Highspring the exclusive right to present your as a candidate for the foregoing employment opportunity. You further agree that you have represented information about yourself accurately and have not affirmatively misrepresented your qualifications. You also agree to maintain as confidential, to the fullest extent permitted by law, any information you learn from Vaco by Highspring about the position and you will limit disclosure of information about the position only to the extent necessary to perform any obligations in furtherance of your application. In exchange, Vaco by Highspring agrees to exercise reasonable efforts to represent you through all solicitation, job screening and resume dispersal. For residents of Ontario, Canada: Based on Highspring’s discussions with its Client, Highspring’s understanding is that this position for employment is a current vacancy (either through Highspring as a contractor or with the client directly). Privacy Notice Vaco by Highspring and its parents, affiliates, and subsidiaries (“we,” “our,” or “Vaco by Highspring”) respects your privacy and are committed to providing transparent notice of our policies. California residents may access Vaco by Highspring HR Notice at Collection for California Applicants and Employees here. Virginia residents may access our state specific policies here. Residents of all other states may access our policies here. Canadian residents may access our policies in English here and in French here. Residents of countries governed by GDPR may access our policies here. Additionally, submissions to this position are subject to the use of AI to perform preliminary candidate screenings, focused on ensuring minimum job requirements noted in the position are satisfied. More details about Vaco by Highspring’s use of AI can be found here ( Further assessment of candidates beyond this initial phase will be conducted by recruiters and hiring managers. Vaco by Highspring does not know and cannot opine on if its client’s use of AI products in hiring. Pay Transparency Notice Determining compensation for this role (and others) at Vaco by Highspring depends upon a wide array of factors including but not limited to: the individual’s skill sets, experience and training; licensure and certification requirements; office location and other geographic considerations; other business and organizational needs. With that said, as required by local law, Vaco by Highspring believes that the following salary range referenced above reasonably estimates the base compensation for an individual hired into this position in geographies that require salary range disclosure. The individual may also be eligible for discretionary bonuses.aa415a4b-8b21-40fc-a65c-70d2b25ca29a