Senior QA Automation Engineering

Our award-winning SaaS platform, Medallia Experience Cloud, leads the market in the management of experiences, insights, and actions for candidates, customers, employees, patients, and residents alike.
At Medallia, we are committed to creating a world where organizations are loved by their customers and their employees.
We are bringing new GenAI features in Medallia Experience Cloud (MEC) online for GovCloud, including Insights Assistant, Root Cause Assist, and Smart Topic Builder. This is a chance to help define how we validate AI-powered product behavior in one of the most demanding cloud environments in the industry, with the rigor our public-sector customers expect.
You will join a strong MEC engineering team with full-stack capabilities, including quality engineers, frontend engineers, and backend engineers. You will be the primary quality owner for GovCloud GenAI onboarding: validation in GovCloud staging, release criteria, and partnership with engineering from development through rollout. You will also partner with GovCloud customer management and Site Reliability Engineering.
After the initial GenAI rollout, expect the role to expand within about six months to other MEC quality areas, including new innovation projects on our roadmap.
Own GovCloud GenAI release quality end to end: test planning, staging validation, regression coverage, release sign-off, and clear documentation
Partner with software engineering, security, release management, GovCloud customer management, and customer-facing teams to deploy changes safely and resolve quality issues, using staging environments, logs, and APIs when direct customer instance access is not available
Design and run test approaches for AI features where pass/fail is not binary, including output evaluation, guardrails, prompt regression, and edge cases. Build datasets and repeatable workflows to track GenAI quality over time
Develop and maintain automated test suites integrated into CI/CD pipelines
Use AI-assisted tools (Cursor, Claude, GitHub Copilot, or similar) to accelerate test design, automation, debugging, and documentation, with the security and privacy discipline GovCloud requires
Advocate for testability in design and mentor other quality engineers on automation and AI feature testing
Candidates based in the Tysons vicinity will be prioritized as this role is Hybrid, 3 days per week onsite.
Citizenship or a Green Card (Lawful Permanent Resident) to meet GovCloud compliance and access requirements
5+ years in software quality engineering, test automation, or a closely related role
Experience testing complex SaaS or enterprise applications at the application and API layers, including REST services and authentication flows
Hands-on experience with test automation integrated into CI/CD pipelines
Experience validating releases in regulated environments where staging, logs, APIs, and risk-based judgment are core to the quality process
Experience troubleshooting complex issues, writing technical documentation, and prioritizing testing based on risk and explaining trade-offs to technical and non-technical partners
Bachelor's degree or equivalent experience in Computer Science, Information Systems, or a related field
Experience in FedRAMP, AWS GovCloud, or other regulated cloud environments, including work with federal agencies or public-sector customers
Experience with Playwright and JavaScript/TypeScript, or a comparable modern UI/API automation stack
Experience testing AI, ML, or LLM-powered features, including evaluating outputs where pass/fail is not binary
Experience using AI-assisted development tools to improve QE productivity

Medallia considers factors such as (but not limited to) scope and responsibilities of the position, candidate's work experience, candidate's work location, education/training, key skills, internal peer equity, external market data, as well as, market and business considerations when making compensation decisions.
Medallia also offers competitive health and wellness benefits, including but not limited to medical, dental, vision, 401(k), short-term and long-term disability, life and AD&D insurance, statutory leaves, paid parental leave, and paid holidays. At Medallia, we celebrate diversity and recognize the value it brings to our customers and employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age (40 and over), disability, genetic information, veteran status or military service, or any other status protected by state or local law. Individuals with a disability who need an accommodation to apply please contact us at View email address on click.appcast.io information regarding how Medallia collects and uses personal information, please review our Privacy Policies. Applications will be accepted for 30 days from the date this role was posted or until the role has been filled.