Hardware Quality Engineering

Work at Home

Full time

Evolent partners with health plans and providers to achieve better outcomes for people with most complex and costly health conditions. That's one reason why diversity and inclusion are core to our business.

The Quality Engineer develops and executes test plans, performs exploratory and automated testing, and builds and maintains automated tests for the Evolent Platform web user experience. Working in an Agile, globally dispersed team, this role partners with developers, business analysts, and stakeholders to understand requirements and expected agent behavior, surface quality issues early, and report clearly on quality status.

This individual works with minimal supervision on assigned features, actively learning and adopting the testing methods, automation frameworks, and patterns defined for the role and by the team. The role is expected to use approved AI-assisted tools to accelerate testing and improve quality while remaining fully accountable for every delivered result.

AI-Assisted Engineering Expectations

code assistants, copilots, automation agents, knowledge assistants, and analytics tools) to improve quality, efficiency, and innovation while maintaining accountability for all delivered work. These expectations span the full engineering lifecycle, not only code generation, including iterating with AI on test design and solution design, evaluating alternatives, and producing design artifacts. Engineers remain responsible for validating outputs, ensuring solution quality, protecting sensitive information, and complying with security, privacy, regulatory, and Responsible AI standards.

Test Planning and Execution

• Develop, document, and execute test plans and test cases for assigned features.
• Perform exploratory and automated testing to ensure software functionality, reliability, and performance.
• Conduct regression testing to ensure new code does not adversely impact existing functionality.
• Collaborate with development teams to understand requirements, expected agent behavior, and human-in-the-loop flows, and identify potential quality issues early.
• Participate in code reviews, design discussions, and sprint planning, and contribute to the design and implementation of enhancements to the team’s test systems.

Execute and maintain contract tests and API tests using the team’s established tooling.

• Create and maintain synthetic test data.
• Follow and help reinforce the team’s testing processes and automation standards, holding peers accountable constructively and making sure the team understands the risks of exceptions.

Accessibility Testing

• Run automated axe-core accessibility checks and manual screen reader tests (JAWS, NVDA, VoiceOver) against WCAG 2.1/2.2 AA.

Defect Management and Quality Reporting

• Identify, isolate, document, and track defects, working closely with developers to ensure timely resolution.
• Analyze test and evaluation results, generate quality metrics, and report on software quality status to the team and stakeholders.
• Present work in Agile ceremonies, participate in knowledge-sharing sessions, and seek feedback to continuously improve skills.

AI-Enabled Quality Engineering

• Utilize approved AI-assisted engineering tools to accelerate test case design, test script development, test data generation, documentation, and troubleshooting.
• Evaluate and validate AI-generated tests, scripts, and analysis for correctness, security, maintainability, compliance, and business appropriateness before use.
• Learn and adopt the prompts, skills, agents, and AI-assisted testing patterns defined by the team and share improvements that benefit the team.
• Identify opportunities to improve testing productivity and quality through AI-enabled workflows and automation.

Follow enterprise policies governing AI usage, intellectual property protection, security, privacy, PHI handling, and Responsible AI practices.

• Ensure no confidential, regulated, or protected information (including PHI in test data) is used with unapproved AI services or tooling; use synthetic data for testing.
• 3+ years of experience in software quality assurance or testing, including hands-on UI test automation.
• Experience with Playwright or similar end-to-end automation tools, preferably using TypeScript or JavaScript.
• Working knowledge of JavaScript or TypeScript for test automation.
• Familiarity with component testing frameworks such as Vitest or Jest.
• Familiarity with API testing tools (e.g., Proficiency in software testing methodologies, including functional, regression, and performance testing.
• Knowledge of Agile methodologies and experience working in an Agile development environment.
• Exposure to testing AI or LLM output using test datasets and scoring rubrics.
• Familiarity with testing React applications and streaming user interfaces.
• Familiarity with contract testing and basic load testing.
• Working knowledge of accessibility testing, including axe-core and screen readers (JAWS, NVDA, or VoiceOver).
• Exposure to AI-assisted testing tools such as GitHub Copilot or Playwright MCP.
• Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or a related field, or equivalent experience.

#The use of artificial intelligence tools during interviews is prohibited and monitored. Misrepresentation will result in immediate disqualification from consideration.

Evolent is an equal opportunity employer and considers all qualified applicants equally without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, or disability status. If you need reasonable accommodation to access the information provided on this website, please contact View email address on click.appcast.io part of our total compensation package, Evolent is proud to offer comprehensive benefits (including health insurance benefits) to qualifying employees.