Senior QA Automation Engineer - Playwright / TypeScript / AI

Job Description

Job Description

Job at a Glance

• Title: Senior QA Automation Engineer
• Location:  Orlando, FL | Glendale, CA | Anaheim, CA
• Contract: Through March 2027, likelihood of extension of up to 22 months
• Pay: $70.00/hour + optional medical, dental, vision, 401(k) match

Overview
Our Client is seeking a Senior QA Tester to support a product team building AI-powered conversational experiences that help guests discover and plan theme park vacations. This role will be a primary contributor to the UI automation suite, with a strong emphasis on Playwright, TypeScript, end-to-end testing, and strategies for validating non-deterministic AI/LLM responses.
The ideal candidate has built and maintained production automation suites and is comfortable working directly with product managers, engineers, and content owners to translate Gherkin stories, acceptance criteria, and business rules into reliable automated tests.
Key Responsibilities

• Become deeply familiar with product features, guest journeys, and business rules and serve as a knowledgeable voice on expected product behavior.
• Translate Gherkin user stories, acceptance criteria, and business rules into automated Playwright and TypeScript tests.
• Identify gaps and ambiguity in requirements before functionality is built.
• Build and maintain end-to-end automated tests covering complete guest journeys.
• Design rule-based, semantic, and evaluation-dataset approaches for testing non-deterministic AI/agent responses rather than relying on exact-string matching.
• Develop reusable fixtures, authentication setup, helpers, and test data.
• Validate UI experiences against API responses and use request interception and mocking where appropriate.
• Execute automated test suites through Jenkins and Harness CI/CD pipelines.
• Triage failures to determine whether root causes originate from the application, automation, environment, or test data.
• Document clear, reproducible defects.
• Use AI coding and agent tools to accelerate test creation, refactoring, and maintenance, and share effective approaches with the team.

Required Skills

• Strong hands-on Playwright and TypeScript skills, including experience building and maintaining a production end-to-end automation suite.
• Experience testing AI- or LLM-powered products and designing tests for non-deterministic output.
• Demonstrable hands-on use of AI coding tools such as Claude, Copilot, or Cursor to accelerate test authoring and maintenance.
• Fluency with Gherkin, acceptance criteria, and business rules.
• Ability to quickly understand complex product domains and guest journeys.
• API testing experience, including request interception and mocking.
• Experience integrating or running automated test suites within Jenkins and/or Harness CI/CD.
• Strong written communication and ability to work directly with product stakeholders in addition to engineering.

Required Education

• Bachelor's degree required

Preferred Skills

• Experience with LLM evaluation or observability tools such as Arize, Phoenix, LangSmith, or Promptfoo.
• Experience testing travel, hospitality, e-commerce, or booking workflows.
• Accessibility testing experience.
• Visual regression testing experience.
• Experience building agent- or MCP-driven test tooling.

Why Should I Apply?
This role offers the opportunity to work at the intersection of modern QA automation and generative AI. You will own meaningful portions of a Playwright/TypeScript automation suite while solving a newer testing challenge: determining how to reliably validate conversational AI experiences whose responses can legitimately vary between runs. The position also offers direct collaboration with product, engineering, and content stakeholders and encourages practical use of AI development tools.
About CEI
As a trusted technology partner, CEI delivers solutions that help our customers transform their business and achieve meaningful results. From strategy and custom application development through application management - our technology and digital experience services are tailored to meet each unique need of our customers. Our staffing solutions bring specialized skills to complement our customers' workforce and project requirements.

#ZR
#INDGEN