Test Automation Specialist (AI & Playwright)

Job Title: Test Automation Specialist (AI & Playwright)

Remote

Job Description

We are looking for a Test Automation Specialist with strong expertise in Playwright, TypeScript, AI Agents, and Test Automation Frameworks to design, develop, and enhance AI-driven test automation solutions. The ideal candidate will build scalable automation frameworks, develop LLM-powered agents, integrate testing into CI/CD pipelines, and drive automation strategy across enterprise applications.

Key Responsibilities

• Develop and maintain Playwright (TypeScript) automation frameworks.
• Create automated UI, API, Database, and E2E test scripts.
• Build and manage smoke, sanity, and regression test suites.
• Integrate automation into CI/CD pipelines .
• Design and optimize AI Agents, GitHub Copilot Agents, and prompts .
• Develop LLM evaluation frameworks and quality metrics.
• Troubleshoot automation failures and improve test reliability.
• Establish automation standards and conduct code reviews.
• Package and deploy reusable automation tools and frameworks.
• Mentor QA teams on Playwright and AI-assisted testing .
• Collaborate with Engineering and QA teams on automation strategy.
• Ensure compliance with HIPAA, security, and AI governance standards .
• Monitor automation coverage, quality metrics, and execution results.
• Provide technical leadership for AI-driven test automation initiatives .

Mandatory Skills

• Playwright Automation (TypeScript)
• AI Agents / Agentic Workflows
• GitHub Copilot Custom Agents & Prompt Engineering
• TypeScript & Python
• Test Automation Framework Design
• UI, API & End-to-End Testing
• CI/CD (Jenkins, Azure DevOps)
• GitHub / Bitbucket
• LLM Evaluation & Testing
• SDLC, STLC & Agile Methodologies