Quality Assurance Test Lead

QA Automation Lead

QA Automation · AI Model Evaluation · Test Automation Leadership

Fort Mill, SC | Hybrid | Full-Time Opportunity

ABOUT US

Incedo is a global AI, data, and digital transformation specialist that helps leading enterprises drive innovation and business growth through technology. With over 4,000 professionals across the US, Canada, Latin America, and India, Incedo combines expertise in AI, data analytics, and digital engineering to deliver impactful solutions across Banking & Payments, Telecom, Hi-Tech, Wealth Management, and Life Sciences. At Incedo, we foster a culture of innovation, collaboration, and continuous learning, empowering our people to solve complex challenges and shape the future of technology.

THE ROLE

You will lead quality engineering initiatives for next-generation digital and AI-powered applications. This role combines traditional test automation leadership with AI model evaluation, Generative AI testing, and Large Language Model (LLM) validation. You will drive quality across web, mobile, and AI solutions by designing scalable automation frameworks, evaluating model behavior, and ensuring applications meet both business and technical expectations. [QA

WHAT YOU'LL DO

• Lead end-to-end automation testing initiatives for web, mobile, and AI-powered applications

• Design, develop, and maintain automation frameworks using Java, Selenium, Playwright, and TestNG

• Build and execute regression, functional, integration, and end-to-end automated test suites

• Create test plans, test strategies, test scenarios, and test cases for software and AI systems

• Evaluate AI/ML and Generative AI models through prompt testing, response validation, and behavioral analysis

• Define and execute test scenarios for LLM-based solutions, focusing on accuracy, relevance, consistency, robustness, safety, and response quality

• Validate AI-generated outputs against business requirements and expected behavior

• Collaborate closely with developers, product owners, business analysts, and stakeholders to implement Shift-Left testing practices

• Participate in Agile ceremonies including sprint planning, reviews, and retrospectives

• Track, manage, and validate defects using JIRA and related quality management tools

• Leverage AI-assisted tools such as GitHub Copilot, Microsoft Copilot, ChatGPT, and similar platforms to improve automation efficiency and testing productivity

• Generate quality metrics, testing reports, and recommendations that improve overall product quality and release readiness

WHAT YOU BRING

Must Haves

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline

• 10–15 years of experience in Software Quality Assurance and Test Automation

• Strong expertise in Java programming and Object-Oriented Programming (OOP) concepts

• Hands-on experience with Selenium WebDriver automation

• Strong expertise with Playwright automation framework

• Extensive experience with TestNG and Page Object Model (POM) design patterns

• Experience working with Microsoft SQL Server and database validation techniques

• 2+ years of hands-on experience in AI model evaluation, Generative AI testing, or Machine Learning validation

• Experience testing LLM-based and Generative AI applications, including prompt engineering validation and model output assessment

• Hands-on experience using AI-powered productivity and development tools such as GitHub Copilot, Microsoft Copilot, ChatGPT, Gemini, Cursor, or similar solutions

• Strong analytical, troubleshooting, and problem-solving skills

• Excellent verbal and written communication skills

• Experience working in Agile development environments

Good to Have

• API testing experience using Postman, Rest Assured, or similar tools

• Mobile application testing experience across Android and iOS platforms

• Experience with Azure DevOps or TFS integration

• Familiarity with CI/CD pipelines and automated deployment processes

• Experience with quality reporting, dashboards, and testing metrics

• Knowledge of AI evaluation frameworks, LLM observability platforms, and automated model evaluation techniques

• Exposure to cloud-native testing environments and modern DevOps practices

WHY YOU'LL LIKE IT HERE

Join a high-growth AI-native organization where innovation, continuous learning, and engineering excellence are at the core of everything we do. You'll work with leading Fortune 500 enterprises, solve complex business challenges using cutting-edge AI technologies, and have significant opportunities for professional growth and career advancement.

EQUAL OPPORTUNITY

We are an equal opportunity employer and celebrate diversity. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We are committed to creating an inclusive environment for all employees.