AI Tester - Senior QA Automation Engineer (Selenium & AI Testing)

Job Description

Job Description

Job Summary: We are seeking a highly skilled Senior QA Automation Engineer with 6 years of experience in Software Functional Testing and 4 7 years of expertise in Selenium . The ideal candidate will lead system integration testing, ensure adherence to quality standards, and develop AI-specific automated testing frameworks. This role requires expertise in Agile methodologies, test automation tools, and AI model evaluation using LLMs and RAG architectures .
Key Responsibilities:

• Conduct system integration testing for new and enhanced applications.
• Develop and execute automated tests using Selenium and other industry-standard tools.
• Collaborate with project teams to establish plans, standards, and procedures that optimize testing efforts.
• Ensure on-time delivery by monitoring dependencies, progress, and milestones.
• Educate business and development teams on the testing methodology, with a focus on end-to-end quality assurance .
• Lead project and quality management initiatives , including issue tracking and communication .
• Optimize resource utilization by assisting the Testing Manager in reviewing forecasting reports.
• Ensure compliance with Agile methodologies , maintaining detailed process documentation.
• Perform AI-specific testing , including validation of LLMs and RAG architectures using vector databases.
• Implement automated testing frameworks for Gen AI applications , such as DeepEval and RAGAs .
• Develop custom validation scripts for evaluating AI model accuracy, relevance, and faithfulness.
• Test prompt engineering techniques to refine AI-generated responses.
• Execute SQL queries in Snowflake to validate database integrity and application responses.

Essential Skills & Experience:

• 6 years of experience in Software Functional Testing with automation expertise in Selenium .
• Experience with Jira and ALM for test and issue tracking.
• Strong proficiency in Python , with experience in AI testing frameworks such as LangChain, Pytest, and PyTorch .
• Hands-on expertise in LLM & RAG architecture testing using vector databases.
• Familiarity with Snowflake , SQL querying , and data validation techniques.
• Excellent communication and leadership skills to engage with stakeholders.