AI Quality Assurance Analyst

Detail-oriented and curious, the full-time remote AI Quality Assurance Analyst will evaluate AI-powered applications for reliability and accuracy, ensuring they are ready for real-world use across various business lines. Key responsibilities Design and execute test plans for AI applications, focusing on output quality and functional behavior Evaluate AI responses for accuracy, consistency, and edge case handling while testing application workflows and integrations Document and track defects using issue tracking tools, collaborating with AI Builders and Product Managers to define quality standards Required qualifications Experience in a QA or testing role, preferably with exposure to AI or LLM-based products Strong ability to evaluate AI-generated outputs for quality and appropriateness Experience writing and executing test cases and documenting defects Familiarity with issue tracking tools such as Jira Bachelor's degree or equivalent experience in a related field