AI Product Business Analyst

AI Product Business Analyst

Work Location: Hartford, CT 06156 Contract duration: 12+ months Interview Process (Is face to face required?): Yes

Nice to have skills:

• Experience in HR technology, learning technology, content creation platforms, or knowledge management solutions as a Business Analyst, Product Analyst, Product Owner, or equivalent role.
• Hands-on experience in building and executing specialized AI test cases, evaluating LLM outputs, prompt variations, and agentic workflows.
• Hands-on experience with prompt engineering, prompt optimization, and evaluation of AI-generated content quality, accuracy, completeness, and consistency.
• Experience designing e Detailed Job Description AI powered product focused, collaborating with business stakeholders, engineering, UX, and data science teams to gather requirements, create Jira user stories, manage product backlogs, define acceptance criteria, evaluate LLM based solutions, analyze AI performance metrics, execute product validation and drive continuous product improvements through Agile methodology.

Minimum years of experience: 8-10 years

Top 3 responsibilities you would expect the Subcon to shoulder and execute:

• Gather business requirements, create detailed Jira user stories, define acceptance criteria, and manage the product backlog while translating AI product requirements into actionable features and workflows.
• Plan, execute, and monitor AI/LLM evaluations by designing test scenarios, validating model outputs, performing metrics, and driving continuous product quality improvements.
• Collaborate with cross-functional teams Engineering, UX, Data Science, and Business stakeholders to prioritize AI capabilities.