AI QA Engineer

Salary: $78,300 - 113,550 per year Requirements:

• We look for a basic understanding of software testing concepts, including manual, exploratory, regression, API, and integration testing.
• We value basic programming or scripting knowledge, preferably in Python, along with familiarity with APIs, databases, JSON, version control, and defect tracking tools.
• We seek a foundational understanding of AI concepts, large language models, and common limitations such as hallucinations, incomplete responses, and inconsistent outputs.
• We are interested in candidates with curiosity about prompt engineering, context engineering, and evaluating AI-enabled products.
• We expect the ability to document defects clearly, including steps to reproduce, expected results, and actual results.
• We look for strong analytical, communication, documentation, and problem-solving skills, plus the ability to collaborate across engineering and product teams.
• We want a basic understanding of artificial intelligence concepts, enthusiasm for learning how AI tools can improve processes and efficiency, and awareness of responsible AI practices, including risk management and ethical use.
• We require a bachelors degree in Computer Science, Software Engineering, or a related field.

• We support quality engineering work across an Agile team by running software and AI product tests, recording findings, and helping improve QA processes.
• We perform manual, exploratory, regression, API, and integration testing in an Agile environment under close guidance.
• We test features that include AI or large language model components, assessing outputs for accuracy, relevance, completeness, consistency, and instruction-following.
• We create basic test scenarios, prompts, and test data to evaluate AI behavior and identify issues such as hallucinations, incomplete responses, and inconsistent results.
• We apply introductory prompt engineering and context engineering techniques during testing.
• We use AI-assisted tools such as Codex, Claude Code, and similar command-line tools with support from senior team members.
• We assist with AI evaluation harnesses, test scripts, and regression checks to support quality validation.
• We document defects clearly and work with engineers, developers, and product owners to investigate and resolve issues.
• We contribute to test documentation, reusable test cases, and the ongoing improvement of quality assurance standards and processes.

• AI
• API
• Claude Code
• Support
• JSON
• Python

More:

We are Moodys Corporation, and hackajob is partnering with us to connect exceptional professionals to this role. Our mission is to bring together top talent to turn todays risks into tomorrows opportunities. We foster an inclusive environment where everyone can contribute ideas, think creatively, and collaborate openly with colleagues and customers. As a global leader in ratings and integrated risk assessment, we are advancing AI to transform insight into action and help clients navigate uncertainty with clarity, speed, and confidence. Our Quality Engineering team builds reliable, high-quality software and AI-enabled products that our clients and stakeholders depend on. This role offers hands-on experience at the intersection of traditional quality assurance and emerging AI technologies, along with a competitive benefits package that may include medical, dental, vision, parental leave, paid time off, a 401(k) with company contribution opportunities, life, disability, and accident insurance, an employee stock purchase plan, and tuition reimbursement. For US-based roles, the anticipated base salary range is $78,300.00 to $113,550.00, depending on experience, education, skills, and location, and the role is also eligible for incentive compensation.

last updated 39 week of 2026