Senior AI Test Engineer QA Automation Engineer AI LLM at Houston, TX- Onsite

Hi ,

Hope you are doing well

Please find the Job Description (JD) below.

Role : Senior AI Test Engineer (API & AI Validation)

Location: Houston, TX- Onsite

Job Summary

We are seeking an experienced Senior AI Test Engineer with 10 12 years of experience in Quality Engineering, including hands-on expertise in API testing and AI application validation . The ideal candidate should have strong experience testing AI/LLM-powered applications, validating REST APIs, designing automation frameworks, and ensuring the quality, reliability, security, and performance of modern AI-enabled systems.

This role requires a blend of traditional testing expertise and knowledge of AI-specific validation techniques, including prompt testing, model evaluation, hallucination detection, and retrieval validation.

Key Responsibilities

• Define and implement end-to-end test strategies for AI-enabled applications.
• Design and execute comprehensive test plans for Generative AI, LLM, RAG, and AI Agent workflows.
• Perform functional, integration, regression, system, and UAT testing.
• Validate RESTful APIs using tools such as Postman, Swagger, REST Assured, or similar frameworks.
• Develop and maintain API automation frameworks.
• Validate AI model responses for:
  • Accuracy
  • Relevance
  • Consistency
  • Hallucinations
  • Bias
  • Toxicity
• Test prompt engineering scenarios and optimize prompt quality.
• Validate Retrieval-Augmented Generation (RAG) pipelines and vector search accuracy.
• Verify AI guardrails, content moderation, and responsible AI compliance.
• Perform database validation using SQL.
• Conduct performance and load testing for APIs and AI services.
• Collaborate with Product Owners, Architects, Data Scientists, ML Engineers, and Developers.

Thanks & Regards

Madhu Challa
Sr. Technical recruiter

Propelsys Technologies | 4975 Preston Park Boulevard, Suite 70 West
Plano, TX 75093



E: View email address on us.fitly.work