QA Engineer with AI testing

Job : QA Engineer with AI testing

Location : Charlotte, NC(Onsite)

Fulltime Only

Job Description

Must Have Technical/Functional Skills

Primary Skill: Test AI applications, RAG systems, agents, APIs and Data Pipeline using automated development framework

Experience: Minimum 8 years

Roles & Responsibilities

Bachelor's or master's degree in computer science or related field.

Key Responsibilities

Lead Strategy: Design end-to-end test plans for generative AI, LLMs, and machine learning models.

Model Validation: Test models for accuracy, drift, latency, robustness, and security vulnerabilities.

Automation: Build advanced test automation frameworks using Python, PyTest, and specialized AI testing tools.

Data Quality: Validate training, validation, and test datasets for bias, leakage, and data integrity.

Performance Testing: Evaluate system scalability and response times under heavy concurrent loads.

Team Leadership: Mentor junior engineers and collaborate with data scientists and software developers.

Certifications in Automation