AI QA Engineer
Ova Technologies
About The Role
We are looking for a highly skilled AI QA Engineer to join our team and ensure the quality, reliability, and performance of AI/ML-driven applications. The ideal candidate will have a strong background in software testing, a solid understanding of AI/ML workflows, and experience with automated testing frameworks. This role will focus on validating AI models, testing data pipelines, and ensuring the overall robustness of intelligent systems before deployment.
Key Responsibilities
Design, develop, and execute test plans and test cases for AI/ML-based products.
Validate AI models for accuracy, fairness, robustness, and performance.
Test data pipelines, feature engineering processes, and model integration with production systems.
Develop automated test scripts for model APIs, training pipelines, and inference workflows.
Collaborate with data scientists, ML engineers, and software developers to identify and resolve quality issues.
Implement monitoring and alerting mechanisms for deployed AI systems.
Conduct regression testing to ensure changes do not degrade model performance.
Ensure compliance with data privacy, security, and responsible AI standards.
Required Qualifications
Bachelor's or Master's degree in Computer Science, Engineering, or related field.
3+ years of experience in software quality assurance, with at least 1 year in AI/ML testing.
Strong knowledge of QA methodologies, tools, and processes.
Hands-on experience with automated testing frameworks (e.g., PyTest, Selenium, Robot Framework).
Familiarity with ML frameworks (TensorFlow, PyTorch, Scikit-learn).
Experience testing RESTful APIs and microservices.
Proficiency in Python (preferred), Java, or other programming languages.
Strong problem-solving skills and attention to detail.
Preferred Qualifications
Experience with ML model validation, monitoring, and drift detection.
Knowledge of MLOps tools (MLflow, Kubeflow, Airflow, CI/CD for ML).
Understanding of bias, fairness, and explainability in AI systems.
Exposure to cloud platforms (AWS, GCP, Azure) for AI/ML deployment.
ISTQB or equivalent certification in QA.
What We Offer
Competitive salary and benefits package.
Opportunity to work on cutting-edge AI products.
Collaborative, innovative, and growth-focused work environment.
Professional development and learning opportunities.
- ...We are seeking a highly skilled AI Engineer with strong full-stack Python development experience and a deep understanding of large language models (LLMs), agent orchestration, and cloud infrastructure. The ideal candidate will be responsible for designing and deploying...Suggested
- ...Job Title: Lead Consultant | Artificial Intelligence | Artificial Intelligence - ALL - Agentic Gen AI Engineer Work Location & Reporting Address: Alpharetta, GA 30005 (Onsite. LOCAL CANDIDATES ONLY!) Contract duration: 12 Does this position require Visa independent...SuggestedContract workLocal area
$100k - $110k
...Job: AI/LLM Engineer Location: Alpharetta, GA Fulltime Pay rate : $100,000/ - $110,000/ Annum + Benefits Roles and Responsibilities : We are looking for a highly skilled AI/LLM Engineer to design and build intelligent agent-based systems that...SuggestedFull timeWork at office$65 per hour
...Onsite) Duration: 6 months Skill/Job Title: Python, Java, Agentic AI, RAG, LLMs NOTE: Submit profiles that are available for in-person interviews only. Job Description - AI Engineer We are looking for a driven AI Engineer to join our engineering team...SuggestedWork at officeLocal area$109k - $182.4k
...from the bank, we're involved. If you want to make an impact on a global scale, come make a difference at Fiserv. Job Title: AI Engineer About Your Role: As an AI Engineer you will apply advanced machine learning and statistical techniques to detect, prevent,...SuggestedTemporary workH1bWork at officeMonday to Friday- ...A global consulting firm is looking for an AI & Data - Physical AI Engineering Consultant – Manager to deliver innovative AI solutions. You will lead projects, enhance data pipelines, and ensure optimal data accuracy. The ideal candidate should have over 5 years of experience...
- ...skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. We are seeking a seasoned Senior AI Engineer with deep expertise in AI solution engineering, design and contact center intelligence to join our growing team. In this role,...Full timeWork at officeImmediate startRemote workMonday to Friday
- ...About the Role The AI Agent Engineer is responsible for ensuring AI agents run safely, reliably, and effectively within enterprise environments. The role focuses on operational design, execution, continuous optimization, system integration, monitoring, and governance controls...Flexible hours
$78.8k - $131.3k
...Are you excited to help operate and improve AI agents that deliver reliable, real-world outcomes in production environments? Do... ...improve how work gets done. About the Role: The AI Agent Engineer plays a critical role in ensuring AI agents run safely, reliably...Local areaFlexible hours- ...Overview As an Associate AI Engineer on the IT AI team, you will work alongside our team of talented engineers to build GenAI agents, optimize... ...Kaleris. This is a hands‑on engineering role, not a support or QA position. You will write production code, instrument token...Shift work
$156.4k - $301k
...build a better working world. The Opportunity As an Associate Director in EY’s Forward Deployed Engineering team, you will support the design, development, and deployment of AI-driven, data-centric solutions within strategic client environments. This role blends strong...Summer holidayLocal areaFlexible hours- Mandatory Skills: Designing scalableMLsystems Advanced statistical modeling Preferred Skills: Leadership inAIstrategy Cutting-edge frameworks (Transformers, LLMs) ROBOTICS TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans...Permanent employmentContract workLocal area
$128k - $216k
...Senior AI Solutions Engineer Calling all innovators - find your future at Fiserv. We're Fiserv, a global leader in Fintech and payments, and we move money and information in a way that moves the world. We connect financial institutions, corporations, merchants and consumers...Work at officeVisa sponsorshipMonday to Friday- ...Job Title AI/ML Engineer Job Summary We are looking for a talented AI/ML Engineer to design, develop, and deploy machine learning and artificial intelligence solutions. The ideal candidate will work on building scalable AI models, optimizing machine learning...
- ...Job Description: AI/ML Engineer (2026) Role Summary: We are looking for a highly skilled AI/ML Engineer to design, build, and deploy production-grade AI systems. You will bridge the gap between data science and operational software, creating intelligent, scalable...
- ...Job Title: AI/ML Engineer Location : Alpharetta GA Interview type: final discussion- Face to Face Entry Level (1-5 years) Mandatory Skills: Python TensorFlow/PyTorch basics Understanding of ML algorithms Preferred Skills: Exposure to data...Hourly payContract work
- ...A global professional services firm is seeking a Senior AI Native Engineer to drive innovative AI solutions in Alpharetta, Georgia. The role involves researching and implementing AI systems, enhancing data pipelines, and providing technical leadership for diverse clients...Flexible hours
- Overview CLOUD ANALYTICS TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without...Permanent employmentContract workLocal area
- ...basics - Understanding of ML algorithms Preferred Skills: - Exposure to data preprocessing tools (Pandas, NumPy) - Basic cloud AI services Mid Level (5–12 years) Mandatory Skills: - Model development & deployment - REST API integration for ML models...
$65.5k - $134k
...working world. Senior Analyst - Financial Services Organization – AI and Data – Service Delivery Center EY is the only... ...(trading, risk, compliance, or banking) Knowledge of prompt engineering and in-context learning optimization Familiarity with model...Summer holidayFlexible hours- ...Overview: Job Title: AI/ML Ops & Infrastructure Engineer Company: R2 Technologies Location: Alpharetta, GA (Hybrid / Remote Options Available) Employment Type: Full-Time / Contractual About R2 Technologies: R2 Technologies is a Certified Minority...Full timeRemote workShift work
- ...student assistant, apprentice, or intern to join our Agile IT team, working closely with Enterprise Applications, IT FinOps, BI, and AI team members. In this role, you will: Assist in developing and deploying AI-driven solutions to automate and optimize internal...ApprenticeshipInternship
$77.1k - $206.82k
...implement necessary fixes for the end user's benefit. As a Senior QA, you'll also leverage your leadership and teaching skills to train... ...ADP: We are a global leader in HR technology, offering the latest AI and machine learning-enhanced payroll, tax, HR, benefits, and much...Temporary work$76.2k - $174.1k
...better working world. Manager - Financial Services Organization – AI and Data - Service Delivery Center EY is the only professional... ...majors Minimum of 5 years of related work experience in AI/ML engineering or MLE/ML Ops Experience working with business, management, and...Work experience placementSummer holidayFlexible hours$105.8k - $174.8k
...fast‑paced environment and the opportunity to develop your own career path for your unique skills and ambitions. As a Senior AI Native Engineer, you will be at the forefront of revolutionizing how businesses leverage artificial intelligence. Your role will involve researching...Full timeWork experience placementSummer holidayFlexible hours$55 - $60 per hour
...Title: AI Automation Engineer Requirement ID: 92782-1 Location: Alpharetta, GA - Need to work from office 3 Days a week Pay Rate: $55 - $60/hr Duration: 6 months Job Summary We are looking for a results-driven AI Automation Engineer with expertise...Work at office3 days per week$142.8k - $261.8k
...of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. AI & Data - Physical AI Engineering Consultant – Manager The opportunity Our Artificial Intelligence and Data team helps apply cutting‑edge technology and...Full timeWork experience placementSummer holidayFlexible hours- ...expanding healthcare organization undergoing a major enterprise AI transformation initiative. Backed directly by executive leadership... ...efficiency and user experience. As a Forward Deployed AI Engineer (FDE), you will operate at the intersection of software engineering...Temporary workImmediate start
$70k - $80k
...Job Role: QA Engineer Job Location: Alpharetta, GA 30005 Job Type: Full Tim e ( Need to come to office for F2F Round of Client Interview and once Selected has to work from office 3 Days a week) Salary Range: $70000 to $80000/Annum Must Have Technical/Functional...Work experience placementWork at office3 days per week- ...Job title:QA Engineer Location : Alpharetta, GA-Hybrid Type: Contract Job Summary Seeking a Specialist with 5 to 7 years of experience in Automotive Testing skilled in API Microservices Rest Assured Testing Cloud testing and Selenium...Contract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI QA Engineer. Be the first to apply!
- ai developer Alpharetta, GA
- machine learning ai engineer Alpharetta, GA
- ai ml engineer Alpharetta, GA
- ai engineer Alpharetta, GA
- senior ai engineer Alpharetta, GA
- ai prompt engineer Alpharetta, GA
- software quality assurance engineer Alpharetta, GA
- quality assurance engineer Alpharetta, GA
- software test engineer Alpharetta, GA
- qa engineer Alpharetta, GA


