Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI QA Engineer

Ova Technologies

About The Role

We are looking for a highly skilled AI QA Engineer to join our team and ensure the quality, reliability, and performance of AI/ML-driven applications. The ideal candidate will have a strong background in software testing, a solid understanding of AI/ML workflows, and experience with automated testing frameworks. This role will focus on validating AI models, testing data pipelines, and ensuring the overall robustness of intelligent systems before deployment.

Key Responsibilities
  • Design, develop, and execute test plans and test cases for AI/ML-based products.

  • Validate AI models for accuracy, fairness, robustness, and performance.

  • Test data pipelines, feature engineering processes, and model integration with production systems.

  • Develop automated test scripts for model APIs, training pipelines, and inference workflows.

  • Collaborate with data scientists, ML engineers, and software developers to identify and resolve quality issues.

  • Implement monitoring and alerting mechanisms for deployed AI systems.

  • Conduct regression testing to ensure changes do not degrade model performance.

  • Ensure compliance with data privacy, security, and responsible AI standards.

Required Qualifications
  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.

  • 3+ years of experience in software quality assurance, with at least 1 year in AI/ML testing.

  • Strong knowledge of QA methodologies, tools, and processes.

  • Hands-on experience with automated testing frameworks (e.g., PyTest, Selenium, Robot Framework).

  • Familiarity with ML frameworks (TensorFlow, PyTorch, Scikit-learn).

  • Experience testing RESTful APIs and microservices.

  • Proficiency in Python (preferred), Java, or other programming languages.

  • Strong problem-solving skills and attention to detail.

Preferred Qualifications
  • Experience with ML model validation, monitoring, and drift detection.

  • Knowledge of MLOps tools (MLflow, Kubeflow, Airflow, CI/CD for ML).

  • Understanding of bias, fairness, and explainability in AI systems.

  • Exposure to cloud platforms (AWS, GCP, Azure) for AI/ML deployment.

  • ISTQB or equivalent certification in QA.

What We Offer
  • Competitive salary and benefits package.

  • Opportunity to work on cutting-edge AI products.

  • Collaborative, innovative, and growth-focused work environment.

  • Professional development and learning opportunities.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI QA Engineer in Alpharetta, GA vacancy
  •  ...We are seeking a highly skilled AI Engineer with strong full-stack Python development experience and a deep understanding of large language models (LLMs), agent orchestration, and cloud infrastructure. The ideal candidate will be responsible for designing and deploying... 
    Suggested

    Compunnel

    Alpharetta, GA
    4 days ago
  •  ...Job Title: Lead Consultant | Artificial Intelligence | Artificial Intelligence - ALL - Agentic Gen AI Engineer Work Location & Reporting Address: Alpharetta, GA 30005 (Onsite. LOCAL CANDIDATES ONLY!) Contract duration: 12 Does this position require Visa independent... 
    Suggested
    Contract work
    Local area

    Diverse Lynx

    Alpharetta, GA
    2 days ago
  • $100k - $110k

     ...Job: AI/LLM Engineer Location: Alpharetta, GA Fulltime Pay rate : $100,000/ - $110,000/ Annum + Benefits Roles and Responsibilities : We are looking for a highly skilled AI/LLM Engineer to design and build intelligent agent-based systems that... 
    Suggested
    Full time
    Work at office

    Diverse Lynx

    Alpharetta, GA
    2 days ago
  • $65 per hour

     ...Onsite) Duration: 6 months Skill/Job Title: Python, Java, Agentic AI, RAG, LLMs NOTE: Submit profiles that are available for in-person interviews only. Job Description - AI Engineer We are looking for a driven AI Engineer to join our engineering team... 
    Suggested
    Work at office
    Local area

    Diverse Lynx

    Alpharetta, GA
    2 days ago
  • $109k - $182.4k

     ...from the bank, we're involved. If you want to make an impact on a global scale, come make a difference at Fiserv. Job Title: AI Engineer About Your Role: As an AI Engineer you will apply advanced machine learning and statistical techniques to detect, prevent,... 
    Suggested
    Temporary work
    H1b
    Work at office
    Monday to Friday

    BentoBox

    Alpharetta, GA
    4 days ago
  •  ...A global consulting firm is looking for an AI & Data - Physical AI Engineering Consultant – Manager to deliver innovative AI solutions. You will lead projects, enhance data pipelines, and ensure optimal data accuracy. The ideal candidate should have over 5 years of experience... 

    Ernst & Young Oman

    Alpharetta, GA
    5 days ago
  •  ...skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. We are seeking a seasoned Senior AI Engineer with deep expertise in AI solution engineering, design and contact center intelligence to join our growing team. In this role,... 
    Full time
    Work at office
    Immediate start
    Remote work
    Monday to Friday

    Equifax

    Alpharetta, GA
    2 days ago
  •  ...About the Role The AI Agent Engineer is responsible for ensuring AI agents run safely, reliably, and effectively within enterprise environments. The role focuses on operational design, execution, continuous optimization, system integration, monitoring, and governance controls... 
    Flexible hours

    LexisNexis Risk Solutions

    Alpharetta, GA
    18 hours ago
  • $78.8k - $131.3k

     ...Are you excited to help operate and improve AI agents that deliver reliable, real-world outcomes in production environments? Do...  ...improve how work gets done. About the Role: The AI Agent Engineer plays a critical role in ensuring AI agents run safely, reliably... 
    Local area
    Flexible hours

    RELX Group plc

    Alpharetta, GA
    3 days ago
  •  ...Overview As an Associate AI Engineer on the IT AI team, you will work alongside our team of talented engineers to build GenAI agents, optimize...  ...Kaleris. This is a hands‑on engineering role, not a support or QA position. You will write production code, instrument token... 
    Shift work

    NAVIS

    Alpharetta, GA
    4 days ago
  • $156.4k - $301k

     ...build a better working world. The Opportunity As an Associate Director in EY’s Forward Deployed Engineering team, you will support the design, development, and deployment of AI-driven, data-centric solutions within strategic client environments. This role blends strong... 
    Summer holiday
    Local area
    Flexible hours

    Ernst & Young Oman

    Alpharetta, GA
    3 days ago
  • Mandatory Skills: Designing scalableMLsystems Advanced statistical modeling Preferred Skills: Leadership inAIstrategy Cutting-edge frameworks (Transformers, LLMs) ROBOTICS TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans...
    Permanent employment
    Contract work
    Local area

    Robotics Technologies LLC

    Alpharetta, GA
    4 days ago
  • $128k - $216k

     ...Senior AI Solutions Engineer Calling all innovators - find your future at Fiserv. We're Fiserv, a global leader in Fintech and payments, and we move money and information in a way that moves the world. We connect financial institutions, corporations, merchants and consumers... 
    Work at office
    Visa sponsorship
    Monday to Friday

    BentoBox

    Alpharetta, GA
    1 day ago
  •  ...Job Title AI/ML Engineer Job Summary We are looking for a talented AI/ML Engineer to design, develop, and deploy machine learning and artificial intelligence solutions. The ideal candidate will work on building scalable AI models, optimizing machine learning... 

    Ova Technologies

    Alpharetta, GA
    4 days ago
  •  ...Job Description: AI/ML Engineer (2026) Role Summary: We are looking for a highly skilled AI/ML Engineer to design, build, and deploy production-grade AI systems. You will bridge the gap between data science and operational software, creating intelligent, scalable... 

    Ova Technologies

    Alpharetta, GA
    16 hours ago
  •  ...Job Title: AI/ML Engineer Location : Alpharetta GA Interview type: final discussion- Face to Face Entry Level (1-5 years) Mandatory Skills: Python TensorFlow/PyTorch basics Understanding of ML algorithms Preferred Skills: Exposure to data... 
    Hourly pay
    Contract work

    Yantran LLC

    Alpharetta, GA
    3 days ago
  •  ...A global professional services firm is seeking a Senior AI Native Engineer to drive innovative AI solutions in Alpharetta, Georgia. The role involves researching and implementing AI systems, enhancing data pipelines, and providing technical leadership for diverse clients... 
    Flexible hours

    Ernst & Young Oman

    Alpharetta, GA
    5 days ago
  • Overview CLOUD ANALYTICS TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without...
    Permanent employment
    Contract work
    Local area

    Cloud Analytics Technologies, LLC

    Alpharetta, GA
    5 days ago
  •  ...basics - Understanding of ML algorithms Preferred Skills: - Exposure to data preprocessing tools (Pandas, NumPy) - Basic cloud AI services Mid Level (5–12 years) Mandatory Skills: - Model development & deployment - REST API integration for ML models... 

    Tech M USAAvance Consulting

    Alpharetta, GA
    4 days ago
  • $65.5k - $134k

     ...working world. Senior Analyst - Financial Services Organization – AI and Data – Service Delivery Center EY is the only...  ...(trading, risk, compliance, or banking) Knowledge of prompt engineering and in-context learning optimization Familiarity with model... 
    Summer holiday
    Flexible hours

    EY

    Alpharetta, GA
    4 days ago
  •  ...Overview: Job Title: AI/ML Ops & Infrastructure Engineer Company: R2 Technologies Location: Alpharetta, GA (Hybrid / Remote Options Available) Employment Type: Full-Time / Contractual About R2 Technologies: R2 Technologies is a Certified Minority... 
    Full time
    Remote work
    Shift work

    R2 Technologies

    Alpharetta, GA
    3 days ago
  •  ...student assistant, apprentice, or intern to join our Agile IT team, working closely with Enterprise Applications, IT FinOps, BI, and AI team members. In this role, you will: Assist in developing and deploying AI-driven solutions to automate and optimize internal... 
    Apprenticeship
    Internship

    Kaleris

    Alpharetta, GA
    3 days ago
  • $77.1k - $206.82k

     ...implement necessary fixes for the end user's benefit. As a Senior QA, you'll also leverage your leadership and teaching skills to train...  ...ADP: We are a global leader in HR technology, offering the latest AI and machine learning-enhanced payroll, tax, HR, benefits, and much... 
    Temporary work

    Fairygodboss

    Alpharetta, GA
    4 days ago
  • $76.2k - $174.1k

     ...better working world. Manager - Financial Services Organization – AI and Data - Service Delivery Center EY is the only professional...  ...majors Minimum of 5 years of related work experience in AI/ML engineering or MLE/ML Ops Experience working with business, management, and... 
    Work experience placement
    Summer holiday
    Flexible hours

    Ernst & Young Oman

    Alpharetta, GA
    5 days ago
  • $105.8k - $174.8k

     ...fast‑paced environment and the opportunity to develop your own career path for your unique skills and ambitions. As a Senior AI Native Engineer, you will be at the forefront of revolutionizing how businesses leverage artificial intelligence. Your role will involve researching... 
    Full time
    Work experience placement
    Summer holiday
    Flexible hours

    Ernst & Young Oman

    Alpharetta, GA
    4 days ago
  • $55 - $60 per hour

     ...Title: AI Automation Engineer Requirement ID: 92782-1 Location: Alpharetta, GA - Need to work from office 3 Days a week Pay Rate: $55 - $60/hr Duration: 6 months Job Summary We are looking for a results-driven AI Automation Engineer with expertise... 
    Work at office
    3 days per week

    Artech

    Alpharetta, GA
    1 day ago
  • $142.8k - $261.8k

     ...of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. AI & Data - Physical AI Engineering Consultant – Manager The opportunity Our Artificial Intelligence and Data team helps apply cutting‑edge technology and... 
    Full time
    Work experience placement
    Summer holiday
    Flexible hours

    Ernst & Young Oman

    Alpharetta, GA
    5 days ago
  •  ...expanding healthcare organization undergoing a major enterprise AI transformation initiative. Backed directly by executive leadership...  ...efficiency and user experience. As a Forward Deployed AI Engineer (FDE), you will operate at the intersection of software engineering... 
    Temporary work
    Immediate start

    TRC Talent Solutions

    Sandy Springs, GA
    a month ago
  • $70k - $80k

     ...Job Role: QA Engineer Job Location: Alpharetta, GA 30005 Job Type: Full Tim e ( Need to come to office for F2F Round of Client Interview and once Selected has to work from office 3 Days a week) Salary Range: $70000 to $80000/Annum Must Have Technical/Functional... 
    Work experience placement
    Work at office
    3 days per week

    Diverse Lynx

    Alpharetta, GA
    4 days ago
  •  ...Job title:QA Engineer Location : Alpharetta, GA-Hybrid Type: Contract Job Summary Seeking a Specialist with 5 to 7 years of experience in Automotive Testing skilled in API Microservices Rest Assured Testing Cloud testing and Selenium... 
    Contract work

    VBeyond

    Alpharetta, GA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI QA Engineer. Be the first to apply!