Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI QA Engineer

Ova Technologies

About The Role

We are looking for a highly skilled AI QA Engineer to join our team and ensure the quality, reliability, and performance of AI/ML-driven applications. The ideal candidate will have a strong background in software testing, a solid understanding of AI/ML workflows, and experience with automated testing frameworks. This role will focus on validating AI models, testing data pipelines, and ensuring the overall robustness of intelligent systems before deployment.

Key Responsibilities
  • Design, develop, and execute test plans and test cases for AI/ML-based products.

  • Validate AI models for accuracy, fairness, robustness, and performance.

  • Test data pipelines, feature engineering processes, and model integration with production systems.

  • Develop automated test scripts for model APIs, training pipelines, and inference workflows.

  • Collaborate with data scientists, ML engineers, and software developers to identify and resolve quality issues.

  • Implement monitoring and alerting mechanisms for deployed AI systems.

  • Conduct regression testing to ensure changes do not degrade model performance.

  • Ensure compliance with data privacy, security, and responsible AI standards.

Required Qualifications
  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.

  • 3+ years of experience in software quality assurance, with at least 1 year in AI/ML testing.

  • Strong knowledge of QA methodologies, tools, and processes.

  • Hands-on experience with automated testing frameworks (e.g., PyTest, Selenium, Robot Framework).

  • Familiarity with ML frameworks (TensorFlow, PyTorch, Scikit-learn).

  • Experience testing RESTful APIs and microservices.

  • Proficiency in Python (preferred), Java, or other programming languages.

  • Strong problem-solving skills and attention to detail.

Preferred Qualifications
  • Experience with ML model validation, monitoring, and drift detection.

  • Knowledge of MLOps tools (MLflow, Kubeflow, Airflow, CI/CD for ML).

  • Understanding of bias, fairness, and explainability in AI systems.

  • Exposure to cloud platforms (AWS, GCP, Azure) for AI/ML deployment.

  • ISTQB or equivalent certification in QA.

What We Offer
  • Competitive salary and benefits package.

  • Opportunity to work on cutting-edge AI products.

  • Collaborative, innovative, and growth-focused work environment.

  • Professional development and learning opportunities.

Vacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the AI QA Engineer in Alpharetta, GA vacancy
  •  ...involved. If you want to make an impact on a global scale, come make a difference at Fiserv.Job TitleAI EngineerAbout your role:As an AI Engineer you will apply advanced machine learning and statistical techniques to detect, prevent, and respond to cyber threats. You will... 
    Suggested
    Full time
    Temporary work
    H1b
    Work at office
    Monday to Friday

    Fiserv

    Alpharetta, GA
    2 days ago
  • $128.4k - $215.8k

     ...a minimum of 5 days per week and is only located in the location(s) posted. No relocation is offered.AT&T is seeking an AI-Native Software Engineer, Senior who combines strong software engineering fundamentals with expertise in AI-enabled application development, agentic... 
    Suggested
    Temporary work
    Work at office
    Local area
    Relocation

    AT&T

    Alpharetta, GA
    2 days ago
  • The Senior AI Software Engineer to design, develop, and deploy AI-powered solutions that enhance how Rheem builds and operates digital products. This role will partner closely with engineering, DevOps, QA, and product teams to implement practical AI solutions that deliver... 
    Suggested
    Work at office
    Remote work
    Worldwide
    Monday to Thursday

    Rheem Manufacturing Company

    Roswell, GA
    3 days ago
  •  ...If you want to make an impact on a global scale, come make a difference at Fiserv.Job TitleLead AI Transformation EngineerAbout Your RoleAs a Lead AI Transformation Engineer, you will play a critical role in advancing AI-driven engineering practices and establishing technical... 
    Suggested
    Full time
    Work at office
    Visa sponsorship

    Fiserv

    Alpharetta, GA
    2 days ago
  •  ...we’re involved. If you want to make an impact on a global scale, come make a difference at Fiserv.Job TitleLead AI EngineerAbout Your RoleAs a Lead AI Engineer, you will play a critical role in advancing AI-driven engineering practices and establishing technical... 
    Suggested
    Full time
    Work at office
    Visa sponsorship
    Monday to Friday

    Fiserv

    Alpharetta, GA
    2 days ago
  •  ...editor configuration and batch support. • Expertise in Azure AI Doc Intelligence • Experience in building and maintaining DEVOPS...  ...expert responsible for sharing expertise and insight with other engineers. • Identifies significant internal and external stakeholders... 

    Yochana

    Alpharetta, GA
    21 hours ago
  •  ...career global? Make your mark at one of the biggest names in payments. We are seeking a highly skilled and forward-thinking AI Engineer to join our AI Engineering team. This role is ideal for a hands-on technologist with deep expertise in machine learning (ML) and... 
    H1b
    Worldwide

    Global Payments

    Alpharetta, GA
    1 day ago
  •  ...AI Engineer Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. Equifax is seeking a visionary AI engineer... 
    Full time
    Immediate start

    Equifax

    Alpharetta, GA
    2 days ago
  • $131k - $218.3k

     ...to be part of tomorrow’s health today, we want to hear from you.We are seeking a highly skilled and experienced Senior AI Full Stack Software Engineer to join our innovative team at CMM. This role involves designing, developing, and deploying end-to-end AI-powered solutions... 
    Full time

    McKesson

    Alpharetta, GA
    2 days ago
  • $109k - $182.4k

     ...If you want to make an impact on a global scale, come make a difference at Fiserv.Job TitleAI - Cyber Security Engineer - IIAbout your role:As an Advisor II, AI - Software Engineering, you will design, build, and deploy AI-powered cybersecurity solutions that strengthen... 
    Full time
    Temporary work
    H1b
    Work at office
    Monday to Friday

    Fiserv

    Alpharetta, GA
    21 hours ago
  • $196.1k - $326.9k

     ...functional workflows, and ensures strategic communication across stakeholder groups.Key Responsibilities: Proven leadership of AI/ML engineering orgs through a management layer — direct experience managing people, not just individual senior engineers or a single flat... 
    Full time

    McKesson

    Alpharetta, GA
    2 days ago
  •  ...Proven experience (2+ years) supporting Microsoft 365 technologies, including hands-on experience with Copilot Premium or equivalent AI-driven platforms.Strong understanding of how Copilot integrates with SharePoint Online, OneDrive, Exchange, Microsoft Search, and related... 
    Full time

    Axis Capital

    Alpharetta, GA
    2 days ago
  •  ...I have an opening for the below requirement. If you're interested please let me know. Position: Business Consultant AI Integration Engineer Location: Alpharetta, GA [100% Onsite] Duration: 12+ months Job Description: Description... 
    Local area

    United Software Group

    Alpharetta, GA
    21 hours ago
  •  ...Title: AI Engineer Location: Alpharetta, GA (Hybrid) Type: Contract Technical Skills: LangGraph (graphs, tool-nodes, memory/state, streaming agents), Google Vertex AI (Gemini, RAG, Vector Search, embeddings, safety). Python. Job Description:... 
    Contract work

    VDart Inc

    Alpharetta, GA
    2 days ago
  • $156.4k - $301k

     ...better working world. The Opportunity As an Associate Director in EY’s Forward Deployed Engineering team, you will support the design, development, and deployment of AI-driven, data-centric solutions within strategic client environments. This role blends strong technical... 
    Summer holiday
    Local area
    Flexible hours

    EY

    Alpharetta, GA
    21 hours ago
  •  ...Collaborative, people-first culture focused on work-life balance Location Alpharetta, GA Position Overview The Senior Data & AI Engineer is responsible for designing, building, and scaling Meadows & Ohly's enterprise data platform and AI capabilities. This hands-on... 
    Work at office

    Meadows & Ohly , LLC

    Alpharetta, GA
    29 days ago
  • $127.5k - $204k

     ...scale, come make a difference at Fiserv.Job TitleAI Automation Engineer - Network Security GovernanceAbout your role:You will be responsible...  ...security controls, policy compliance, and governance outcomes.AI-Enabled Security TransformationLead initiatives that leverage AI... 
    Full time
    Temporary work
    H1b
    Work at office
    Monday to Friday

    Fiserv

    Alpharetta, GA
    2 days ago
  • $92.16k - $138.24k

     ...to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Backend & AI/ML Engineer to join our team in Alpharetta, Georgia,, Georgia (US-GA), United States (US). Day to Day Job Duties:  Develop and... 
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA, Inc.

    Alpharetta, GA
    9 days ago
  • Job-ID29181050Reference26-02386Job Title :: Agentic AI DeveloperJob Location :: Irving, TX / Alpharetta, GA - OnsiteDescription:...  ...systems. In this role, you will go beyond traditional static prompt engineering to create resilient, decision-making agentic workflows capable... 
    Temporary work

    AgreeYa Solutions

    Alpharetta, GA
    1 day ago
  •  ...Job title:QA Engineer Location : Alpharetta, GA-Hybrid Type: Contract Job Summary Seeking a Specialist with 5 to 7 years of experience in Automotive Testing skilled in API Microservices Rest Assured Testing Cloud testing and Selenium... 
    Contract work

    VBeyond

    Alpharetta, GA
    7 hours ago
  • $148k

     ...and shape the future of our communities. What you’ll do in the role: Morgan Stanley Services Group, Inc. is seeking a Director, QA Engineer in Alpharetta, GA to plan and execute across all software testing phases. Understand business domains and use abilities to connect... 
    Temporary work
    Remote work
    Worldwide
    2 days per week

    Morgan Stanley

    Alpharetta, GA
    2 days ago
  • Job ID: 25644435Reference Number: 25-00577Title: Sr. QA Automation EngineerLocation: Alpharetta, GA, 08830Posted Date: 2025-06-04Company...  ...: Alpharetta, GA, Lincoln, NE Complete OnsiteSr. QA Automation Engineer Develop and maintain automation solutions & code base, with... 
    Work experience placement

    HAN Staffing

    Alpharetta, GA
    2 days ago
  • $99k - $164.8k

     ...an experience to our stakeholders that delivers on our promises.SummaryKemper Auto is seeking a highly skilled Resident Actuarial Engineer Manager to integrate solution development and data engineering practices within actuarial processes. This role bridges actuarial science... 
    Full time
    Remote work

    Kemper Corporation

    Alpharetta, GA
    1 day ago
  • Job Tittle : Python Developer Location : Alpharetta, GA Required Skills : * Python expertise * Python automation scripting experience * Unix/Linux Admin experience * Git and Jenkins knowledge * 5-10 years of working experience in Python * Build extract...
    Work experience placement

    Prophecy Technologies

    Alpharetta, GA
    2 days ago
  •  ...Python Job Developer We are looking for a Python Job Developer to join our growing engineering team. The ideal candidate will be responsible for designing, building, and maintaining Python-based data processing jobs, RESTful APIs, and backend systems that support our... 

    Ova Technologies

    Alpharetta, GA
    7 hours ago
  •  ...Department: Software Development / IT Reports To: Lead Developer / Engineering Manager Job Summary: We are looking for a skilled...  ...) for full-stack capabilities. Familiarity with data analytics, machine learning, or AI integration is a plus.... 

    Ova Technologies

    Alpharetta, GA
    8 hours ago
  • Python Developer Responsibilities: Design and implement scalable cloud-based solutions. Collaborate with cross-functional teams to define, design, and ship new features. Ensure the performance, quality, and responsiveness of applications. Identify and correct...

    Kasmo Global

    Alpharetta, GA
    4 days ago
  • Job Description We are seeking a highly skilled Python contractor to support development, debugging, and issue resolution efforts. This is a hands-on role focused on quickly understanding existing systems, fixing defects, and delivering reliable code improvements. ...
    For contractors

    Insight Global

    Alpharetta, GA
    3 days ago
  •  ...the bank, we’re involved. If you want to make an impact on a global scale, come make a difference at Fiserv.Job TitleQA Engineer - Automation & AI ExpertAbout your role:Lead quality engineering and release coordination for a high-volume portfolio of mainframe and integrated... 
    Full time
    Temporary work
    H1b

    Fiserv

    Alpharetta, GA
    21 hours ago
  • Job Details: Executes test cases and / or automation scripts. Identifies and documents defects thoroughly. Excellent knowledge of software test design and testing methodologies. Working knowledge of test techniques including using automation testing ...

    Omni Inclusive

    Alpharetta, GA
    7 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI QA Engineer. Be the first to apply!