AI QA Engineer
Ova Technologies
About The Role
We are looking for a highly skilled AI QA Engineer to join our team and ensure the quality, reliability, and performance of AI/ML-driven applications. The ideal candidate will have a strong background in software testing, a solid understanding of AI/ML workflows, and experience with automated testing frameworks. This role will focus on validating AI models, testing data pipelines, and ensuring the overall robustness of intelligent systems before deployment.
Key Responsibilities
Design, develop, and execute test plans and test cases for AI/ML-based products.
Validate AI models for accuracy, fairness, robustness, and performance.
Test data pipelines, feature engineering processes, and model integration with production systems.
Develop automated test scripts for model APIs, training pipelines, and inference workflows.
Collaborate with data scientists, ML engineers, and software developers to identify and resolve quality issues.
Implement monitoring and alerting mechanisms for deployed AI systems.
Conduct regression testing to ensure changes do not degrade model performance.
Ensure compliance with data privacy, security, and responsible AI standards.
Required Qualifications
Bachelor's or Master's degree in Computer Science, Engineering, or related field.
3+ years of experience in software quality assurance, with at least 1 year in AI/ML testing.
Strong knowledge of QA methodologies, tools, and processes.
Hands-on experience with automated testing frameworks (e.g., PyTest, Selenium, Robot Framework).
Familiarity with ML frameworks (TensorFlow, PyTorch, Scikit-learn).
Experience testing RESTful APIs and microservices.
Proficiency in Python (preferred), Java, or other programming languages.
Strong problem-solving skills and attention to detail.
Preferred Qualifications
Experience with ML model validation, monitoring, and drift detection.
Knowledge of MLOps tools (MLflow, Kubeflow, Airflow, CI/CD for ML).
Understanding of bias, fairness, and explainability in AI systems.
Exposure to cloud platforms (AWS, GCP, Azure) for AI/ML deployment.
ISTQB or equivalent certification in QA.
What We Offer
Competitive salary and benefits package.
Opportunity to work on cutting-edge AI products.
Collaborative, innovative, and growth-focused work environment.
Professional development and learning opportunities.
- ...involved. If you want to make an impact on a global scale, come make a difference at Fiserv.Job TitleAI EngineerAbout your role:As an AI Engineer you will apply advanced machine learning and statistical techniques to detect, prevent, and respond to cyber threats. You will...SuggestedFull timeTemporary workH1bWork at officeMonday to Friday
$128.4k - $215.8k
...a minimum of 5 days per week and is only located in the location(s) posted. No relocation is offered.AT&T is seeking an AI-Native Software Engineer, Senior who combines strong software engineering fundamentals with expertise in AI-enabled application development, agentic...SuggestedTemporary workWork at officeLocal areaRelocation- The Senior AI Software Engineer to design, develop, and deploy AI-powered solutions that enhance how Rheem builds and operates digital products. This role will partner closely with engineering, DevOps, QA, and product teams to implement practical AI solutions that deliver...SuggestedWork at officeRemote workWorldwideMonday to Thursday
- ...If you want to make an impact on a global scale, come make a difference at Fiserv.Job TitleLead AI Transformation EngineerAbout Your RoleAs a Lead AI Transformation Engineer, you will play a critical role in advancing AI-driven engineering practices and establishing technical...SuggestedFull timeWork at officeVisa sponsorship
- ...we’re involved. If you want to make an impact on a global scale, come make a difference at Fiserv.Job TitleLead AI EngineerAbout Your RoleAs a Lead AI Engineer, you will play a critical role in advancing AI-driven engineering practices and establishing technical...SuggestedFull timeWork at officeVisa sponsorshipMonday to Friday
- ...editor configuration and batch support. • Expertise in Azure AI Doc Intelligence • Experience in building and maintaining DEVOPS... ...expert responsible for sharing expertise and insight with other engineers. • Identifies significant internal and external stakeholders...
- ...career global? Make your mark at one of the biggest names in payments. We are seeking a highly skilled and forward-thinking AI Engineer to join our AI Engineering team. This role is ideal for a hands-on technologist with deep expertise in machine learning (ML) and...H1bWorldwide
- ...AI Engineer Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. Equifax is seeking a visionary AI engineer...Full timeImmediate start
$131k - $218.3k
...to be part of tomorrow’s health today, we want to hear from you.We are seeking a highly skilled and experienced Senior AI Full Stack Software Engineer to join our innovative team at CMM. This role involves designing, developing, and deploying end-to-end AI-powered solutions...Full time$109k - $182.4k
...If you want to make an impact on a global scale, come make a difference at Fiserv.Job TitleAI - Cyber Security Engineer - IIAbout your role:As an Advisor II, AI - Software Engineering, you will design, build, and deploy AI-powered cybersecurity solutions that strengthen...Full timeTemporary workH1bWork at officeMonday to Friday$196.1k - $326.9k
...functional workflows, and ensures strategic communication across stakeholder groups.Key Responsibilities: Proven leadership of AI/ML engineering orgs through a management layer — direct experience managing people, not just individual senior engineers or a single flat...Full time- ...Proven experience (2+ years) supporting Microsoft 365 technologies, including hands-on experience with Copilot Premium or equivalent AI-driven platforms.Strong understanding of how Copilot integrates with SharePoint Online, OneDrive, Exchange, Microsoft Search, and related...Full time
- ...I have an opening for the below requirement. If you're interested please let me know. Position: Business Consultant AI Integration Engineer Location: Alpharetta, GA [100% Onsite] Duration: 12+ months Job Description: Description...Local area
- ...Title: AI Engineer Location: Alpharetta, GA (Hybrid) Type: Contract Technical Skills: LangGraph (graphs, tool-nodes, memory/state, streaming agents), Google Vertex AI (Gemini, RAG, Vector Search, embeddings, safety). Python. Job Description:...Contract work
$156.4k - $301k
...better working world. The Opportunity As an Associate Director in EY’s Forward Deployed Engineering team, you will support the design, development, and deployment of AI-driven, data-centric solutions within strategic client environments. This role blends strong technical...Summer holidayLocal areaFlexible hours- ...Collaborative, people-first culture focused on work-life balance Location Alpharetta, GA Position Overview The Senior Data & AI Engineer is responsible for designing, building, and scaling Meadows & Ohly's enterprise data platform and AI capabilities. This hands-on...Work at office
$127.5k - $204k
...scale, come make a difference at Fiserv.Job TitleAI Automation Engineer - Network Security GovernanceAbout your role:You will be responsible... ...security controls, policy compliance, and governance outcomes.AI-Enabled Security TransformationLead initiatives that leverage AI...Full timeTemporary workH1bWork at officeMonday to Friday$92.16k - $138.24k
...to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Backend & AI/ML Engineer to join our team in Alpharetta, Georgia,, Georgia (US-GA), United States (US). Day to Day Job Duties: Develop and...Temporary workWork at officeRemote workFlexible hours- Job-ID29181050Reference26-02386Job Title :: Agentic AI DeveloperJob Location :: Irving, TX / Alpharetta, GA - OnsiteDescription:... ...systems. In this role, you will go beyond traditional static prompt engineering to create resilient, decision-making agentic workflows capable...Temporary work
- ...Job title:QA Engineer Location : Alpharetta, GA-Hybrid Type: Contract Job Summary Seeking a Specialist with 5 to 7 years of experience in Automotive Testing skilled in API Microservices Rest Assured Testing Cloud testing and Selenium...Contract work
$148k
...and shape the future of our communities. What you’ll do in the role: Morgan Stanley Services Group, Inc. is seeking a Director, QA Engineer in Alpharetta, GA to plan and execute across all software testing phases. Understand business domains and use abilities to connect...Temporary workRemote workWorldwide2 days per week- Job ID: 25644435Reference Number: 25-00577Title: Sr. QA Automation EngineerLocation: Alpharetta, GA, 08830Posted Date: 2025-06-04Company... ...: Alpharetta, GA, Lincoln, NE Complete OnsiteSr. QA Automation Engineer Develop and maintain automation solutions & code base, with...Work experience placement
$99k - $164.8k
...an experience to our stakeholders that delivers on our promises.SummaryKemper Auto is seeking a highly skilled Resident Actuarial Engineer Manager to integrate solution development and data engineering practices within actuarial processes. This role bridges actuarial science...Full timeRemote work- Job Tittle : Python Developer Location : Alpharetta, GA Required Skills : * Python expertise * Python automation scripting experience * Unix/Linux Admin experience * Git and Jenkins knowledge * 5-10 years of working experience in Python * Build extract...Work experience placement
- ...Python Job Developer We are looking for a Python Job Developer to join our growing engineering team. The ideal candidate will be responsible for designing, building, and maintaining Python-based data processing jobs, RESTful APIs, and backend systems that support our...
- ...Department: Software Development / IT Reports To: Lead Developer / Engineering Manager Job Summary: We are looking for a skilled... ...) for full-stack capabilities. Familiarity with data analytics, machine learning, or AI integration is a plus....
- Python Developer Responsibilities: Design and implement scalable cloud-based solutions. Collaborate with cross-functional teams to define, design, and ship new features. Ensure the performance, quality, and responsiveness of applications. Identify and correct...
- Job Description We are seeking a highly skilled Python contractor to support development, debugging, and issue resolution efforts. This is a hands-on role focused on quickly understanding existing systems, fixing defects, and delivering reliable code improvements. ...For contractors
- ...the bank, we’re involved. If you want to make an impact on a global scale, come make a difference at Fiserv.Job TitleQA Engineer - Automation & AI ExpertAbout your role:Lead quality engineering and release coordination for a high-volume portfolio of mainframe and integrated...Full timeTemporary workH1b
- Job Details: Executes test cases and / or automation scripts. Identifies and documents defects thoroughly. Excellent knowledge of software test design and testing methodologies. Working knowledge of test techniques including using automation testing ...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI QA Engineer. Be the first to apply!
- ai engineer Alpharetta, GA
- ai developer Alpharetta, GA
- software quality assurance engineer Alpharetta, GA
- quality assurance engineer Alpharetta, GA
- qa automation engineer Alpharetta, GA
- qa automation test engineer Alpharetta, GA
- software quality engineer Alpharetta, GA
- qa automation engineer remote Alpharetta, GA
- software test engineer Alpharetta, GA
- senior software test automation engineer Alpharetta, GA


