Automation QA Engineer

American IT Systems

Automation QA Engineer

Alpharetta, GA

6+ Months

Experience: 5 7+ years

Tech Stack: Python/JavaScript, Test Automation, Pytest/Selenium, LLM Evaluation, Jira/Test Management

Job Description:

Design and execute test cases for multi-turn agent conversations .
Build evaluation frameworks to assess LLM quality .
Automate API and UI testing .
Create regression suites for agentic outputs.
Drive test coverage and quality metrics.
Develop automated testing frameworks using Python/JavaScript, Pytest, Selenium , or similar technologies.
Validate AI/LLM responses and agent behavior against defined quality criteria.
Track defects and test results using Jira or other test-management tools .

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Automation QA Engineer in Alpharetta, GA vacancy

QA Automation Engineer
...QA Automation Engineer Location: Alpharetta GA Duration: Contract Rate: DOE 7 - 10 years of hands-on experience in QA. Experience in Core Java 1.8+, SQL, Gherkins-Cucumber, JMeter. (Must and Critical) Techno functional skills. Experience in Unix/Linux environments...
Suggested
Contract work
Staffing the Universe
Alpharetta, GA
2 days ago
Sr. QA Automation Engineer
Job ID: 25644435Reference Number: 25-00577Title: Sr. QA Automation EngineerLocation: Alpharetta, GA, 08830Posted Date: 2025-06-04Company... ...Alpharetta, GA, Lincoln, NE Complete OnsiteSr. QA Automation Engineer Develop and maintain automation solutions & code base, with contributions...
Suggested
Work experience placement
HAN Staffing
Alpharetta, GA
13 hours ago
Salesforce QA Automation Engineer
The Salesforce QA Automation Engineer is a key member of the QTS Business Support Services team responsible for manual and automated testing for the Salesforce platform, with a primary focus on Sales, CPQ, ARM, and related Quote to Cash processes. This role will manage...
Suggested
Full time
Quality Technology Services
Suwanee, GA
4 days ago
QA Engineer/Lead SDET (Mobile Automation)
...Job Title: QA Engineer/Lead SDET (Mobile Automation) Location: Alpharetta, GA (Onsite) Duration: Long term Job Description: Well versed in testing native mobile applications with solid understanding of mobile testing techniques, challenges...
Suggested
Trinity Technology Solutions
Alpharetta, GA
5 days ago
Salesforce QA Automation Engineer
...Suwanee, GA Ashburn, VA Irving, TX Overland Park, KS Full time R2026-1635 The Salesforce QA Automation Engineer is a key member of the QTS Business Support Services team responsible for manual and automated testing for the Salesforce platform, with...
Suggested
Full time
Immediate start
Worldwide
Quality Technology Services, LLC
Suwanee, GA
4 days ago
Test Automation Engineer
...Test Automation Engineer Location: Alpharetta, GA - Hybrid - 3 Days a week - Better to look for Local Candidates Full Time ***K The... ...business workflows, and building insightful dashboards to support QA and business teams. Job Description: Azure foundry and...
Full time
Local area
3 days per week
Yantran LLC
Alpharetta, GA
3 days ago
Field Automation Engineer (m/f/d) - PLC & Robotics
...Field Automation Engineer (m/f/d) – PLC & Robotics At VisiConsult, we deliver high-end X-ray systems and intelligent automation technology to ensure safety and efficiency across industries. As a Field Automation Engineer – PLC & Robotics in the US, you will support...
Work at office
Remote work
VisiConsult
Alpharetta, GA
3 days ago
Automation Engineer
...and lifecycle management of manufacturing process controls, automation, and field instrumentation technologies.Job ResponsibilitiesDevelop... ...projects. Responsible for the application of automation engineering principles in the design, specification, construction, startup...
Vantage Point Consulting Inc.
Alpharetta, GA
5 days ago
Automation Engineer
$100k
...Automation EngineerLocation: Oakland, CA, Alpharetta, GA, San Francisco, CA - Hybrid - 3 Days a week – Better to look for Local Candidates... ...Minimum Qualifications2+ years with Bachelor’s degreeKnowledge of QA principles, concepts, systems, industry practices, and standards...
Full time
Contract work
Local area
3 days per week
Yochana
Alpharetta, GA
4 days ago
Automation Engineer
...Selenium Automation Test EngineerAnalyzing business requirement in order to determine the test strategy covered by automation testingDeveloping new test scriptsMaintaining existing test scripts/regression suitesAttending Agile meetings (Daily scrum meeting/Sprint planning...
Omni Inclusive
Alpharetta, GA
5 days ago
Automation Engineer
...Automation EngineerDesign, develop, maintain and implement automation framework using Java Selenium webdriver on Maven project. Collaborate... ...Minimum Qualifications:2+ years with Bachelor's degreeKnowledge of QA principles, concepts, systems, industry practices, and...
Yantran LLC
Alpharetta, GA
4 days ago
AUtomation engineer
...Automation QA EngineerWe are looking for a detail-oriented and experienced Automation QA Engineer to join our QA team. You will be responsible for designing and implementing automated test solutions to ensure the quality and reliability of our software products. The ideal...
Flexible hours
Ova Technologies
Alpharetta, GA
5 days ago
QA Test Engineer
...Job Code - QA Test Engineer Work Location - Alpharetta GA 30005 or Plano TX 75023 Business Unit - DIGITAL Positions... .... Preferred Qualifications Experience in writing automation scripts using Java, TestNG, Selenium Strong analytical...
Contract work
TriOptus LLC
Alpharetta, GA
3 days ago
Corporate Automation Engineer II
...Job Description Job Description Corporate Automation Engineer Alpharetta, GA | Manufacturing Automation, Process Controls & Industry 4.0 Drive the Future of Smart Manufacturing with Arclin About Arclin: You can find Arclin everywhere. Our technologies make...
Arclin USA LLC
Alpharetta, GA
7 days ago
Developer / Automation Engineer - Vulnerability Patching
...Job Title: Developer / Automation Engineer Vulnerability Patching Location: Alpharetta, GA Duration: Long-Term Contract Strong python skills Experience with Ansible playbooks and automation platform Knowledge of Docker, Kubernetes, OpenShift...
Long term contract
VDart Inc
Alpharetta, GA
4 days ago
Automation Controls Engineer
...Primetals Technologies USA, LLC at Alpharetta, GA is seeking a Consulting Systems Engineer – Automation. The role focuses on engineering, design, testing and commissioning of PLC, DCS, and HMI automation systems for large metals industry projects. Candidates must have...
Primetals Technologies, Ltd.
Alpharetta, GA
3 days ago
QA Engineer
...QA Engineer – Terabit (Networking / ISP Platform)We are looking for a skilled QA Engineer to ensure the quality, performance, and reliability of Terabit-scale networking and ISP platforms. The role involves testing APIs, backend systems, monitoring tools, and high-throughput...
Ova Technologies
Alpharetta, GA
5 days ago
QA Engineer
...QA Engineer Location: Candidate should be local to below locations and should be ready to work from office: Alpharetta, GA... ...counterparts in overseeing bug tracking, test prioritization, test automation and release. Engages in dependency analysis, functional...
Work at office
Local area
Flexible hours
Yochana
Alpharetta, GA
5 days ago
QA Engineer
...QA Engineer Alpharetta, GA Mandatory Work from office 5 days Qualifications and Requirements ~5+ Years of Software Quality Assurance... ...is required. ~ Experience in Coalesce tool is a plus, automate SQL scripts in the tool for automation. Roles and...
Work at office
E-Solutions
Alpharetta, GA
5 days ago
Pharmaceutical - Siemens Desigo / Insight Building Automation Engineer USA
...be offered for qualified candidate. MMR Consulting is an engineering and consulting firm specializing in the pharmaceutical and... ...is for a Pharmaceutical - Siemens Desigo / Insight Building Automation Engineer USA to work on the design, project execution and commissioning...
For contractors
Relocation package
MMR Consulting
Alpharetta, GA
18 days ago
QA Engineer
...Quality Assurance Engineer (Salesforce)Alpharetta, Georgia, United StatesJoin Aperia Solutions, a leader in SaaS... ...company policies and procedures. Additionally, a great QA engineer should have the capability to automate test cases using industry-standard software testing...
Aperia Solutions
Alpharetta, GA
5 days ago
QA Engineer
...Job Summary: We are seeking a skilled Automation Engineer with strong expertise in JavaScript and the Playwright automation framework to join... ...collaborate with developers, product managers, and other QA team members to identify testing requirements, improve software...
Equiliem
Alpharetta, GA
2 days ago
QA Engineer
...Skills: 10+ Year experience Proven experience in leading QA teams and managing testing processes. Strong knowledge of software... ...QA methodologies. Extensive hands-on experience with test automation tools and frameworks (Cypress and JMeter) and a proven track...
Syntricate Technologies
Alpharetta, GA
5 days ago
QA Engineer
...Quality Assurance (QA) Engineer A Quality Assurance (QA) Engineer ensures software quality by designing, developing, and executing manual and automated tests. They work with development teams to identify, document, and resolve defects, ensuring products meet functional...
Ova Technologies
Alpharetta, GA
3 days ago
QA Engineer
...Job title:QA Engineer Location : Alpharetta, GA-Hybrid Type: Contract Job Summary Seeking a Specialist... ...of automotive software applications Design and implement automated test frameworks using Selenium with Java for UI testing Develop...
Contract work
VBeyond
Alpharetta, GA
3 days ago
Building Automation BAS Service Sales Engineer
...ATS Service Sales Engineer ATS-Companies is the leading provider of energy management services, automated control systems, critical airflow solutions, and building systems integration. We aim to be the market leader in excellence in building technologies by providing...
Full time
Local area
Monday to Friday
ATS Automation, Inc
Roswell, GA
13 hours ago
AI Automation Engineer
...AI Automation EngineerAlpharetta, GA Rate: 50-70/hr Long-TermJob Summary:We are looking for a results-driven AI Automation Engineer with expertise in integration development, workflow automation, and data analytics/BI. The ideal candidate will design and implement scalable...
Diverse Lynx
Alpharetta, GA
5 days ago
Senior Automation Engineer
...Services LLC (IS) is a uniquely qualified business providing engineering services to customers of varying size and industry. We offer... ...experience ranges from power generation, power transmission, factory automation, to oil and gas process automation.Job Description:IS has an...
Immediate start
Relocation package
Flexible hours
IS International
Lawrenceville, GA
13 hours ago
Director, QA Engineer
$148k
...Morgan Stanley Services Group, Inc. is seeking a Director, QA Engineer in Alpharetta, GA to plan and execute across all software testing... ...to the fleet leadership on a regular basis. Develop test automation solutions for software applications across different platforms...
Full time
Temporary work
Remote work
Worldwide
2 days per week
Morgan Stanley
Alpharetta, GA
2 days ago
Engineering Manager - Automation
...of the impact we create together. Join us and help run what runs the world.This position reports to:Director Engineering & Services__B&R Industrial Automation, a part of ABB's Automation Business Segment, seeks to hire an Engineering Manager. In this role, you will have...
Contract work
Temporary work
Monday to Friday
ABB
Alpharetta, GA
1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Automation QA Engineer. Be the first to apply!