QA Tester II
Insight
QA Tester, AI Development
About This Role
The QA Tester is the quality gatekeeper for Insight's AI Development team, responsible for defining and executing test strategies across AI-powered applications. This role goes beyond traditional functional testing — you will validate the reasoning, accuracy, and safety of AI agents and LLM-powered features, while also maintaining robust automation frameworks for the full application stack. You will lead QA efforts across multiple projects and mentor team members on testing best practices for AI applications.
Key Responsibilities
Define and implement test strategies for AI-powered applications, including functional, integration, regression, and AI-specific testing (prompt evaluation, hallucination detection, guardrail validation).
Build and maintain automated test frameworks using Python (Pytest) and UI automation tools (Playwright, Cypress, or Selenium) for React front-ends and API back-ends.
Validate AI model outputs for accuracy, safety, and adherence to expected behaviors across agentic workflows and conversational interfaces.
Integrate automated test suites into CI/CD pipelines to ensure rapid feedback on code changes.
Lead defect management: identify, document, reproduce, and track bugs; work closely with developers to verify fixes.
Collaborate with AI Developers, Full Stack Developers, and DevOps Engineers to ensure quality is embedded throughout the development lifecycle.
Establish QA metrics and reporting to communicate quality status and risk to stakeholders.
Qualifications
Experience: Minimum 3 years of experience as a QA Engineer or SDET, with experience testing complex web applications and API integrations.
Automation: Proficient in Python for writing automated test scripts (Pytest preferred); experience with UI automation tools (Playwright, Cypress, or Selenium).
API Testing: Strong understanding of REST APIs; experience validating API responses and JSON schemas.
AI/ML Testing: Familiarity with testing LLM-powered applications, including non-deterministic output validation. Experience with evaluation frameworks (RAGAS, LangSmith, or similar) is a plus.
Cloud: Working knowledge of Microsoft Azure; ability to navigate cloud logs and debug deployed services.
CI/CD: Experience integrating test suites into CI/CD pipelines (Azure DevOps, GitHub Actions).
Communication: Strong written and verbal English communication skills; ability to articulate risk and quality metrics to stakeholders.
Nice to Have: Experience with performance testing, security testing, or accessibility testing.
The position described above provides a summary of some the job duties required and what it would be like to work at Insight. For a comprehensive list of physical demands and work environment for this position, click here .
About Insight
Today, every business is a technology business. Insight Enterprises, Inc. empowers organizations of all sizes with Insight Intelligent Technology Solutions™ and services to maximize the business value of IT. As a Fortune 500-ranked global provider of digital innovation, cloud/data center transformation, connected workforce, and supply chain optimization solutions and services, we help clients successfully manage their IT today while transforming for tomorrow. From IT strategy and design to implementation and management, our 11,000 teammates help clients innovate and optimize their operations to run smarter. Discover more at insight.com
- Founded in 1988 in Tempe, Arizona
- 11,000+ teammates in 19 countries providing Insight Intelligent Technology Solutions™ for organizations across the globe
- $8.3 billion in revenue in 2020
- Ranked #409 on the Fortune 500, #15 on the CRN Solution Provider 500, 2020 CRN Innovator of the Year Award
- 2020 Intel Innovation Partner of Year, 2020 Microsoft U.S. Partner of the Year and Worldwide Customer Experience Partner of the Year
- Ranked #7 on the 2021 Fortune World's Most Admired Companies (Information Technology Services industry), #70 on the Fortune 100 Best Workplaces for Diversity, #296 on Forbes World's Best Employers (#27 within IT), and #5 on the Phoenix Business Journal 2020 list of Best Places to Work
- Join the Pioneer Crypto Brand in the Philippines! Coins is the most established crypto brand in The Philippines and has gained the trust of more than 18 million users. Through the easy-to-use mobile app, users can buy and sell a variety of different cryptocurrencies and...SuggestedFull time
- About Analog Devices Analog Devices, Inc. (NASDAQ: ADI ) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the Intelligent Edge. ADI combines analog, digital, and software technologies into solutions that help ...SuggestedPermanent employmentInternshipWork at officeShift work
- The Allegro team is united by a clear purpose—advancing technologies that make the world safer, more efficient, and more sustainable. With over 30 years of experience in semiconductor innovation, we bring that purpose to life across every part of the business—from breakthrough...SuggestedFor contractorsLocal area
- Every day, Global Payments makes it possible for millions of people to move money between buyers and sellers using our payments solutions for credit, debit, prepaid and merchant services. Our worldwide team helps over 3 million companies, more than 1,300 financial institutions...SuggestedRemote jobWorldwideFlexible hours
- Location: This is a hybrid opportunity. Our office location is at 10th and 11th Floor Robinsons Cyber Omega, Pearl Drive, Ortigas Center, Pasig City, Metro Manila, Philippines 1605 Insight at a Glance ~ Received 35+ industry and partner awards in the past year ...SuggestedWork at officeLocal areaImmediate start
- We are actively seeking a highly skilled and experienced Senior SOC Engineer with expertise in cryptocurrency exchange security operations. This pivotal role is instrumental in ensuring the security of our digital assets and customer funds by leading comprehensive security...
- The Allegro team is united by a clear purpose—advancing technologies that make the world safer, more efficient, and more sustainable. With over 30 years of experience in semiconductor innovation, we bring that purpose to life across every part of the business—from breakthrough...Work at office
- Bachelor’s in Civil, Geotechnical, or Structural Engineering Master’s in Geotechnical or Hydraulic Engineering Minimum 15 years’ experience in dam engineering and grouting. Previous experience as Resident Engineer or similar on large dam/hydropower projects. ...Contract work
- The Allegro team is united by a clear purpose—advancing technologies that make the world safer, more efficient, and more sustainable. With over 30 years of experience in semiconductor innovation, we bring that purpose to life across every part of the business—from breakthrough...
- Marketing Systems Engineer Say hello to opportunities at Acquire Asia Pacific Philippines Inc. (Acquire BPO) under the RingCentral account (RingCentral). It’s not everyday that you consider starting a new career. We’re Acquire BPO, and we’re happy that someone as...Work at officeLocal areaWork from homeFlexible hoursShift workNight shift
- Every day, Global Payments makes it possible for millions of people to move money between buyers and sellers using our payments solutions for credit, debit, prepaid and merchant services. Our worldwide team helps over 3 million companies, more than 1,300 financial institutions...Local areaWorldwideFlexible hoursShift work
- Come join Analog Devices (ADI) – a place where Innovation meets Impact. For more than 55 years, Analog Devices has been inventing new breakthrough technologies that transform lives. At ADI you will work alongside the brightest minds to collaborate on solving complex problems...Permanent employmentWork at officeRemote work
- Bachelor’s Degree in Civil Engineering Professional Engineer License (PRC, or equivalent) Specialization in Dams / Hydropower (e.g., short course, certification) Experience in Construction Supervision for Dams/Hydropower Projects Experience in the conduct of ...
- Let’s be #BrilliantTogether Overview: The Desktop Engineering Audit and Policy Engineer is a key contributor to ISS’s global IT Services organization. The successful candidate will assist with the monitoring and reporting to the Desktop Engineering and larger IT ...Work experience placementWork at officeLocal areaWork from homeWorldwideShift work
- Come join Analog Devices (ADI) – a place where Innovation meets Impact. For more than 55 years, Analog Devices has been inventing new breakthrough technologies that transform lives. At ADI you will work alongside the brightest minds to collaborate on solving complex problems...Permanent employmentWork at officeRemote workShift work
- Come join Analog Devices (ADI) – a place where Innovation meets Impact. For more than 55 years, Analog Devices has been inventing new breakthrough technologies that transform lives. At ADI you will work alongside the brightest minds to collaborate on solving complex problems...Permanent employmentWork at officeRemote work
- Come join Analog Devices (ADI) – a place where Innovation meets Impact. For more than 55 years, Analog Devices has been inventing new breakthrough technologies that transform lives. At ADI you will work alongside the brightest minds to collaborate on solving complex problems...Permanent employmentWork at officeRemote work
- Job Title : Product & Packaging Development Specialist Working Hours: TBD (possibly 9AM to 6PM PST) Salary: Experienced based Industry: Retail (Hair-related) About the role: We are looking for a detail-oriented and proactive Product Development Specialist...Remote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to QA Tester II. Be the first to apply!
