Test Lead
Pinnacle Talent Placement
AI Test Lead
Status: Must be legally eligible to work where you live.
Resume must be in English
Location : Remote, some travel to Atlanta, GA
Engagement : Contract, Long Term, Full Time
About the Role
We are looking for an AI Test Lead with 10+ years of overall testing experience, including 2+ years testing AI/ML systems, to own the quality strategy for our AI-powered applications and models. You will define how we test AI systems end-to-end, lead testing execution using modern AI tools, and set the standard for reliable, trustworthy AI delivery.
Key Responsibilities
- Define and own the AI testing strategy for applications and models.
- Lead AI application testing across functional, integration, and user-facing behavior.
- Perform model testing and validation (accuracy, robustness, bias, drift, hallucination, and performance).
- Leverage AI-powered testing tools to design, automate, and accelerate test coverage.
- Establish Agentic test frameworks, quality gates, and acceptance criteria for AI features.
- Collaborate with data science, engineering, and product teams to embed quality early.
- Report on quality metrics, risks, and readiness for release.
Required Skills & Experience
- 10+ years in software QA/testing, with 2+ years hands-on testing AI/ML applications and models.
- Hands-on with AI-based testing tools and test automation.
- Ability to create and drive AI testing strategy from the ground up.
- Strong understanding of model evaluation metrics and AI failure modes.
- Proven experience leading QA teams and mentoring testers.
- Experience testing LLM / GenAI applications (prompt testing, RAG evaluation).
- Familiarity with CI/CD and MLOps pipelines.
Nice to have:
LangFuse, Langsmith, Test Rigor of Functionize experience
Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the Test Lead in Plano, TX vacancy
- ...Automation Test Lead E*Pro Consulting service offerings include contingent Staff Augmentation of IT professionals, Permanent Recruiting and Temp-to-Hire. In addition, our industry expertise and knowledge within financial services, Insurance, Telecom, Manufacturing,...SuggestedPermanent employmentTemporary workFlexible hours
E-Pro
Richardson, TX1 day ago - ...Job Title: Software Testing Specialist Location: TechM US Texas Plano Years of Experience: 5 7 Years Job Summary: We are seeking a highly skilled Software Testing Specialist with a strong background in test data management and experience in the telecommunications...Suggested
Yantran LLC
Plano, TX14 hours ago - ...Performance Test Lead / Performance Test Architect Seeking an experienced Performance Test Lead / Performance Test Architect with 7+ years of experience in performance engineering, load testing, resiliency validation, and cloud-based application testing. This role will...Suggested
Omni Inclusive
Plano, TX4 days ago - An innovative company is seeking a Test Lead Engineer with expertise in device testing, particularly for voice services and the latest technologies like 5G. This role involves developing rigorous test plans, executing them, and analyzing results to ensure high-quality performance...Suggested
- Infosys Limited is seeking a Technology Project Lead 2 in Richardson, TX. The role focuses on objective-driven project delivery, client relationship management, and implementing innovative testing and automation practices. You will lead cross-functional teams, drive cost...Suggested
- eTeki is seeking an experienced Software Development and Testing professional with expertise in Sitefinity, located in Plano, Texas. The candidate should have over 5 years of experience in software development and testing. Responsibilities include developing and testing...Contract work
$60 per hour
Diverse Lynx is seeking an experienced Software Development Engineer in Test (SDET) for an onsite Plano, Texas assignment. The contract runs for 6 months with a rate of $60/hr. The role emphasizes hands-on test automation, scalable frameworks, and improving testability...Contract work- ...Job Description Job Description We are looking for a Test Automation Lead to assess software quality through manual and automated testing. You will be responsible for finding and reporting bugs and glitches. In this role, you should have a keen eye for detail...Shift work
Forhyre
Plano, TX16 days ago - ...Job Description Job Description Job Description: Minimum 10 yrs of IT experience Minimum 5 yrs of UAT Testing experience Medicare/Medicaid experience is a must Good reporting & analytic skills Azure Databricks is a plus Excellent in Communication...
ClifyX, INC
Richardson, TX3 days ago - Celestica in Richardson, TX is seeking a Senior Lead, DFT and Test Engineer to ensure testability is embedded early in hardware design. You will drive high-yield, debug-ready releases by auditing test point access and boundary scan chains, modeling coverage, and collaborating...
- Infosys is seeking a Technology Project Lead 2 in Richardson, Texas, to drive end-to-end test automation initiatives for telecom OSS projects. You will partner with stakeholders, shape project scope, and ensure delivery excellence leveraging Playwright, Selenium, and API...
- Krypton Solutions LLC is seeking a Senior Vibration Test Engineer to establish and lead our vibration testing capability around the LDS V8800 shaker system in Plano, TX. You will define lab standards, mentor staff, and act as the technical authority on shaker testing, fixture...
- ...and fortify technology governance, making a pivotal impact in our firm's robust risk strategy. As a Compliance and Operations Risk Test Lead in the Testing Center of Excellence, you will play a pivotal role in enhancing our compliance and operational risk management....
- Celestica Inc. in Richardson, TX seeks a Senior Lead, DFT and Test Engineer to drive design-for-testability across PCB schematics and layouts. You will model coverage, work with hardware and software teams, and guide testability from concept through first-fixture validation...
- Testing Site - JPMC in Plano, TX is seeking a Compliance and Operations Risk Test Lead to strengthen our testing framework for governance and risk management. You will plan and execute tests, identify control coverage gaps, coordinate across departments, and drive remediation...
- Celestica is seeking a Senior Manager of HPS Test Engineering in Richardson, TX to own end-to-end testing architecture, strategy, and execution... ..., hardware/software teams, and volume manufacturing. You will lead a high‑performing team of test hardware and software engineers,...
- Celestica Inc. seeks a Sr Staff Engineer to own end-to-end testing architecture, strategy and execution for next-generation product and infrastructure. You will lead a high-performing team of test hardware and software engineers, delivering ICT, FCT, SLT, and burn-in solutions...
- Job Summary/Responsibilities • This role demonstrates a competent understanding of Test Data Management related to data security, data masking, synthetic data creation, and test data strategy planning. • Strong ability to multi-task in an environment of changing priorities...
- ...City: Richardson Summary As the Senior Manager of HPS Test Engineering, you will own the end-to-end testing architecture, strategy... ...volume manufacturing operations. You will be responsible for leading a high-performing team of test hardware and software engineers...Work at officeLocal areaWorldwideShift work
- Celestica Inc. seeks a Sr Staff Engineer to own end-to-end test architecture and execution for next-generation products. You will lead a team of test hardware and software engineers and align with front-end/back-end leadership to maximize test coverage and throughput. The...
- ...APIs to communicate with upstream and downstream application it will need to integrate with kafka , MQ etc. there will be batch testing , data migration testing as well Java APIs, Postgress will be the DB, AWS will be the platform , data migration will be done...
Yantran LLC
Plano, TX3 days ago - Job Description Sanmina Corporation (Nasdaq: SANM) is a leading integrated manufacturing solutions provider serving the fastest-growing... ...and fix issues in hardware/software using schematics, BOMs, and test procedures. Component-Level Work: Rework, replace, and repair faulty...
- ...executives and cross-functional partners across one of the world's leading financial institutions. Our culture is all about thinking... ...methodology insights that inform quarterly allowance and stress testing exercises. You will be part of a diverse, talented, and global...Work at office
- Heads Up Technologies in Addison, TX is seeking a Lighting Testing Technician to join our manufacturing team. You will perform comprehensive testing of Lighting Cell products, document results, and support quality control to ensure high-performance lighting solutions meet...Full time
- ...make a direct, measurable impact on our mission and the future of the company - regardless of your function. Near Field Test and Automation Lead We are looking for a Senior Antenna Test Engineer to own the development, automation, and production operation of our near...Contract workFor contractorsWork at officeLocal area
- ...The Test Manager is responsible for overseeing all test laboratory operations and serving as the technical authority for the testing... ...validation, and release of electronic products for shipment. This role leads the test team, develops and implements test strategies, ensures...Full timeShift work
HumCap
Plano, TX1 day ago - ...Test Manager Join Krypton Solutions as a Test Manager where you'll lead the electronics test function to protect quality, throughput, and on-time delivery in a electronic manufacturing test lab environment. You'll set test strategy for new products, own lab execution...Shift work
Krypton Solutions
Plano, TX3 days ago - .... 8+ years of exp. in performance testing & engineering 2. Understand the end to end systems & products. Support customer IT, business and solution architects in defining the right NFRs (Non Functional Requirements) & recommend for process improvement if any identified...
3B Staffing LLC
Murphy, TX4 days ago - ...Description Job Description We are currently seeking a highly skilled and experienced Test Automation Manager. As the Test Automation Manager, you will be responsible for leading and managing our automation testing efforts. Your extensive experience in automation...
Forhyre
Plano, TX16 days ago - ...resource who is capable of independently establishing the enterprise testing, validation, certification, and readiness framework required to... ...• Must have experience in Enterprise Test Strategy & Readiness Lead to support a large-scale One Browser Initiative that will...
TechDigital Corporation
Richardson, TX3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Test Lead. Be the first to apply!
