Test Lead
Pinnacle Talent Placement
AI Test Lead
Status: Must be legally eligible to work where you live.
Resume must be in English
Location : Remote, some travel to Atlanta, GA
Engagement : Contract, Long Term, Full Time
About the Role
We are looking for an AI Test Lead with 10+ years of overall testing experience, including 2+ years testing AI/ML systems, to own the quality strategy for our AI-powered applications and models. You will define how we test AI systems end-to-end, lead testing execution using modern AI tools, and set the standard for reliable, trustworthy AI delivery.
Key Responsibilities
- Define and own the AI testing strategy for applications and models.
- Lead AI application testing across functional, integration, and user-facing behavior.
- Perform model testing and validation (accuracy, robustness, bias, drift, hallucination, and performance).
- Leverage AI-powered testing tools to design, automate, and accelerate test coverage.
- Establish Agentic test frameworks, quality gates, and acceptance criteria for AI features.
- Collaborate with data science, engineering, and product teams to embed quality early.
- Report on quality metrics, risks, and readiness for release.
Required Skills & Experience
- 10+ years in software QA/testing, with 2+ years hands-on testing AI/ML applications and models.
- Hands-on with AI-based testing tools and test automation.
- Ability to create and drive AI testing strategy from the ground up.
- Strong understanding of model evaluation metrics and AI failure modes.
- Proven experience leading QA teams and mentoring testers.
- Experience testing LLM / GenAI applications (prompt testing, RAG evaluation).
- Familiarity with CI/CD and MLOps pipelines.
Nice to have:
LangFuse, Langsmith, Test Rigor of Functionize experience
Vacancy posted 8 hours ago
Similar jobs that could be interesting for youBased on the Test Lead in San Jose, CA vacancy
- Maximum Salary (US): 148000Minimum Salary (US): 78000Job SummaryThe Data Center Network Engineer is responsible for managing and maintaining the organization's data center network infrastructure, focusing on Cisco platforms such as Nexus 9000, 7000, and 5000 series, as ...SuggestedWeekend work
HCL Technologies
Santa Clara, CA21 hours ago - ...5 days/week (Cupertino and San Diego)Role: Thermal QA Automation Engineer (2x)Key Responsibilities• Define, implement, and execute tests to validate Hardware/Software for Thermal• Control Systems on Apple products.• Analyze automation test results for failures, identifying...SuggestedWork experience placement
HCL Technologies
Santa Clara, CA3 days ago - ...to work in the U.S. are encouraged to apply. Tax Terms: W2, 1099 Corp-Corp or 3rd Parties: Yes Description Design and develop Test Automation Scripts using Selenium. Experience in Agile methodology Hands on Java Cucumber is added advantage Review and contribute to...Suggested
Keylent Inc
San Jose, CA17 hours ago $175.5k - $311.7k
...that enable product development, characterization, and calibration/testing that fuel Apple's never- ending pursuit of perfection in... ...customers around the world. Description The System Test Design Lead (TDL) champions product calibration and test strategy while balancing...SuggestedRelocationApple Inc.
Cupertino, CA2 days ago- ...Honda's new mobility ecosystem, we will serve people with a vehicle which represents all of Honda's value. We are seeking a Flight Test Team Lead to accelerate the development and testing of our new advance air mobility vehicle. San Luis Obispo, CA The applicant is...SuggestedFull timeWork at office
Honda Research Institute USA
San Jose, CA1 day ago - Bayside Solutions, Inc. in Santa Clara, CA is seeking a Test Lab Manager to lead a medical device mechanical testing laboratory onsite. You will plan, execute, and document static and dynamic tests, schedule equipment maintenance, and ensure regulatory compliance. Responsibilities...
- ...for a skilled Technical Program Manager (TPM) based in Milpitas, California. This role focuses on leading the development and deployment of semiconductor and memory test solutions across the product lifecycle. The ideal candidate should possess strong program management...
$211k - $356k
Test and Validation Tech LeadCategoryChip DesignLocationSan Jose, CAExperienceMore than 8 Years Work Expe.Job DescriptionWe are seeking an Optical Validation & Test Lead to lead validation of next-generation fiber optic transceivers and optical engines for AI infrastructure...Temporary workMediaTek
San Jose, CA5 days ago- ...TimeIndustry: Computer SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsUAT Test LeadSunnyvale, CAEx A and currently with A*** both are workableUAT Test Lead role to support upcoming initiatives. Below are the role details for your review and sourcing...Full timeImmediate start
SRI Tech
Sunnyvale, CA2 days ago - Onsite Test Automation Lead Local Mountain View: Hybrid (onsite 2/3 days a week) Hands-on Test automation lead with experience working on Typescript, Playwright and Neodyme. Must be able to work with off-shore team 5 to 8 years of experienceLocal area2 days per week3 days per week
Tranzeal
Mountain View, CA1 day ago - Flex is seeking a Senior Test Engineering Manager in Milpitas, CA to lead the global test engineering strategy and teams. You will drive validation methodologies, test plans, and automation initiatives for new and existing products, while coordinating with cross-functional...Flexible hours
- Test Automation Lead Location: Sunnyvale, CA Job Type: Fulltime/Contract Required Skill: Fluent in Core Java or Ruby. Knowledge of internet protocols, web proxies, caching and other Web related fundamentals. Hands on experience in Selenium, TestNG.Full timeContract work
ClifyX
Sunnyvale, CA1 day ago - Scrum Master with Test Integration skills(50%-Test Integration skills,50%-Scrum skills) Oversee project planning, execution, tracking,... ...acting as a Scrum Master and facilitating Agile best practices. Lead Sprint Planning and ensure seamless execution of development cycles...Full time
- Test Lead Location: Sunnyvale, CA, United States Employment Duration: Fulltime Nature of position: Permanent Work Auth Requirement: US Citizens / Permanent Residents Only Education Qualification: Bachelor Degree Assignment Start Date: 3/15/18Permanent employmentFull time
ClifyX
Sunnyvale, CA4 days ago - ...Main skills required Very strong Java and Python for test automation. Mobile Harness experience is good to have. Have telephony background and its terminology. Writing Automated test cases using Java and python languages in Mobile Harness and Platform side as well. Figuring...Immediate start
Procyon TS
Mountain View, CA17 hours ago - ...permanent, contract & project-based staffing services for world s leading organizations in a broad range of industries. In this quickly... ...can help you find the best job for you. Job Position: TOSCA Test Automation Lead Location : Deaborn, MI (Remote is OK) Job...Permanent employmentContract workRemote work
$35 per hour
...Job Description Job Description Job Title: Test Lead Analyst Location: Sacramento, CA (Hybrid) Job Type: Contract Duration: 12 Months Shift & Schedule: Hybrid | On-Site Tuesday–Thursday | Occasional Mondays and Fridays as Needed Note: This job doesn...Hourly payContract workMonday to FridayShift work- ...Job Description Job Description Should have 8 10 years of experience in Manual and Automation Testing Experienced in Automation testing using Playwright wih Typescript/Javascript Experienced in using AI powered tools for testing Good to have experience in...Work experience placement
- ...of a highly motivated candidate to join our talented team and contribute to our ongoing success. Job Title: Senior Test Automation Lead Location(s): San Jose, CA 95110 Must Have Skills: Primary Skills : Python, Playwright, Pytest framework, Robot, QA...
$160.2k - $320k
Builds and leads Adobe’s Adversarial Fraud Testing function within Global Consumer Trust. Proactively simulates and recreates real-world fraud and abuse attacks against Adobe’s externally facing products and fraud controls to identify weaknesses and validate defenses. Partners...Full timeTemporary workLocal areaWorldwideAdobe Systems
San Jose, CA5 days ago$196.3k - $314.2k
We are the global test and automation specialists, powering next-generation technologies through sophisticated solutions. Behind every... ...Level for the Memory Test Division The role is responsible for leading a defined product or technology segment in memory test, owning strategy...Flexible hoursUniversal Robots
San Jose, CA2 days ago$175k - $210k
We are the global test and automation specialists, powering next-generation technologies through sophisticated solutions. Behind every... ...are seeking a dynamic and experienced Regional Sales Manager to lead a high-performing team within our Sales organization. This role is...Flexible hoursUniversal Robots
San Jose, CA4 days ago$320k
...for complex silicon products from new product introduction through high-volume manufacturing. This role leads a global organization responsible for production test architecture, hardware and program development, silicon correlation, quality screening, yield enablement,...Full timeNvidia
Santa Clara, CA1 day ago- ...Job Description Job Description We are looking for a Test Automation Lead to assess software quality through manual and automated testing. You will be responsible for finding and reporting bugs and glitches. In this role, you should have a keen eye for detail...Shift work
$207k - $230k
...Muon is seeking a Sr. Manager of Production Test Engineering to lead our Production Test Engineering organization and scale test capabilities to support increasing spacecraft production. This role manages Spacecraft Test Engineers and Environmental Test Engineers while...Permanent employmentFull timeTemporary workWork at officeRemote workFlexible hoursMuon Space, Inc.
San Jose, CA4 days ago- We are the global test and automation specialists, powering next-generation technologies through sophisticated solutions. Behind every... ...experienced Engineering Manager, New Product Introduction (NPI) to lead a team of Product and Hardware Engineers responsible for...Local areaRelocationFlexible hours
Universal Robots
San Jose, CA3 days ago $170.5k - $272.8k
We are the global test and automation specialists, powering next-generation technologies through sophisticated solutions. Behind every electronic device you use, Teradyne's test technology ensures your device works right the first time, every time! Our portfolio of automation...Flexible hoursUniversal Robots
San Jose, CA2 days ago- ...is seeking an experienced leader to serve as Sr. Manager, System Test and Validation, and to head the System Test team. The role owns the... ...and integrated software for the North American market. You will lead a multidisciplinary team of hardware, systems, and software...
- ...validating subsystem components for a scalable, fault-tolerant quantum computer. The role leads a focused validation team across photonic, electronic, firmware, and software domains, planning tests and developing advanced quantum characterization methods. The successful...
- The SAP Test Manager will oversee all testing activities. This role requires a seasoned professional with extensive experience in SAP testing... ...test strategy and plan for the SAP upgrade project. Lead and manage the testing team, including internal testers and third...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Test Lead. Be the first to apply!
