Test Lead
Pinnacle Talent Placement
AI Test Lead
Status: Must be legally eligible to work where you live.
Resume must be in English
Location : Remote, some travel to Atlanta, GA
Engagement : Contract, Long Term, Full Time
About the Role
We are looking for an AI Test Lead with 10+ years of overall testing experience, including 2+ years testing AI/ML systems, to own the quality strategy for our AI-powered applications and models. You will define how we test AI systems end-to-end, lead testing execution using modern AI tools, and set the standard for reliable, trustworthy AI delivery.
Key Responsibilities
- Define and own the AI testing strategy for applications and models.
- Lead AI application testing across functional, integration, and user-facing behavior.
- Perform model testing and validation (accuracy, robustness, bias, drift, hallucination, and performance).
- Leverage AI-powered testing tools to design, automate, and accelerate test coverage.
- Establish Agentic test frameworks, quality gates, and acceptance criteria for AI features.
- Collaborate with data science, engineering, and product teams to embed quality early.
- Report on quality metrics, risks, and readiness for release.
Required Skills & Experience
- 10+ years in software QA/testing, with 2+ years hands-on testing AI/ML applications and models.
- Hands-on with AI-based testing tools and test automation.
- Ability to create and drive AI testing strategy from the ground up.
- Strong understanding of model evaluation metrics and AI failure modes.
- Proven experience leading QA teams and mentoring testers.
- Experience testing LLM / GenAI applications (prompt testing, RAG evaluation).
- Familiarity with CI/CD and MLOps pipelines.
Nice to have:
LangFuse, Langsmith, Test Rigor of Functionize experience
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Test Lead in Seattle, WA vacancy
$41.57 per hour
...Job Title: Functional Test Lead Location: Mountlake Terrace, WA 98043 Duration: 6 Months Job Type: Temporary Assignment Work Type: Onsite Pay Rate: $41.57 - $41.57/Hr Overview: TekWissen is a global workforce management provider headquartered in...SuggestedTemporary workTekWissen ®
Mountlake Terrace, WA3 hours ago- ...Job Title : Functional Test Lead Location : Seattle, WA Duration : 03 months with possibility of extensions Shift Details : Domain Experience (If any) – Healthcare Payer / Facets Onsite Requirement – Must be onsite in Seattle, WA Number of days onsite...SuggestedShift work
ProKatchers LLC
Seattle, WA3 hours ago - ...Job Title: QA Functional Test Lead Seattle WA 4 days per week Key Responsibilities Lead functional discovery workshops with business product application and testing stakeholders. Assess business processes application landscape testing scope dependencies...SuggestedFull time
Unicom Technologies INC
Seattle, WA17 days ago - ...Job Title: E2E Test Lead Seattle WA $54/hr W2 Key Responsibilities Lead end-to-end (E2E) testing across multiple applications interfaces and business domains. Define the E2E test strategy scope coverage entry/exit criteria and release readiness plans...SuggestedFull timeShift work
Unicom Technologies INC
Seattle, WA15 days ago - UST is seeking an E2E Test Lead in Seattle, WA to own end-to-end testing across multiple applications and business domains, driving test planning, execution, and release validation. The candidate should have 10+ years in Quality Engineering, 5+ years leading large-scale...Suggested
- Blue Origin is seeking an experienced program manager to lead the planning and execution of structural test campaigns for the New Glenn vehicle. You will coordinate across engineering, test and procurement to ensure campaigns run on time and within budget. You will manage...
- ...seeking a seasoned EGSE engineer to design, develop, and integrate EGSE hardware and software for satellite assembly, integration, and test across all production phases. You will work with systems, avionics, RF, payload, and flight software teams, define requirements,...
- ...engineering projects, Radical is the startup for you. Join us and push the boundaries of what’s possible. Core responsibilities As Flight Test Lead you will be responsible for conducting flight tests of new aircraft systems at Radical. This role will work closely with...Work at office
- NPAworldwide is seeking a Test Lead to plan, coordinate, and oversee testing for a Dayforce HR/Payroll implementation in the Seattle area. You will define the test strategy, manage resources, and ensure coverage across HR/Payroll modules while collaborating with functional...
- Position Summary We are seeking an experienced Functional Test Lead with strong expertise in Healthcare Payer systems, particularly the Facets healthcare platform , to lead functional testing assessments, discovery workshops, and testing transformation initiatives. The...
- ALTEN Technology USA is seeking a Mechanical Test Engineer to lead the planning, execution, and analysis of development and verification tests for complex mechanical and aerospace systems. This role is onsite in Mukilteo, WA and involves partnering with design, manufacturing...
$160k - $200k
This is a full-time, hybrid role located in the Greater Seattle Area for the Senior Systems Test Lead. The Test Lead will manage the execution of integration, verification, and validation of onboard system software. They will also provide mentorship and leadership to more...Minimum wageFull timeWork at officeLocal areaRemote workFlexible hours3 days per week1 day per week- A technology consulting firm is seeking a Facets Functional Lead in Seattle, WA. The ideal candidate will have extensive experience in Facets Testing, particularly in claims, membership, and provider modules, alongside strong leadership skills and a solid grounding in the...Contract work
- We are looking for an AI Test Lead with 8+ years of overall testing experience , including 2+ years testing AI/ML systems , to own the quality strategy for our AI-powered applications and models. You will define how we test AI systems end-to-end, lead testing execution...
- Affim is building a proactive compliance program and seeks a Compliance Lead to administer testing, engage with Legal, Operations, Product, and Engineering, and help ensure regulatory conformity for new products and services. You will report to the Senior Compliance Manager...Remote work
- ...Seattle office. We are assembling a dynamic team of engineers and builders to propel our technology to the next level. As Flight Test Lead you will develop flight test plans, oversee preparations and execution, and work with partners to ensure safe, successful testing...Work at office
- Blue Origin LLC seeks a Senior Avionics & RF Component Test Lead to direct development, qualification, and acceptance testing of avionics and RF components. You will guide test plans, procedures, and risk mitigation while coordinating resources and schedules across internal...
$78k - $117k
UST is seeking an E2E Test Lead with strong expertise in test planning, execution management, defect governance, and release validation across multiple applications. You will lead SIT, E2E, Regression and UAT activities, define strategies and criteria, coordinate multi-...- UST is seeking a Functional Test Lead to guide functional discovery workshops with business, product, application, and testing stakeholders in Seattle, WA. You will assess processes, dependencies, and quality practices to define the target-state testing model. You'll lead...
- Shield AI seeks a Senior Propulsion Test Engineer to lead the planning and execution of propulsion test campaigns for the X-BAT platform. You will own test architecture, build test stands and fixtures, define instrumentation and DAQ methods, and drive test-to-flight handoffs...
- ...and Enterprise Engineering team seeks a Senior Radiation Effects Engineer to plan, execute, and optimize radiation testing for space hardware. You will lead test programs (TID, DDD, SEE), develop custom setups with automated data collection, and advise on parts selection...
- UST in Seattle, Washington, is seeking an experienced Functional Test Lead with deep healthcare payer domain expertise across Claims, Enrollment, Billing, Provider, and EDI transactions. You will lead functional discovery workshops with business, product, and testing stakeholders...
$78k - $117k
The Role UST is searching for an E2E Test Lead with strong expertise in test planning, execution management, defect governance, and release validation. Role Description E2E Test Lead UST is searching for an E2E Test Lead with strong expertise in test planning, execution...Full timeTemporary workPart timeWork at officeLocal areaFlexible hoursShift work- UST is seeking an E2E Test Lead to drive end-to-end testing across multiple applications and business domains in the Seattle area. You will define strategy, scope, coverage, and release readiness, and coordinate SIT, E2E, regression, and UAT activities with cross-functional...
- Data Capital Inc. is seeking an experienced Functional Test Lead with strong expertise in Healthcare Payer systems and the Facets platform. The role focuses on leading functional testing assessments, discovery workshops, and testing transformation initiatives to improve...
- TMMG, LLC is seeking a highly experienced Integration Test Coordinator/Ship Repair Execution Lead to manage on-site integration of HM&E systems for DDG-class destroyers during modernization and repair. The role requires coordinating diverse teams to ensure safe, efficient...
- ...Job Description Job Title : Functional Test Lead \n Location : Seattle, WA \n Duration : 03 months with possibility of extensions \n Shift Details : \n Domain Experience (If any) – Healthcare Payer / Facets \n Onsite Requirement – Must be onsite in...Shift work
ProKatchers LLC
Seattle, WA9 days ago - Oliver Wyman in the Greater Seattle Area seeks a Senior Systems Test Lead to manage integration, verification and validation of onboard system software. You will mentor junior engineers and guide design assurance processes while coordinating with external stakeholders on...
- ...competitors establishing the wider channel of media marketing building a better connection with clients. Job Description As a Test /QA Lead you will have the opportunity to: Create and maintain test strategy / plans Analyze and interpret design specifications, business...
- ...for the Autonomy Systems Validation team in Seattle. You will plan, coordinate, and lead vehicle-operator teams on public roads and private facilities, ensuring safety protocols and test procedures are followed while collaborating with hardware and software teams. The...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Test Lead. Be the first to apply!
