AI Test Lead
CirrusLabs, LLC
We are looking for an AI Test Lead with 8+ years of overall testing experience , including 2+ years testing AI/ML systems , to own the quality strategy for our AI-powered applications and models. You will define how we test AI systems end-to-end, lead testing execution using modern AI tools, and set the standard for reliable, trustworthy AI delivery. Key Responsibilities Define and own the AI testing strategy for applications and models. Lead AI application testing across functional, integration, and user‑facing behavior. Perform model testing and validation (accuracy, robustness, bias, drift, hallucination, and performance). Leverage AI‑powered testing tools to design, automate, and accelerate test coverage. Establish test frameworks, quality gates, and acceptance criteria for AI features. Collaborate with data science, engineering, and product teams to embed quality early. Report on quality metrics, risks, and readiness for release. Required Skills & Experience 8+ years in software QA/testing, with 2+ years hands‑on testing AI/ML applications and models . Hands‑on with AI‑based testing tools and test automation. Ability to create and drive AI testing strategy from the ground up. Strong understanding of model evaluation metrics and AI failure modes. Proven experience leading QA teams and mentoring testers. Nice to Have Familiarity with CI/CD and MLOps pipelines. #J-18808-Ljbffr CirrusLabs, LLC
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Test Lead in Seattle, WA vacancy
- Shield AI seeks a Senior Propulsion Test Engineer to lead the planning and execution of propulsion test campaigns for the X-BAT platform. You will own test architecture, build test stands and fixtures, define instrumentation and DAQ methods, and drive test-to-flight handoffs...Suggested
$78k - $117k
Functional Test Lead The Role UST is searching for an experienced Functional Test Lead with strong healthcare payer domain expertise across... ...and maturity assessments. Test Data Management exposure. AI-enabled Quality Engineering initiatives. CMS and regulatory testing...SuggestedFull timeTemporary workPart timeWork at officeLocal areaFlexible hours- ...Job Title: E2E Test Lead Seattle WA $54/hr W2 Key Responsibilities Lead end-to-end (E2E) testing across multiple applications... ..., and compliance testing programs. Experience supporting AI-enabled Quality Engineering initiatives. Key Must-Have Skills...SuggestedShift work
Unicom Technologies INC
Seattle, WA9 days ago - Shield AI is seeking a Staff Electrical Test Engineering Specialist to build, modify, troubleshoot, and sustain the electrical test systems used to prove X-BAT hardware is reliable and mission ready. The Hardware Test Engineering team develops custom equipment for component...Suggested
- ...Job Description Job Description Job Title: Functional Test Lead(23961-1) Duration: 6-12 Months Contract Location – Seattle, WA(4... ...maturity assessments. Test Data Management (TDM) exposure. AI-enabled Quality Engineering initiatives. CMS and regulatory testing...SuggestedContract work
- ...Job Description Job Description Job Title: E2E Test Lead Domain Experience (If any) – Healthcare Payer / Facets Location – Seattle... ..., and compliance testing programs. Experience supporting AI-enabled Quality Engineering initiatives. Key Must-Have Skills...Shift work
- ...Job Title: QA Functional Test Lead Seattle WA 4 days per week Key Responsibilities Lead functional discovery workshops with... ...maturity assessments. Test Data Management (TDM) exposure. AI-enabled Quality Engineering initiatives. CMS and regulatory testing...Full time
- ...Job Title : Functional Test Lead Location : Seattle, WA Duration : 03 months with possibility of extensions Shift Details : Domain Experience (If any) – Healthcare Payer / Facets Onsite Requirement – Must be onsite in Seattle, WA Number of days onsite...Shift work
ProKatchers LLC
Seattle, WA4 days ago $41.57 per hour
...Job Title: Functional Test Lead Location: Mountlake Terrace, WA 98043 Duration: 6 Months Job Type: Temporary Assignment Work Type: Onsite Pay Rate: $41.57 - $41.57/Hr Overview: TekWissen is a global workforce management provider headquartered in...Full timeTemporary workTekWissen ®
Mountlake Terrace, WA2 days ago- Qualtrics XM is searching for a quality engineer to lead the quality initiatives within the Core Machine Learning Team in Seattle. You... ...work at the cutting edge of technology, evaluating and driving testing approaches for machine learning projects, while developing automation...
- ...seeking a seasoned EGSE engineer to design, develop, and integrate EGSE hardware and software for satellite assembly, integration, and test across all production phases. You will work with systems, avionics, RF, payload, and flight software teams, define requirements,...
- UST is seeking an E2E Test Lead in Seattle, WA to own end-to-end testing across multiple applications and business domains, driving test planning, execution, and release validation. The candidate should have 10+ years in Quality Engineering, 5+ years leading large-scale...
- Blue Origin is seeking an experienced program manager to lead the planning and execution of structural test campaigns for the New Glenn vehicle. You will coordinate across engineering, test and procurement to ensure campaigns run on time and within budget. You will manage...
$78k - $117k
UST is seeking an E2E Test Lead with strong expertise in test planning, execution management, defect governance, and release validation across multiple applications. You will lead SIT, E2E, Regression and UAT activities, define strategies and criteria, coordinate multi-...- ...Seattle office. We are assembling a dynamic team of engineers and builders to propel our technology to the next level. As Flight Test Lead you will develop flight test plans, oversee preparations and execution, and work with partners to ensure safe, successful testing...Work at office
- Blue Origin LLC seeks a Senior Avionics & RF Component Test Lead to direct development, qualification, and acceptance testing of avionics and RF components. You will guide test plans, procedures, and risk mitigation while coordinating resources and schedules across internal...
- ...We are seeking an experienced Test Program Manager / QE Transformation Lead to lead discovery, due diligence, transition, and workforce planning for a large... ...and stakeholder communications. Support adoption of AI-enabled quality engineering, performance engineering, and...Full time
BrickRed Systems
Seattle, WA4 days ago - UST is seeking a Functional Test Lead to guide functional discovery workshops with business, product, application, and testing stakeholders in Seattle, WA. You will assess processes, dependencies, and quality practices to define the target-state testing model. You'll lead...
- Affim is building a proactive compliance program and seeks a Compliance Lead to administer testing, engage with Legal, Operations, Product, and Engineering, and help ensure regulatory conformity for new products and services. You will report to the Senior Compliance Manager...Remote work
$160k - $200k
This is a full-time, hybrid role located in the Greater Seattle Area for the Senior Systems Test Lead. The Test Lead will manage the execution of integration, verification, and validation of onboard system software. They will also provide mentorship and leadership to more...Minimum wageFull timeWork at officeLocal areaRemote workFlexible hours3 days per week1 day per week- A technology consulting firm is seeking a Facets Functional Lead in Seattle, WA. The ideal candidate will have extensive experience in Facets Testing, particularly in claims, membership, and provider modules, alongside strong leadership skills and a solid grounding in the...Contract work
- ALTEN Technology USA is seeking a Mechanical Test Engineer to lead the planning, execution, and analysis of development and verification tests for complex mechanical and aerospace systems. This role is onsite in Mukilteo, WA and involves partnering with design, manufacturing...
- ...engineering projects, Radical is the startup for you. Join us and push the boundaries of what’s possible. Core responsibilities As Flight Test Lead you will be responsible for conducting flight tests of new aircraft systems at Radical. This role will work closely with...Work at office
- Position Summary We are seeking an experienced Functional Test Lead with strong expertise in Healthcare Payer systems, particularly the Facets healthcare platform , to lead functional testing assessments, discovery workshops, and testing transformation initiatives. The...
- Data Capital Inc. is seeking an experienced Functional Test Lead with strong expertise in Healthcare Payer systems and the Facets platform. The role focuses on leading functional testing assessments, discovery workshops, and testing transformation initiatives to improve...
- TMMG, LLC is seeking a highly experienced Integration Test Coordinator/Ship Repair Execution Lead to manage on-site integration of HM&E systems for DDG-class destroyers during modernization and repair. The role requires coordinating diverse teams to ensure safe, efficient...
- ...and Enterprise Engineering team seeks a Senior Radiation Effects Engineer to plan, execute, and optimize radiation testing for space hardware. You will lead test programs (TID, DDD, SEE), develop custom setups with automated data collection, and advise on parts selection...
- UST in Seattle, Washington, is seeking an experienced Functional Test Lead with deep healthcare payer domain expertise across Claims, Enrollment, Billing, Provider, and EDI transactions. You will lead functional discovery workshops with business, product, and testing stakeholders...
- UST is seeking an E2E Test Lead to drive end-to-end testing across multiple applications and business domains in the Seattle area. You will define strategy, scope, coverage, and release readiness, and coordinate SIT, E2E, regression, and UAT activities with cross-functional...
- ...Job Description Job Title : Functional Test Lead \n Location : Seattle, WA \n Duration : 03 months with possibility of extensions \n Shift Details : \n Domain Experience (If any) – Healthcare Payer / Facets \n Onsite Requirement – Must be onsite in...Shift work
ProKatchers LLC
Seattle, WA10 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Test Lead. Be the first to apply!
