Test Lead
Pinnacle Talent Placement
AI Test Lead
Status: Must be legally eligible to work where you live.
Resume must be in English
Location : Remote, some travel to Atlanta, GA
Engagement : Contract, Long Term, Full Time
About the Role
We are looking for an AI Test Lead with 10+ years of overall testing experience, including 2+ years testing AI/ML systems, to own the quality strategy for our AI-powered applications and models. You will define how we test AI systems end-to-end, lead testing execution using modern AI tools, and set the standard for reliable, trustworthy AI delivery.
Key Responsibilities
- Define and own the AI testing strategy for applications and models.
- Lead AI application testing across functional, integration, and user-facing behavior.
- Perform model testing and validation (accuracy, robustness, bias, drift, hallucination, and performance).
- Leverage AI-powered testing tools to design, automate, and accelerate test coverage.
- Establish Agentic test frameworks, quality gates, and acceptance criteria for AI features.
- Collaborate with data science, engineering, and product teams to embed quality early.
- Report on quality metrics, risks, and readiness for release.
Required Skills & Experience
- 10+ years in software QA/testing, with 2+ years hands-on testing AI/ML applications and models.
- Hands-on with AI-based testing tools and test automation.
- Ability to create and drive AI testing strategy from the ground up.
- Strong understanding of model evaluation metrics and AI failure modes.
- Proven experience leading QA teams and mentoring testers.
- Experience testing LLM / GenAI applications (prompt testing, RAG evaluation).
- Familiarity with CI/CD and MLOps pipelines.
Nice to have:
LangFuse, Langsmith, Test Rigor of Functionize experience
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Test Lead in Columbus, OH vacancy
$127.6k - $191.4k
...opportunity to achieve your goals - and to help others accomplish theirs, too. Join our team as we help shape the future. As an Automation Test Lead, you will be instrumental in developing frameworks for automated testing and managing test data to facilitate the organization’s...SuggestedFull timeTemporary workWork at office3 days per weekThe Hartford Financial Services Group
Columbus, OH4 days ago- Job SummaryKnowledge of handling data center components such as Optical Modules, CPU, GPU, DDR, and NIC- Knowledge of test setup preparation- Executing test cases based on defined SOPs- Inventory management and tracking- Reporting and documentation- Handling shipments...Suggested
HCL Technologies
Columbus, OH4 days ago - Test Lead: On behalf of our Utilities client, Procom is searching for a Test Lead for a full time perm direct hire role. This position is a remote position with monthly trips to Columbus Ohio. What matters most:• SAP IS-U experience and utility meter to cash knowledge•...SuggestedPermanent employmentFull timeRemote work
ProCom
Columbus, OH3 days ago - ...Technical Skills: Integration Testing, API Testing, Automation testing API testing using tools such as Postman, SoapUI, Swagger/OpenAPI... ...level test strategy aligned to multi-phase transformation roadmap Lead end-to-end integration testing across CIS, ERP, ADMS, and...Suggested
programmers.io
Columbus, OH5 days ago - ...Job#: 3055026Job Description:Sr BA Testing LeadLocation: RemoteDuration: 12 monthsRate: $50-60hr on w2We are unable to provide sponsorship... ...Summary The Senior Business Systems Analyst (BSA) / Testing Lead will serve as a key delivery resource supporting Agentic AI and...Suggested
Apex Systems Inc Defunct
Columbus, OH5 days ago $100 - $130 per hour
...Job Title: Test Lead (2-3 Year Contract) Location: Columbus, OH Work Model: Remote with required travel to Columbus once every 3 weeks for 3 days onsite Rate: $100–$130/hour depending on experience Contract Term: Immediate start – December 31, 2028 Possibility...Contract workImmediate startRemote workVisa sponsorshipBlue Star Partners LLC
Columbus, OHa month ago- Test Lead | SAP IS-U Utility CIS Transformation Location: Remote within the United States, with monthly travel to Columbus, Ohio | Start: Mid November 2026 | Type: [Full time | Contract] About TTC Global Since 2004, TTC Global has helped high-profile organizations improve...Full timeContract workLocal areaRemote work
- Agility Partners is seeking an experienced CIS Test Lead for a major SAP IS-U implementation with a leading utility client in the United States. You will own the end-to-end testing strategy across SIT, UAT, and go-live, coordinating with the System Integrator and business...
- FirstEnergy Corp is seeking a coordinating testing and technical services professional for transmission and distribution substations. The role involves collaborating with Utility Operations, Construction & Design Services, and Transmission & Substation Services to ensure...
- Calculated Hire is seeking an experienced Senior Testing Program Manager in Ohio to lead the testing strategy for enterprise software implementations, HRIS, Payroll, and WFM initiatives. You will coordinate SIT, UAT, Time Compare, and Pay Compare testing streams, manage...
- Our client, a leading utility organization undergoing a large-scale Customer Information System (CIS) transformation, is seeking an experienced CIS Test Lead to own the end-to-end testing strategy for a major SAP IS-U implementation. This role will provide critical testing...
$104k - $124.8k
...equivalent experience. We require 5–7+ years of progressive experience in Quality Assurance, testing leadership, or test program delivery. We seek strong experience leading QA efforts on complex projects with distributed teams. We require extensive experience...Hourly payContract workTemporary workH1bLocal area3 days per weekBlue Star Partners LLC
Columbus, OH7 days ago- ...Senior Business Systems Analyst / Testing LeadGenesis10 is currently seeking a Senior Business Systems Analyst (BSA) / Testing Lead for a contract position with a Regional Financial Institution located in Columbus, OH. This is a 2+ month contract opportunity. Compensation...Hourly payContract work
Genesis10
Columbus, OH4 days ago - ...and fortify technology governance, making a pivotal impact in our firm's robust risk strategy. As a Compliance and Operations Risk Test Lead in the Testing Center of Excellence, you will play a pivotal role in enhancing our compliance and operational risk management....
- Responsibilities Develop and manage the overall testing strategy and testing roadmap. Coordinate System Integration Testing (SIT), Time... ...testing schedules, milestones, dependencies, and readiness reviews. Lead defect management, prioritization, escalation, and resolution...
- Join a Team Where Your Expertise Drives Real Impact At PNDE, we’re not just hiring NDE/NDT professionals, we’re building a team of problem-solvers, experts, and customer-focused leaders who want to make a difference. If you’re results‑driven, take pride in your work, and...
- Testing Site - JPMC in Ohio is seeking a Compliance and Operations Risk Test Lead to enhance our compliance and operational risk management through precise testing and coordination across departments. You will plan and organize work, potentially lead a team, and ensure...
- ...Genesis10 is currently seeking a Senior Business Systems Analyst / Testing Lead for a contract position with a Regional Financial Institution located in Columbus OH Akron OH or Flint MI. This is a 2 month contract opportunity that can extend and likely convert. Compensation...Hourly payPermanent employmentContract workTemporary work
PMO
Columbus, OH14 days ago - ...Work arrangement: Onsite presence in Columbus as required for key testing milestones, UAT, cutover, and go-live; travel expectations to be... ...Position Overview We are seeking an experienced SAP IS-U Test Lead to support a multi-year Customer Information System (CIS) implementation...Contract workLocal area
- TTC Global is seeking a Test Lead to provide independent testing leadership for a regulated utility CIS replacement on SAP IS-U. Join a global team, review the SI's approach, maintain coverage tied to business risk, and guide SIT, UAT, conversion and deployment readiness...Remote job
- The Hartford invites applications for a Senior Staff Software Engineer focused on automation test leadership. You will architect and maintain automated test frameworks, drive GenAI-enabled testing strategies, and mentor QA teams across agile environments. This hybrid role...
- Keysight Technologies seeks a senior Business Development leader to drive growth in radar test and evaluation across aerospace, defense, and government sectors. You will shape opportunities, engage customers early, and build partnerships with OEMs, labs, and system integrators...
$50 - $60 per hour
...Job Description Job Description Job Title: Quality Assurance Test Lead Location: Columbus, OH (Local Candidates only - Hybrid – 3 days onsite per week) Duration: 6-Month Contract (Possible Extensions) Rate: $50 - 60/hr (W2) Benefits: 401(k) with 4% company...Contract workH1bLocal area3 days per week$100 per hour
...Job Description Job Description CCaaS Business Test Lead Location: Columbus, OH Work Model for Local Candidates: Hybrid (Tuesday–Thursday onsite, Monday & Friday remote) Work Model for Non-Local Candidates: Travel as needed, likely every other week Tuesday–...Contract workLocal areaRemote workVisa sponsorshipMonday to Friday- ...Position Overview We are seeking an experienced SAP IS-U Test Lead to support a multi-year Customer Information System (CIS) implementation for a public utility. This individual will establish the test strategy, develop test plans and scripts, and lead testing across...
- ...different Enterprise release • Application design walk thru with stake holders • Creation of Risk Mitigation Plan • Coordinating the Test data & Test environment set-up • Supervise the execution process and generate daily, weekly and monthly reports and Metrics •...
System Canada Technologies
Columbus, OH4 days ago $171k - $320k
...your future as we are, join our team.KPMG is currently seeking a Director, Adversarial Testing Program Leader to join our Enterprise Security Services organization.Responsibilities:Lead the program in conducting adversary emulation and advanced offensive security...Contract workH1bLocal areaKPMG
Columbus, OH2 days ago$173.9k - $290.1k
...continuity of the business as usual require heavy information security measures. As a Manager in the Attack & Penetration Testing team, you will lead sophisticated offensive security operations that contribute to our client’s resilience against the latest cyber-attacks....Work experience placementRemote workEY
Columbus, OH4 days ago$123k
...Specialist – Base salary at Zone 2 would be $105K with a $5K sign-on.Candidates should have a minimum of 7-8 years' experience with Test Leadership & Management at the project and program level. Hands-on Automation Framework Development experience in any one of the following...ClifyX
Columbus, OH1 day ago- ...place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Test Engineering Manager to lead validation of IoT and computer vision products. MUST HAVES You must be authorized to work for ANY employer in the US...Work at officeRemote workVisa sponsorshipWork visaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Test Lead. Be the first to apply!
