Test Lead
Pinnacle Talent Placement
AI Test Lead
Status: Must be legally eligible to work where you live.
Resume must be in English
Location : Remote, some travel to Atlanta, GA
Engagement : Contract, Long Term, Full Time
About the Role
We are looking for an AI Test Lead with 10+ years of overall testing experience, including 2+ years testing AI/ML systems, to own the quality strategy for our AI-powered applications and models. You will define how we test AI systems end-to-end, lead testing execution using modern AI tools, and set the standard for reliable, trustworthy AI delivery.
Key Responsibilities
- Define and own the AI testing strategy for applications and models.
- Lead AI application testing across functional, integration, and user-facing behavior.
- Perform model testing and validation (accuracy, robustness, bias, drift, hallucination, and performance).
- Leverage AI-powered testing tools to design, automate, and accelerate test coverage.
- Establish Agentic test frameworks, quality gates, and acceptance criteria for AI features.
- Collaborate with data science, engineering, and product teams to embed quality early.
- Report on quality metrics, risks, and readiness for release.
Required Skills & Experience
- 10+ years in software QA/testing, with 2+ years hands-on testing AI/ML applications and models.
- Hands-on with AI-based testing tools and test automation.
- Ability to create and drive AI testing strategy from the ground up.
- Strong understanding of model evaluation metrics and AI failure modes.
- Proven experience leading QA teams and mentoring testers.
- Experience testing LLM / GenAI applications (prompt testing, RAG evaluation).
- Familiarity with CI/CD and MLOps pipelines.
Nice to have:
LangFuse, Langsmith, Test Rigor of Functionize experience
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Test Lead in Jersey City, NJ vacancy
$147k - $194k
...with Mitsubishi UFJ Financial Group (MUFG), one of the world’s leading financial groups. Across the globe, we’re 150,000 colleagues, striving... ...of our recruitment team will provide more details.The Control Testing Lead will be responsible for leading a team that plans,...SuggestedFull timeWork at officeLocal areaRemote workMUFG
Jersey City, NJ3 days ago- ...Must have skills: API Testing & UI Automation Overview: We are seeking a highly skilled and experienced Senior Automation Tester to join our dynamic team. The ideal candidate will have over 8 years of experience in the field of automation testing, with a strong focus...Suggested
Omni Inclusive
Hoboken, NJ2 days ago - ...Position: Performance Testing Lead Location:remote # Design and implement performance testing strategies using Tricentis NeoLoad . # Develop load testing scenarios, scripts, and execution plans based on system requirements and user load models in...SuggestedRemote workRelocation
3B Staffing LLC
Jersey City, NJ4 days ago - Job Title : QA Test Lead Location : Jersey City, NJ Duration : 12 Months Contract Need 10+ Years of EXP Candidates Visa & Passport Number Mandatory For H1B NOTE: Need to have Selenium + RPA+ AI/ ML (Artificial Intelligence/ Machine Learning) QA Tester Responsibilities...SuggestedContract workWork experience placementH1b
- ...Job Description Job Description Role: Senior Test Lead - Python, Selenium with some capital markets or banking domain Location Jersey City, NJ ( 3 days onsite mandatory only local nearby candidates who can go for F2F) Must-Have Skills " Selenium " Microservices...SuggestedLocal area
Tekfortune Inc.
Jersey City, NJ2 days ago - ...Position Title: Automation Test Lead Location: Camden, NJ (Hybrid model, minimum 3 days/week onsite) Duration: Long Term Contract Job description: This role involves leading the automation testing efforts for an automotive IT project, focusing on...Long term contractShift work3 days per week
Apolis
Bloomfield, NJ1 day ago - ZT Systems, a Sanmina Company, is seeking a Senior Test Operations & Fleet Manager to lead large-scale test laboratory operations, fleet management, and infrastructure readiness across complex hardware development programs in Secaucus, NJ. The role requires strong technical...
- ...We are seeking an experienced SAP Functional Test Lead with 12+ years of SAP testing experience and strong expertise in SAP FICO. The ideal candidate will have hands-on experience leading testing activities for SAP implementation, rollout, and upgrade projects, along with...Contract work
2T Consulting
Nutley, NJ28 days ago - ...• At least 4+ years of QA experience for Simcorp or Aladdin or any other Asset Management solution product. • Candidate should have Test Automation experience to develop platform wide Test Automation strategy and drive automation implementation.• At least 4+ years of in...Permanent employmentFull timeH1b
Sonsoft
Weehawken, NJ3 days ago - Sika Corporation is seeking a Sales & Field Testing Manager for Cement Additives in the USA. You will visit cement plants, build relationships with cement customers, conduct on-site field trials, and collaborate with commercial/technical teams to adapt products and expand...
- ...Quality Control Technician: Cable to perform visual and dimensional inspections of cable products and conduct electrical and mechanical testing to ensure conformance with specifications. You will document results, collaborate with production, participate in audits, and help...Shift work
- Veriipro seeks an experienced SAP Functional Test Lead with 12+ years of SAP testing experience and strong expertise in SAP FICO. The role leads testing for SAP implementations, rollouts, and upgrades, coordinating onsite and offshore teams and guiding QA/test efforts across...
$60 - $70 per hour
...Job Description Job Description Job Title: SAP Functional Test Lead Work Location: Nutley NJ 07110 Contract duration: 5 Rate: $60-$70/hr Job Details: Detailed Job Description Experience in SAP testing. Must have played the role of SAP test manager...Contract workDiverse Lynx
Nutley, NJ2 days ago- ...Job Description Job Description Description: Job Title: SAP Test Lead Work Location: Nutley, NJ 7110 (Hybrid) Contract duration: 06 months Job Details : Must Have Skills: Strong hold on testing multiple areas of SAP FICO module [AP, AR, GL, Point of...Contract workWork experience placement
eTeam Inc.
Nutley, NJ2 days ago $145k - $185k
...Test Engineering ManagerThea Energy is leveraging recent breakthroughs in stellarator physics and engineering to create a faster and... ...strategy. This role is central to the organizational build-up of a leading fusion energy company and requires a high degree of autonomy....Night shiftWeekend workThea Energy
Kearny, NJ2 days ago- Fusion Energy Base in Kearny, NJ is seeking a Test Engineering Manager to oversee the verification and validation of superconducting magnets... .... The successful candidate will have 7-10+ years of experience, lead a dedicated team, and possess strong skills in LabVIEW and Python...
$97.88k - $130.5k
...About the Role The Test Manager is responsible for leading and scaling manufacturing test strategy, test operations, and validation processes across the product lifecycle. This role drives the development and execution of comprehensive test programs to ensure product...Permanent employmentWork at officeLocal areaZT Systems
Secaucus, NJ4 days ago- Thea Energy, Inc. is looking for a Test Engineering Manager to lead verification and validation efforts for superconducting magnets and other key technologies. This role is crucial for ensuring that hardware meets the demands of a fusion environment, requiring cross-functional...
- ...Test Engineering ManagerDepartment: Manufacturing Test Engineering (MTE)Location: Newark, CAPosition SummaryOur client is seeking an experienced Test Engineering Manager to lead its Test Engineering team in an electronics manufacturing environment. This role will oversee...
Career Development Partners
Newark, NJ1 day ago - ...work independently and willing to travel on a frequent basisExcellent customer relationship management skillAbility to influence and lead multi function to achieve goalsGood communication and team playerAdditional Information· 401k with Generous Company Match· Bonuses·...Local areaWorldwide
Sika
Lyndhurst, NJ1 day ago - ...between leadership and support with Product team based on upstream test quality, but always be the "quarterback" driving the effort to... ...Go/No-Go assurance to program leadership and sponsors. \n Lead, mentor, and develop the QA team , setting objectives, driving capability...Flexible hours
Envision Technology Solutions
Newark, NJ13 days ago - TG Therapeutics, Inc. is seeking an Associate Director/Director of Program Management for QC Testing, focusing on outsourced analytical/testing activities with CDMOs, ensuring timely delivery of quality data for development and regulatory submissions. This remote role interfaces...Remote job
- Hitachi Energy in Mount Pleasant, PA is seeking a Testing Laboratory Manager to lead our advanced testing facility for breakers, modules, and power system technologies. You will oversee testing strategies, optimize lab operations, and guide engineers and technicians to...
- AVIAN, Inc. is seeking an Assistant Program Manager Test and Evaluation/Lead Test Engineer for the PMA-259/Air-to-Air program. You will help plan, coordinate, and execute testing efforts and work with geographically diverse teams. In an employee-owned environment, you’...
- Nortek Data Center Cooling, LLC is seeking a Manager - End-of-Line Quality Systems to lead the standardization and reliability of EOL testing across our manufacturing network. The role interfaces with engineering, production, supply chain, and quality teams to ensure tests...
- ZT Group Intl, Inc. dba ZT Systems is seeking a Validation Lab Manager to oversee a team of technicians involved in several validation engineering projects. The successful candidate will manage the physical hosting of validation racks and ensure efficient lab operations...
- ...make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Test Engineering Manager to lead validation of IoT and computer vision products. MUST HAVES - You must be authorized to work for ANY employer...Work at officeRemote workVisa sponsorshipWork visaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Test Lead. Be the first to apply!
