Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Quality Engineering Lead (Hybrid - Onsite interviews)

Cleo Consulting

Job title: AI Quality Engineering Lead

Job Location - NY, NY

Duration: 12+ months

OPEN TO GC/USC/GC EAD/H4 EAD/H1B (they must be local)

Interview: In-person

Hybrid expectation 3 days onsite per week

Please fill the below details while submitting your candidates:

  • Full Name:
  • Contact #
  • Email Address:
  • MM/DD:
  • Pay Rate (indicate W2 or C2C w/Terms: $0.00/ Hourly/ C2C
  • Availability: Immediately
  • Actively Interviewing (Y/N):
  • Visa Status:
  • Current Location:
  • On-site Interviewing (Y/N, Explanation):
  • LinkedIn:
  • AI Quality Engineering Lead | Agentic AI, Enterprise AI Solutions, AI-Driven Software Quality Engineering

Role Overview

  • We are seeking a highly motivated AI Quality Engineering Lead with 8+ years of experience in Quality Engineering, Test Automation, Software Engineering, AI/ML, and Technology Transformation to lead the adoption of AI-powered Quality Engineering capabilities across the Testing Center of Excellence (TCoE).
  • This is a hands-on technical leadership role responsible for designing, implementing, and scaling enterprise AI solutions that improve software quality, engineering productivity, automation, and SDLC efficiency.
  • The role will drive adoption of Agentic AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Multi-Agent Systems, AI-powered testing solutions, and engineering accelerators while establishing governance, standards, and reusable frameworks for enterprise use.
  • The AI Quality Engineering Lead will partner closely with Engineering, Architecture, DevOps, Security, Product Teams, and Vendor Partners to accelerate software delivery through AI-first engineering practices while maintaining quality, security, and Responsible AI standards.

Key Responsibilities

  • Lead enterprise adoption of AI-powered Quality Engineering capabilities across the SDLC.
  • Define and execute the AI Quality Engineering strategy, roadmap, standards, and governance model.
  • Design and implement Agentic AI solutions using LangChain, LangGraph, LLMs, RAG, and Multi-Agent architectures.
  • Develop reusable AI frameworks, accelerators, libraries, reference implementations, and engineering playbooks.
  • Lead implementation of AI-enabled solutions for:
  • Requirements analysis
  • Test case generation
  • Test automation development
  • Defect analysis
  • Traceability validation
  • Test data generation
  • Knowledge management
  • Documentation generation
  • Quality reporting and analytics
  • Establish standards for Responsible AI, Human-in-the-Loop controls, AI observability, model evaluation, security, and governance.
  • Drive integration of AI solutions into DevOps and CI/CD pipelines.
  • Evaluate emerging AI technologies and establish enterprise adoption recommendations.
  • Define AI adoption metrics, KPIs, ROI measures, and value realization frameworks.
  • Provide technical leadership and mentoring to engineering teams adopting AI-first delivery practices.
  • Collaborate with senior leadership to define and evolve the enterprise AI-enabled Quality Engineering operating model.

Required Skills & Experience

  • Experience in Test Consulting, Quality Engineering, and Test Automation.
  • Experience in AI/ML Solution Architecture design to create scalable, enterprise-grade AI systems by selecting optimal models (e.g., LLMs and traditional Machine Learning models), defining data pipelines, and ensuring seamless integration with existing cloud infrastructure and governance frameworks.
  • Experience in Python, FastAPI framework
  • Experience in Agentic AI engineering workflow orchestration using LangGraph, LangChain, Large Language Models (LLMs), and AI orchestration frameworks.
  • Experience in building reusable reference implementations, libraries, accelerators, frameworks, and playbooks for AI/ML-augmented engineering and software delivery.
  • Experience in Prompt Engineering, Solution Architecture and Design, Retrieval-Augmented Generation (RAG), and Multi-Agent Systems.
  • Experience with Microservices, API-First Design, and Event-Driven Architecture.
  • Experience with Docker, Kubernetes, DevOps practices, and CI/CD pipelines.
  • Experience in Software Architecture, Engineering Transformation, and AI-driven Engineering Solutions.
  • Strong understanding of Software Development Lifecycle (SDLC), Quality Engineering, and AI-enabled software delivery practices.
  • Experience establishing AI governance, Responsible AI practices, Human-in-the-Loop controls, security standards, and engineering best practices.
  • Strong technical leadership, stakeholder management, consulting, and communication skills.

Preferred Skills & Experience

  • Experience building enterprise Test Automation Frameworks and reusable automation accelerators.
  • Experience in AI observability, monitoring, model evaluation, and operational monitoring frameworks.
  • Experience in automated documentation generation and release management solutions.
  • Experience in engineering governance, standards, operating models, and AI-first engineering practices.
  • Experience in technical consulting and stakeholder management.
  • Experience with Microsoft Azure AI, OpenAI, Azure AI Search and cloud-native AI platforms.
  • Experience leading engineering transformation and AI adoption initiatives.

Required Experience

  • 8+ years of experience in Quality Engineering, Software Engineering, Test Automation, AI/ML, or Enterprise Technology Delivery.
  • 3+ years of experience designing and implementing AI/ML, GenAI, or Agentic AI solutions.
  • Proven experience leading enterprise-scale technical initiatives and cross-functional teams.
  • Experience defining architecture standards, governance frameworks, and reusable engineering solutions.

Education and Qualifications

  • Bachelor's Degree or higher in Computer Science, Engineering, Information Systems, Data Science, Artificial Intelligence, or a related field.
  • Advanced AI/ML, Cloud, or Architecture certifications preferred.
  • Strong software engineering and solution architecture background preferred.

What Success Looks Like

  • AI-powered Quality Engineering solutions are successfully adopted across TCoE programs and delivery teams.
  • Reusable AI agents, frameworks, accelerators, and reference architectures are established and broadly utilized across the organization.
  • Measurable improvements are achieved in testing productivity, automation efficiency, software quality, and delivery velocity.
  • Responsible AI, security, governance, observability, and Human-in-the-Loop controls are consistently implemented.
  • Leadership has clear visibility into AI adoption, business value, risk management, and ROI.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Quality Engineering Lead (Hybrid - Onsite interviews) in New York, NY vacancy
  • AI Quality Engineering Lead Agentic AI & GenAI Location: New York, NY Hybrid (3 days onsite / 2 days remote) Interview Process: 1st Round Remote via MS Teams; 2nd Round Onsite Job Summary STAFFXPERT LLC is seeking an AI Quality Engineering Lead Agentic... 
    Suggested
    Remote work

    Staffxpert LLC

    New York, NY
    3 days ago
  •  ...Job Description Job Description We are hiring Sr. Generative AI (GenAI) Software Engineer - hybrid - onsite 10-12 days a month for a Full Time position in New York, NY "Applicants must be currently authorized to work in the United States on a full-time basis. The... 
    Suggested
    Full time
    Work at office
    Visa sponsorship
    Work visa
    Flexible hours

    Calance US

    New York, NY
    22 days ago
  •  ...We are seeking an  AI Quality Engineering Lead with 8+ years of experience in Quality Engineering, Test Automation, Software Engineering, and AI/ML. The role will lead the design and adoption of AI-powered Quality Engineering solutions, automation frameworks, and Agentic... 
    Suggested
    Contract work

    Techvilla Solutions

    New York, NY
    15 days ago
  •  ...early-stage, cutting-edge AI startup in New York...  ...to hire a Full Stack AI Engineer with strong zero-to-one...  ...experience.This is a fully onsite position. Candidates...  ...are seeking remote or hybrid work.About the RoleOur...  ...workflows, evaluate output quality, manage latency and... 
    Suggested
    Work at office
    Local area
    Remote work
    Relocation

    Affinity Executive Search

    New York, NY
    2 days ago
  • $150k - $250k

     ...About Hazel Hazel is the AI coworker for consumer brands...  ...You'll join a small, senior engineering team working directly with the...  ...health, dental, vision ~ Hybrid in NYC (ask about our pool...  ...Founder call # Technical interview # Onsite - meet the team # Offer... 
    Suggested

    Hazel

    New York, NY
    6 hours ago
  • $200k - $225k

    Madhive is the leading independent and fully customizable operating...  ...evolution of local media. AI Code Engineering Lead Madhive is seeking an...  ...credibility and influence. This is a hybrid role, working 3 days a week...  ...experience. Guardrail: A quality/stability bar (e.g., code... 
    Work at office
    Local area
    3 days per week

    MadHive

    New York, NY
    2 days ago
  • $170k

    Mace leads the Gateway Program in New York, delivering critical tunneling and civil works...  ...coordination to ensure safety, quality, and timely delivery. The role requires TBM...  ...proactive problem-solving approach. We offer hybrid work options and a competitive compensation... 

    Mace

    New York, NY
    5 days ago
  • $140k - $160k

     ...Principal Full-Stack AI Engineer - Platform Architect Location: New York, NY (Hybrid) Employment Type: Full-Time Job ID: 00070578971 About the role...  ...Stack AI Engineer - Platform Architect, you will lead the design and development of a next-generation... 
    Full time
    Temporary work
    Work at office

    Jobleads-US

    New York, NY
    1 day ago
  • $109k - $203k

    Software Engineer - AI - CoCounsel Forward Deployed EngineeringAre...  ..., relevance, citation quality, consistency, and...  ....What’s in it For You?Hybrid Work Model: We’ve...  ...and knowledge to grow, lead, and thrive in an AI-enabled...  ...interpreter, making interview rooms accessible,... 
    Full time
    Contract work
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    New York, NY
    1 day ago
  • About the job Senior AI Platform Engineer Job Title: Senior AI Platform Engineer Location: New York (Hybrid - 4 days/week onsite) Interview Process: Onsite interview required Company Overview...  ...top-tier technical talent with leading enterprise organizations. Project... 

    Glint Tech Solutions LLC

    New York, NY
    4 days ago
  •  ...The Senior Software Engineer operates as a senior/lead team member of a team...  .... This role is on onsite role in our Holmdel,...  ...which has a flexible hybrid work model. Objectives...  ...implementation of AI based solutions for the...  ...standards for code quality and application design... 
    Flexible hours

    247Hire

    New York, NY
    4 days ago
  • $170k - $200k

     ...Metropolis is seeking a Senior AI Engineer to join our Applied AI...  ...AI workflows, ensuring data quality and reliability for your stakeholders...  ...plans, and more. #LI-CM1 #LI-Onsite Metropolis may utilize an...  ...part of the application or interview process, please reach out to... 
    Temporary work
    Work at office
    Local area

    Metropolis

    New York, NY
    18 days ago
  •  ...Job Title: AI Engineer / Forward Deployed Engineer (AI Engineering) Location: Charlotte, NC OR New York City, NY / Northern New Jersey Work Model: Hybrid (Approximately 10 onsite days per month)     Overview We are seeking a highly skilled Forward... 
    Temporary work

    Delan Associates, Inc

    New York, NY
    3 days ago
  •  ...Job Description Job Description Senior AI Engineer Location: New York City Work Style: Hybrid Onsite Employment Type: Full-time Focus: AI, LLMs,...  ...building AI technology with the mission of making high-quality healthcare more accessible, affordable, and... 
    Full time

    NxT Level

    New York, NY
    a month ago
  • $130k - $140k

     ...right job posting. The Role AI is no longer a roadmap item —...  ...win. We're hiring a AI Native Engineer, Growth Marketing to be the...  ...and beyond. This is a rare hybrid role. You're equal parts engineer...  ...ending in @cookunity.com and interviews held through official company... 
    Day shift

    CookUnity

    New York, NY
    18 days ago
  • $140k - $180k

     ...raise the bar on what agentic AI, CTV, eCommerce, social, and...  ...Kargo is hiring an AI Engineer to architect, build, and scale...  ...operations at Kargo. This is a hybrid role requiring onsite presence 4 days per week....  ...Insights   Following Our Lead Big Picture:  kargo.com... 
    Work experience placement
    Local area

    KARGO

    New York, NY
    a month ago
  • $140 per hour

     ...Job Title: AI Engineer Location: New York, NY (Hybrid: 3 days onsite, 2 days remote) Position Type: Contract-to-Hire About the Opportunity Are you...  ...pipelines or ETL synchronization. Proficiency with leading cloud infrastructure providers (AWS, GCP, or Azure... 
    Contract work
    Remote work
    Monday to Friday

    Infratech Solutions LLC

    New York, NY
    4 days ago
  •  ...Technologies is seeking entry and mid level Hybrid developers with at least 1 - 2 years of...  ...driven self starter and open to working onsite, following the lifting of Covid -19 limitations...  ...ones, we are seeking brilliant software engineers. Not only do we offer a great team to... 
    Immediate start
    Remote work
    Relocation

    Adidev Technologies Inc

    New York, NY
    a month ago
  •  ...Applied AI Engineer Hybrid 3 days In- person Interview Description We are seeking senior hands-on full stack engineers who have designed, built,...  ...building AI-first data ingestion pipelines with measurable quality, accuracy, and reliability. ~ Advanced retrieval... 

    Talentify

    New York, NY
    21 hours ago
  • $121.79k - $159k

     ...patient outcomes through a rigorous focus on quality that has resulted in some of the lowest...  ...to join our team as a Quality Engineering Lead. We are looking for a Quality Engineering...  ...testing, automation, framework evaluation, AI in Quality, technical innovation, and... 

    NYU Langone Hospitals

    New York, NY
    4 days ago
  • $230k - $300k

     ...healthcare system. We’ve built AI-powered technology that...  ...deliver safer, higher-quality care - starting with the first...  ...We're hiring a Senior AI Engineer to own and evolve the...  ...professional development Hybrid Work Schedule (4 days onsite, 3 if located 1 hour away... 

    Brellium, Inc.

    New York, NY
    2 days ago
  • $119k - $159k

    As Lead of Web Content Engineering & AI Visibility on Datadog’s Web Experience team, you...  ...table. We operate as a hybrid workplace to ensure our Datadogs...  ...time needed for high-quality executionOwn technical...  ...AI policy, please visit Interviewing at Datadog AI Guidelines.
    Work at office

    Datadog

    New York, NY
    5 hours ago
  • $151.8k - $265.35k

    Senior AI / Machine Learning Engineer — Fraud DetectionThe OpportunityWe are in search...  ...adapt to mitigations.Hybrid Work Model: This role follows...  .... Adobe’s industry-leading offerings including Adobe...  ...com.AI Use Guidelines for Interviews:Our interviews are designed... 
    Full time
    Temporary work
    Work at office
    Local area
    Worldwide
    3 days per week

    Adobe Systems

    New York, NY
    4 days ago
  •  ...Job Description Job Description Role: Vice President - AI Consulting Engineering Lead NY/ NJ (preferred) / Remote Key Responsibilities: Lead Deep tech partner ecosystem and practice Collaborate with Labs and partner ecosystems (Google, Microsoft, Salesforce... 
    Remote work

    Inizio Partners

    New York, NY
    a month ago
  •  ...We are seeking an experienced Quality Engineer . Pl. go through the below description and let me know your interest. If you are interested...  .../ salary and best time to reach you. Location: Remote/Hybrid (New York, NY) A minimum of 4 years of experience with... 
    Remote work

    Vinsys Information Technology Inc

    New York, NY
    3 days ago
  •  ...Services) Location: New York City, NY (Hybrid - 3 Days Onsite) Contract Important Note:...  ...willing to attend Face-to-Face (F2F) interviews. Key Responsibilities: Design,...  ...driven development initiatives. Utilize AI tools and technologies to improve... 
    Contract work
    Temporary work
    Local area
    Relocation

    BuzzClan LLC

    New York, NY
    10 days ago
  • $100k - $130k

     ...has to hold up to scientific and regulatory scrutiny. As our AI Quality Engineer, reporting to the Vice President of Scientific and Medical Affairs...  ...quality control that keeps our extractors trustworthy. You lead the regulatory alignment that lets clients rely on our... 
    Remote work

    xCures

    New York, NY
    23 hours ago
  •  ...changing impact to ZS. AI Engineer We are seeking an...  ...software solutions, leading architecture design, and...  ..., ensuring code quality, adherence to deadlines...  ...like RAG, Vector DB, Hybrid Search, Agent development...  ...of working. ZSers are onsite at clients or ZS offices... 
    Work experience placement
    Local area
    Remote work
    Worldwide
    Flexible hours
    2 days per week
    3 days per week

    Jobleads-US

    New York, NY
    19 hours ago
  • $182.3k - $220k

     ...and the chance to help lead the patient revolution...  ...We're hiring a Senior AI Product Engineer to join a new team we'...  ...ground up. This is a hybrid Product + Engineering...  ...continuously improve quality and reliability. Define...  ...our application and interview process. If you require... 
    Local area

    Roman Health Pharmacy LLC

    New York, NY
    4 days ago
  • $178k - $215k

     ...Description As a Mid-Level AI / Agent Application Engineer, you will be the core...  ...(e.g., GraphRAG, hybrid search). ~ Strong background...  ...the lives of patients and leading innovation within the healthcare...  ...to participate in the interview and hiring process, please... 
    Local area
    Monday to Friday

    EVERSANA

    New York, NY
    25 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Quality Engineering Lead (Hybrid - Onsite interviews). Be the first to apply!