Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead AI Quality Engineering

Full-time

Connvertex Technologies Inc.

JOB DESCRIPTION
AI Quality Engineering Lead Agentic AI Enterprise AI Solutions AI-Driven Software Quality Engineering



Role Overview
We are seeking a highly motivated AI Quality Engineering Lead with 8 years of experience in Quality Engineering Test Automation Software Engineering AI/ML and Technology Transformation to lead the adoption of AI-powered Quality Engineering capabilities across the Testing Center of Excellence (TCoE).
This is a hands-on technical leadership role responsible for designing implementing and scaling enterprise AI solutions that improve software quality engineering productivity automation and SDLC efficiency.
The role will drive adoption of Agentic AI Large Language Models (LLMs) Retrieval-Augmented Generation (RAG) Multi-Agent Systems AI-powered testing solutions and engineering accelerators while establishing governance standards and reusable frameworks for enterprise use.
The AI Quality Engineering Lead will partner closely with Engineering Architecture DevOps Security Product Teams and Vendor Partners to accelerate software delivery through AI-first engineering practices while maintaining quality security and Responsible AI standards.



Key Responsibilities

  • Lead enterprise adoption of AI-powered Quality Engineering capabilities across the SDLC.
  • Define and execute the AI Quality Engineering strategy roadmap standards and governance model.
  • Design and implement Agentic AI solutions using LangChain LangGraph LLMs RAG and Multi-Agent architectures.
  • Develop reusable AI frameworks accelerators libraries reference implementations and engineering playbooks.
  • Lead implementation of AI-enabled solutions for:
    o Requirements analysis
    o Test case generation
    o Test automation development
    o Defect analysis
    o Traceability validation
    o Test data generation
    o Knowledge management
    o Documentation generation
    o Quality reporting and analytics
  • Establish standards for Responsible AI Human-in-the-Loop controls AI observability model evaluation security and governance.
  • Drive integration of AI solutions into DevOps and CI/CD pipelines.
  • Evaluate emerging AI technologies and establish enterprise adoption recommendations.
  • Define AI adoption metrics KPIs ROI measures and value realization frameworks.
  • Provide technical leadership and mentoring to engineering teams adopting AI-first delivery practices.
  • Collaborate with senior leadership to define and evolve the enterprise AI-enabled Quality Engineering operating model.

Required Skills & Experience

  • Experience in Test Consulting Quality Engineering and Test Automation.
  • Experience in AI/ML Solution Architecture design to create scalable enterprise-grade AI systems by selecting optimal models (e.g. LLMs and traditional Machine Learning models) defining data pipelines and ensuring seamless integration with existing cloud infrastructure and governance frameworks.
  • Experience in Python FastAPI framework
  • Experience in Agentic AI engineering workflow orchestration using LangGraph LangChain Large Language Models (LLMs) and AI orchestration frameworks.
  • Experience in building reusable reference implementations libraries accelerators frameworks and playbooks for AI/ML-augmented engineering and software delivery.
  • Experience in Prompt Engineering Solution Architecture and Design Retrieval-Augmented Generation (RAG) and Multi-Agent Systems.
  • Experience with Microservices API-First Design and Event-Driven Architecture.
  • Experience with Docker Kubernetes DevOps practices and CI/CD pipelines.
  • Experience in Software Architecture Engineering Transformation and AI-driven Engineering Solutions.
  • Strong understanding of Software Development Lifecycle (SDLC) Quality Engineering and AI-enabled software delivery practices.
  • Experience establishing AI governance Responsible AI practices Human-in-the-Loop controls security standards and engineering best practices.
  • Strong technical leadership stakeholder management consulting and communication skills.

Preferred Skills & Experience

  • Experience building enterprise Test Automation Frameworks and reusable automation accelerators.
  • Experience in AI observability monitoring model evaluation and operational monitoring frameworks.
  • Experience in automated documentation generation and release management solutions.
  • Experience in engineering governance standards operating models and AI-first engineering practices.
  • Experience in technical consulting and stakeholder management.
  • Experience with Microsoft Azure AI OpenAI Azure AI Search and cloud-native AI platforms.
  • Experience leading engineering transformation and AI adoption initiatives.

Required Experience

  • 8 years of experience in Quality Engineering Software Engineering Test Automation AI/ML or Enterprise Technology Delivery.
  • 3 years of experience designing and implementing AI/ML GenAI or Agentic AI solutions.
  • Proven experience leading enterprise-scale technical initiatives and cross-functional teams.
  • Experience defining architecture standards governance frameworks and reusable engineering solutions.

Education and Qualifications

  • Bachelors Degree or higher in Computer Science Engineering Information Systems Data Science Artificial Intelligence or a related field.
  • Advanced AI/ML Cloud or Architecture certifications preferred.
  • Strong software engineering and solution architecture background preferred.

What Success Looks Like

  • AI-powered Quality Engineering solutions are successfully adopted across TCoE programs and delivery teams.
  • Reusable AI agents frameworks accelerators and reference architectures are established and broadly utilized across the organization.
  • Measurable improvements are achieved in testing productivity automation efficiency software quality and delivery velocity.
  • Responsible AI security governance observability and Human-in-the-Loop controls are consistently implemented.
  • Leadership has clear visibility into AI adoption business value risk management and ROI.
Vacancy posted 11 days ago
Similar jobs that could be interesting for youBased on the Lead AI Quality Engineering in New York, NY vacancy
  • $70 - $73 per hour

    job summary: We are seeking a highly motivated AI Quality Engineering Lead with 8+ years of experience in Quality Engineering, Test Automation, Software Engineering, AI/ML, and Technology Transformation to lead the adoption of AI-powered Quality Engineering capabilities... 
    Suggested
    Hourly pay
    Contract work
    Temporary work
    Work experience placement
    New York, NY
    27 days ago
  •  ...We are seeking an  AI Quality Engineering Lead with 8+ years of experience in Quality Engineering, Test Automation, Software Engineering, and AI/ML. The role will lead the design and adoption of AI-powered Quality Engineering solutions, automation frameworks, and Agentic... 
    Suggested
    Contract work

    Techvilla Solutions

    New York, NY
    27 days ago
  • Seeking a skilled AI Engineer Lead for a full-time position in Sunnyvale, CA, who will manage service rationalization, design API-first architectures, and contribute to hands-on domain services and integrations. Key responsibilities Lead service rationalization and decomposition... 
    Suggested
    Full time

    Virtual Vocations Inc

    New York, NY
    4 days ago
  • $147.5k - $211k

     ...per week Business UnitTechnology, Data, AI and Ventures (TDAV)Business Unit...  ...investment of an industry leader, access to leading-edge technologies and the opportunity to...  ...a Corporate Vice President, Enterprise Quality Engineering to lead the transformation of quality engineering... 
    Suggested
    Local area
    3 days per week

    New York Life Insurance Company

    New York, NY
    4 days ago
  • Hearth is building the next layer of its AI-first growth system in NYC, and seeks a hands-on leader who will own the AI acquisition engine end-to-end. You will run the system daily, optimize it with bid logic and measurement, and expand the funnel from ads to sales with... 
    Suggested
    For contractors

    Hearth

    New York, NY
    4 days ago
  • $180k - $250k

    Our client, an early-stage AI startup, are hiring a Founding Applied AI Engineer to join their team in New York. The successful candidate will design and build the intelligence layer that powers the company’s personalisation, recommendation systems and external APIs, including... 
    Full time

    Alldus International Consulting Ltd

    New York, NY
    more than 2 months ago
  • AI Quality Engineer, Safety and RAG - Assistant Vice President Location(s): Chennai, Tamil Nadu, India, Pune, Maharashtra, India Job Type: Hybrid Discover your future at Citi Working at Citi is far more than just a job. A career with us means joining a team of approximately... 
    Full time
    Temporary work

    Citi

    New York, NY
    2 days ago
  • Aircall is seeking a Forward‑Deployed Engineer to own end‑to‑end delivery of low‑code AI solutions connecting AI Agents with CRMs, help desks, and communications tools. You will design, implement, and operationalize workflows, drive team upskilling, and build reusable... 

    Aircall

    New York, NY
    3 days ago
  • $220k

     ...CPGR Growth Leader - AI Engineering, Strategic Accounts Fractal is a strategic AI partner to Fortune 500 companies, with a vision to power...  ...this insight into focused account and pursuit plans. Lead executive briefings, innovation sessions, modernization assessments... 
    Hourly pay
    Full time
    Local area

    Fractal

    New York, NY
    1 day ago
  • To lead AI/ML initiatives, the remote contract Lead AI/ML Full-Stack Engineer will define solution architecture for Generative AI use cases, design scalable applications...  ...guide engineering teams while ensuring high-quality development practices over a 6-month engagement... 
    Contract work
    Remote work

    Virtual Vocations Inc

    New York, NY
    2 days ago
  • To support the development of AI-driven systems, the contractor-based AI Platform Engineer Lead will design and implement frameworks for AI coding agents, focusing on enterprise engineering collaboration in a hybrid work environment based in Chicago or Philadelphia. Key... 
    For contractors

    Virtual Vocations Inc

    New York, NY
    3 days ago
  • Circle is seeking a Lead Engineer for the AI Quality team to build evaluation infrastructure, observability tooling, and diagnostic systems for Circle's AI agents. You will lead and grow the team while staying hands-on and partnering with AI Core engineering to improve... 
    Remote work

    CIRCLE

    New York, NY
    3 days ago
  • Code Metal, Inc. is seeking a Staff AI Platform Engineer to lead the AI platform team building scalable inference, model gateways, and context management. This role focuses on production systems, collaboration with Applied AI Research, and advancing observability, experimentation... 
    Remote job

    Code Metal, Inc.

    New York, NY
    3 days ago
  • Citi is seeking a Gen AI Engineer - Vice President to lead the design and delivery of high-scale AI-powered solutions. The role focuses on agentic flows, enterprise integrations, and cross‑team collaboration to accelerate Gen AI adoption across processes. The candidate... 

    Citi

    New York, NY
    2 days ago
  • $126.82k - $149.2k

     ...stage of your career. Try new things, learn new skills and discover what you excel at—all from Day One.Job DescriptionThe AI Red Team Lead Engineer leads the execution and evolution of offensive security activities focused on AI/ML systems, platforms, and integrations,... 
    Full time
    Local area
    3 days per week

    US Bank

    New York, NY
    6 days ago
  •  ...CPGR Growth Leader AI Engineering Strategic Accounts Location: New York NY or Chicago IL (Onsite) Immigration Sponsorship: This position...  ...these insights into focused account and pursuit plans. Lead executive briefings innovation sessions modernization assessments... 
    Full time
    Local area

    AOB Recruitment

    New York, NY
    2 days ago
  • $30 per hour

     ...AI Software Engineer — Python, Document Intelligence & AWS NextGen Coding Company Location: New York City — Hybrid / In-Person Required Compensation: $30/hour Hours: 40 Hours/Week Engagement: Contract with potential for long-term engagement Eligibility... 
    Contract work
    Immediate start
    Visa sponsorship

    NextGen Coding Company

    New York, NY
    4 days ago
  •  ...CPGR Growth Leader – AI Engineering, Strategic Accounts Location: New York, NY or Chicago, IL Work Arrangement: On-site Employment...  ...executive relationships, budgets, and transformation roadmaps. Lead executive discussions on AI engineering, Generative AI,... 
    Full time

    Umanist Staffing LLC

    New York, NY
    2 days ago
  • Compunnel, Inc. seeks an Evaluation Engineer - AI Models in New York to evaluate and validate AI/ML and Generative AI models across business and technical use cases. This role combines extensive Quality Engineering and software testing experience with hands-on AI model... 

    Compunnel

    New York, NY
    6 days ago
  • Equiliem is seeking an AI Evaluation/Test Engineer to test AI-powered agent experiences across customer and internal workflows. The role focuses...  ...product managers, engineers, and stakeholders to identify quality gaps and improve reliability, accuracy, and user experience... 
    Remote job

    Equiliem

    New York, NY
    4 days ago
  • AI Trainer Jobs is seeking an Engineering & Technical Documentation Specialist for a remote, contractor role to evaluate AI outputs across engineering documentation operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational... 
    Remote job
    For contractors

    AI Trainer Jobs

    New York, NY
    2 days ago
  •  ...Systems is seeking a Sr. Automation Test Engineer for a fully remote, contract opportunity in the United States. You will lead the design and implementation of scalable...  ...microservices, using Java, Selenium WebDriver, and AI-assisted quality engineering practices. The role requires... 
    Remote job
    Contract work

    Apex Systems

    New York, NY
    2 days ago
  •  ...AI / Forward Deployed Engineer Must have 4+ years of professional experience after graduation. We are an executive search firm focused primarily...  ...several AI / Forward Deployed Engineering searches with leading investment firms and have already started interviewing... 

    Long Ridge Partners

    New York, NY
    3 days ago
  •  ...Boardy is an AI super-connector that helps ambitious professionals build a network that...  ...own! Boardy is seeking an AI Software Engineer to join our small but mighty engineering team...  ...dental, and vision coverage from day - Lead a critical technical area in a fast-... 
    Full time
    Casual work
    Internship
    Work at office

    Boardy

    New York, NY
    4 days ago
  •  ...Responsibilities Design and build agentic AI applications that can reason, plan, execute tasks, and interact with external tools...  ...AI applications in production environments. Partner with engineering, data, security, product, and business teams to identify opportunities... 
    Full time

    The Phoenix Group

    New York, NY
    3 days ago
  • $115k - $130k

     ...technology to deliver industry-leading digital solutions. Synechron’...  ...& DevOps, Data, and Software Engineering, servicing an array of...  ...are seeking a hands-on Senior AI Engineer to design, build, and...  ...CI/CD ,Version control, Code quality and review, Containerization,... 
    Full time
    Temporary work
    Flexible hours

    Synechron

    New York, NY
    2 days ago
  • $130k - $180k

     ...Payments verticals, supplemented with Data & AI, Cybersecurity, Risk & Compliance, Change...  ...seeking a hands-on Forward Deployed AI Engineer to work directly with business...  ...Balance speed of delivery with solution quality and long-term maintainability. Communication... 
    Temporary work
    Remote work
    Worldwide

    BIP US

    New York, NY
    3 days ago
  • $190k - $235k

     ...SENIOR AI FULL-STACK ENGINEER Thresh Consulting — Strategy in Action for the AI Era Salary: $1...  ...design. We value clarity over complexity, quality over shortcuts, and learning as a core...  ...70% of your time building and 30% leading. You'll guide a team of 2-4 engineers,... 
    Full time
    Shift work

    Thresh Consulting

    New York, NY
    2 days ago
  •  ...codebase: you’ll work directly with PE portfolio companies to scope, build, and ship AI agents against real operational data, as well as build out the core platform. Half forward-deployed engineer, half platform builder. What You’ll Own Forward Deployment: Embed with... 
    Full time

    Alldus

    New York, NY
    2 hours ago
  • $180k - $250k

     ...AI Engineer – Agentic AI / LLM Systems New York | Series A Startup $180–$250k + Equity In office (5 days) No visa sponsorship...  ...technical team building next-generation AI systems backed by leading investors, working on problems at the edge of what’s currently... 
    Full time
    Work at office
    Visa sponsorship

    Stott and May

    New York, NY
    2 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead AI Quality Engineering. Be the first to apply!