Lead AI Quality Engineering
Connvertex Technologies Inc.
JOB DESCRIPTION
AI Quality Engineering Lead | Agentic AI, Enterprise AI Solutions, AI-Driven Software Quality Engineering
Role Overview
We are seeking a highly motivated AI Quality Engineering Lead with 8+ years of experience in Quality Engineering, Test Automation, Software Engineering, AI/ML, and Technology Transformation to lead the adoption of AI-powered Quality Engineering capabilities across the Testing Center of Excellence (TCoE).
This is a hands-on technical leadership role responsible for designing, implementing, and scaling enterprise AI solutions that improve software quality, engineering productivity, automation, and SDLC efficiency.
The role will drive adoption of Agentic AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Multi-Agent Systems, AI-powered testing solutions, and engineering accelerators while establishing governance, standards, and reusable frameworks for enterprise use.
The AI Quality Engineering Lead will partner closely with Engineering, Architecture, DevOps, Security, Product Teams, and Vendor Partners to accelerate software delivery through AI-first engineering practices while maintaining quality, security, and Responsible AI standards.
Key Responsibilities
- Lead enterprise adoption of AI-powered Quality Engineering capabilities across the SDLC.
- Define and execute the AI Quality Engineering strategy, roadmap, standards, and governance model.
- Design and implement Agentic AI solutions using LangChain, LangGraph, LLMs, RAG, and Multi-Agent architectures.
- Develop reusable AI frameworks, accelerators, libraries, reference implementations, and engineering playbooks.
- Lead implementation of AI-enabled solutions for:
o Requirements analysis
o Test case generation
o Test automation development
o Defect analysis
o Traceability validation
o Test data generation
o Knowledge management
o Documentation generation
o Quality reporting and analytics - Establish standards for Responsible AI, Human-in-the-Loop controls, AI observability, model evaluation, security, and governance.
- Drive integration of AI solutions into DevOps and CI/CD pipelines.
- Evaluate emerging AI technologies and establish enterprise adoption recommendations.
- Define AI adoption metrics, KPIs, ROI measures, and value realization frameworks.
- Provide technical leadership and mentoring to engineering teams adopting AI-first delivery practices.
- Collaborate with senior leadership to define and evolve the enterprise AI-enabled Quality Engineering operating model.
Required Skills & Experience
- Experience in Test Consulting, Quality Engineering, and Test Automation.
- Experience in AI/ML Solution Architecture design to create scalable, enterprise-grade AI systems by selecting optimal models (e.g., LLMs and traditional Machine Learning models), defining data pipelines, and ensuring seamless integration with existing cloud infrastructure and governance frameworks.
- Experience in Python, FastAPI framework
- Experience in Agentic AI engineering workflow orchestration using LangGraph, LangChain, Large Language Models (LLMs), and AI orchestration frameworks.
- Experience in building reusable reference implementations, libraries, accelerators, frameworks, and playbooks for AI/ML-augmented engineering and software delivery.
- Experience in Prompt Engineering, Solution Architecture and Design, Retrieval-Augmented Generation (RAG), and Multi-Agent Systems.
- Experience with Microservices, API-First Design, and Event-Driven Architecture.
- Experience with Docker, Kubernetes, DevOps practices, and CI/CD pipelines.
- Experience in Software Architecture, Engineering Transformation, and AI-driven Engineering Solutions.
- Strong understanding of Software Development Lifecycle (SDLC), Quality Engineering, and AI-enabled software delivery practices.
- Experience establishing AI governance, Responsible AI practices, Human-in-the-Loop controls, security standards, and engineering best practices.
- Strong technical leadership, stakeholder management, consulting, and communication skills.
Preferred Skills & Experience
- Experience building enterprise Test Automation Frameworks and reusable automation accelerators.
- Experience in AI observability, monitoring, model evaluation, and operational monitoring frameworks.
- Experience in automated documentation generation and release management solutions.
- Experience in engineering governance, standards, operating models, and AI-first engineering practices.
- Experience in technical consulting and stakeholder management.
- Experience with Microsoft Azure AI, OpenAI, Azure AI Search and cloud-native AI platforms.
- Experience leading engineering transformation and AI adoption initiatives.
Required Experience
- 8+ years of experience in Quality Engineering, Software Engineering, Test Automation, AI/ML, or Enterprise Technology Delivery.
- 3+ years of experience designing and implementing AI/ML, GenAI, or Agentic AI solutions.
- Proven experience leading enterprise-scale technical initiatives and cross-functional teams.
- Experience defining architecture standards, governance frameworks, and reusable engineering solutions.
Education and Qualifications
- Bachelor's Degree or higher in Computer Science, Engineering, Information Systems, Data Science, Artificial Intelligence, or a related field.
- Advanced AI/ML, Cloud, or Architecture certifications preferred.
- Strong software engineering and solution architecture background preferred.
What Success Looks Like
- AI-powered Quality Engineering solutions are successfully adopted across TCoE programs and delivery teams.
- Reusable AI agents, frameworks, accelerators, and reference architectures are established and broadly utilized across the organization.
- Measurable improvements are achieved in testing productivity, automation efficiency, software quality, and delivery velocity.
- Responsible AI, security, governance, observability, and Human-in-the-Loop controls are consistently implemented.
- Leadership has clear visibility into AI adoption, business value, risk management, and ROI.
$70 per hour
job summary: We are seeking a highly motivated AI Quality Engineering Lead with 8+ years of experience in Quality Engineering, Test Automation, Software Engineering, AI/ML, and Technology Transformation to lead the adoption of AI-powered Quality Engineering capabilities...SuggestedHourly payContract workTemporary workWork experience placement$100k - $130k
...has to hold up to scientific and regulatory scrutiny. As our AI Quality Engineer, reporting to the Vice President of Scientific and Medical Affairs... ...quality control that keeps our extractors trustworthy. You lead the regulatory alignment that lets clients rely on our...SuggestedRemote work- ...We are seeking an AI Quality Engineering Lead with 8+ years of experience in Quality Engineering, Test Automation, Software Engineering, and AI/ML. The role will lead the design and adoption of AI-powered Quality Engineering solutions, automation frameworks, and Agentic...SuggestedContract work
$170k - $200k
...Job Description Job Description About the Role This is the first dedicated quality-infrastructure hire at a well-backed AI/data startup, and it is a software engineering role through and through. You will own the full verification and release system, from agentic...SuggestedRemote work$180k - $250k
Our client, an early-stage AI startup, are hiring a Founding Applied AI Engineer to join their team in New York. The successful candidate will design and build the intelligence layer that powers the company’s personalisation, recommendation systems and external APIs, including...SuggestedFull time- AI Quality Engineering Lead Agentic AI & GenAI Location: New York, NY Hybrid (3 days onsite / 2 days remote) Interview Process: 1st Round Remote via MS Teams; 2nd Round Onsite Job Summary STAFFXPERT LLC is seeking an AI Quality Engineering Lead Agentic AI...Remote work
- ...Circle is seeking a Lead Engineer for the AI Quality team to build evaluation infrastructure, observability tooling, and diagnostic systems for Circle's AI agents. You will lead and grow the team while staying hands-on and partnering with AI Core engineering to improve...Remote work
- ...We are seeking a Python Agentic AI Engineer to design, build, and deploy scalable AI agent and backend solutions. The role combines Python, agentic AI, LLMs, RAG, AWS, APIs, microservices, and event-driven architectures to deliver production-ready AI applications. Roles...Contract work
$148.5k - $223.9k
...SalesforceSalesforce is the #1 AI CRM, where humans with agents... ...up your career at the company leading workforce transformation in the... ...the founding team and engineers in an organization offering the... ...and raise the bar for technical quality, execution, and mentorship across...Full timeRemote work$130k - $180k
...who value entrepreneurship, intellectual rigor, hard work and continuous improvement.Role and Responsibilities:We are seeking an AI Engineer to drive innovation and automation across Prospect’s operations and our portfolio of 120+ companies. You will design and deploy advanced...Daily paidPermanent employmentWork at office- ...changes the operating model an engineering organization runs on, the... ...target. What we design from it is AI-native by construction. We... ...of model differences across leading LLM providers and ability to... ...performance KPIs including response quality scores, deflection rates,...Full timeWork experience placementLive inWork at officeLocal area
- ...highly embedded, client-facing engineering role. The individual will... ...involves identifying high-value AI use cases, translating business... ...directly with business stakeholders, lead discovery discussions, clarify... ..., including test datasets, quality metrics, human review loops,...Full timeContract work
$121k - $206k
...in our New York City office or with our AI Engineering squad in Harbor Point, Baltimore, MD. In... ...solve complex business problems. You will lead technical workstreams, incubate new AI... ...non-deterministic AI systems, including quality metrics, regression testing, failure analysis...Full timeWork at officeLocal areaRemote work3 days per week$109k - $203k
Software Engineer - AI - CoCounsel Forward Deployed EngineeringAre you excited about building... ...for legal accuracy, relevance, citation quality, consistency, and hallucination risk.Contribute... ...have the tools and knowledge to grow, lead, and thrive in an AI-enabled future....Full timeContract workWork at officeLocal areaFlexible hours$95k - $120k
Software Engineer- AI Engineering TrackNew York, New York|Software EngineerForward Deployed Engineer is the fastest-growing job title in tech — and you don’t need AI experience to claim it. You need to be a solid software developer. SkillStorm takes working developers,...Full timeRelocation- ...Serotonin seeks an AI GTM Engineer to enhance marketing workflows using AI tools. This role is ideal for candidates skilled in prompt engineering... ...to integrate AI solutions, aiming to boost speed and quality across various marketing channels. Your responsibilities will...
$150k - $190k
...Business Operations GTM AI Engineer NYC Full-time Description I joined Zenity because it’s a rare opportunity to help build the operational foundation for a new security category focused on securing AI. The team is operating at a high level and moving quickly...Full timeWorldwideShift work$229.9k - $262.4k
...AI Engineer 5 (AI Foundations, VLM Customization) At Capital One, we are creating responsible... ...teams to deliver our industry leading capabilities with breakthrough product experiences... ...to build systems, take pride in the quality of your work, and also share our passion...Full timePart timeLocal area$229.9k - $262.4k
...AI Engineer 5 (MLX, Agentic AI, Gen AI platform Services) At Capital One, we are creating... ...engineering teams to deliver our industry leading capabilities with breakthrough product... ...love to build systems, take pride in the quality of your work, and also share our passion...Full timePart timeLocal area$229.9k - $262.4k
...creating responsible and reliable AI systems, changing banking for good... ...build world-class applied science and engineering teams to deliver our industry leading capabilities with breakthrough... ...build systems, take pride in the quality of your work, and also share our passion...Full timePart timeLocal area$229.9k - $262.4k
...creating responsible and reliable AI systems, changing banking for good... ...build world-class applied science and engineering teams to deliver our industry leading capabilities with breakthrough... ...build systems, take pride in the quality of your work, and also share our passion...Full timePart timeLocal area- ...Bachelor's program with a degree an engineering discipline.Who you'll work... ...that powers cutting-edge AI applications leveraging LLMs,... ...data landscapes, apply data quality fundamentals, and prepare data... ...AI while collaborating with leading AI and data experts in the industry...ApprenticeshipInternshipWork at officeLocal areaEasy work
$150k - $200k
...per annum New York, United States Permanent Senior AI Security EngineerLocation: New York, NYWorking Pattern: HybridEmployment... ...services organization that is continuing to invest in its AI engineering and security capabilities.They are looking for an experienced...Permanent employment$126k - $189k
Job Description Summary:Join Fenwick's AI Innovation team to build and deploy the next... ...candidate is an experienced software engineer with a builder mindset, strong product instincts... ...performance and continuously improve quality, accuracy, and user experience.Advance the...Full timeTemporary workFlexible hours$144.25k - $256.25k
...applicable) + benefitsJob Function: Engineering & ArchitectureSchedule: Full... ...an uninterrupted, high-quality customer experience. Technology... ....At American Express, AI is reshaping the future of commerce... ...You will be responsible for leading a team of mobile engineers building...Visa sponsorship$125.8k - $209.7k
...help to build a better working world.The OpportunityAs a Cyber AI Engineer at the Senior Consultant level in EY's Cyber practice, you... ...troubleshooting skills across cyber workflows, model behavior, data quality, and production issues.Ability to explain model behavior,...Immediate start$175k - $250k
Applied AI EngineerAbout MillenniumMillennium is a global, diversified alternative investment firm, founded in 1989. Defined by evolution... ...projects. What You'll DoOwn agentic process automation: reverse-engineer manual, undocumented workflows and build agents that execute...Work at officeFlexible hours$144.25k - $256.25k
...annually + bonus + equity (if applicable) + benefitsJob Function: Engineering & ArchitectureSchedule: Full timeShift: DayWorkplace:... ...TechnologyCompany: American ExpressDescriptionAt American Express, AI is reshaping the future of commerce and redefining the experiences...Visa sponsorship$124k - $280k
...SummaryThe OpportunityAs an AML and Sanctions- AI Engineer- Senior Manager, you will leverage data... ...your skills and influence to deliver quality results, motivating and coaching teams... ...team effectiveness.Responsibilities- Leading the development and implementation of innovative...Full timeH1b$125k - $250k
...Bank is seeking an experienced Senior AI Engineering to design, build, and operationalize enterprise... ...AI solutions ~ Proven experience leading AI, data, automation, or emerging... ...process and data discipline, including data quality, lineage, metadata, workflow design,...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead AI Quality Engineering. Be the first to apply!
- lead operating engineer New York, NY
- lead algorithm engineer New York, NY
- lead security engineer New York, NY
- lead infrastructure engineer New York, NY
- lead web developer New York, NY
- lead system engineer New York, NY
- lead app. developer New York, NY
- lead network engineer New York, NY
- lead engineer New York, NY
- senior ai engineer New York, NY





