Lead AI Quality Engineering
Connvertex Technologies Inc.
JOB DESCRIPTION
AI Quality Engineering Lead Agentic AI Enterprise AI Solutions AI-Driven Software Quality Engineering
Role Overview
We are seeking a highly motivated AI Quality Engineering Lead with 8 years of experience in Quality Engineering Test Automation Software Engineering AI/ML and Technology Transformation to lead the adoption of AI-powered Quality Engineering capabilities across the Testing Center of Excellence (TCoE).
This is a hands-on technical leadership role responsible for designing implementing and scaling enterprise AI solutions that improve software quality engineering productivity automation and SDLC efficiency.
The role will drive adoption of Agentic AI Large Language Models (LLMs) Retrieval-Augmented Generation (RAG) Multi-Agent Systems AI-powered testing solutions and engineering accelerators while establishing governance standards and reusable frameworks for enterprise use.
The AI Quality Engineering Lead will partner closely with Engineering Architecture DevOps Security Product Teams and Vendor Partners to accelerate software delivery through AI-first engineering practices while maintaining quality security and Responsible AI standards.
Key Responsibilities
- Lead enterprise adoption of AI-powered Quality Engineering capabilities across the SDLC.
- Define and execute the AI Quality Engineering strategy roadmap standards and governance model.
- Design and implement Agentic AI solutions using LangChain LangGraph LLMs RAG and Multi-Agent architectures.
- Develop reusable AI frameworks accelerators libraries reference implementations and engineering playbooks.
- Lead implementation of AI-enabled solutions for:
o Requirements analysis
o Test case generation
o Test automation development
o Defect analysis
o Traceability validation
o Test data generation
o Knowledge management
o Documentation generation
o Quality reporting and analytics - Establish standards for Responsible AI Human-in-the-Loop controls AI observability model evaluation security and governance.
- Drive integration of AI solutions into DevOps and CI/CD pipelines.
- Evaluate emerging AI technologies and establish enterprise adoption recommendations.
- Define AI adoption metrics KPIs ROI measures and value realization frameworks.
- Provide technical leadership and mentoring to engineering teams adopting AI-first delivery practices.
- Collaborate with senior leadership to define and evolve the enterprise AI-enabled Quality Engineering operating model.
Required Skills & Experience
- Experience in Test Consulting Quality Engineering and Test Automation.
- Experience in AI/ML Solution Architecture design to create scalable enterprise-grade AI systems by selecting optimal models (e.g. LLMs and traditional Machine Learning models) defining data pipelines and ensuring seamless integration with existing cloud infrastructure and governance frameworks.
- Experience in Python FastAPI framework
- Experience in Agentic AI engineering workflow orchestration using LangGraph LangChain Large Language Models (LLMs) and AI orchestration frameworks.
- Experience in building reusable reference implementations libraries accelerators frameworks and playbooks for AI/ML-augmented engineering and software delivery.
- Experience in Prompt Engineering Solution Architecture and Design Retrieval-Augmented Generation (RAG) and Multi-Agent Systems.
- Experience with Microservices API-First Design and Event-Driven Architecture.
- Experience with Docker Kubernetes DevOps practices and CI/CD pipelines.
- Experience in Software Architecture Engineering Transformation and AI-driven Engineering Solutions.
- Strong understanding of Software Development Lifecycle (SDLC) Quality Engineering and AI-enabled software delivery practices.
- Experience establishing AI governance Responsible AI practices Human-in-the-Loop controls security standards and engineering best practices.
- Strong technical leadership stakeholder management consulting and communication skills.
Preferred Skills & Experience
- Experience building enterprise Test Automation Frameworks and reusable automation accelerators.
- Experience in AI observability monitoring model evaluation and operational monitoring frameworks.
- Experience in automated documentation generation and release management solutions.
- Experience in engineering governance standards operating models and AI-first engineering practices.
- Experience in technical consulting and stakeholder management.
- Experience with Microsoft Azure AI OpenAI Azure AI Search and cloud-native AI platforms.
- Experience leading engineering transformation and AI adoption initiatives.
Required Experience
- 8 years of experience in Quality Engineering Software Engineering Test Automation AI/ML or Enterprise Technology Delivery.
- 3 years of experience designing and implementing AI/ML GenAI or Agentic AI solutions.
- Proven experience leading enterprise-scale technical initiatives and cross-functional teams.
- Experience defining architecture standards governance frameworks and reusable engineering solutions.
Education and Qualifications
- Bachelors Degree or higher in Computer Science Engineering Information Systems Data Science Artificial Intelligence or a related field.
- Advanced AI/ML Cloud or Architecture certifications preferred.
- Strong software engineering and solution architecture background preferred.
What Success Looks Like
- AI-powered Quality Engineering solutions are successfully adopted across TCoE programs and delivery teams.
- Reusable AI agents frameworks accelerators and reference architectures are established and broadly utilized across the organization.
- Measurable improvements are achieved in testing productivity automation efficiency software quality and delivery velocity.
- Responsible AI security governance observability and Human-in-the-Loop controls are consistently implemented.
- Leadership has clear visibility into AI adoption business value risk management and ROI.
- ...We are seeking an AI Quality Engineering Lead with 8+ years of experience in Quality Engineering, Test Automation, Software Engineering, and AI/ML. The role will lead the design and adoption of AI-powered Quality Engineering solutions, automation frameworks, and Agentic...SuggestedContract work
$174k - $252k
...Physics, Economics, Operations Research, Engineering, or a related quantitative field. 5 years... ...working on a consumer facing product or quality evaluations preferred. Ability to apply appropriate... ...our flagship products, including Search, AI Overviews, and Gemini in Search. You will...SuggestedWork experience placement$147.5k - $211k
...per week Business UnitTechnology, Data, AI and Ventures (TDAV)Business Unit... ...investment of an industry leader, access to leading-edge technologies and the opportunity to... ...a Corporate Vice President, Enterprise Quality Engineering to lead the transformation of quality engineering...SuggestedLocal area3 days per week$180k - $250k
Our client, an early-stage AI startup, are hiring a Founding Applied AI Engineer to join their team in New York. The successful candidate will design and build the intelligence layer that powers the company’s personalisation, recommendation systems and external APIs, including...Suggested- AI Quality Engineer, Safety and RAG - Assistant Vice President Location(s): Chennai, Tamil Nadu, India, Pune, Maharashtra, India Job Type: Hybrid Discover your future at Citi Working at Citi is far more than just a job. A career with us means joining a team of approximately...SuggestedFull timeTemporary work
- Aircall is seeking a Forward‑Deployed Engineer to own end‑to‑end delivery of low‑code AI solutions connecting AI Agents with CRMs, help desks, and communications tools. You will design, implement, and operationalize workflows, drive team upskilling, and build reusable...
$220k
...CPGR Growth Leader - AI Engineering, Strategic Accounts Fractal is a strategic AI partner to Fortune 500 companies, with a vision to power... ...this insight into focused account and pursuit plans. Lead executive briefings, innovation sessions, modernization assessments...Hourly payFull timeLocal area- Code Metal, Inc. is seeking a Staff AI Platform Engineer to lead the AI platform team building scalable inference, model gateways, and context management. This role focuses on production systems, collaboration with Applied AI Research, and advancing observability, experimentation...Remote job
$126.82k - $149.2k
...stage of your career. Try new things, learn new skills and discover what you excel at—all from Day One.Job DescriptionThe AI Red Team Lead Engineer leads the execution and evolution of offensive security activities focused on AI/ML systems, platforms, and integrations,...Full timeLocal area3 days per week- Hamilton Barnes is seeking a Senior Automation Engineer to transform infrastructure into a full-... ...platform automation function, focusing on AI-driven automation with Kubernetes at the... ...across multiple environments and lead platform evolution with IaC practices. You...
- ...interested in this opportunity. \n \n Job Title: Akamai with AI Engineer \n \n Job Term: Contract (12 months+) \n \n Location:... ...: \n \n 1. WAF Onboarding and Application Migration \n Lead onboarding internet-facing applications to Akamai WAF. \n...Contract workRelocation
$30 per hour
...AI Software Engineer — Python, Document Intelligence & AWS NextGen Coding Company Location: New York City — Hybrid / In-Person Required Compensation: $30/hour Hours: 40 Hours/Week Engagement: Contract with potential for long-term engagement Eligibility...Contract workImmediate startVisa sponsorship- Equiliem is seeking an AI Evaluation/Test Engineer to test AI-powered agent experiences across customer and internal workflows. The role focuses... ...product managers, engineers, and stakeholders to identify quality gaps and improve reliability, accuracy, and user experience...Remote job
- ...Systems is seeking a Sr. Automation Test Engineer for a fully remote, contract opportunity in the United States. You will lead the design and implementation of scalable... ...microservices, using Java, Selenium WebDriver, and AI-assisted quality engineering practices. The role requires...Remote jobContract work
- Compunnel, Inc. seeks an Evaluation Engineer - AI Models in New York to evaluate and validate AI/ML and Generative AI models across business and technical use cases. This role combines extensive Quality Engineering and software testing experience with hands-on AI model...
- We are looking for a Lead Python AI Engineer to build robust, AI-powered API services and agentic workflows. In this role, you will bridge the gap between traditional backend systems and modern language models, focusing on secure and scalable LLM interactions with internal...
$200k - $250k
...Job Description Director of AI Engineering \n Location: New York, NY; Hybrid (Candidates MUST be local - No relocation) \n Compensation... ...for autonomous systems \n Evaluate emerging AI techniques, lead complex cross-cutting initiatives, and balance tradeoffs among...Local areaRelocationVisa sponsorship- BMC Software, Inc. is seeking a skilled AI evaluation engineer to build evaluation frameworks, golden datasets, and rubrics for generative AI... ...drive down hallucinations and drift while ensuring release quality. You will own defined eval work from definition through delivery...
- BMC Software, Inc. in the United States is hiring a Principal Quality Automation Engineer to shape evaluation frameworks for Generative AI and agentic AI systems. You will own the end-to-end evaluation process and build robust datasets, rubrics, and CI-tested evaluation...Remote job
$210k - $250k
...Founding AI Engineer New York City, NY | In-Person | $210,000–$250,000 Base + Equity About the Company Shields Group Search is... ...a transition into modern AI engineering is welcome. Depth and quality of AI experience matter more than the total number of years spent...Full time$100 - $120 per hour
...Snowflake AI Engineer – Cortex Location: New York City - Hybrid 2 days per week Contract Length: 6 Months Initial Rate: $100-$12... ...tools, including APIs and MCP-based tooling. Evaluation & Quality ~ Set up testing and evaluation frameworks to measure AI output...Contract work2 days per week$180k - $200k
...Forward Deployed AI Engineer Location: New York, NY Compensation: $180-200K + Bonus US Citizens only; No Visa Sponsorship Candidates must be local Responsibilities: Partner with stakeholders to identify operational friction, map complex systems, and...Local areaImmediate startVisa sponsorship$160k - $200k
...AI Engineer [Senior Associate / AVP] Founded in 1992, Cerberus is a global leader in alternative... ...pragmatic trade-offs: Balance speed, quality, security, cost and maintainability in a... ...with experience designing AI systems or leading small AI-native engineering efforts....- ...codebase: you’ll work directly with PE portfolio companies to scope, build, and ship AI agents against real operational data, as well as build out the core platform. Half forward-deployed engineer, half platform builder. What You’ll Own Forward Deployment: Embed with...Full time
$190k - $235k
...SENIOR AI FULL-STACK ENGINEER Thresh Consulting — Strategy in Action for the AI Era Salary: $1... ...design. We value clarity over complexity, quality over shortcuts, and learning as a core... ...70% of your time building and 30% leading. You'll guide a team of 2-4 engineers,...Full timeShift work$115k - $130k
...technology to deliver industry-leading digital solutions. Synechron’... ...& DevOps, Data, and Software Engineering, servicing an array of... ...are seeking a hands-on Senior AI Engineer to design, build, and... ...CI/CD ,Version control, Code quality and review, Containerization,...Full timeTemporary workFlexible hours- ...AI Engineer (GenAI Workflows for OTC Derivatives) Location: New York City (SoHo) — In-Person About Our Client Our client is building... ...engineering infrastructure—ensuring model outputs are high-quality, reliable, and explainable. You’ll work closely with...Full time
- ...Boardy is an AI super-connector that helps ambitious professionals build a network that... ...own! Boardy is seeking an AI Software Engineer to join our small but mighty engineering team... ...dental, and vision coverage from day - Lead a critical technical area in a fast-...Full timeCasual workInternshipWork at office
- ...Applied AI Engineer NYC, hybrid We're partnered with a leading quantitative investment and technology firm that is building out a new generation of AI-powered tooling and looking to hire an AI Engineer to help drive the initiative. This is a highly hands-on role...For contractors
$180k - $250k
...AI Engineer – Agentic AI / LLM Systems New York | Series A Startup $180–$250k + Equity In office (5 days) No visa sponsorship... ...technical team building next-generation AI systems backed by leading investors, working on problems at the edge of what’s currently...Full timeWork at officeVisa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead AI Quality Engineering. Be the first to apply!
- lead engineer New York, NY
- lead operating engineer New York, NY
- lead security engineer New York, NY
- lead app. developer New York, NY
- lead infrastructure engineer New York, NY
- lead product engineer New York, NY
- lead network engineer New York, NY
- lead quality engineer New York, NY
- lead system engineer New York, NY
- lead algorithm engineer New York, NY




