Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Quality Engineer Lead - Hybrid NYC

$70 - $73 per hour
job summary:
We are seeking a highly motivated AI Quality Engineering Lead with 8+ years of experience in Quality Engineering, Test Automation, Software Engineering, AI/ML, and Technology Transformation to lead the adoption of AI-powered Quality Engineering capabilities across the Testing Center of Excellence (TCoE).

This is a hands-on technical leadership role responsible for designing, implementing, and scaling enterprise AI solutions that improve software quality, engineering productivity, automation, and SDLC efficiency. The role will drive adoption of Agentic AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Multi-Agent Systems, AI-powered testing solutions, and engineering accelerators while establishing governance, standards, and reusable frameworks for enterprise use.

The AI Quality Engineering Lead will partner closely with Engineering, Architecture, DevOps, Security, Product Teams, and Vendor Partners to accelerate software delivery through AI-first engineering practices while maintaining quality, security, and Responsible AI standards.

Key Responsibilities

Lead enterprise adoption of AI-powered Quality Engineering capabilities across the SDLC.

Define and execute the AI Quality Engineering strategy, roadmap, standards, and governance model.

Design and implement Agentic AI solutions using LangChain, LangGraph, LLMs, RAG, and Multi-Agent architectures.

Develop reusable AI frameworks, accelerators, libraries, reference implementations, and engineering playbooks.

Lead implementation of AI-enabled solutions for:

Requirements analysis

Test case generation

Test automation development

Defect analysis

Traceability validation

Test data generation

Knowledge management

Documentation generation

Quality reporting and analytics

Establish standards for Responsible AI, Human-in-the-Loop controls, AI observability, model evaluation, security, and governance.

Drive integration of AI solutions into DevOps and CI/CD pipelines.

Evaluate emerging AI technologies and establish enterprise adoption recommendations.

Define AI adoption metrics, KPIs, ROI measures, and value realization frameworks.

Provide technical leadership and mentoring to engineering teams adopting AI-first delivery practices.

Collaborate with senior leadership to define and evolve the enterprise AI-enabled Quality Engineering operating model.

Required Skills & Experience

Experience in Test Consulting, Quality Engineering, and Test Automation.

Experience in AI/ML Solution Architecture design to create scalable, enterprise-grade AI systems by selecting optimal models (e.g., LLMs and traditional Machine Learning models), defining data pipelines, and ensuring seamless integration with existing cloud infrastructure and governance frameworks.

Experience in Python, FastAPI framework

Experience in Agentic AI engineering workflow orchestration using LangGraph, LangChain, Large Language Models (LLMs), and AI orchestration frameworks.

Experience in building reusable reference implementations, libraries, accelerators, frameworks, and playbooks for AI/ML-augmented engineering and software delivery.

Experience in Prompt Engineering, Solution Architecture and Design, Retrieval-Augmented Generation (RAG), and Multi-Agent Systems.

Experience with Microservices, API-First Design, and Event-Driven Architecture.

Experience with Docker, Kubernetes, DevOps practices, and CI/CD pipelines.

Experience in Software Architecture, Engineering Transformation, and AI-driven Engineering Solutions.

Strong understanding of Software Development Lifecycle (SDLC), Quality Engineering, and AI-enabled software delivery practices.

Experience establishing AI governance, Responsible AI practices, Human-in-the-Loop controls, security standards, and engineering best practices.

Strong technical leadership, stakeholder management, consulting, and communication skills.

Preferred Skills & Experience

Experience building enterprise Test Automation Frameworks and reusable automation accelerators.

Experience in AI observability, monitoring, model evaluation, and operational monitoring frameworks.

Experience in automated documentation generation and release management solutions.

Experience in engineering governance, standards, operating models, and AI-first engineering practices.

Experience in technical consulting and stakeholder management.

Experience with Microsoft Azure AI, OpenAI, Azure AI Search and cloud-native AI platforms.

Experience leading engineering transformation and AI adoption initiatives.

Required Experience

8+ years of experience in Quality Engineering, Software Engineering, Test Automation, AI/ML, or Enterprise Technology Delivery.

3+ years of experience designing and implementing AI/ML, GenAI, or Agentic AI solutions.

Proven experience leading enterprise-scale technical initiatives and cross-functional teams.

Experience defining architecture standards, governance frameworks, and reusable engineering solutions.

Education and Qualifications

Bachelor's Degree or higher in Computer Science, Engineering, Information Systems, Data Science, Artificial Intelligence, or a related field.

Advanced AI/ML, Cloud, or Architecture certifications preferred.

Strong software engineering and solution architecture background preferred.

What Success Looks Like

AI-powered Quality Engineering solutions are successfully adopted across TCoE programs and delivery teams.

Reusable AI agents, frameworks, accelerators, and reference architectures are established and broadly utilized across the organization.

Measurable improvements are achieved in testing productivity, automation efficiency, software quality, and delivery velocity.

Responsible AI, security, governance, observability, and Human-in-the-Loop controls are consistently implemented.

Leadership has clear visibility into AI adoption, business value, risk management, and ROI.

 
location: New York, New York
job type: Contract
salary: $70 - 73 per hour
work hours: 9am to 5pm
education: Bachelors

responsibilities:
We are seeking a highly motivated AI Quality Engineering Lead with 8+ years of experience in Quality Engineering, Test Automation, Software Engineering, AI/ML, and Technology Transformation to lead the adoption of AI-powered Quality Engineering capabilities across the Testing Center of Excellence (TCoE).

This is a hands-on technical leadership role responsible for designing, implementing, and scaling enterprise AI solutions that improve software quality, engineering productivity, automation, and SDLC efficiency. The role will drive adoption of Agentic AI , Large Language Models (LLMs) , Retrieval-Augmented Generation (RAG) , Multi-Agent Systems , AI-powered testing solutions, and engineering accelerators while establishing governance, standards, and reusable frameworks for enterprise use.

The AI Quality Engineering Lead will partner closely with Engineering, Architecture, DevOps, Security, Product Teams, and Vendor Partners to accelerate software delivery through AI-first engineering practices while maintaining quality, security, and Responsible AI standards.

Key Responsibilities

  • Lead enterprise adoption of AI-powered Quality Engineering capabilities across the SDLC.
  • Define and execute the AI Quality Engineering strategy, roadmap, standards, and governance model .
  • Design and implement Agentic AI solutions using LangChain, LangGraph, LLMs, RAG, and Multi-Agent architectures.
  • Develop reusable AI frameworks, accelerators, libraries, reference implementations, and engineering playbooks .
  • Lead implementation of AI-enabled solutions for:
    • Requirements analysis
    • Test case generation
    • Test automation development
    • Defect analysis
    • Traceability validation
    • Test data generation
    • Knowledge management
    • Documentation generation
    • Quality reporting and analytics
  • Establish standards for Responsible AI , Human-in-the-Loop controls, AI observability, model evaluation, security, and governance.
  • Drive integration of AI solutions into DevOps and CI/CD pipelines .
  • Evaluate emerging AI technologies and establish enterprise adoption recommendations.
  • Define AI adoption metrics, KPIs, ROI measures, and value realization frameworks .
  • Provide technical leadership and mentoring to engineering teams adopting AI-first delivery practices.
  • Collaborate with senior leadership to define and evolve the enterprise AI-enabled Quality Engineering operating model.
Required Skills & Experience

  • Experience in Test Consulting, Quality Engineering, and Test Automation .
  • Experience in AI/ML Solution Architecture design to create scalable, enterprise-grade AI systems by selecting optimal models (e.g., LLMs and traditional Machine Learning models), defining data pipelines, and ensuring seamless integration with existing cloud infrastructure and governance frameworks.
  • Experience in Python , FastAPI framework
  • Experience in Agentic AI engineering workflow orchestration using LangGraph, LangChain, Large Language Models (LLMs), and AI orchestration frameworks.
  • Experience in building reusable reference implementations, libraries, accelerators, frameworks, and playbooks for AI/ML-augmented engineering and software delivery.
  • Experience in Prompt Engineering, Solution Architecture and Design, Retrieval-Augmented Generation (RAG), and Multi-Agent Systems .
  • Experience with Microservices, API-First Design, and Event-Driven Architecture .
  • Experience with Docker, Kubernetes, DevOps practices, and CI/CD pipelines .
  • Experience in Software Architecture, Engineering Transformation, and AI-driven Engineering Solutions .
  • Strong understanding of Software Development Lifecycle (SDLC) , Quality Engineering, and AI-enabled software delivery practices.
  • Experience establishing AI governance, Responsible AI practices, Human-in-the-Loop controls, security standards, and engineering best practices .
  • Strong technical leadership, stakeholder management, consulting, and communication skills.
Preferred Skills & Experience

  • Experience building enterprise Test Automation Frameworks and reusable automation accelerators.
  • Experience in AI observability, monitoring, model evaluation, and operational monitoring frameworks .
  • Experience in automated documentation generation and release management solutions .
  • Experience in engineering governance, standards, operating models, and AI-first engineering practices .
  • Experience in technical consulting and stakeholder management .
  • Experience with Microsoft Azure AI, OpenAI, Azure AI Search and cloud-native AI platforms .
  • Experience leading engineering transformation and AI adoption initiatives .
Required Experience

  • 8+ years of experience in Quality Engineering, Software Engineering, Test Automation, AI/ML, or Enterprise Technology Delivery.
  • 3+ years of experience designing and implementing AI/ML, GenAI, or Agentic AI solutions.
  • Proven experience leading enterprise-scale technical initiatives and cross-functional teams.
  • Experience defining architecture standards, governance frameworks, and reusable engineering solutions.
Education and Qualifications

  • Bachelor's Degree or higher in Computer Science, Engineering, Information Systems, Data Science, Artificial Intelligence, or a related field.
  • Advanced AI/ML, Cloud, or Architecture certifications preferred.
  • Strong software engineering and solution architecture background preferred.
What Success Looks Like

  • AI-powered Quality Engineering solutions are successfully adopted across TCoE programs and delivery teams .
  • Reusable AI agents, frameworks, accelerators, and reference architectures are established and broadly utilized across the organization.
  • Measurable improvements are achieved in testing productivity, automation efficiency, software quality, and delivery velocity .
  • Responsible AI , security, governance, observability, and Human-in-the-Loop controls are consistently implemented.
  • Leadership has clear visibility into AI adoption, business value, risk management, and ROI .
qualifications:
Education and Qualifications

Bachelor's Degree or higher in Computer Science, Engineering, Information Systems, Data Science, Artificial Intelligence, or a related field.

Advanced AI/ML, Cloud, or Architecture certifications preferred.

Strong software engineering and solution architecture background preferred.

What Success Looks Like

AI-powered Quality Engineering solutions are successfully adopted across TCoE programs and delivery teams.

Reusable AI agents, frameworks, accelerators, and reference architectures are established and broadly utilized across the organization.

Measurable improvements are achieved in testing productivity, automation efficiency, software quality, and delivery velocity.

Responsible AI, security, governance, observability, and Human-in-the-Loop controls are consistently implemented.

Leadership has clear visibility into AI adoption, business value, risk management, and ROI.

skills:
AI platforms,API-First,reusable frameworks,AI solutions,AI,AI frameworks,AI-enabled solutions,integration of AI,emerging AI technologies,AI-enabled,Artificial Intelligence,Advanced AI,Test automation,cloud infrastructure,Cloud,cloud-native,CI/CD pipelines,data generation,data pipelines,DevOps,DevOps practices,Docker,Enterprise Technology,Event-Driven Architecture,FastAPI,Retrieval-Augmented Generation (RAG),Information Systems,Computer Science,Knowledge management,Kubernetes,Large Language Models,LLMs,Machine Learning models,Microservices,Microsoft Azure,Azure,model evaluation,Multi-Agent Systems,Multi-Agent,AI orchestration,Prompt Engineering,Python,release management,AI Search,Software Architecture,Software Development Lifecycle,Software Engineering,software quality,Test Automation Frameworks,SDLC,Test case,Agentic AI,communication skills,leadership,Architecture,architecture standards,automation,automated,software engineering,software quality,Consulting,Responsible AI,Data Science,validation Test,Defect analysis,governance,governance frameworks,AI governance,AI systems,mentoring,metrics,operating model,operating models,automation efficiency,Quality reporting,Quality Engineering,reference architectures,Requirements analysis,risk management,Security,Solution Architecture design,Solution Architecture,stakeholder management,technical consulting,technical leadership,testing,Traceability,business value


Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact View email address on us.fitly.work.




Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.



Vacancy posted 24 days ago
Similar jobs that could be interesting for youBased on the AI Quality Engineer Lead - Hybrid NYC in New York, NY vacancy
  • $200k - $250k

     ...together!   Circana is a leading provider of technology, AI, and data solutions for...  ...and an expansive, high-quality data set.   At Circana...  ...retailers run on. AI Principal Engineers build the foundations of...  ...area(s): Chicago, IL (Hybrid) or NYC, NY (Hybrid)   The... 
    Suggested
    Local area
    Flexible hours
    Shift work

    Circana, LLC.

    New York, NY
    3 days ago
  • $150k - $190k

     ...!   Circana is a leading provider of technology, AI, and data solutions...  ...an expansive, high-quality data set.   At Circana...  ...Senior DevOps Engineer to design, implement...  ...operational excellence in hybrid infrastructure...  ...Chicago, IL (Hybrid) or NYC, NY (Hybrid) The... 
    Suggested
    Local area
    Flexible hours
    Shift work

    Circana, LLC.

    New York, NY
    3 days ago
  •  ...Intuit, Inc. is seeking a Senior Staff Software Engineer in New York for a hybrid role that combines product leadership with hands-on engineering....  ...functional teams to accelerate end-to-end outcomes, build AI-native applications, and drive architectural decisions across... 
    Suggested

    Jobleads-US

    New York, NY
    3 days ago
  •  ...in New York City. You will own live programmatic campaigns, lead client communications, and act as the technical owner of campaign...  ...partnering across Sales, Analytics, and Operations. Join a hybrid role based in NYC, collaborating with teams to optimize performance, grow... 
    Suggested

    Sierra Ventures

    New York, NY
    2 days ago
  • $200k

     ...Senior/Staff AI Engineer (NYC) Compensation: [Compensation varies by role — ($200k - $650k) + Equity] Location: New York City — Hybrid / Onsite Join some of NYC’s most ambitious teams...  ...both experimentation and production quality Interest in working closely... 
    Suggested

    People In AI

    New York, NY
    3 days ago
  • $141k - $248k

     ...Hybrid Senior Backend Engineer at Blueflame AI for Datasite Datasite and its associated businesses...  ...role in producing high-quality software solutions to...  ...is a hybrid position in NYC with 3 days in office (Mondays...  ...ownership Experience leading a team or coordinating... 
    Work at office
    Relocation
    3 days per week

    BlueFlame AI, LLC

    New York, NY
    4 days ago
  • Bertelsmann, Inc. is seeking an experienced Partnership Tax Manager to lead day-to-day partnership tax operations in New York, ensuring...  ..., Schedule K-1, ASC 740, and a proven ability to manage complex deadlines in a hybrid NYC office environment. #J-18808-Ljbffr Apply now!
    Work at office

    Apply now!

    New York, NY
    1 day ago
  • Publicis Commerce is seeking a Manager of Ecommerce to lead client strategies and programs across retail media networks with a hybrid New York/Chicago presence. The role emphasizes CPG or shopper marketing agency background, particularly Amazon or Instacart, and cross-... 

    Publicis Groupe Holdings B.V

    New York, NY
    4 days ago
  • A leading staffing agency is looking for a Senior Billing Coordinator to join a prestigious international law firm's finance team in New...  ...position offers a competitive salary, year-end bonuses, and a hybrid work schedule, allowing for three days per week in the office.... 
    Work at office
    3 days per week

    SR Staffing

    New York, NY
    1 day ago
  • AECOM is seeking a Proposal Specialist II to support the NY Metro marketing team in a hybrid role based near New York City. You will lead RFQ/RFP responses across transportation, water, environment/energy, PM/CM, coordinating with graphics and subconsultants. The role requires... 
    Work at office
    1 day per week

    AECO

    New York, NY
    4 days ago
  • Kashable is seeking a Regulatory Compliance Lead to join our growing Compliance team in New York City, offering a hybrid work arrangement. You will oversee consumer complaint handling, licensing activities, vendor due diligence, and risk assessments across regulatory programs... 

    Kashable LLC

    New York, NY
    3 days ago
  • A leading consulting firm in New York is seeking a Senior Talent Management Lead for its Finance, Risk and Restructuring practice. This...  ...services and significant people management experience. It’s a hybrid position requiring in-office presence three days a week. #J-188... 
    Work at office
    3 days per week

    Oliver Wyman

    New York, NY
    5 days ago
  •  ...ML solutions; collaborate with product, engineering and business stakeholders to translate questions...  ...pursuing BS/MS in data science, CS, AI or statistics, with proficiency in...  ...2028 and ability to work full-time in a hybrid NYC #J-18808-Ljbffr New York Life Insurance... 
    Full time
    Internship
    Summer internship

    New York Life Insurance Co

    New York, NY
    2 days ago
  • $144k - $236k

     ...location of this role is hybrid, meaning it will be...  ...team.Responsibilities: AI is at the core of how LinkedIn...  ...a Senior AI Software Engineer you will own end-to-end...  ...efficiency or quality improvement (i.e. inference...  ...teamLeadership: communicate and lead through influence, not... 
    For contractors
    Work at office
    Immediate start
    Flexible hours

    Linkedin

    New York, NY
    2 days ago
  • TheGuarantors is seeking an Engineering Manager to lead a distributed team of 4-6 engineers building landlord-facing products. You’ll guide...  ...APIs, PostgreSQL, Redis, and AWS. Location-based hybrid role in NYC with ownership of renewals and landlord payment capabilities... 

    Jobleads-US

    New York, NY
    2 days ago
  • $145k - $247k

     ...York City office or with our AI Engineering squad in Harbor Point, Baltimore...  ...across the firm. As a Lead Software Engineer on T. Rowe...  ...on architecture, engineering quality, problem solving, and execution...  ...FlexibilityThis role is eligible for hybrid work, with up to three days... 
    Full time
    Work at office
    Local area
    Immediate start
    Remote work
    Work from home
    3 days per week

    T. Rowe Price

    New York, NY
    1 day ago
  •  ...Title :Sr. Salesforce Dev. Location : New York, NY (Hybrid) Responsibilities: • Lead development efforts by example, working with your...  ...design, implement, estimate, and deliver valuable and high-quality software and products alongside our customers. •... 

    A-1 Consulting Inc, Atlanta, GA

    New York, NY
    2 days ago
  • A growing independent media agency is seeking a Media Director to lead multi-channel media strategy and buying. This role, based in a hybrid environment in NYC, will oversee high-profile campaigns with substantial budgets. The ideal candidate has over 8 years in media planning... 

    Gainor Staffing

    New York, NY
    4 days ago
  •  ...seeking a Freelance Executive Producer in New York City to lead production from bid through delivery across broadcast,...  ...production, a broad content background, and a proven network of NYC vendors and partners; a hybrid schedule in NYC is available. Join an award-winning... 
    Freelance

    Day One Perspective, LLC

    New York, NY
    3 days ago
  • SAP SE in New York City leads a high-performing team of senior engineers, data scientists, and AI practitioners embedded in strategic customer environments. As a Director...  ...manager, you own delivery outcomes, technical quality, and team wellbeing while aligning with SAP's... 

    SAP SE

    New York, NY
    4 days ago
  • $104.9k - $218.55k

     ...thinking organization, apply now.We are currently seeking a AI Solutions Engineer - HYBRID to join our team in New York, New York (US-NY), United...  ...through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched... 
    Work at office
    Remote work
    Flexible hours

    NTT DATA

    New York, NY
    5 days ago
  •  ...Industrial Designer (strong staff 2 level) to lead design concepts from ideation through...  ..., prototyping, and collaboration with engineers to create meaningful home goods...  ...rigorous approach to DFM and cost objectives. Hybrid NYC-based position. #J-18808-Ljbffr Fromfolio

    Fromfolio

    New York, NY
    1 day ago
  •  ...Optomi, in partnership with a leading consulting firm, is seeking two Data...  ...and provide recommendations around AI/LLM opportunities. This is not a deep AI engineering role, but rather a data science...  ..., and business impact. This is a hybrid, 12-month contract role. What... 
    Contract work
    Remote work
    2 days per week

    Optomi

    New York, NY
    3 days ago
  • AI Engineer / Intern (Zurich, NYC) Summary This blog post maps closely to what we're looking for. We are open to interns or FTEs for this role. Your...  ...Machine Learning for customer conversations. We support leading B2C brands like OLAPLEX, Unilever, SSENSE, and MARS Inc.... 
    Internship

    Chatdesk

    New York, NY
    3 days ago
  •  ...Position: Gen AI Developer Location: NYC, NY Hybrid work from day one Duration: Long-Term Contract Job Description Software Requirements: Proficiency in programming languages such as Python, R, or SQL Knowledge of data analysis... 
    Long term contract

    Realtech Services

    New York, NY
    2 days ago
  •  ...engagement with court-mandated treatment. You will assess care quality, participate in case conferences, and manage program administration...  ...relevant experience with supervisory duties are required, with CSW/LMSW #J-18808-Ljbffr NYC Department of Health and Mental Hygiene

    NYC Department of Health and Mental Hygiene

    New York, NY
    4 days ago
  •  ...Job Title AI QA Engineer Location Hybrid / Remote Employment Type Full-time Job Summary We are seeking an AI QA Engineer to ensure the quality, reliability, safety, and performance of AI-powered applications and machine... 
    Full time
    Remote work

    Ova Technologies

    New York, NY
    4 days ago
  • KIPP NYC is seeking an Accounts Payable Manager to lead AP operations, ensure timely and accurate vendor payments, and strengthen...  ...and external vendors to deliver high-quality financial services. Based in New York City with a hybrid schedule and travel to campuses in the... 

    Kipp-School

    New York, NY
    3 days ago
  • A leading medical organization in New York City is seeking an experienced Assistant Chief...  ...includes hands-on management with a focus on quality assurance and staff development within a...  ...and strong leadership skills. A hybrid work schedule is offered with requirements... 
    2 days per week

    Lloyd

    New York, NY
    4 days ago
  • $30 per hour

     ...AI Software Engineer — Python, Document Intelligence & AWS NextGen Coding Company Location: New York City — Hybrid / In-Person Required Compensation: $30/hour Hours: 40 Hours/Week...  ...to meet with our team in person in NYC Able to complete a technical engineering... 
    Contract work
    Immediate start
    Remote work
    Visa sponsorship

    NextGen Coding Company

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Quality Engineer Lead - Hybrid NYC. Be the first to apply!