Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Quality Engineer Lead - Hybrid NYC

$70 - $73 per hour
job summary:
We are seeking a highly motivated AI Quality Engineering Lead with 8+ years of experience in Quality Engineering, Test Automation, Software Engineering, AI/ML, and Technology Transformation to lead the adoption of AI-powered Quality Engineering capabilities across the Testing Center of Excellence (TCoE).

This is a hands-on technical leadership role responsible for designing, implementing, and scaling enterprise AI solutions that improve software quality, engineering productivity, automation, and SDLC efficiency. The role will drive adoption of Agentic AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Multi-Agent Systems, AI-powered testing solutions, and engineering accelerators while establishing governance, standards, and reusable frameworks for enterprise use.

The AI Quality Engineering Lead will partner closely with Engineering, Architecture, DevOps, Security, Product Teams, and Vendor Partners to accelerate software delivery through AI-first engineering practices while maintaining quality, security, and Responsible AI standards.

Key Responsibilities

Lead enterprise adoption of AI-powered Quality Engineering capabilities across the SDLC.

Define and execute the AI Quality Engineering strategy, roadmap, standards, and governance model.

Design and implement Agentic AI solutions using LangChain, LangGraph, LLMs, RAG, and Multi-Agent architectures.

Develop reusable AI frameworks, accelerators, libraries, reference implementations, and engineering playbooks.

Lead implementation of AI-enabled solutions for:

Requirements analysis

Test case generation

Test automation development

Defect analysis

Traceability validation

Test data generation

Knowledge management

Documentation generation

Quality reporting and analytics

Establish standards for Responsible AI, Human-in-the-Loop controls, AI observability, model evaluation, security, and governance.

Drive integration of AI solutions into DevOps and CI/CD pipelines.

Evaluate emerging AI technologies and establish enterprise adoption recommendations.

Define AI adoption metrics, KPIs, ROI measures, and value realization frameworks.

Provide technical leadership and mentoring to engineering teams adopting AI-first delivery practices.

Collaborate with senior leadership to define and evolve the enterprise AI-enabled Quality Engineering operating model.

Required Skills & Experience

Experience in Test Consulting, Quality Engineering, and Test Automation.

Experience in AI/ML Solution Architecture design to create scalable, enterprise-grade AI systems by selecting optimal models (e.g., LLMs and traditional Machine Learning models), defining data pipelines, and ensuring seamless integration with existing cloud infrastructure and governance frameworks.

Experience in Python, FastAPI framework

Experience in Agentic AI engineering workflow orchestration using LangGraph, LangChain, Large Language Models (LLMs), and AI orchestration frameworks.

Experience in building reusable reference implementations, libraries, accelerators, frameworks, and playbooks for AI/ML-augmented engineering and software delivery.

Experience in Prompt Engineering, Solution Architecture and Design, Retrieval-Augmented Generation (RAG), and Multi-Agent Systems.

Experience with Microservices, API-First Design, and Event-Driven Architecture.

Experience with Docker, Kubernetes, DevOps practices, and CI/CD pipelines.

Experience in Software Architecture, Engineering Transformation, and AI-driven Engineering Solutions.

Strong understanding of Software Development Lifecycle (SDLC), Quality Engineering, and AI-enabled software delivery practices.

Experience establishing AI governance, Responsible AI practices, Human-in-the-Loop controls, security standards, and engineering best practices.

Strong technical leadership, stakeholder management, consulting, and communication skills.

Preferred Skills & Experience

Experience building enterprise Test Automation Frameworks and reusable automation accelerators.

Experience in AI observability, monitoring, model evaluation, and operational monitoring frameworks.

Experience in automated documentation generation and release management solutions.

Experience in engineering governance, standards, operating models, and AI-first engineering practices.

Experience in technical consulting and stakeholder management.

Experience with Microsoft Azure AI, OpenAI, Azure AI Search and cloud-native AI platforms.

Experience leading engineering transformation and AI adoption initiatives.

Required Experience

8+ years of experience in Quality Engineering, Software Engineering, Test Automation, AI/ML, or Enterprise Technology Delivery.

3+ years of experience designing and implementing AI/ML, GenAI, or Agentic AI solutions.

Proven experience leading enterprise-scale technical initiatives and cross-functional teams.

Experience defining architecture standards, governance frameworks, and reusable engineering solutions.

Education and Qualifications

Bachelor's Degree or higher in Computer Science, Engineering, Information Systems, Data Science, Artificial Intelligence, or a related field.

Advanced AI/ML, Cloud, or Architecture certifications preferred.

Strong software engineering and solution architecture background preferred.

What Success Looks Like

AI-powered Quality Engineering solutions are successfully adopted across TCoE programs and delivery teams.

Reusable AI agents, frameworks, accelerators, and reference architectures are established and broadly utilized across the organization.

Measurable improvements are achieved in testing productivity, automation efficiency, software quality, and delivery velocity.

Responsible AI, security, governance, observability, and Human-in-the-Loop controls are consistently implemented.

Leadership has clear visibility into AI adoption, business value, risk management, and ROI.

 
location: New York, New York
job type: Contract
salary: $70 - 73 per hour
work hours: 9am to 5pm
education: Bachelors

responsibilities:
We are seeking a highly motivated AI Quality Engineering Lead with 8+ years of experience in Quality Engineering, Test Automation, Software Engineering, AI/ML, and Technology Transformation to lead the adoption of AI-powered Quality Engineering capabilities across the Testing Center of Excellence (TCoE).

This is a hands-on technical leadership role responsible for designing, implementing, and scaling enterprise AI solutions that improve software quality, engineering productivity, automation, and SDLC efficiency. The role will drive adoption of Agentic AI , Large Language Models (LLMs) , Retrieval-Augmented Generation (RAG) , Multi-Agent Systems , AI-powered testing solutions, and engineering accelerators while establishing governance, standards, and reusable frameworks for enterprise use.

The AI Quality Engineering Lead will partner closely with Engineering, Architecture, DevOps, Security, Product Teams, and Vendor Partners to accelerate software delivery through AI-first engineering practices while maintaining quality, security, and Responsible AI standards.

Key Responsibilities

  • Lead enterprise adoption of AI-powered Quality Engineering capabilities across the SDLC.
  • Define and execute the AI Quality Engineering strategy, roadmap, standards, and governance model .
  • Design and implement Agentic AI solutions using LangChain, LangGraph, LLMs, RAG, and Multi-Agent architectures.
  • Develop reusable AI frameworks, accelerators, libraries, reference implementations, and engineering playbooks .
  • Lead implementation of AI-enabled solutions for:
    • Requirements analysis
    • Test case generation
    • Test automation development
    • Defect analysis
    • Traceability validation
    • Test data generation
    • Knowledge management
    • Documentation generation
    • Quality reporting and analytics
  • Establish standards for Responsible AI , Human-in-the-Loop controls, AI observability, model evaluation, security, and governance.
  • Drive integration of AI solutions into DevOps and CI/CD pipelines .
  • Evaluate emerging AI technologies and establish enterprise adoption recommendations.
  • Define AI adoption metrics, KPIs, ROI measures, and value realization frameworks .
  • Provide technical leadership and mentoring to engineering teams adopting AI-first delivery practices.
  • Collaborate with senior leadership to define and evolve the enterprise AI-enabled Quality Engineering operating model.
Required Skills & Experience

  • Experience in Test Consulting, Quality Engineering, and Test Automation .
  • Experience in AI/ML Solution Architecture design to create scalable, enterprise-grade AI systems by selecting optimal models (e.g., LLMs and traditional Machine Learning models), defining data pipelines, and ensuring seamless integration with existing cloud infrastructure and governance frameworks.
  • Experience in Python , FastAPI framework
  • Experience in Agentic AI engineering workflow orchestration using LangGraph, LangChain, Large Language Models (LLMs), and AI orchestration frameworks.
  • Experience in building reusable reference implementations, libraries, accelerators, frameworks, and playbooks for AI/ML-augmented engineering and software delivery.
  • Experience in Prompt Engineering, Solution Architecture and Design, Retrieval-Augmented Generation (RAG), and Multi-Agent Systems .
  • Experience with Microservices, API-First Design, and Event-Driven Architecture .
  • Experience with Docker, Kubernetes, DevOps practices, and CI/CD pipelines .
  • Experience in Software Architecture, Engineering Transformation, and AI-driven Engineering Solutions .
  • Strong understanding of Software Development Lifecycle (SDLC) , Quality Engineering, and AI-enabled software delivery practices.
  • Experience establishing AI governance, Responsible AI practices, Human-in-the-Loop controls, security standards, and engineering best practices .
  • Strong technical leadership, stakeholder management, consulting, and communication skills.
Preferred Skills & Experience

  • Experience building enterprise Test Automation Frameworks and reusable automation accelerators.
  • Experience in AI observability, monitoring, model evaluation, and operational monitoring frameworks .
  • Experience in automated documentation generation and release management solutions .
  • Experience in engineering governance, standards, operating models, and AI-first engineering practices .
  • Experience in technical consulting and stakeholder management .
  • Experience with Microsoft Azure AI, OpenAI, Azure AI Search and cloud-native AI platforms .
  • Experience leading engineering transformation and AI adoption initiatives .
Required Experience

  • 8+ years of experience in Quality Engineering, Software Engineering, Test Automation, AI/ML, or Enterprise Technology Delivery.
  • 3+ years of experience designing and implementing AI/ML, GenAI, or Agentic AI solutions.
  • Proven experience leading enterprise-scale technical initiatives and cross-functional teams.
  • Experience defining architecture standards, governance frameworks, and reusable engineering solutions.
Education and Qualifications

  • Bachelor's Degree or higher in Computer Science, Engineering, Information Systems, Data Science, Artificial Intelligence, or a related field.
  • Advanced AI/ML, Cloud, or Architecture certifications preferred.
  • Strong software engineering and solution architecture background preferred.
What Success Looks Like

  • AI-powered Quality Engineering solutions are successfully adopted across TCoE programs and delivery teams .
  • Reusable AI agents, frameworks, accelerators, and reference architectures are established and broadly utilized across the organization.
  • Measurable improvements are achieved in testing productivity, automation efficiency, software quality, and delivery velocity .
  • Responsible AI , security, governance, observability, and Human-in-the-Loop controls are consistently implemented.
  • Leadership has clear visibility into AI adoption, business value, risk management, and ROI .
qualifications:
Education and Qualifications

Bachelor's Degree or higher in Computer Science, Engineering, Information Systems, Data Science, Artificial Intelligence, or a related field.

Advanced AI/ML, Cloud, or Architecture certifications preferred.

Strong software engineering and solution architecture background preferred.

What Success Looks Like

AI-powered Quality Engineering solutions are successfully adopted across TCoE programs and delivery teams.

Reusable AI agents, frameworks, accelerators, and reference architectures are established and broadly utilized across the organization.

Measurable improvements are achieved in testing productivity, automation efficiency, software quality, and delivery velocity.

Responsible AI, security, governance, observability, and Human-in-the-Loop controls are consistently implemented.

Leadership has clear visibility into AI adoption, business value, risk management, and ROI.

skills:
AI platforms,API-First,reusable frameworks,AI solutions,AI,AI frameworks,AI-enabled solutions,integration of AI,emerging AI technologies,AI-enabled,Artificial Intelligence,Advanced AI,Test automation,cloud infrastructure,Cloud,cloud-native,CI/CD pipelines,data generation,data pipelines,DevOps,DevOps practices,Docker,Enterprise Technology,Event-Driven Architecture,FastAPI,Retrieval-Augmented Generation (RAG),Information Systems,Computer Science,Knowledge management,Kubernetes,Large Language Models,LLMs,Machine Learning models,Microservices,Microsoft Azure,Azure,model evaluation,Multi-Agent Systems,Multi-Agent,AI orchestration,Prompt Engineering,Python,release management,AI Search,Software Architecture,Software Development Lifecycle,Software Engineering,software quality,Test Automation Frameworks,SDLC,Test case,Agentic AI,communication skills,leadership,Architecture,architecture standards,automation,automated,software engineering,software quality,Consulting,Responsible AI,Data Science,validation Test,Defect analysis,governance,governance frameworks,AI governance,AI systems,mentoring,metrics,operating model,operating models,automation efficiency,Quality reporting,Quality Engineering,reference architectures,Requirements analysis,risk management,Security,Solution Architecture design,Solution Architecture,stakeholder management,technical consulting,technical leadership,testing,Traceability,business value


Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact View email address on us.fitly.work.




Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.



Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Quality Engineer Lead - Hybrid NYC in New York, NY vacancy
  •  ...Job Summary for AI Quality Engineering Lead - Lead the enterprise adoption of AI-powered Quality Engineering solutions across the Software Development Lifecycle (SDLC) and Testing Center of Excellence (TCoE). - Define and execute strategies, roadmaps, standards... 
    Suggested

    Expert Technology Services

    New York, NY
    3 days ago
  •  ...in New York City. You will own live programmatic campaigns, lead client communications, and act as the technical owner of campaign...  ...partnering across Sales, Analytics, and Operations. Join a hybrid role based in NYC, collaborating with teams to optimize performance, grow... 
    Suggested

    Sierra Ventures

    New York, NY
    6 days ago
  •  ...seeking a Senior Client Success Manager to build strategic partnerships and manage 5-7 high-value enterprise accounts in a hybrid role based in NYC. This position emphasizes proactive engagement and transforming frontline insights into product intelligence. The ideal... 
    Suggested

    PulseRise Technologies

    New York, NY
    4 days ago
  • Raydar, a consumer AI startup, is hiring an AI Engineer to own the conversational intelligence layer end to end. You will transform LLM capabilities into reliable product behavior across agent loops, prompt architecture, tool calling, state, memory, streaming, and error... 
    Suggested

    Raydar

    New York, NY
    3 days ago
  • $144k - $236k

     ...location of this role is hybrid, meaning it will be...  ...Responsibilities:  AI is at the core of how LinkedIn...  ...a Senior AI Software Engineer you will own end-to-end...  ...efficiency or quality improvement (i.e. inference...  ...Leadership: communicate and lead through influence, not... 
    Suggested
    Full time
    For contractors
    Work at office
    Immediate start
    Flexible hours

    Linkedin

    New York, NY
    1 day ago
  •  ...practice supporting Financial Services clients. This is a hybrid role based in NYC combining: hands-on GCP implementation What you’ll do: Work...  ...solutions Support solutioning and pre‑sales discussions Lead cloud migration and modernization efforts Partner with global... 
    Full time

    Capgemini

    New York, NY
    6 days ago
  • A leading consulting firm in New York is seeking a Senior Talent Management Lead for its Finance, Risk and Restructuring practice. This...  ...services and significant people management experience. It’s a hybrid position requiring in-office presence three days a week. #J-188... 
    Work at office
    3 days per week

    Oliver Wyman

    New York, NY
    4 days ago
  •  ...Account Supervisor for our dynamic Sports PR practice. You will lead client programs, manage multiple campaigns and serve as the primary...  ...writing and relationship-building skills. This role offers a hybrid schedule with opportunities to shape high-profile campaigns. #J... 

    Dan Klores Communications

    New York, NY
    4 days ago
  • $144k - $236k

     ...location of this role is hybrid, meaning it will be...  ...team.Responsibilities: AI is at the core of how LinkedIn...  ...a Senior AI Software Engineer you will own end-to-end...  ...efficiency or quality improvement (i.e. inference...  ...teamLeadership: communicate and lead through influence, not... 
    For contractors
    Work at office
    Immediate start
    Flexible hours

    Linkedin

    New York, NY
    1 day ago
  • Amer Sports is seeking a Manager, OneStream Administrator for its NYC or Chicago office. You will lead global OneStream administration, development, and governance to translate finance needs into scalable platform solutions. The role requires SOX controls, cross‑functional... 
    Work at office

    Moventas Wind Ltd

    New York, NY
    6 days ago
  •  ...to minimize risk while guiding contract strategy and negotiations. Ideal candidates hold a JD with NY bar admission and bring 12+ years in construction law, including leadership. Hybrid work is possible, and sponsorship is not offered. #J-18808-Ljbffr Jobleads-US
    Contract work

    Jobleads-US

    New York, NY
    4 days ago
  • $145k - $247k

     ...York City office or with our AI Engineering squad in Harbor Point, Baltimore...  ...across the firm. As a Lead Software Engineer on T. Rowe...  ...on architecture, engineering quality, problem solving, and execution...  ...FlexibilityThis role is eligible for hybrid work, with up to three days... 
    Full time
    Work at office
    Local area
    Immediate start
    Remote work
    Work from home
    3 days per week

    T. Rowe Price

    New York, NY
    4 days ago
  •  ...seeking a Freelance Executive Producer in New York City to lead production from bid through delivery across broadcast,...  ...production, a broad content background, and a proven network of NYC vendors and partners; a hybrid schedule in NYC is available. Join an award-winning... 
    Freelance

    Day One Perspective, LLC

    New York, NY
    2 days ago
  •  ...Director, Analytics in New York City. You will build and lead a team of data analysts, turning insights into...  ...talent and elevating the agency’s analytics capabilities. Hybrid work is expected, with 2-3 days in the NYC office. The ideal candidate has extensive experience... 
    Work at office

    VaynerMedia

    New York, NY
    4 days ago
  • $104.9k - $218.55k

     ...thinking organization, apply now.We are currently seeking a AI Solutions Engineer - HYBRID to join our team in New York, New York (US-NY), United...  ...through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched... 
    Work at office
    Remote work
    Flexible hours

    NTT DATA

    New York, NY
    4 days ago
  • $342.7k

     ...09/24/2026This position is a hybrid role, requiring the employee to...  ...we are building best-in-class AI capabilities into our platform...  ...are looking for a Distinguished Engineer with outstanding technical...  ...LLM).Demonstrated experience in leading impactful AI product development... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    CISCO Systems

    New York, NY
    a month ago
  • $140k - $180k

     ...successful candidate will automate complex legal workflows, build AI-driven solutions, and collaborate with engineers to innovate in the legal tech space. Offering a salary range of $140,000 - $180,000, a hybrid working model, and opportunities for personal development,... 

    Orbital.

    New York, NY
    4 days ago
  • KIPP NYC is seeking an Accounts Payable Manager to lead AP operations, ensure timely and accurate vendor payments, and strengthen...  ...and external vendors to deliver high-quality financial services. Based in New York City with a hybrid schedule and travel to campuses in the... 

    Kipp-School

    New York, NY
    2 days ago
  •  ...Job Description Job Description We are hiring Sr. Generative AI (GenAI) Software Engineer - hybrid - onsite 10-12 days a month for a Full Time position in New York, NY "Applicants must be currently authorized to work in the United States on a full-time basis. The... 
    Full time
    Work at office
    Visa sponsorship
    Work visa
    Flexible hours

    Calance US

    New York, NY
    10 days ago
  • Java Developer Location: New York (Hybrid 3 days onsite) Duration: 12+ Months Rate: $50/hr...  ...Strong understanding of: Performance Engineering Design Principles & Design Skills Excellent...  ...Financial Services industry projects Exposure to AI-assisted development tools such as... 
    Remote job

    Staffing the Universe

    New York, NY
    2 days ago
  • $147.5k - $211k

    Location Designation: Hybrid - 3 days per week Business UnitTechnology, Data, AI and Ventures (TDAV)Business Unit OverviewWithin...  ...an industry leader, access to leading-edge technologies and the...  ...Vice President, Enterprise Quality Engineering to lead the transformation of... 
    Local area
    3 days per week

    New York Life Insurance Company

    New York, NY
    5 hours ago
  •  ...is seeking a Technical Recruiter for our NYC office to own full-cycle hiring across software...  ...roles. You’ll partner with the VP of Engineering and CTO to shape headcount and process...  ...managers on interviewing, drive fast, high-quality offers, and represent Mercor to top... 
    Work at office

    Mercor Inc

    New York, NY
    6 days ago
  • $180k - $240k

     ...Forward Deployed Software Engineer — US / NYC About Indicium AI Indicium AI was Anthropic’s first European...  ...data pipelines, vector search, and hybrid RAG layers over Lakehouse...  ...run daily requirements discovery, lead architecture reviews, and rapidly ship... 
    Full time
    Flexible hours

    Indicium Ai

    New York, NY
    1 day ago
  •  ...We're a team of ex-Google engineers who built some of the largest defensive platforms on the planet - Safe Browsing and reCAPTCHA . Now...  ...an even bigger challenge: stopping the new wave of adversarial AI attacks already hitting organizations today. We're still in... 
    Full time
    Flexible hours

    Aegis Ai

    New York, NY
    1 day ago
  • $180k - $250k

    Our client, an early-stage AI startup, are hiring a Founding Applied AI Engineer to join their team in New York. The successful candidate will design and build...  ...ML and recommender systems, with pre-LLM or hybrid systems experience strongly preferred. ~Experience... 
    Full time

    Alldus International Consulting Ltd

    New York, NY
    more than 2 months ago
  •  ...is recruiting a Talent Manager to build and lead the recruiting function, scaling a team of...  ...specialized roles, drive strategy, and ensure a high-quality candidate experience as the company scales its New York City presence in a hybrid work environment. #J-18808-Ljbffr Socket.... 

    Socket.dev

    New York, NY
    4 days ago
  •  ...Associate Director of Business Development for Finance and Project Development & Finance. You will shape BD strategy across practices, lead, and advise partners on client acquisition, account growth, and retention, using market insights to drive strategic initiatives and... 

    White & Case LLP

    New York, NY
    6 days ago
  • A leading consulting firm is seeking an experienced professional for a mid-senior level HR category sourcing position....  ...experience and strong contract negotiation skills. This position offers a hybrid work model and is based in the NYC Metro Area. #J-18808-Ljbffr Confidential Jobs
    Contract work

    Confidential Jobs

    New York, NY
    4 days ago
  • Eliassen Group in New York, NY seeks a client-facing professional to manage inquiries and translate complex information into clear messaging. This contract-to-hire role requires proactive communication and cross-functional collaboration to deliver seamless client support...
    Contract work

    Eliassen Group

    New York, NY
    2 days ago
  •  ...Group seeks a seasoned Disaster Recovery & BCP Lead for a long-term consulting role. You will own...  ...across a complex technology environment. Hybrid role, 3 days onsite; must be commutable to Warren, NJ, Westport, CT, or NYC. You will partner with infrastructure, applications... 

    The Connors Group

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Quality Engineer Lead - Hybrid NYC. Be the first to apply!