AI Quality Engineer Lead - Hybrid NYC
$70 - $73 per hourRandstad Digital
We are seeking a highly motivated AI Quality Engineering Lead with 8+ years of experience in Quality Engineering, Test Automation, Software Engineering, AI/ML, and Technology Transformation to lead the adoption of AI-powered Quality Engineering capabilities across the Testing Center of Excellence (TCoE).
This is a hands-on technical leadership role responsible for designing, implementing, and scaling enterprise AI solutions that improve software quality, engineering productivity, automation, and SDLC efficiency. The role will drive adoption of Agentic AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Multi-Agent Systems, AI-powered testing solutions, and engineering accelerators while establishing governance, standards, and reusable frameworks for enterprise use.
The AI Quality Engineering Lead will partner closely with Engineering, Architecture, DevOps, Security, Product Teams, and Vendor Partners to accelerate software delivery through AI-first engineering practices while maintaining quality, security, and Responsible AI standards.
Key Responsibilities
Lead enterprise adoption of AI-powered Quality Engineering capabilities across the SDLC.
Define and execute the AI Quality Engineering strategy, roadmap, standards, and governance model.
Design and implement Agentic AI solutions using LangChain, LangGraph, LLMs, RAG, and Multi-Agent architectures.
Develop reusable AI frameworks, accelerators, libraries, reference implementations, and engineering playbooks.
Lead implementation of AI-enabled solutions for:
Requirements analysis
Test case generation
Test automation development
Defect analysis
Traceability validation
Test data generation
Knowledge management
Documentation generation
Quality reporting and analytics
Establish standards for Responsible AI, Human-in-the-Loop controls, AI observability, model evaluation, security, and governance.
Drive integration of AI solutions into DevOps and CI/CD pipelines.
Evaluate emerging AI technologies and establish enterprise adoption recommendations.
Define AI adoption metrics, KPIs, ROI measures, and value realization frameworks.
Provide technical leadership and mentoring to engineering teams adopting AI-first delivery practices.
Collaborate with senior leadership to define and evolve the enterprise AI-enabled Quality Engineering operating model.
Required Skills & Experience
Experience in Test Consulting, Quality Engineering, and Test Automation.
Experience in AI/ML Solution Architecture design to create scalable, enterprise-grade AI systems by selecting optimal models (e.g., LLMs and traditional Machine Learning models), defining data pipelines, and ensuring seamless integration with existing cloud infrastructure and governance frameworks.
Experience in Python, FastAPI framework
Experience in Agentic AI engineering workflow orchestration using LangGraph, LangChain, Large Language Models (LLMs), and AI orchestration frameworks.
Experience in building reusable reference implementations, libraries, accelerators, frameworks, and playbooks for AI/ML-augmented engineering and software delivery.
Experience in Prompt Engineering, Solution Architecture and Design, Retrieval-Augmented Generation (RAG), and Multi-Agent Systems.
Experience with Microservices, API-First Design, and Event-Driven Architecture.
Experience with Docker, Kubernetes, DevOps practices, and CI/CD pipelines.
Experience in Software Architecture, Engineering Transformation, and AI-driven Engineering Solutions.
Strong understanding of Software Development Lifecycle (SDLC), Quality Engineering, and AI-enabled software delivery practices.
Experience establishing AI governance, Responsible AI practices, Human-in-the-Loop controls, security standards, and engineering best practices.
Strong technical leadership, stakeholder management, consulting, and communication skills.
Preferred Skills & Experience
Experience building enterprise Test Automation Frameworks and reusable automation accelerators.
Experience in AI observability, monitoring, model evaluation, and operational monitoring frameworks.
Experience in automated documentation generation and release management solutions.
Experience in engineering governance, standards, operating models, and AI-first engineering practices.
Experience in technical consulting and stakeholder management.
Experience with Microsoft Azure AI, OpenAI, Azure AI Search and cloud-native AI platforms.
Experience leading engineering transformation and AI adoption initiatives.
Required Experience
8+ years of experience in Quality Engineering, Software Engineering, Test Automation, AI/ML, or Enterprise Technology Delivery.
3+ years of experience designing and implementing AI/ML, GenAI, or Agentic AI solutions.
Proven experience leading enterprise-scale technical initiatives and cross-functional teams.
Experience defining architecture standards, governance frameworks, and reusable engineering solutions.
Education and Qualifications
Bachelor's Degree or higher in Computer Science, Engineering, Information Systems, Data Science, Artificial Intelligence, or a related field.
Advanced AI/ML, Cloud, or Architecture certifications preferred.
Strong software engineering and solution architecture background preferred.
What Success Looks Like
AI-powered Quality Engineering solutions are successfully adopted across TCoE programs and delivery teams.
Reusable AI agents, frameworks, accelerators, and reference architectures are established and broadly utilized across the organization.
Measurable improvements are achieved in testing productivity, automation efficiency, software quality, and delivery velocity.
Responsible AI, security, governance, observability, and Human-in-the-Loop controls are consistently implemented.
Leadership has clear visibility into AI adoption, business value, risk management, and ROI.
location: New York, New York job type: Contract salary: $70 - 73 per hour work hours: 9am to 5pm education: Bachelors responsibilities:We are seeking a highly motivated AI Quality Engineering Lead with 8+ years of experience in Quality Engineering, Test Automation, Software Engineering, AI/ML, and Technology Transformation to lead the adoption of AI-powered Quality Engineering capabilities across the Testing Center of Excellence (TCoE).
This is a hands-on technical leadership role responsible for designing, implementing, and scaling enterprise AI solutions that improve software quality, engineering productivity, automation, and SDLC efficiency. The role will drive adoption of Agentic AI , Large Language Models (LLMs) , Retrieval-Augmented Generation (RAG) , Multi-Agent Systems , AI-powered testing solutions, and engineering accelerators while establishing governance, standards, and reusable frameworks for enterprise use.
The AI Quality Engineering Lead will partner closely with Engineering, Architecture, DevOps, Security, Product Teams, and Vendor Partners to accelerate software delivery through AI-first engineering practices while maintaining quality, security, and Responsible AI standards.
Key Responsibilities
- Lead enterprise adoption of AI-powered Quality Engineering capabilities across the SDLC.
- Define and execute the AI Quality Engineering strategy, roadmap, standards, and governance model .
- Design and implement Agentic AI solutions using LangChain, LangGraph, LLMs, RAG, and Multi-Agent architectures.
- Develop reusable AI frameworks, accelerators, libraries, reference implementations, and engineering playbooks .
- Lead implementation of AI-enabled solutions for:
- Requirements analysis
- Test case generation
- Test automation development
- Defect analysis
- Traceability validation
- Test data generation
- Knowledge management
- Documentation generation
- Quality reporting and analytics
- Establish standards for Responsible AI , Human-in-the-Loop controls, AI observability, model evaluation, security, and governance.
- Drive integration of AI solutions into DevOps and CI/CD pipelines .
- Evaluate emerging AI technologies and establish enterprise adoption recommendations.
- Define AI adoption metrics, KPIs, ROI measures, and value realization frameworks .
- Provide technical leadership and mentoring to engineering teams adopting AI-first delivery practices.
- Collaborate with senior leadership to define and evolve the enterprise AI-enabled Quality Engineering operating model.
- ...Job Summary for AI Quality Engineering Lead - Lead the enterprise adoption of AI-powered Quality Engineering solutions across the Software Development Lifecycle (SDLC) and Testing Center of Excellence (TCoE). - Define and execute strategies, roadmaps, standards...Suggested
Expert Technology Services
New York, NY1 day ago - ...account planning with revenue growth, and engaging senior partners across integrated marketing and product teams. The position requires 5-7 years in digital media sales, strong negotiation, and autonomy, with a hybrid schedule based in NYC. #J-18808-Ljbffr Red VenturesSuggested
- ...in New York City. You will own live programmatic campaigns, lead client communications, and act as the technical owner of campaign... ...partnering across Sales, Analytics, and Operations. Join a hybrid role based in NYC, collaborating with teams to optimize performance, grow...Suggested
- ...between clients and internal teams to ensure alignment with business priorities and deliver measurable outcomes. In this hybrid NYC role, you’ll lead business reviews, identify expansion opportunities, and coordinate across support, delivery, cybersecurity, and sales to...Suggested
- ...seeking a Senior Client Success Manager to build strategic partnerships and manage 5-7 high-value enterprise accounts in a hybrid role based in NYC. This position emphasizes proactive engagement and transforming frontline insights into product intelligence. The ideal...Suggested
- ...York seeks an experienced Billing & Credentialing Manager for a hybrid role. Responsibilities include managing billing and collections,... ...years of medical billing experience, preferably in primary care in NYC. Bonuses include competitive salary and a supportive remote work...Remote work
- ...Clever is seeking a proactive Workplace Manager & Executive Assistant to support the CEO and Global President and own the NYC office experience. This hybrid, full-time role places you at the center of our fast-moving fintech scale-up, coordinating complex calendars, travel,...Full timeWork at office
- Raydar, a consumer AI startup, is hiring an AI Engineer to own the conversational intelligence layer end to end. You will transform LLM capabilities into reliable product behavior across agent loops, prompt architecture, tool calling, state, memory, streaming, and error...
- ...practice supporting Financial Services clients. This is a hybrid role based in NYC combining: hands-on GCP implementation What you’ll do: Work... ...solutions Support solutioning and pre‑sales discussions Lead cloud migration and modernization efforts Partner with global...Full time
- A leading consulting firm in New York is seeking a Senior Talent Management Lead for its Finance, Risk and Restructuring practice. This... ...services and significant people management experience. It’s a hybrid position requiring in-office presence three days a week. #J-188...Work at office3 days per week
- A leading staffing agency is looking for a Senior Billing Coordinator to join a prestigious international law firm's finance team in New... ...position offers a competitive salary, year-end bonuses, and a hybrid work schedule, allowing for three days per week in the office....Work at office3 days per week
- Amer Sports is seeking a Manager, OneStream Administrator for its NYC or Chicago office. You will lead global OneStream administration, development, and governance to translate finance needs into scalable platform solutions. The role requires SOX controls, cross‑functional...Work at office
- ...Account Supervisor for our dynamic Sports PR practice. You will lead client programs, manage multiple campaigns and serve as the primary... ...writing and relationship-building skills. This role offers a hybrid schedule with opportunities to shape high-profile campaigns. #J...
- Bertelsmann, Inc. is seeking an experienced Partnership Tax Manager to lead day-to-day partnership tax operations in New York, ensuring... ..., Schedule K-1, ASC 740, and a proven ability to manage complex deadlines in a hybrid NYC office environment. #J-18808-Ljbffr Apply now!Work at office
- the company LLC, a subsidiary of Capital One, N.A., is seeking a Risk & Compliance Lead in New York City. The role is hybrid, with three in-office days (Mon, Wed, Thu) and up to four weeks of fully remote work annually. You will drive regulatory compliance programs, partner...Work at officeRemote work
- AECOM is seeking a Proposal Specialist II to support the NY Metro marketing team in a hybrid role based near New York City. You will lead RFQ/RFP responses across transportation, water, environment/energy, PM/CM, coordinating with graphics and subconsultants. The role requires...Work at office1 day per week
- ...across product, sales, brand marketing, and revenue operations. This role also leads GTM pipeline programs and trains revenue teams on product configurations. You will act as the local expert for NYC-based Sellers and Account Strategists, translating complex ad product...Local area
$144k - $236k
...location of this role is hybrid, meaning it will be... ...Responsibilities: AI is at the core of how LinkedIn... ...a Senior AI Software Engineer you will own end-to-end... ...efficiency or quality improvement (i.e. inference... ...Leadership: communicate and lead through influence, not...Full timeFor contractorsWork at officeImmediate startFlexible hoursLinkedin
New York, NYa month ago- ...Director, Analytics in New York City. You will build and lead a team of data analysts, turning insights into... ...talent and elevating the agency’s analytics capabilities. Hybrid work is expected, with 2-3 days in the NYC office. The ideal candidate has extensive experience...Work at office
- A growing independent media agency is seeking a Media Director to lead multi-channel media strategy and buying. This role, based in a hybrid environment in NYC, will oversee high-profile campaigns with substantial budgets. The ideal candidate has over 8 years in media planning...
- ...seeking a Freelance Executive Producer in New York City to lead production from bid through delivery across broadcast,... ...production, a broad content background, and a proven network of NYC vendors and partners; a hybrid schedule in NYC is available. Join an award-winning...Freelance
- TheGuarantors, a fintech leader in renter underwriting, seeks a Data Engineer in a hybrid NYC role. You will build, optimize, and maintain data pipelines, ensure data availability for analytics, and support AI/ML workflows. This role emphasizes collaboration with data...
- Catch Talent in New York invites a Senior Data Engineer to design and build scalable data pipelines, AI/ML workflows, and data models powering a world-class... ...Airflow and cloud data warehouses in a high-performance, hybrid NYC office environment. #J-18808-Ljbffr Catch TalentWork at office
- ...Industrial Designer (strong staff 2 level) to lead design concepts from ideation through... ..., prototyping, and collaboration with engineers to create meaningful home goods... ...rigorous approach to DFM and cost objectives. Hybrid NYC-based position. #J-18808-Ljbffr Fromfolio
- ...Job Description Job Description We are hiring Sr. Generative AI (GenAI) Software Engineer - hybrid - onsite 10-12 days a month for a Full Time position in New York, NY "Applicants must be currently authorized to work in the United States on a full-time basis. The...Full timeWork at officeVisa sponsorshipWork visaFlexible hours
Calance US
New York, NY15 days ago $119k - $192.5k
...infrastructure that powers the global economy. As a leading provider of market infrastructure and... ...is looking for an experienced software engineer who is excited about combining strong... ...~ Paid Time Off #LI-CP2 #LI-Hybrid More About Cboe Global Markets We...Full timeWork at office- ...engagement with court-mandated treatment. You will assess care quality, participate in case conferences, and manage program administration... ...relevant experience with supervisory duties are required, with CSW/LMSW #J-18808-Ljbffr NYC Department of Health and Mental Hygiene
- A leading medical organization in New York City is seeking an experienced Assistant Chief... ...includes hands-on management with a focus on quality assurance and staff development within a... ...and strong leadership skills. A hybrid work schedule is offered with requirements...2 days per week
$150k - $250k
..., we're solving grocery food waste with AI. We forecast exactly how much of each product... ...to 7‑figures in ARR. We're backed by leading investors including Y Combinator, 1984... ...technology. We're looking for talented data engineers in NYC to join our mission. About the Role As...Work at office- Blossom Health is seeking an experienced software engineer to build AI-native product experiences for clinicians and patients in a fast-growing... ...workflows in a highly autonomous, high-trust environment in NYC, collaborating with clinicians and engineers to maximize real...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Quality Engineer Lead - Hybrid NYC. Be the first to apply!
- ai engineer New York, NY
- ai research engineer New York, NY
- ai engineer remote New York, NY
- ai prompt engineer New York, NY
- ai developer New York, NY
- senior ai engineer New York, NY
- machine learning ai engineer New York, NY
- ai ml engineer New York, NY
- advanced quality engineer New York, NY
- senior quality engineer New York, NY