Head of AI Quality, Assurance and Evaluation
$226.18k - $353.4kAgilent Technologies
- # Head of AI Quality, Assurance and EvaluationApplylocations: Spain-Barcelona: US-CA-Santa Claratime type: Full timeposted on: Posted Todayjob requisition id: 4039086## **Job Description**Agilent inspires and supports discoveries that advance the quality of life by providing life science, diagnostic, and applied market laboratories worldwide with instruments, services, consumables, applications, and both measurement and asset management expertise.Owns trustworthy deployment of AI in the enterprise. Design-in risk management, evaluation, compliance, and other required constraints into the Enterprise AI solutions development and deployment stack.Ensure the required technological capabilities across four pillars: Data Substrate (lineage at ingest), Data Plane (semantic grounding), Agentic plane (evaluation and observability), and Activation (risk-tiered human-in-the-loop). This role exists to make safe deployment fast by leveraging technology to enable quality, regulatory, risk, and other guardrails. For example, leveraging Eval gates to replace manual reviews; auditability instead of after-the-fact forensics.**Responsible for** :* Responsible for developing and operationalizing responsible and trustworthy AI practices by designing and implementing risk-based governance frameworks, evaluation methodologies, and compliance controls that enable the safe, scalable, and efficient deployment of AI models, agents, and applications.* Conducts AI risk, bias, transparency, privacy, and compliance assessments; establishes audit-ready evaluation frameworks, monitoring, and observability standards; and translates legal, quality, security, privacy, and regulatory requirements into measurable and testable controls throughout the AI lifecycle.* Collaborates closely with cross-functional teams, including engineering, data science, product, legal, quality, and compliance stakeholders, to embed responsible AI principles into development workflows, ensure audit readiness, and mitigate ethical and operational risks.* Ensure technical architecture fit for Audit and policy via Eval suites and observability, benchmark sets, regression gates for promotion, and production observability for deployed agents, built on the shared eval harness operated with Harness Engineering.* Develops policies, standards, documentation, and training programs to promote ethical AI awareness, supports governance reviews and technical discussions, and drives continuous improvement of AI deployment practices to deliver trustworthy, compliant, and business-enabling AI solutions.## ## **Qualifications*** Experience building or operating ML/LLM evaluation infrastructure in production, not only authoring policy.* Working knowledge of regulated computerized systems; GxP, Part 11, or equivalent validation experience strongly preferred.* The credibility to be trusted by both engineers and compliance officers, and the translation skill to keep them out of each other's way.* Curiosity about AI, its potential and its pitfalls. The field moves monthly, and the people who thrive here are genuinely curious about both sides of it: what these systems can newly do, and where they fail, mislead, or quietly degrade. We want people who read the failure analyses as eagerly as the launch posts, who experiment on their own initiative, and who hold excitement and skepticism at the same time without letting either one win permanently.* Lifelong learners. Whatever expertise a candidate arrives with will be partially obsolete within a year, and that is not a defect of the candidate; it is the condition of the field. We hire people who have reinvented their toolkit before and expect to do it again, who learn in public, and who treat being wrong as information rather than injury. A history of deliberate self-reinvention counts for more than any single credential.* Excellent communication and the ability to influence. Nothing in this organization ships by authority alone. Every role here persuades: domain experts to engage, stewards to share what they know, sponsors to stay honest about value, and functions like Legal, Quality, and Security to move from gatekeeping to partnership. We look for people who write and speak clearly, who adapt their register from bench scientist to Board, and who change minds through credibility and clarity rather than escalation* Bachelor's or Master's Degree or equivalent.* Post-graduate, certification, and/or license may be required.* Typically, at least 10+ years relevant experience for entry to this level.The full-time equivalent pay range for this position when based in Santa Clara, CA, USA is $226.176,00 - $353.400,00/yr plus eligibility for bonus, stock and benefits. Our pay ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. During the hiring process, a recruiter can share more about the specific pay range for a preferred location. Pay and benefit information by country are available at: Details**This job has a full time weekly schedule.Our pay ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. During the hiring process, a recruiter can share more about the specific pay range for a preferred location. Pay and benefit information by country are available at: Technologies Inc. is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability or any other protected categories under all applicable laws.## **Travel Required:**10% of the Time## **Shift:**Day## **Duration:**No End Date## **Job Function:**Administration
- J-18808-Ljbffr Agilent Technologies, Inc.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Head of AI Quality, Assurance and Evaluation in Brooklyn, NY vacancy
$220k - $292k
Director, Program Test & Evaluation - Advanced Effects Lead and execute comprehensive test and evaluation programs for advanced air and missile... ...sold. Anduril's family of systems is powered by Lattice OS, an AI-powered operating system that turns thousands of data streams...SuggestedFull timeContract workWork experience placement$147k - $194k
...establish testing priorities, oversee quality of execution, and drive... ...practices, and risk-based assurance methodologies.This position will... ...secure configuration baselines.Evaluate on-premises technical controls... ...concepts.Strong understanding of AI models and ability to define...SuggestedFull timeWork at officeLocal areaRemote work- ...scalability tests. Should have conducted Chaos experiments and used AI /GHCP across the PT lifecycle. Cloud-Native & Container... ...usage, HPA behavior, and autoscaling performance. Experienced with evaluating limits/requests, node saturation, and cluster-level constraints....Suggested
Wise Skulls
Jersey City, NJ20 hours ago $150k - $180k
AVIAN is seeking an Assistant Program Manager Test and Evaluation (Senior) for the PMA-231 office to lead engineering, design, and test efforts. The role requires clear communication, collaboration, and the ability to work with IPTs and external orgs. Required are a technical...SuggestedWork at office$127.6k - $191.4k
...organization’s transition to Continuous Testing practices using Gen AI technologies. The role involves collaborating with multiple... ...solutions and related tools across the value stream, assist in defining quality engineering standards and best practices, provide technical...SuggestedTemporary workWork at office3 days per weekThe Hartford
Brooklyn, NY2 days ago$95k - $145k
...role helps clients address emerging validation considerations for AI/ML-enabled systems and automation frameworks. If this sounds... ...and verbal communication skillsMeticulous attention to detail and quality of work productAbility to build and sustain professional relationshipsAbility...Remote workVisa sponsorship- Dyna Robotics is seeking a senior QA leader to build and direct the QA function across cloud inference and factory-floor IoT devices. You will hire, mentor, and set testing standards, balancing automation with hands-on validation to ensure robust real-world performance....
- Credence is seeking a B‑2 Test Management professional at the principal level to support modernization, test, production, fielding, and sustainment of the B‑2 aircraft and related systems at OK facilities. The role emphasizes T&E program design, execution, and coordination...For contractors
$140k - $160k
...US Are you interested in working with the World’s leading AI-first Quality Engineering Company? Ready to advance your career, team up with... ..., and operational environments, the company provides assurance and engineering expertise that helps organizations ensure systems...Casual workLocal areaFlexible hours- Trellis Technologies, Inc. is seeking a Quality Lead to turn AI-powered QA insights into actionable coaching, training, and process improvements across Sales and Service. You’ll identify trends, reduce errors, and scale our quality program while partnering with Sales, Service...
- ...experienced Technical Test Manager to lead testing governance quality assurance and delivery excellence across strategic insurance programs The... ...metrics dashboards and status reports Ability to leverage AI tools to improve quality engineering productivity and efficiency...
Ztek Consulting INC
Jersey City, NJ2 days ago - ...coordinating testing across multiple streams and stakeholders to ensure quality and timely delivery. The successful candidate will lead test... ..., while supporting release readiness and collaborating with business users and third-party suppliers. #J-18808-Ljbffr Quality Ai
$145k - $185k
...disability, veteran’s status, or other characteristic protected by applicable laws and regulations. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and...Night shiftWeekend workThea Energy
Kearny, NJ27 days ago- ...Worth is now looking for a Head of Quality Assurance to build, lead, and elevate our QA function across the organization. This role is both strategic and hands-on. You will define quality standards, build scalable testing processes, and lead a team of QA engineers — while...Contract workRemote workFlexible hours
GrabJobs
Jersey City, NJ20 hours ago $155k - $248.1k
...delivers better business results. Opportunity Overview The Product Manager will be responsible for driving Teradyne’s software product and AI strategy for the Power Test Division. This role partners across marketing, engineering, sales, and operations to define product...Local areaRelocationFlexible hours- ...and ordinances. Summary of Position Uses and improves existing quality processes in collaboration with the Value stream team to... ...organizational goals. Essential Duties and Responsibilities Evaluate field and internal failures by utilizing problem solving and root...Work at office
- Title Quality Assurance Coordinator Department Configuration Position Summary The Quality Assurance Coordinator is responsible for monitoring... ...data into actionable insights for leadership. Ability to evaluate adherence to procedures, maintain accurate documentation,...
- ...Thinkers We Play To Win We Respect Everyone and Work As A Team The Quality Assurance Coordinator is responsible for supporting dnata Catering USA... ...and operational procedures for compliance. Perform product evaluations on raw materials, work-in-process items, and finished...Full timeWork at officeLocal areaAfternoon shift
$95k - $112k
...Job Title: Quality Assurance Manager - Food Safety Job Location: Jamaica-USA-11430 Work Location Type: On-Site Salary Range:... ...Critical Control Points (HACCP), food safety, sensory and quality evaluations. Conduct monthly-required assessments of the food safety...Contract workWork at officeLocal areaSkyChefs
Jamaica, NYa month ago- ...methodologies, tools, and processes, as well as a passion for quality assurance and continuous improvement. Key Responsibilities Develop and... ...interfaces, ensuring the best user experience. API Testing: Evaluate and test APIs to ensure their reliability, performance, and...
TechDigital Group
Hoboken, NJ1 day ago - Gainwell Technologies is seeking a Senior Quality Assurance - Lead to act as a QA SME for the Customer Experience organization. You will drive... ...You will work remotely, with responsibilities that include evaluation across channels, root-cause analysis, and escalation support...Remote job
- ...robots powered by a proprietary embodied AI foundation model with top-in-industry generalization... ...with company vision, translate quality risks into business impact, and drive... ...automation is not yet feasible. AI Model Evaluation & Regression Testing: Design and execute...Full timeShift work
- ...Quality Control Manager – Aggregates & Asphalt Location: NW Ohio Position Overview The Quality Control Manager is responsible for leading... ..., compaction, or surface performance. Train, mentor, and evaluate QC technicians; manage staffing, scheduling, and certifications...
Imperium Global LLC
Brooklyn, NY1 day ago - ...ICP Group is comprised of leading brands known for innovation, quality, and performance. Founded in 2015 and supported by a lean corporate... ...quality standards. Batch & Product Quality Management Review, evaluate, and approve incoming batches, in-process materials, and...
6AM City
Brooklyn, NY13 hours ago $110k - $150k
...With a Commitment to Serve Subsidiary: KIRA Services Job Title: Quality Manager Work Location: Washington Navy Yard Labor Category:... ...Contracting Officer and Contracting Officer’s Representative (COR),who evaluate contract performance. Investigates customer complaints,...Contract workTemporary workFor contractorsWork at officeLocal areaShift workTlingit Haida Tribal Business Corporation
Brooklyn, NY2 days ago- ...prevent chronic disease, translating scientific research into high-quality food products for patients nationwide. Our evidence-based... ...reports. Qualifications: Required ~7+ years in Quality Assurance, Food Manufacturing, Fulfillment or Distribution ~ Experience...Hourly payLocal areaShift work
Epicured
Staten Island, NY4 days ago $115.28k - $196.13k
...individual on our team. We tackle challenges head-on, learn from every experience and... ...activities. This role directs and guides the evaluation, implementation, and validation of... ...variety of testing activities to ensure high quality of work performed, adequate documentation...Work at officeFlexible hoursShift work- ...DoD/T&E background is required. Responsibilities include developing test strategies, coordinating with government leads, and ensuring data collection aligns with evaluation criteria while supporting SEEK EAGLE stores certification and avionics #J-18808-Ljbffr Credence
$55k - $60k
...nutrition for patients and consumers. Job Summary: The Product Quality Assurance Coordinator (Vitamins/Supplements) will facilitate and... ...results. If test results are OOS, start a non-conformance and evaluate for retest requirements. If test results are in spec, file with...Work experience placementMonday to Friday- Quality Control Manager - Reynolds Army Community Hospital Job Category : Quality and Compliance Requisition Number : QUALI003689... ...program to ensure compliance, accurate records, and timely employee evaluations Manage subcontractor COIs to ensure required coverage, current...Full timeContract workFor subcontractorH1bImmediate startRemote workMonday to FridayFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Head of AI Quality, Assurance and Evaluation. Be the first to apply!
Related searches
- qa manager Brooklyn, NY
- qa director Brooklyn, NY
- qa manager remote Brooklyn, NY
- senior qa manager Brooklyn, NY
- quality assurance supervisor Brooklyn, NY
- quality assurance manager Brooklyn, NY
- quality assurance qa manager Brooklyn, NY
- quality assurance manager remote Brooklyn, NY
- qa supervisor Brooklyn, NY
- quality lead Brooklyn, NY