Senior Director, AI Evaluation Platform & Quality
ServiceNow
ServiceNow in Santa Clara is seeking a Senior Director, AI Evaluation Platform to lead the CoreAI team within Platform and AI. You will define strategy, scale the evaluation platform, and oversee internal research and engineering while enabling customer-facing monitoring of AI quality. You will drive verifier architectures (LLM-as-judge, rule-based, reference-based, and process verifiers) and deliver APIs, dashboards, and reporting to support AI quality across GenAI offerings. #J-18808-Ljbffr ServiceNow
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Director, AI Evaluation Platform & Quality in Santa Clara, CA vacancy
$279.1k
...Today, ServiceNow is the AI control tower for... ...reinvention. Our ServiceNow AI platform brings together any AI... ...on building the evaluation infrastructure and... ...frameworks that ensure the quality, reliability, and... ...capabilities they depend on.As a Senior Director, AI Evaluation...PlatformQualitySeniorWork at officeImmediate startRemote workFlexible hours- The CoreAI team, part of the Platform and AI organization, is focused on building the evaluation infrastructure and frameworks that ensure the quality, reliability, and safety of AI capabilities... ...capabilities they depend on As a Senior Director, AI Evaluation Platform, you will...PlatformQualitySeniorFlexible hours
$168k - $258.75k
How do bold AI research ideas become diligent training, evaluation, and production systems? NVIDIA’s... ...team is looking for a Senior Technical Program Manager... ...partner across research, platform engineering,... ..., test configurations, quality gates, collaborator approvals...PlatformQualitySeniorFull time$168k - $258.75k
...the next generation of AI-powered simulation tools... ...workflows. As a Senior Technical Program Manager... ...feedback back to internal platform teams and external partners... ...the evaluation of both internal and external... ...ensure delivery meets quality, performance, and scalability...PlatformQualitySeniorFull time$168k - $258.75k
...bring NVIDIA's autonomous vehicle platform out to the world. As a key... ...technologies scope, schedule, and quality.Assist in improving process... ...improvements.Shown ability to evaluate and drive adoption of new and... ...existing vacancy. NVIDIA uses AI tools in its recruiting processes...PlatformQualitySeniorFull time$168k - $258.75k
What happens when AI research, GPU infrastructure... .... We are looking for a Senior Technical Program Manager... ...building, training, evaluating, optimizing, and deploying... ...accelerated computing platform. We’re excited to add a... ..., product, quality, security, legal, operations...PlatformQualitySeniorFull time$200k - $275k
...connect our world - like AI and IoT. If you want to... ..., IP, or compliance. Evaluate tech—inside and outside the company. Look at platforms, models, tools, vendors... ...prompts/workflows are high quality, outputs are validated... ...working with senior leaders and technical experts...PlatformQualitySeniorFull time$176k - $280k
...a Technical Marketing Senior Manager to join our System... ...the best silicon/platform solutions to enable customer... ...prioritize talent and qualities such as humility, kindness... ...Intelligence (AI) tools in the recruitment... ...ensure every candidate is evaluated fairly and holistically...PlatformQualitySeniorLocal areaFlexible hours$190.9k - $334.1k
...Today, ServiceNow is the AI control tower for... ...reinvention. Our ServiceNow AI platform brings together any AI,... ...role: We are seeking a Senior Staff Technical Program... ...Programs team — evaluating, adopting, and scaling... ...uncompromising regard for quality; proven track record creating...PlatformQualitySeniorWork at officeImmediate startRemote workFlexible hours$148.5k - $174.7k
...are looking for an experienced AI Product Manager to define and... ...enterprise data governance platforms. This role focuses on automation... ...• Data lineage, metadata, or quality frameworks • APIs and... ...automation tools • Familiarity with evaluation frameworks for AI systems: •...PlatformQualitySeniorFull timeWork at officeLocal area3 days per week$224k - $356.5k
...unlimited potential of AI to define the next era... ...performance computing. As a Senior / Principal Deep Learning Engineer — Model Evaluation & AI Systems, you will... ...as an open-source platform, focusing on correctness... ...appreciation for evaluation quality, including correctness,...PlatformQualitySeniorFull time$152k - $241.5k
...are now looking for a Senior Software Engineer for Agent Simulation & Evaluation! Today, NVIDIA is tapping... ...unlimited potential of AI to define the next era... ...different accelerator platforms. We are looking for an... ...to improve simulation quality and accelerate engineering...PlatformQualitySeniorFull time$152k - $241.5k
...tapping into the unlimited potential of AI to define the next era of computing.... ...a Software Engineer - Scientific Evaluation to own a shared platform for classical testing, scientific benchmarking... ...owners to create reproducible quality signals and production-readiness gates...PlatformQualitySeniorFull time$168k - $258.75k
...with over 270 partners that are using our platform in the development of autonomous cars,... ...Establishing metrics to assess and improve product quality and execution.Develop a strong technical... ...in Automotive, Robotics and/or AI.Strong leadership and interpersonal skills...PlatformQualitySeniorFull time$168k - $258.75k
...Technical Program Manager for Sensor Image Quality. As a world leader in artificial intelligence, NVIDIA is using its AGX platform to save lives by enabling breakthroughs in robotics... ...our outstanding Image Signal Processor and AI within the Tegra System-On-Chip. In this...PlatformQualitySeniorFull time$224k - $356.5k
...Engineers to join our Physical AI teams. As the pioneers of the... ..., we will build advanced quality assurance technology to validate... ...a strong mentality for KPI evaluation and validation to ensure the... ....Familiarity with simulation platforms and deep understanding of 3D...PlatformQualitySeniorFull time$192k - $278k
...development lifecycle (SDLC).Experience executing AI/ML programs and leveraging AI for... ...drive the strategy and execution of high quality, targeted data for model development.... ...the underlying design elements, developer platforms, product components, and infrastructure at...PlatformQualitySenior$180k - $230k
...Systems builds the world's largest AI chip, 56 times larger than... ...inference.About The RoleAs a Senior Hardware Technical Program Manager... ...in product management, quality, reliability, supply chain, and... ...Cerebras:Build a breakthrough AI platform beyond the constraints of the...PlatformQualitySenior$141k - $221k
...Country: USA SummaryThe Senior Staff Engineer, Program... ..., implementation, and evaluation of complex designs. They... ...objectives (Cost, Quality, Schedule, Features, Fulfillment... ...compute and AI technologies . This understanding... ..., hardware platform and supply chain solutions...PlatformQualitySeniorTemporary workWork at officeLocal areaRemote work$129.4k - $198.4k
.... About the Organization:The Evaluation team builds and evolves the evaluation... ...arbiters of end-to-end AV quality. We own large scale test... ...shape GM’s core evaluation platforms, turn system-level results into... ...best practices. Leverage AI-assisted development tools and...PlatformQualitySeniorFull timeLocal areaRemote workWork from homeFlexible hours$164.9k - $299.4k
...TVRoku is the #1 TV streaming platform in the U.S., Canada, and Mexico... ...the roleRoku is looking for a Senior Technical Program Manager to... ...engineering, product, design, and quality assurance teams to align... ...methodologiesExperience leveraging AI tools for workflow...PlatformQualitySeniorWork at officeLocal areaRemote workMonday to ThursdayFlexible hours$200k - $322k
NVIDIA’s deep learning platforms have significantly influenced many areas... ...scope, schedule, and quality, ensuring the programs meet quality... ...drive cross org alignment across senior and executive leaders.Possess... ...existing vacancy. NVIDIA uses AI tools in its recruiting...PlatformQualitySeniorFull time$168k - $258.75k
...Program Management team for Compute Platform Software. You will work with... ...cross-industry advancement of AI applications. Our work has... ...ensuring smooth, timely, and high-quality software releases from design... ...status and key issues to senior leadershipUtilize coding skills...PlatformQualitySeniorFull time$208k - $416k
...you'll do...Role summary: The Senior Distinguished I, Technical Program... ...team members, and ensures quality delivery by integrating emerging... ...develops and manages critical platforms that detect, prevent, and... ...decisioning, data platforms, AI, machine learning, risk intelligence...PlatformQualitySeniorFull timeTemporary workPart timeWorldwide$144.7k - $221.4k
.... About the Organization The Evaluation team builds and evolves the evaluation... ...arbiters of end-to-end AV quality. We own large-scale test... ...shape GM’s core evaluation platforms, turn system-level results into... .... Experience leveraging AI-assisted development and analytics...PlatformQualitySeniorFull timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours$201.3k - $352.3k
...Today, ServiceNow is the AI control tower for... ...reinvention. Our ServiceNow AI platform brings together any AI,... ..., data-driven Senior Engineering Manager, Agentic... ...GenAI Benchmarking and Evaluations to establish and lead AI... ...) to measure agent quality and eliminate regressions...PlatformQualitySeniorWork experience placementWork at officeImmediate startRemote workFlexible hoursShift work$168k - $258.75k
...DGX Cloud TPM Team is seeking a Senior Technical Program Manager (TPM... ...NVIDIA’s next-generation AI infrastructure. This role involves... ...software, hardware, and cloud platforms. You will support NVIDIA’s top... ...and ensuring timely and high-quality delivery. This role requires strong...PlatformQualitySeniorFull time$126.2k - $264.1k
...customer needs. We are building a platform to enable an autonomous cloud... ...in cloud computing? As a Senior Principal Product Manager, you... ...to life-saving care. And with AI embedded across our products and... ...conferences, and social media.Quality & Continuous Improvement: Maintain...PlatformQualitySeniorTemporary workWork experience placementWorldwideFlexible hoursShift work$119.8k - $234.7k
...Engineering (SCHIE) is looking for a Senior Technical Program Managertolead Hardware Server Platform development and delivery for... ...on time, with high quality and in high volume is of paramount... ...Azure cloud services, including AI, compute, storage and networking...PlatformQualitySeniorOngoing contractWork at officeLocal areaMicrosoft Corporation
Sunnyvale, CA5 days ago$217k - $271k
...mission focused on improving quality of life, increasing... ...study which was intended to evaluate ivonescimab combined... .... Overview of Role The Senior Director, Artificial Intelligence (AI) will lead the company's... .... Recommend enterprise platforms and tools that maximize...PlatformQualitySenior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Director, AI Evaluation Platform & Quality. Be the first to apply!
Related searches
- director of quality improvement Santa Clara, CA
- senior manager quality engineering Santa Clara, CA
- director supplier quality Santa Clara, CA
- senior director quality Santa Clara, CA
- corporate quality manager Santa Clara, CA
- quality manager healthcare Santa Clara, CA
- director quality engineering Santa Clara, CA
- director of quality Santa Clara, CA
- director quality assurance regulatory affairs Santa Clara, CA
- director quality management Santa Clara, CA