AI Eval & Benchmarking Manager - 8-Engineer Team Lead
ServiceNow
ServiceNow is seeking a senior AI evaluation lead to own the Build Agent evaluation framework, roadmap, and telemetry, with responsibility for scoring, failures, and model benchmarking.
You will manage an eight-engineer team, align across teams, and drive fixes with cross-functional partners to ensure scalable, measurable improvements. This role offers a high-impact path in AI-native product development.
#J-18808-LjbffrVacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the AI Eval & Benchmarking Manager - 8-Engineer Team Lead in California, MO vacancy
$166.5k - $291.4k
...started when engineer Fred Luddy wrote... ...is the AI control tower... ...people. The team Build Agent... ...types. This role leads the team... ...The team is 8 engineers and... ...Model Support & Benchmarking : Structured... ...Prioritizing eval coverage,... ...default). Manage the daily activities...SuggestedWork at officeImmediate startRemote workFlexible hoursServiceNow
California, MO6 hours ago$130k - $200k
...believe meaningful AI doesn’t start... ...scientists, engineers, financial experts... ...! About the Team Marketing at Snorkel... ...operators who lead independently,... ...Marketing Manager, Frontier Labs... ...pagers, decks, benchmark and eval narratives) sharp... ...marketer with 5‑8+ years of experience...SuggestedLocal areaInvestedintheMission
California, MO2 days ago- ...Intelligence? – We Power AI – and so could you!... ...as a networker to manage key stakeholders.... ...cross functional team. You will define... ...development of a winning/leading product roadmap.... ...in electrical engineering, microelectronics... ...power systems. ~8+ years of experience...SuggestedWorldwide
Analog Group
California, MO6 hours ago - ...Snorkel AI is seeking a Product Marketing Manager, Frontier Labs, to own end‑to‑end GTM for frontier lab offerings. You will partner with Research, FDE,... ...research and procurement leaders. This role requires 5–8+ years in product marketing, AI‑native product focus, and...Suggested
InvestedintheMission
California, MO7 hours ago - ...Curran is a national engineering, science and... ...strive to cultivate teams that encourage collaboration... ...with an ability to lead and grow the South... ...a Senior Technical Manager with strong... ...holidays – Choose up to 8 holidays to... ..., Privacy & Use of AI in Hiring Woodard...SuggestedTemporary workWork at officeLocal area1 day per week
Woodardcurran
California, MO6 hours ago $136k - $177k
...Data, automation, and AI are quickly... ...decision - and Alteryx is leading the transformation.... ...20 years, over 8,000 customers have... ...partners, and field teams to understand, adopt... ...Product Marketing Manager that leads demo strategy... ...of Product, Engineering, Product Marketing,...Work experience placementRemote workHome officeFlexible hoursShift work- ...A leading technology firm is seeking a Technical Architect to integrate Generative AI into their Software Development Life Cycle. You will innovate... ...processes, work closely with teams, and provide client... ...solutions. The ideal candidate has 8-12 years of experience, a...Full time
Tavant
California, MO6 hours ago $90k - $115k
...TCI is seeking an experienced Lab Manager to oversee daily laboratory operations and lead a team supporting microbiological and... ...reporting. Schedule: Monday - Friday 8 AM - 5 PM (Onsite) Salary: $90,... ...aligned with market benchmarks 401(k) retirement plan with company...Local areaMonday to Friday- ...Albert OS, the first AI-native operating... ..., site reliability engineering, and enterprise security... ...all engineering teams — commonIaCtooling,... ...layers. Lead compliance and audit... ...coverage sustainable. Manage vendor relationships... ...You will have ~8+ years in cloud infrastructure...Remote workWork from home
Albert Invent Corp
California, MO6 hours ago $236k - $275k
...Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do... ...is no barrier to impact. Our hybrid teams collaborate across geographies to... ...Director within Unit 42’s Cyber Risk Management team, you will lead our AI Security Assessment offering and...Remote workVisa sponsorshipWork visaSocket.dev
California, MO3 days ago- ...A leading semiconductor company seeks a Marketing Director for their Controller & Protection ICs segment to drive product strategy and market execution. The successful candidate will leverage their extensive experience in product development and marketing to build out...
Analog Group
California, MO6 hours ago - Leading the development and implementation of governance frameworks to manage risk and compliance for clients Analyzing... ...Coaching and mentoring team members to enhance... ...Cybersecurity, Economics, Engineering, Finance, Mathematics... ...Experience in AI/ML governance, risk,...
- ...sales experience and the ability to self-source high-value deals. As a key member of the leadership team, you will create and execute a winning sales strategy while managing a dedicated sales team. The position offers competitive compensation, including a base salary and...Remote work
RevsUp
California, MO4 days ago - Jobtailor is seeking a senior marketing leader to own marketing strategy and drive the positioning for Unit 42. You will oversee the creation of world‑class thought leadership and align marketing plans with sales to maximize Unit 42 value. Ideal candidates bring 15+...
- ...risk to transform Capital Markets into a world-class, programmatic function. You will drive an AI-enabled Capital Allocation Engine, build an analytics foundation, and lead cross-functional collaboration to fund growth across mortgage, auto, and credit cards with...
Achieve
California, MO6 hours ago - ...OpenSesame is seeking a Senior Product Marketing Manager to own GTM strategy, messaging, and enablement for AI-driven learning products. This role acts as a strategic... ...entrepreneurial ownership. The candidate will lead market research, competitive analysis, and storytelling...
OpenSesame
California, MO6 hours ago - ...through our core construction management services and complementary business... ...John Fish. Suffolk is ranked #8 on ENR’s list of “Top CM-at-... ...roles access to market leading medical and emotional and mental... ...a daily basis to the project team and others as directed by management...Temporary workFor contractorsWork experience placementFor subcontractorWork at officeLocal areaFlexible hours
$90k - $100k
...experienced Human Resources Manager based in California to... .... About Our HR Team At Wei-Chuan, the HR team... ...Compliance What You Will Do Lead and oversee California... ...planning, compensation benchmarking, and organizational... .... Minimum eight (8) years of progressive...Work at officeLocal area$134k - $195k
...applications. Backed by leading investors including Y... ...to grow into a people manager within 12-24 months, giving... ...the function and the team beneath you. You will report... ...and compensation benchmarking Required Qualifications... ...individual as defined by 8 U.S.C. 1324b(a)(3), or...Permanent employmentFor contractors- ...Oliver Wyman is a global leader in management consulting. With offices in 60... ...Role: Telco + Quotient -AI - Engagement Manager Practice... ...leaders within our consulting team, working side-by-side with our... ...of a specific engagement(s) Leading and managing complex programs...Work at officeFlexible hours
- ...every launch. Stay deeply in sync with the Product and Solution Engineering teams to understand new innovations as they ship. Rapidly update... ...and maintaining product demo environments. Deep curiosity about AI and marketing technology; you geek out over how things work under...
Jobtailor
California, MO5 days ago - About us At Pareto.AI, we’re on a mission to enable... ...an AI Engagement Manager responsible for owning... ...researchers, PMs, and engineering leaders shaping next‑generation... ...evaluation, RLHF, red‑teaming, and emerging workflows... ...ability to lead solution design and scoping...
$165.5k - $289.6k
...It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker... ...meaningful work. Today, ServiceNow is the AI control tower for business reinvention.... ..., Developer Relations, PMM, and creative teams to align on message, sequence, and what’s...Work at officeImmediate startRemote workFlexible hoursServiceNow
California, MO6 hours ago- ...ServiceNow is hiring a builder who writes code, wires up AI models, and ships live demos. You’ll own the AI narrative, data and... ...demonstrations at major events. Collaboration across Product, Engineering, and developer relations will be essential as you create evergreen...
ServiceNow
California, MO6 hours ago - ...Inc. in the United States seeks a Director, Global Total Rewards to lead Compensation and Benefits for a global workforce. You will shape a modern Total Rewards strategy integrating technology, AI, and analytics to support business growth. You will partner with People...Remote work
Alteryx Inc.
California, MO6 hours ago - ...Senior Director of TM & OE to lead talent management strategy and succession and... ...roles. Determine how we can use AI, automation, and other... ...with sector HR, OE, and Talent teams and support all related executive... ...Master’s degree and at least 8 years of experience in...Work at office
Jobtailor
California, MO5 days ago $132.18k - $174.48k
...core values and our participant-focus lead the way no matter what. The Manager, People (Assignment: Compensation)... ..., Finance, and Talent Acquisition teams to ensure compensation programs are... ...well as conduct market pricing and benchmarking for clinical, non-clinical,...Temporary workSocket
California, MO1 day ago- ...serve. Learn more about us at How You Will Make an Impact The Compensation Manager will lead and execute job analyses for all organizational roles, develop and assess job descriptions, benchmark salaries, and recommend compensation adjustments to maintain internal...Full timeTemporary workWork experience placementSeasonal workLocal areaMonday to FridayFlexible hours
Lifelong Learning Administration Corporation
California, MO4 days ago $148.5k - $195k
Ready to lead at scale and drive transformative impact... ...) is a configurable, AI-powered platform... ...integrating financial management, multi-entity operations... ...just about managing a team—it’s about leading leaders... ...insights to Product and Engineering teams to influence future...Contract workImmediate start$170k - $250k
General Manager, AI Data Labeling Remote, San Francisco About Wing Wing... ..., security & compliance, and team building. You’ll build the... ...customers, help set up the operating engine, and report directly to Wing’... ...across AI labs and leading tech companies; able to open...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Eval & Benchmarking Manager - 8-Engineer Team Lead. Be the first to apply!
Related searches
- member team lead California, MO
- team leader production California, MO
- site leader California, MO
- team leader training California, MO
- team lead data science California, MO
- market leader California, MO
- compliance team leader California, MO
- manufacturing team lead California, MO
- focus group leader California, MO
- team lead California, MO