Senior AI Evaluations & Annotations Product Lead
Arize
Arize, a leader in AI observability, is seeking a highly technical, product-minded PM to own Evals & Annotations. You’ll shape evaluation workflows end-to-end—from creation to human review and iteration—while collaborating with Design and Engineering to ship polished experiences. Work with founders and cross-functional peers in a remote‑first environment, with optional offices in NYC and SF. This role emphasizes ownership, prototyping, and pragmatic tradeoffs in a fast-growing startup. #J-18808-Ljbffr Arize
- Arize AI is seeking a highly technical product-minded PM to own Evals & Annotations, managing the full evaluation lifecycle from creation to human review and iteration. You will collaborate with Design and Engineering to deliver a best-in-class developer experience that...Senior
- Hercules is seeking a senior or staff level product manager to own evals for our AI coding agent. You will own Hercules Bench offline evals and Hercules online evals, guiding evaluation design and data-driven improvements. You will leverage our 500k+ users, 1M+ code repos...Senior
- Manta Cares in the San Francisco Bay Area is seeking a Senior Head of Product to lead our clinical map into shipped product. You will own the roadmap, collaborate with the CEO, Chief Medical Officer, and engineering team, and drive end-to-end delivery in a hybrid environment...Senior
- Hover is seeking a product leader to unify Hover into one intuitive platform, from signup to daily workflows. You’ll own the Core experience across Construction and Insurance, partnering with Design and Engineering to ship cohesive, scalable product surfaces for both SMBs...Senior
- OpenAI in San Francisco is seeking a Senior Product Policy Lead, Regulation to map external regulatory trends and translate them into concrete research... ...decisions under uncertainty. You’ll work across frontier AI topics, youth safety, high‑stakes uses, and deceptive use,...SeniorRemote job
$218.4k - $365.2k
...efforts. Job Category Product Job Details About... ...Salesforce is the #1 AI CRM, where humans with... ...career at the company leading workforce transformation... ...strategy for AI quality and evaluation, establish how we... ...clearly to customers and senior stakeholders. Minimum...SeniorFull timeFlexible hours- ...Analyze and triage GitHub issues while evaluating software test quality. About the projects... ...for experienced software engineers (tech lead level) who are familiar with high-quality... ...is one of the world’s fastest-growing AI companies accelerating the advancement and...SeniorContract workPart timeFor contractorsFreelanceRemote work
$302k - $335k
# Senior Product Policy Lead, RegulationOpenAISan Francisco (Hybrid)Full-time$302,000 - $335,000 / yearUpload... ...imageThis policy role tracks AI regulation and legislation and translates... ...developments into research questions, evaluation needs, product requirements, and policy...SeniorPermanent employmentFull timeWork at officeRemote workRelocation package$175k - $250k
...TIMEPosted: 2026-05-13About the RoleWe’re seeking a strong Senior Backend Engineer to join our AI Evaluation team, focused on building the infrastructure and... ...reliable, repeatable evaluation of AI systems in production. In this role, you’ll develop the scaffolding around...SeniorFlexible hours- OpenAI seeks a Product Cost Management Lead to own the costed BOM, platform-wide cost baselines, and platform-to-platform TCO for our AI infrastructure. You will translate component, system,... ...Finance, and Operations, you will evaluate design changes, identify cost-reduction...Remote job
$82.6k - $162.8k
...technology-enabled solutions.Product Owners in Converge for Health... ...feedback.Position Summary As a Senior Product Owner within Deloitte’... ...advancing a ConvergeHEALTH data and AI platform for healthcare... ...ability to synthesize inputs, evaluate tradeoffs, and articulate a clear...SeniorLocal area- Prime Intellect AI is seeking a Head of Product to turn frontier AI infrastructure into a developer-friendly... ...with founders and technical leads. You will partner with Research, Applied... ...to ship polished features, improve evaluation workflows, and build a repeatable loop...
- # Product Cost Management Lead - AI InfrastructureFull Time computer Remote location\\_on San Francisco (Remote... ..., and infrastructure teams to evaluate engineering / design changes, compare... ...clearly to engineering, operations, and senior leaders.In this role, you will:- Own...Remote job
$208k - $260k
...About Handshake AI Human data is the... ...We’re looking for a Senior Software Engineer to join our Annotations team and build the... ...the intersection of product engineering, distributed... ...solutions. Lead projects from initial... ...systems, evaluation workflows, or human...SeniorFull timeWork at officeFlexible hours- ...complex business software into products people can understand, trust, and use. As a Lead Product Designer on the AI Platform team, you will... ...behaviors, model capabilities, evaluations, agentic workflows, and... ...cross-product initiatives as a senior IC, principal designer,...Work at office3 days per week
$190k - $215k
Data Products LeadDealpath is looking for a Data Products Lead to join our growing team and bring our powerful SaaS platform... ...maintain and extend.How we think about AI for this roleWe expect you to... ..., test and ship, and experience evaluating their output.Delivered data to...Work at office- ...parents, and teachers across multiple products. This role exists to make sure every... ...customer. The Role You are the AI Product Support Lead. You will build autonomous systems that... ...right time You are continuously evaluating and improving, not just maintaining...Temporary workWork at office
- OpenAI is seeking a Portfolio Product Marketing Lead to define and scale the global SMB marketing strategy for ChatGPT... ...on how business owners and teams understand, evaluate, adopt, and grow with OpenAI’s offerings. This senior, hands-on leadership position will shape clear...
- Anthropic Limited is seeking several Product Operations Managers to embed within core product teams. You will... ..., Safeguards, Security, and GTM to ship reliable AI products. You will work across launch calendars, evaluate feedback signals, and convert them into actionable...
$142.2k - $264k
The Position Technical Product Owner, RDT Lead - 3PD (Personalized, Predictive Patient Data) The Opportunity... ...data, predictive analytics, and AI/ML capabilities. Spanning ingestion, integration... ...‑solving skills with the ability to evaluate technical options and drive decisions...Local areaImmediate startRelocation package$150k - $240k
...technology. At Rec ( recreation.ai ), we're using AI to change... ...intersection — a consumer product loved by everyday players and... ...down to prompt engineering and evaluation work. You'll set the direction... ...day-to-day prioritization Lead and partner closely with Rec's...SeniorFull timeWork at officeLocal areaFlexible hours$180k - $220k
Senior AI Product Manager Company & Role At Landmark, we believe better living starts with exceptional... ...hiring a Senior AI Product Manager to lead our AI support product suite: Homepilot... ...close to end users and deep in evaluations. You’ll also own the technical readiness...SeniorWork at office$202k - $230k
# Senior Product Manager, AI StudioAsanaSan FranciscoFull-time$202,000 - $230,000 / yearUpload your resume... ...or deploying AI systems. The role leads an AI workflow product and requires... ...engineering, agentic workflows, and evaluations. Building and scaling AI capabilities...SeniorPermanent employmentWork at officeRemote workWork from home$140k - $225k
...care, and we’re developing the AI infrastructure to deliver it... ...copy—we combine rich data, production AI, doctors in the loop , and... ...flat and achieving industry-leading patient NPS and retention. While... ...can remove manual work. Evaluate and operate tools such as...Full timeFor contractorsImmediate startVisa sponsorshipFlexible hoursShift work$205.6k - $257k
Scale has been the leading AI data foundry, helping fuel the most exciting advancements... ...'s most important decisions.Scale's evaluation and data products shape how the industry trains and... ...hands-on software engineering depth.Senior AI PM, Leaderboards: Own and scale the...SeniorFull time$400k
...spend effortlessly. Brex’s AI-native automation and... ...to grow your career.Product at BrexThe Product team... ...manager, a finance ops lead. Their job comes down to... ...enough to act on, how you evaluate an answer that has no... ...and judgment this senior role calls for.You've built...SeniorWork at officeRemote workShift work3 days per week- Speak, an AI language tutor app, is seeking a product leader to direct the technical roadmap of the tutor's AI components—voice, memory, content, and evaluation. The role emphasizes hands-on decision-making and close collaboration with engineers and PMs to drive measurable...
$172.5k - $260.1k
...SalesforceSalesforce is the #1 AI CRM, where humans with agents... ...up your career at the company leading workforce transformation in the... ...'re hiring an AI-native Product Manager to lead AI-native agentic... ...products with AI, not only for AI.Evaluate impact through quantitative...SeniorFull time- ...addresses.About the roleAt Rippling, Product is responsible for turning extraordinary... ...products for our customers. As the Lead Product Manager for AI Semantics and Governance, you will... ...outcomes.What you will needExperience as a senior product leader owning complex data,...Work at office3 days per week
- ...About David AI At David AI, our vision is to bring impactful... ...mission is to help the world's leading AI companies build better... ...We're building the data and evaluation infrastructure behind those models... ...we are managing large-scale production systems. About this role...Full timeH1bWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Evaluations & Annotations Product Lead. Be the first to apply!
- product design lead San Francisco, CA
- product lead San Francisco, CA
- senior living San Francisco, CA
- senior trade analyst San Francisco, CA
- senior accountant manufacturing San Francisco, CA
- senior manager customer operations San Francisco, CA
- senior director information security San Francisco, CA
- senior full stack web developer San Francisco, CA
- senior technical director San Francisco, CA
- senior service engineer San Francisco, CA



