Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Evaluations & Annotations Product Lead

Arize

Arize, a leader in AI observability, is seeking a highly technical, product-minded PM to own Evals & Annotations. You’ll shape evaluation workflows end-to-end—from creation to human review and iteration—while collaborating with Design and Engineering to ship polished experiences. Work with founders and cross-functional peers in a remote‑first environment, with optional offices in NYC and SF. This role emphasizes ownership, prototyping, and pragmatic tradeoffs in a fast-growing startup. #J-18808-Ljbffr Arize

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AI Evaluations & Annotations Product Lead in San Francisco, CA vacancy
  • Arize AI is seeking a highly technical product-minded PM to own Evals & Annotations, managing the full evaluation lifecycle from creation to human review and iteration. You will collaborate with Design and Engineering to deliver a best-in-class developer experience that... 
    Senior

    Royper Royco LLC

    San Francisco, CA
    1 day ago
  • Hercules is seeking a senior or staff level product manager to own evals for our AI coding agent. You will own Hercules Bench offline evals and Hercules online evals, guiding evaluation design and data-driven improvements. You will leverage our 500k+ users, 1M+ code repos... 
    Senior

    Speedrun Talent Network

    San Francisco, CA
    1 day ago
  • Manta Cares in the San Francisco Bay Area is seeking a Senior Head of Product to lead our clinical map into shipped product. You will own the roadmap, collaborate with the CEO, Chief Medical Officer, and engineering team, and drive end-to-end delivery in a hybrid environment... 
    Senior

    Manta Cares

    San Francisco, CA
    1 day ago
  • Hover is seeking a product leader to unify Hover into one intuitive platform, from signup to daily workflows. You’ll own the Core experience across Construction and Insurance, partnering with Design and Engineering to ship cohesive, scalable product surfaces for both SMBs... 
    Senior

    Almaz Capital

    San Francisco, CA
    1 day ago
  • OpenAI in San Francisco is seeking a Senior Product Policy Lead, Regulation to map external regulatory trends and translate them into concrete research...  ...decisions under uncertainty. You’ll work across frontier AI topics, youth safety, high‑stakes uses, and deceptive use,... 
    Senior
    Remote job

    We Love AI Jobs

    San Francisco, CA
    1 day ago
  • $218.4k - $365.2k

     ...efforts. Job Category Product Job Details About...  ...Salesforce is the #1 AI CRM, where humans with...  ...career at the company leading workforce transformation...  ...strategy for AI quality and evaluation, establish how we...  ...clearly to customers and senior stakeholders. Minimum... 
    Senior
    Full time
    Flexible hours

    Salesforce

    San Francisco, CA
    10 days ago
  •  ...Analyze and triage GitHub issues while evaluating software test quality. About the projects...  ...for experienced software engineers (tech lead level) who are familiar with high-quality...  ...is one of the world’s fastest-growing AI companies accelerating the advancement and... 
    Senior
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    San Francisco, CA
    a month ago
  • $302k - $335k

    # Senior Product Policy Lead, RegulationOpenAISan Francisco (Hybrid)Full-time$302,000 - $335,000 / yearUpload...  ...imageThis policy role tracks AI regulation and legislation and translates...  ...developments into research questions, evaluation needs, product requirements, and policy... 
    Senior
    Permanent employment
    Full time
    Work at office
    Remote work
    Relocation package

    We Love AI Jobs

    San Francisco, CA
    1 day ago
  • $175k - $250k

     ...TIMEPosted: 2026-05-13About the RoleWe’re seeking a strong Senior Backend Engineer to join our AI Evaluation team, focused on building the infrastructure and...  ...reliable, repeatable evaluation of AI systems in production. In this role, you’ll develop the scaffolding around... 
    Senior
    Flexible hours

    Ellipsis Health

    San Francisco, CA
    1 day ago
  • OpenAI seeks a Product Cost Management Lead to own the costed BOM, platform-wide cost baselines, and platform-to-platform TCO for our AI infrastructure. You will translate component, system,...  ...Finance, and Operations, you will evaluate design changes, identify cost-reduction... 
    Remote job

    ContentBuffer

    San Francisco, CA
    1 day ago
  • $82.6k - $162.8k

     ...technology-enabled solutions.Product Owners in Converge for Health...  ...feedback.Position Summary As a Senior Product Owner within Deloitte’...  ...advancing a ConvergeHEALTH data and AI platform for healthcare...  ...ability to synthesize inputs, evaluate tradeoffs, and articulate a clear... 
    Senior
    Local area

    Deloitte

    San Francisco, CA
    1 day ago
  • Prime Intellect AI is seeking a Head of Product to turn frontier AI infrastructure into a developer-friendly...  ...with founders and technical leads. You will partner with Research, Applied...  ...to ship polished features, improve evaluation workflows, and build a repeatable loop... 

    Prime Intellect AI

    San Francisco, CA
    1 day ago
  • # Product Cost Management Lead - AI InfrastructureFull Time computer Remote location\\_on San Francisco (Remote...  ..., and infrastructure teams to evaluate engineering / design changes, compare...  ...clearly to engineering, operations, and senior leaders.In this role, you will:- Own... 
    Remote job

    ContentBuffer

    San Francisco, CA
    1 day ago
  • $208k - $260k

     ...About Handshake AI Human data is the...  ...We’re looking for a Senior Software Engineer to join our Annotations team and build the...  ...the intersection of product engineering, distributed...  ...solutions. Lead projects from initial...  ...systems, evaluation workflows, or human... 
    Senior
    Full time
    Work at office
    Flexible hours

    Handshake

    San Francisco, CA
    17 days ago
  •  ...complex business software into products people can understand, trust, and use. As a Lead Product Designer on the AI Platform team, you will...  ...behaviors, model capabilities, evaluations, agentic workflows, and...  ...cross-product initiatives as a senior IC, principal designer,... 
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    10 hours ago
  • $190k - $215k

    Data Products LeadDealpath is looking for a Data Products Lead to join our growing team and bring our powerful SaaS platform...  ...maintain and extend.How we think about AI for this roleWe expect you to...  ..., test and ship, and experience evaluating their output.Delivered data to... 
    Work at office

    Dealpath

    San Francisco, CA
    1 day ago
  •  ...parents, and teachers across multiple products. This role exists to make sure every...  ...customer. The Role You are the AI Product Support Lead. You will build autonomous systems that...  ...right time You are continuously evaluating and improving, not just maintaining... 
    Temporary work
    Work at office

    Wonderschool

    San Francisco, CA
    2 days ago
  • OpenAI is seeking a Portfolio Product Marketing Lead to define and scale the global SMB marketing strategy for ChatGPT...  ...on how business owners and teams understand, evaluate, adopt, and grow with OpenAI’s offerings. This senior, hands-on leadership position will shape clear... 

    OpenAI, Inc.

    San Francisco, CA
    1 day ago
  • Anthropic Limited is seeking several Product Operations Managers to embed within core product teams. You will...  ..., Safeguards, Security, and GTM to ship reliable AI products. You will work across launch calendars, evaluate feedback signals, and convert them into actionable... 

    Anthropic Limited

    San Francisco, CA
    1 day ago
  • $142.2k - $264k

    The Position Technical Product Owner, RDT Lead - 3PD (Personalized, Predictive Patient Data) The Opportunity...  ...data, predictive analytics, and AI/ML capabilities. Spanning ingestion, integration...  ...‑solving skills with the ability to evaluate technical options and drive decisions... 
    Local area
    Immediate start
    Relocation package

    Genentech

    San Francisco, CA
    1 day ago
  • $150k - $240k

     ...technology. At Rec ( recreation.ai ), we're using AI to change...  ...intersection — a consumer product loved by everyday players and...  ...down to prompt engineering and evaluation work. You'll set the direction...  ...day-to-day prioritization Lead and partner closely with Rec's... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours

    rec

    San Francisco, CA
    5 days ago
  • $180k - $220k

    Senior AI Product Manager Company & Role At Landmark, we believe better living starts with exceptional...  ...hiring a Senior AI Product Manager to lead our AI support product suite: Homepilot...  ...close to end users and deep in evaluations. You’ll also own the technical readiness... 
    Senior
    Work at office

    Landmark

    San Francisco, CA
    1 day ago
  • $202k - $230k

    # Senior Product Manager, AI StudioAsanaSan FranciscoFull-time$202,000 - $230,000 / yearUpload your resume...  ...or deploying AI systems. The role leads an AI workflow product and requires...  ...engineering, agentic workflows, and evaluations. Building and scaling AI capabilities... 
    Senior
    Permanent employment
    Work at office
    Remote work
    Work from home

    We Love AI Jobs

    San Francisco, CA
    1 day ago
  • $140k - $225k

     ...care, and we’re developing the AI infrastructure to deliver it...  ...copy—we combine rich data, production AI, doctors in the loop , and...  ...flat and achieving industry-leading patient NPS and retention. While...  ...can remove manual work. Evaluate and operate tools such as... 
    Full time
    For contractors
    Immediate start
    Visa sponsorship
    Flexible hours
    Shift work

    Legion Health

    San Francisco, CA
    21 days ago
  • $205.6k - $257k

    Scale has been the leading AI data foundry, helping fuel the most exciting advancements...  ...'s most important decisions.Scale's evaluation and data products shape how the industry trains and...  ...hands-on software engineering depth.Senior AI PM, Leaderboards: Own and scale the... 
    Senior
    Full time

    Scale AI

    San Francisco, CA
    10 hours ago
  • $400k

     ...spend effortlessly. Brex’s AI-native automation and...  ...to grow your career.Product at BrexThe Product team...  ...manager, a finance ops lead. Their job comes down to...  ...enough to act on, how you evaluate an answer that has no...  ...and judgment this senior role calls for.You've built... 
    Senior
    Work at office
    Remote work
    Shift work
    3 days per week

    Brex

    San Francisco, CA
    1 day ago
  • Speak, an AI language tutor app, is seeking a product leader to direct the technical roadmap of the tutor's AI components—voice, memory, content, and evaluation. The role emphasizes hands-on decision-making and close collaboration with engineers and PMs to drive measurable... 

    present of AI

    San Francisco, CA
    1 day ago
  • $172.5k - $260.1k

     ...SalesforceSalesforce is the #1 AI CRM, where humans with agents...  ...up your career at the company leading workforce transformation in the...  ...'re hiring an AI-native Product Manager to lead AI-native agentic...  ...products with AI, not only for AI.Evaluate impact through quantitative... 
    Senior
    Full time

    Salesforce

    San Francisco, CA
    3 days ago
  •  ...addresses.About the roleAt Rippling, Product is responsible for turning extraordinary...  ...products for our customers. As the Lead Product Manager for AI Semantics and Governance, you will...  ...outcomes.What you will needExperience as a senior product leader owning complex data,... 
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    4 days ago
  •  ...About David AI At David AI, our vision is to bring impactful...  ...mission is to help the world's leading AI companies build better...  ...We're building the data and evaluation infrastructure behind those models...  ...we are managing large-scale production systems. About this role... 
    Full time
    H1b
    Work at office

    david-ai

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Evaluations & Annotations Product Lead. Be the first to apply!