Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Evaluations & Annotations Product Lead

Arize

Arize, a leader in AI observability, is seeking a highly technical, product-minded PM to own Evals & Annotations. You’ll shape evaluation workflows end-to-end—from creation to human review and iteration—while collaborating with Design and Engineering to ship polished experiences. Work with founders and cross-functional peers in a remote‑first environment, with optional offices in NYC and SF. This role emphasizes ownership, prototyping, and pragmatic tradeoffs in a fast-growing startup. #J-18808-Ljbffr Arize

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AI Evaluations & Annotations Product Lead in New York, NY vacancy
  • Arize AI is seeking a highly technical product-minded PM to own Evals & Annotations, managing the full evaluation lifecycle from creation to human review and iteration. You will collaborate with Design and Engineering to deliver a best-in-class developer experience that... 
    Senior

    Royper Royco LLC

    New York, NY
    1 day ago
  • $200k - $250k

    About Arize AI is rapidly transforming the world....  ...come in. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI...  ...first prototype to production scale, Arize unifies build...  ...PM to own Evals & Annotations at Arize. You'll own the... 
    Senior
    Remote job
    Work experience placement
    Work from home
    Flexible hours

    Arize

    New York, NY
    1 day ago
  • $85k

    Carrington Mortgage Services, LLC is seeking a Sr LS Product Integration Analyst to lead cross-functional initiatives, evaluating, implementing, and integrating enterprise...  ...alignment with strategic goals. The role covers AI, workflow automation, system modernization, and... 
    Senior
    Remote job

    Carrington Mortgage Services, LLC

    New York, NY
    1 day ago
  • Google Images is Google’s visual discovery platform, helping people explore, evaluate, and understand the world visually every day. As the Product Lead, you will own the strategy, roadmap, and user experience across core visual search surfaces on mobile and desktop, partnering... 
    Senior

    Google LLC

    New York, NY
    1 day ago
  • Synthires is seeking a Senior AI Trainer (Video Evaluation) contractor to evaluate AI-generated videos and provide detailed feedback on video quality...  ...storytelling. You will use professional judgment and annotation tools to support selection of higher-quality outputs... 
    Senior
    Remote job
    For contractors

    Synthires

    New York, NY
    2 days ago
  • Amazon.com Services LLC is seeking a Senior Principal, Product Manager - Technical for Local & Services Advertising in Seattle, WA. You will own the...  ...with engineering, science, and design to build agentic AI systems, define GTM plans, and scale to billions in revenue... 
    Senior
    Local area

    Amazon Inc.

    New York, NY
    1 day ago
  • Citi's Banking Technology group seeks a visionary AI Product Lead to drive Capital Markets tooling. This senior role blends product management with software engineering, focusing on ECM deal execution, financing workflows, and AI agent leverage to enhance client service... 
    Senior

    Citi

    New York, NY
    1 day ago
  • Rippling is seeking a Product Research Lead to shape the company’s product direction across HR, IT, and finance. You will lead research efforts, write grounded viewpoints, and partner with product, design, engineering, and data teams to guide decisions. This is a lead-level... 
    Senior
    Hourly pay

    Rippling

    New York, NY
    1 day ago
  • Capital One seeks a Senior Manager, Product Management (PXDP55) in New York, NY. You will lead two PM squads within Workflow Orchestrator, steering a modernization of the core platform with AI-powered workflows and scalable UI design. This role emphasizes strong leadership... 
    Senior

    Capital One

    New York, NY
    1 day ago
  • SIDRAM TECHNOLOGIES in New York seeks an experienced Product Lead to own the strategy, roadmap, prioritization, and execution of an enterprise AI platform. This role sits at the intersection of Product, Engineering, AI, and Business, driving reusable platform capabilities... 
    Senior

    SIDRAM TECHNOLOGIES

    New York, NY
    1 day ago
  • Humana is seeking a Lead Product Manager to drive the design, prototyping, and scaling of AI solutions across the enterprise. You will lead a complex AI portfolio, partner with engineers, data scientists, and business stakeholders, and shepherd projects from prototyping... 
    Senior

    Humana

    New York, NY
    1 day ago
  • Pace, the AI operations partner for insurers, seeks a Product Partnerships leader to build the ecosystem that makes Pace more powerful, easier to deploy, and more valuable to customers. You’ll own relationships with frontier AI labs, core insurance platforms, data providers... 
    Senior

    Pace

    New York, NY
    1 day ago
  • Capital One in New York, NY is seeking a Senior Manager of Product Management for Back Office Servicing Experiences. You will lead two product managers and set a multi-year roadmap to automate back-office operations using AI and cloud data. You’ll own end-to-end experiences... 
    Senior

    Capital One

    New York, NY
    1 day ago
  • Intuit, Inc. is seeking a Principal Product Manager for Agent Studio within the Mid-Market Product Management org. You will drive AI-native product initiatives for accountants and finance...  ...of accounting workflows. You will lead research, set vision and roadmaps, and influence... 
    Senior

    Intuit, Inc.

    New York, NY
    1 day ago
  • $123k - $215.25k

     ...company is not just the products we offer, but the personal...  ...market.We are looking for a Senior Technical Product Manager to lead the roadmap for tools and...  ...and adoption of shared evaluation tools and workflows....  ...analytics, quality tooling, or AI products.Experience... 
    Senior

    American Express

    New York, NY
    2 days ago
  • $192k - $288k

    About Citi Citi, the leading global bank, has approximately 200 million...  ...a broad range of financial products and services, including consumer...  ...a visionary and hands-on AI Product Lead to join our Banking...  ...Banking Technology group. This is a senior-level, strategic role designed... 
    Senior
    Full time

    Citi Group

    New York, NY
    1 day ago
  • Abridge is seeking a senior Growth Marketer to lead our product-led growth motion and own paid marketing across channels. You will partner with Product, Data...  ...experiments, and raise the bar for the team, leveraging AI-driven tools to accelerate research, activation, and... 
    Senior

    Abridge

    New York, NY
    4 days ago
  • Foresight Works Ltd. is seeking a senior product marketing leader to define how the market understands our AI-driven infrastructure platform. You will own positioning, messaging and the go-to-market for existing and new products, collaborating with co-founders and cross... 
    Senior

    Foresight Works Ltd

    New York, NY
    3 days ago
  • $195k - $230k

    Maven Clinic is hiring a Senior Staff Product Designer to lead the member-facing experience and innovate AI-native designs. Responsibilities include owning complex projects from concept to delivery, defining AI behavior in sensitive contexts, and creating high-fidelity... 
    Senior

    Maven Clinic

    New York, NY
    1 day ago
  • Rippling in New York, NY seeks a Senior Manager of Product Design for AI Platform to lead design across AI-enabled experiences in HR, IT, and Finance. You’ll coach senior designers, shape interaction models, and partner with product/engineering to craft trusted, scalable... 
    Senior
    Work at office

    Rippling

    New York, NY
    2 days ago
  •  ...banks and rails for ACH, wire, and book transfers. As the first Product Lead for Banking Infrastructure, you'll own partner-bank programs...  ...driven, customer-obsessed builder who can prototype ideas, work AI-natively, and ship code while collaborating with compliance. #J... 
    Senior

    Mural

    New York, NY
    1 day ago
  • Capital One seeks a Sr. Manager, AI Engineer to lead AI platform services, agentic AI, guardrails, and evaluation for scalable production systems in New York and other hubs. You will guide cross‑functional teams and drive responsible AI governance while optimizing performance... 
    Senior

    Capital One Group

    New York, NY
    1 day ago
  • AuraOne, Inc. seeks a Senior MBSE Engineer - SysML v2 for a remote evaluation track focused on assessing AI-produced code against real-world correctness standards. Reviewers reproduce failures, craft unit tests, and explain fixes to guide the modeling team. The role emphasizes... 
    Senior
    Remote job
    For contractors

    AuraOne Human Data

    New York, NY
    2 days ago
  • Turing is seeking a Senior Software Engineer to work on LLM evaluation and repository validation. You will perform hands-on software engineering, automate environments...  ...to work across international teams on cutting-edge AI projects. Strong Ruby experience and familiarity with... 
    Senior
    Remote job

    Turing

    New York, NY
    1 day ago
  • AuraOne, Inc. is seeking a Senior AI Trainer evaluation contractor based in the United States to support remote evaluation tasks. You will review senior AI trainer prompts and responses, label edge cases, and provide structured feedback to retrain models. Responsibilities... 
    Senior
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    3 days ago
  • AuraOne, Inc. seeks a Senior Protection Engineer (Medium Voltage / Utility Distribution) for an AI evaluation track. This remote contractor role involves reviewing generated...  ...document failure modes to help improve production-quality code in a sandboxed environment.... 
    Senior
    Remote job
    For contractors

    AuraOne Human Data

    New York, NY
    3 days ago
  • $200k - $230k

    Juniper Square is seeking an experienced product manager to lead technically complex, cross-functional initiatives within a fast-growing, global R&D organization. You will own a domain end to end, shaping the vision into a roadmap, driving adoption, and ensuring high standards... 
    Senior
    Remote work

    Big Internet Seller Services Inc

    New York, NY
    1 day ago
  • $90k - $124k

    Overview The AI-Native Product Lead is a team-embedded product role responsible for translating business...  ...: Ability to think critically and evaluate information objectively, considering...  ...qualified candidate is selected. #LI-REMOTE #LI-MD1 #SENIOR #J-18808-Ljbffr Cotiviti
    Work at office
    Immediate start
    Remote work

    Cotiviti

    New York, NY
    1 day ago
  • Senior MBSE Engineer - SysML v2 (AI Evaluation) is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model... 
    Senior
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne Human Data

    New York, NY
    2 days ago
  • Job Title: Senior Software Engineer - LLM Evaluation & Repository Validation About the projects: we are building LLM...  ...software engineers (tech lead level) who are familiar with high-quality...  ...one of the world’s fastest-growing AI companies accelerating the advancement... 
    Senior
    For contractors
    Freelance
    Remote work

    Turing

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Evaluations & Annotations Product Lead. Be the first to apply!