Senior AI Evaluations & Annotations Product Lead
Arize
Arize, a leader in AI observability, is seeking a highly technical, product-minded PM to own Evals & Annotations. You’ll shape evaluation workflows end-to-end—from creation to human review and iteration—while collaborating with Design and Engineering to ship polished experiences. Work with founders and cross-functional peers in a remote‑first environment, with optional offices in NYC and SF. This role emphasizes ownership, prototyping, and pragmatic tradeoffs in a fast-growing startup. #J-18808-Ljbffr Arize
- Arize AI is seeking a highly technical product-minded PM to own Evals & Annotations, managing the full evaluation lifecycle from creation to human review and iteration. You will collaborate with Design and Engineering to deliver a best-in-class developer experience that...Senior
$200k - $250k
About Arize AI is rapidly transforming the world.... ...come in. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI... ...first prototype to production scale, Arize unifies build... ...PM to own Evals & Annotations at Arize. You'll own the...SeniorRemote jobWork experience placementWork from homeFlexible hours$85k
Carrington Mortgage Services, LLC is seeking a Sr LS Product Integration Analyst to lead cross-functional initiatives, evaluating, implementing, and integrating enterprise... ...alignment with strategic goals. The role covers AI, workflow automation, system modernization, and...SeniorRemote job- Google Images is Google’s visual discovery platform, helping people explore, evaluate, and understand the world visually every day. As the Product Lead, you will own the strategy, roadmap, and user experience across core visual search surfaces on mobile and desktop, partnering...Senior
- Synthires is seeking a Senior AI Trainer (Video Evaluation) contractor to evaluate AI-generated videos and provide detailed feedback on video quality... ...storytelling. You will use professional judgment and annotation tools to support selection of higher-quality outputs...SeniorRemote jobFor contractors
- Amazon.com Services LLC is seeking a Senior Principal, Product Manager - Technical for Local & Services Advertising in Seattle, WA. You will own the... ...with engineering, science, and design to build agentic AI systems, define GTM plans, and scale to billions in revenue...SeniorLocal area
- Citi's Banking Technology group seeks a visionary AI Product Lead to drive Capital Markets tooling. This senior role blends product management with software engineering, focusing on ECM deal execution, financing workflows, and AI agent leverage to enhance client service...Senior
- Rippling is seeking a Product Research Lead to shape the company’s product direction across HR, IT, and finance. You will lead research efforts, write grounded viewpoints, and partner with product, design, engineering, and data teams to guide decisions. This is a lead-level...SeniorHourly pay
- Capital One seeks a Senior Manager, Product Management (PXDP55) in New York, NY. You will lead two PM squads within Workflow Orchestrator, steering a modernization of the core platform with AI-powered workflows and scalable UI design. This role emphasizes strong leadership...Senior
- SIDRAM TECHNOLOGIES in New York seeks an experienced Product Lead to own the strategy, roadmap, prioritization, and execution of an enterprise AI platform. This role sits at the intersection of Product, Engineering, AI, and Business, driving reusable platform capabilities...Senior
- Humana is seeking a Lead Product Manager to drive the design, prototyping, and scaling of AI solutions across the enterprise. You will lead a complex AI portfolio, partner with engineers, data scientists, and business stakeholders, and shepherd projects from prototyping...Senior
- Pace, the AI operations partner for insurers, seeks a Product Partnerships leader to build the ecosystem that makes Pace more powerful, easier to deploy, and more valuable to customers. You’ll own relationships with frontier AI labs, core insurance platforms, data providers...Senior
- Capital One in New York, NY is seeking a Senior Manager of Product Management for Back Office Servicing Experiences. You will lead two product managers and set a multi-year roadmap to automate back-office operations using AI and cloud data. You’ll own end-to-end experiences...Senior
- Intuit, Inc. is seeking a Principal Product Manager for Agent Studio within the Mid-Market Product Management org. You will drive AI-native product initiatives for accountants and finance... ...of accounting workflows. You will lead research, set vision and roadmaps, and influence...Senior
$123k - $215.25k
...company is not just the products we offer, but the personal... ...market.We are looking for a Senior Technical Product Manager to lead the roadmap for tools and... ...and adoption of shared evaluation tools and workflows.... ...analytics, quality tooling, or AI products.Experience...Senior$192k - $288k
About Citi Citi, the leading global bank, has approximately 200 million... ...a broad range of financial products and services, including consumer... ...a visionary and hands-on AI Product Lead to join our Banking... ...Banking Technology group. This is a senior-level, strategic role designed...SeniorFull time- Abridge is seeking a senior Growth Marketer to lead our product-led growth motion and own paid marketing across channels. You will partner with Product, Data... ...experiments, and raise the bar for the team, leveraging AI-driven tools to accelerate research, activation, and...Senior
- Foresight Works Ltd. is seeking a senior product marketing leader to define how the market understands our AI-driven infrastructure platform. You will own positioning, messaging and the go-to-market for existing and new products, collaborating with co-founders and cross...Senior
$195k - $230k
Maven Clinic is hiring a Senior Staff Product Designer to lead the member-facing experience and innovate AI-native designs. Responsibilities include owning complex projects from concept to delivery, defining AI behavior in sensitive contexts, and creating high-fidelity...Senior- Rippling in New York, NY seeks a Senior Manager of Product Design for AI Platform to lead design across AI-enabled experiences in HR, IT, and Finance. You’ll coach senior designers, shape interaction models, and partner with product/engineering to craft trusted, scalable...SeniorWork at office
- ...banks and rails for ACH, wire, and book transfers. As the first Product Lead for Banking Infrastructure, you'll own partner-bank programs... ...driven, customer-obsessed builder who can prototype ideas, work AI-natively, and ship code while collaborating with compliance. #J...Senior
- Capital One seeks a Sr. Manager, AI Engineer to lead AI platform services, agentic AI, guardrails, and evaluation for scalable production systems in New York and other hubs. You will guide cross‑functional teams and drive responsible AI governance while optimizing performance...Senior
- AuraOne, Inc. seeks a Senior MBSE Engineer - SysML v2 for a remote evaluation track focused on assessing AI-produced code against real-world correctness standards. Reviewers reproduce failures, craft unit tests, and explain fixes to guide the modeling team. The role emphasizes...SeniorRemote jobFor contractors
- Turing is seeking a Senior Software Engineer to work on LLM evaluation and repository validation. You will perform hands-on software engineering, automate environments... ...to work across international teams on cutting-edge AI projects. Strong Ruby experience and familiarity with...SeniorRemote job
- AuraOne, Inc. is seeking a Senior AI Trainer evaluation contractor based in the United States to support remote evaluation tasks. You will review senior AI trainer prompts and responses, label edge cases, and provide structured feedback to retrain models. Responsibilities...SeniorRemote jobFor contractors10 hours per week
- AuraOne, Inc. seeks a Senior Protection Engineer (Medium Voltage / Utility Distribution) for an AI evaluation track. This remote contractor role involves reviewing generated... ...document failure modes to help improve production-quality code in a sandboxed environment....SeniorRemote jobFor contractors
$200k - $230k
Juniper Square is seeking an experienced product manager to lead technically complex, cross-functional initiatives within a fast-growing, global R&D organization. You will own a domain end to end, shaping the vision into a roadmap, driving adoption, and ensuring high standards...SeniorRemote work$90k - $124k
Overview The AI-Native Product Lead is a team-embedded product role responsible for translating business... ...: Ability to think critically and evaluate information objectively, considering... ...qualified candidate is selected. #LI-REMOTE #LI-MD1 #SENIOR #J-18808-Ljbffr CotivitiWork at officeImmediate startRemote work- Senior MBSE Engineer - SysML v2 (AI Evaluation) is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model...SeniorHourly payFor contractorsRemote work10 hours per week
- Job Title: Senior Software Engineer - LLM Evaluation & Repository Validation About the projects: we are building LLM... ...software engineers (tech lead level) who are familiar with high-quality... ...one of the world’s fastest-growing AI companies accelerating the advancement...SeniorFor contractorsFreelanceRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Evaluations & Annotations Product Lead. Be the first to apply!
- product design lead New York, NY
- product lead New York, NY
- senior living New York, NY
- legend senior living New York, NY
- senior trade analyst New York, NY
- senior accountant manufacturing New York, NY
- senior manager customer operations New York, NY
- senior director information security New York, NY
- senior full stack web developer New York, NY
- senior technical director New York, NY

