Lead PM, AI Agent Runtime & Evaluations (Remote)
Juniper Square
Juniper Square is seeking a Lead Product Manager to own the agent runtime and evaluation layer of Foundry, a platform that enables non-engineers to describe needs and deploy governed automations. You'll work with an engineering team to ship features with identity, access, and audit trails. You'll balance governance, model evaluations, and workflows, shaping the future of an AI-driven fund administration platform used by leading GPs worldwide.
#J-18808-LjbffrVacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead PM, AI Agent Runtime & Evaluations (Remote) in Seattle, WA vacancy
$200k - $230k
...JunieAI, our purpose-built AI platform, we’re... ...work, ranging from a fully remote experience to working full... ...We are looking for a Lead Product Manager to own the agent runtime and evaluation layer of Foundry, the platform... ...workflow orchestration PM on the contracts that...Remote workFull timeWork at officeLocal areaWork from homeFlexible hours$200k - $230k
...partner is looking for a Lead Product Manager, Agent Runtime & Evals based in United States... ...of an innovative AI platform designed to build... ...own the agent runtime and evaluation infrastructure, enabling non... ...retirement savings plans. Remote work support: Allowance to...Remote workFull timeHome officeFlexible hours- ...Job Title: AI Skills and Agents Lead (Low/No code) Start Date: ASAP or Mid-November Duration... ...Seattle 2-3 days per week or fully remote within the US. Allocation: 100% Full... ...including prompting, grounding, retrieval, evaluation, structured outputs, tool use, and...Remote workFull timeWork at officeImmediate start2 days per week3 days per week
YunoJuno
Seattle, WA13 days ago - ...Motion Recruitment seeks a Senior Agent PM to own end-to-end mortgage origination experiences, from point of sale to capital markets delivery... ...You will steer APIs, decisioning, and UI components, leveraging AI/LLMs to drive core product outcomes. You will partner with...Suggested
Motion Recruitment
New York, NY2 days ago $170k - $225k
...steps. Our partner is looking for a Lead Product Manager, AI Agents based in the United States. We are... .... You will also establish the evaluation frameworks, quality standards, and safety... ..., and vision insurance. Fully remote work: Remote position available across...Remote workFull timeFlexible hours$170k - $225k
...LawnStarter is the nation's leading on-demand marketplace... ...for both sides, and an AI-run company that moves faster... ...should allow. About AI Agents at LawnStarter Our... ...LawnStarter's first core AI PM role. You'll own our... ...vision Location: Fully remote (US). Evals, transcripts...Remote workFull timeLocal areaFlexible hours- ...Legion is building AI agents that handle workforce management tasks with a human-in-the... .... This Principal Product Manager role leads specification, prototyping, evaluation, and enterprise deployment of agentic AI solutions in a remote US setting. You will work closely with...Remote work
OpenKrill
New York, NY12 hours ago - ...BambooHR is seeking a Sr. Product Manager to own how agents run on our platform—the Agent Runtime. You’ll shape durable execution, governance, and instrumentation... ...for balancing engineering convenience with customer impact. Remote within the U.S. preferred. #J-18808-LjbffrRemote work
OpenKrill
United States2 days ago $60 per hour
...ethically shape the future of AI. What We Do The Mindrift platform... ...? Does an asynchronous, remote, flexible opportunity sound exciting... ...AI systems are tested and evaluated? This is a flexible, project-based... ...for QAs for autonomous AI agents for a new project focused on validating...Remote workPermanent employmentPart timeFreelanceFlexible hoursMind Rift
Raleigh, NC4 days ago- ...AuraOne is seeking an AI Agent Evaluator to remotely review and label ai agent evaluation prompts and responses against AuraOne's quality rubric. You will compare outputs, identify edge cases, and provide structured feedback to support retraining. The role focuses...Remote work
AuraOne
United States4 days ago - ...BambooHR seeks a Sr. Product Manager to own how agents run at BambooHR—the execution layer, triggers, governance, and measurable agent... ...with real consumers, and craft the roadmap for a legacy-to-new-runtime transition. You will drive architecture for the legacy platform...Remote work
BambooHR
Salt Lake City, UT1 day ago $25 - $45 per hour
...This is a fully remote position , open to candidates based in United States. Pay: $25–$45/hr Role Title: AI Agent Evaluator Role Type: Contractor Location: U.S based Opportunity Snapshot Pay: $25-45/hour Time per task: ~1.5 hours per run (evidence...Remote workFor contractorsWork at officeWeekend workRemoteJobsOne
United States3 days ago- ...Turing is seeking US-based academic dermatologists to lead clinical reviews for AI model evaluation. You will curate complex dermatology cases, contribute... ...and participation in professional societies, with fully remote, contract-based work and flexible hours. #J-18808-...Remote workContract workFlexible hours
Aitrainer
San Francisco, CA2 days ago $185k - $260k
...AI Product Manager, Agents & Orchestration This is a fully remote opportunity and can be worked from any location in... ...leap. This is the first PM seat dedicated to the agent runtime and orchestration layer.... ...memory, hand off, and get evaluated. Then you'll turn that into...Remote workFull time- ...HELP SHAPE THE FUTURE OF AI BY EVALUATING HOW WELL AI ASSISTANTS UNDERSTAND USERS, USE PERSONAL CONTEXT, AND DELIVER HELPFUL CONVERSATIONS. Location: Remote Type: Independent contractor / Part-time Project duration: up to 3 months ABOUT THE ROLE At Anyone AI, we create...Remote workPart timeFor contractors
OpenKrill
New York, NY4 days ago $150.1k - $268.5k
...Description RAND’s Center on AI, Security, and Technology (... ...policy analysis projects, and leading multidisciplinary teams of policy... ...team will build systems to evaluate how AI models perform across the... ...Development Program (CNODP), Remote Interactive Operator Training...Remote workFixed term contractWork experience placementWork from home- ...Florida. Job Summary Prove AI works. Prove what it's worth.... ...impact. Your peers will be AI leads for Solutions & Delivery/... ...good enough to ship." Design the evaluation for each capability — baseline... ...local laws. xhyhwjd #AIS Remote working/work at home options are...Remote workWork at officeLocal areaWork from homeFlexible hours
Leonardo DRS
Frederick, MD12 days ago - ...Asurion is seeking a seasoned product manager to lead Joy.ai's agent reasoning layer and drive orchestration across skills and tools. You will partner with engineering to define evaluation harnesses, guardrails, and observability to prove usefulness and trust. You will...
Asurion
New York, NY8 hours ago - YO AI Labs in the United States is seeking experienced AI Agent Power Users to contribute to an enterprise AI training project focused on evaluating and improving AI assistants in real-world business workflows. You'll test complex scenarios, document workflows, and provide...Remote job
- ...technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will have a background...Remote jobPart time
$60 per hour
...contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and critical... ...with structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define expected...Remote jobPart timeFlexible hours$80 per hour
...A tech company specializing in AI is seeking QAs for autonomous AI agents to validate and enhance task structures... ...allows contributors to work remotely while engaging in a complex AI project... ...detail, facilitating AI testing and evaluation without needing a coding...Remote workFlexible hoursMind Rift
Houston, TX4 days ago- ...TEKsystems seeks an AI Governance Lead Program Consultant to design and implement enterprise AI governance capabilities across AI agents, Copilot, and generative AI apps. You will create processes for registration, ownership, monitoring, and reviews while partnering with...Remote work
TEKsystems
Rochester, NY4 days ago - ...- An LTTS Company is seeking a Content Specialist III to evaluate, improve, and shape AI content across diverse topics. The role focuses on high-quality... ...structured guidelines consistently. The position is remote in the United States, with a 6+ month contract (W2). You...Remote workContract work
Intelliswift
New York, NY5 days ago - ...management to design Excel-based tasks that test AI's ability to perform real PM work. You bring 3+ years in PMO roles... ...You will craft tasks, write precise evaluation rubrics, and work as an independent contractor on a fully remote, task-based program with weekly payments...Remote workWeekly payFor contractors
Aptura
United States4 days ago - ...Global Payments is seeking an AI Agent Designer to shape the next generation of AI-enabled... ...workflows, create agent blueprints, and lead discovery workshops with business and technology... ...solutions. In this global role, you’ll evaluate emerging AI technologies, collaborate...Remote work
Global Payments
Columbus, OH4 days ago $107.5k - $188.4k
...the product capabilities that help ensure AI-enabled healthcare experiences are useful... ...checkpoint. AI experiences need to be evaluated, monitored, and improved continuously so... ...available upon request. SummaryLocation: USA-MA-Remote; USA-IL-Remote; USA - Coppell, TX; USA -...Remote workFull timeWork at officeWolters Kluwer
Waltham, MA1 day ago- ...Clutch is seeking an experienced product manager to lead a credit-union AI agent portfolio. You will work closely with customers on-site to shape products that don’t yet exist and guide the first deployments through production. In a high-ownership, low-process environment...Remote work
Clutch
Half Moon Bay, CA2 days ago - ...seeking a Technical Product Manager to own the agentic and core software and infrastructure layers of our platform. Your work will turn agents, scientific models, data, and experimental workflows into a coherent product that guides customers from research goals to results....
- ...created Albert OS, the first AI-native operating system for materials... ...ambitious and results-driven Agent PM to join our growing team. This... ..., prompt engineering, evaluation frameworks, and tool integrations... ...California. An international remote culture is in our DNA. We care...Remote workWork from home
Albert Invent Corp.
Oakland, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead PM, AI Agent Runtime & Evaluations (Remote). Be the first to apply!
Related searches