Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Product Manager, Agent Harness & Modelling

Cohere

Who are we? Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems. We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that. We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft. We are a global technology company co-headquartered in Toronto and San Francisco, with key offices in London, New York City, Montreal, Seoul, Germany and Paris. Join us! About Cohere and North Cohere is revolutionizing enterprise AI with North, an agentic AI platform designed to securely deploy AI agents and automations within organizations' infrastructure. North empowers employees to streamline workflows, automate repetitive tasks, and unlock actionable insights while ensuring data privacy and compliance. North combines cutting-edge generative and search models with customizable integrations to drive productivity and innovation at scale. Role Overview We are seeking an Agent Harness Product Manager to own the execution layer that makes North agents reliable, capable, and production-ready. This is a role that sits at the intersection of three domains: Agent Loop and Execution: Own the core agent runtime: tool orchestration, parallel execution, sub-agent delegation, sandbox code execution, and failure recovery. You will define how North agents plan and act across long, multi-step workflows and ensure the execution environment is robust enough for the most demanding enterprise tasks. You are expected to engage at the implementation level, contributing to architecture decisions alongside engineering rather than simply handing off requirements. Context Engineering: Own how our Agents manage the context window as a deliberately controlled resource. This includes progressive disclosure of tools and skills, context compaction and summarization, offloading of large payloads to a persistent filesystem, and the instrumentation that keeps agents oriented across extended trajectories. Model-Scaffolding Co-evolution: Own the feedback loop between North's harness and the Modeling Team. This PM is the connective tissue that makes that possible: ensuring harness design decisions are validated by Modeling before they are built, that evals are the shared bridge between both teams, and that as the harness evolves the model evolves with it. Responsibilities Define and own the roadmap for North's agent harness, including the agent loop, context engineering layer, tool orchestration, sandbox execution, and sub-agent delegation. Serve as the primary interface between North engineering and Cohere's Modeling team, ensuring new harness capabilities are validated before being built and that neither team paints itself into a corner. Own North's agentic evaluation framework, ensuring evals are compatible with both the North harness and Modeling's training infrastructure, and that they serve as a reliable bridge between product and research. Engage enterprise customers to surface real-world agentic failures and translate findings into concrete product and model requirements. Stay current with the open-source and commercial agent ecosystem and drive adoption decisions that keep North's architecture aligned with emerging standards. Requirements 5+ years of product management experience in agentic AI systems, developer infrastructure, or applied ML products. Deep understanding of modern LLM agent architectures, including multi-agent systems, tool-augmented reasoning, memory and retrieval, programmatic orchestration, RAG, and long-horizon execution. Strong grasp of agentic evaluation design, including how to measure task completion, failure recovery, and long-horizon reliability, and how to diagnose model vs. scaffolding gaps. Technically deep enough to contribute to architecture decisions at the implementation level: comfortable reviewing and shaping design docs, reasoning about async execution patterns, sandboxed environments, filesystem design, and the tradeoffs that come with building harness capabilities into a production platform. Ability to flex between ML research conversations and engineering architecture discussions with equal fluency. Track record of shipping platform-layer products with demonstrated impact on reliability, performance, or capability. Nice-to-Haves An active practitioner of agent frameworks who regularly builds with and follows the latest developments in open-source harnesses, coding agents, and orchestration tools in both professional and personal work. Hands-on experience with enterprise agentic deployments: multi-tenant orchestration, tool permissioning, audit trails, and compliance requirements. Familiarity with infrastructure constraints relevant to enterprise deployments: on-premises environments, scalability challenges, and the operational tradeoffs of running complex agent workloads in restricted or air-gapped settings. Prior work at the intersection of research and product, translating nascent model capabilities into shipped product features. Background working within or closely alongside an ML research or post-training team. Why Join Cohere? Impact: Shape how Canada's most important public institutions adopt and deploy frontier AI. Innovation: Work alongside leading researchers and engineers solving complex ML challenges. Growth: Competitive compensation, equity options, and opportunities for professional development. Flexibility: Hybrid work model with offices in key global locations (Toronto, Montreal, New York, San Francisco, London, Paris, and Korea). Full-Time Employees at Cohere enjoy these Perks: A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch. Full health and dental benefits, including a separate budget for mental health. RRSP matching, 401K, Pension Scheme. 100% Parental Leave top-up for up to 6 months, for either parent. Annual enrichment benefits: Arts & culture, fitness/wellness, quality time, and a workspace improvement credit. Education & learning stipend for conferences, courses, and coaching. 6 weeks of paid vacation (30 working days!) Budget for traveling to other offices if you are remote, plus an annual company offsite. How and Where We Work: Cohere is remote-friendly. We have offices in Toronto, San Francisco, New York City, London, Paris, Montreal, and more coming soon. For those in the office: a daily lunch program, plenty of snacks, and regular community and social events. For those not near an office: a co-working benefit so you can work alongside others in your city. Everyone receives a $500 home office stipend to set up your workspace properly. If any of the above doesn’t line up exactly with your experience, we still encourage you to apply. We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit Accommodations Request Form, and we will work together to meet your needs. We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider. #J-18808-Ljbffr Cohere

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Product Manager, Agent Harness & Modelling in New York, NY vacancy
  • Cohere is seeking an Agent Harness Product Manager to own the execution layer for North, enabling reliable, production-ready agents. You’ll shape...  ...orchestration while working closely with engineering and modeling teams. You will engage with enterprise customers,... 
    Suggested

    Cohere

    New York, NY
    1 day ago
  • $192k - $240k

    What You'll Do Own the Agent Integrations roadmap, determining which...  ...surface by leading product strategy for self-hosted AI workloads...  ..., AI agents, MCP servers, and model orchestration tools, so Datadog...  ...Sales, and Technology Partner Managers on launches, GTM content (blogs... 
    Suggested

    The Consulting Solutions

    New York, NY
    3 days ago
  • $202k - $230k

    The Product Management team drives Asana’s product strategy and execution, translating customer needs...  ...the world. As the Product Manager for Agent Context in NYC, you will lead the...  ...while adopting the best elements of hybrid models to ensure that every one of our global... 
    Suggested
    Work at office
    Work from home
    Worldwide

    Decisive Point

    New York, NY
    3 days ago
  •  ...Health, and Hunter Douglas to deploy AI agents that power personalized, deeply...  ...experience their brand, end to end. Agent Product Managers are the people they trust to make that...  ...the frameworks, and the decision‑making models that make a top‑down transformation feel... 
    Suggested
    Full time
    Work at office
    Local area

    Decagon

    New York, NY
    2 days ago
  •  ...know (and probably love). Our AI agent helps businesses handle even...  ...Google. We work in a hybrid model from our London office, a short...  ...legal/security due diligence, and managing the seamless transition from...  ...feedback that shapes the product roadmap. Establish scalable,... 
    Suggested
    Work at office
    2 days per week
    3 days per week

    Gradient Labs

    New York, NY
    3 days ago
  • $205.6k - $257k

     ...exciting advancements in AI, including frontier model training, enterprise adoption, defense applications...  ...important decisions. We’re looking for an AI Product Manager to own the Healthcare vertical within our Agents Data & Reinforcement Learning Environments team.... 

    Scale AI, Inc.

    New York, NY
    3 days ago
  •  ...growing, global client base, proven product-market fit, and backing from world-class...  ...an exceptional, high-agency product manager to own Felix, the agent at the core of Rogo. This is one of...  ...ship continuously Stay ahead of where models and agent paradigms are going, and... 

    rogo.ai

    New York, NY
    4 days ago
  • $127k - $250k

     ...investible assets. Every day, our teams harness cutting-edge AI and breakthrough...  ...future team member for the role of Senior Product Manager to join our Developer Experience team....  ...include: Familiarity with large language models (LLMs), prompt engineering, or GenAI-... 
    Temporary work
    Work experience placement
    Worldwide
    Flexible hours

    BNY

    New York, NY
    15 days ago
  • $150k - $190k

    Senior Product Manager, Modeling & Machine Learning Operations Remote - United States WHO WE ARE Zeta Global (NYSE: ZETA) is the AI‑Powered Marketing...  ...a user‑friendly Model Workbench that empowers marketers to harness the power of Machine Learning without the need for deep... 
    Remote work

    Zeta-Global

    New York, NY
    4 days ago
  • $180k - $210k

     ...building applied AI that drives real productivity gains and transforms how the...  ...entrepreneurial and experienced Product Manager to join as a founding member of the Agents team and help us build the next...  ...products while the underlying model ecosystem continues changing... 
    Full time
    Temporary work
    Local area
    Flexible hours
    Shift work

    Traba

    New York, NY
    18 hours ago
  •  ...Responsibilities Define and own the product vision, roadmap, and go‑to‑market strategy for AI agents that automate core supply‑chain...  ...proprietary shift data into AI models, ensuring accuracy, security,...  ...5+ years of product management experience, with a focus on AI/... 
    Shift work

    Gravity Engineering Services Pvt Ltd.

    New York, NY
    18 hours ago
  •  ...DESCRIPTION Unleash your expertise in product development and optimization by...  ...and Security Authentication Platforms and Modelling team, you contribute to the team by leveraging...  ...strategy to execution and blend operational management of product requirements and releases... 

    J.P. Morgan

    New York, NY
    15 days ago
  •  ...how artificial intelligence and data products are governed, built, and scaled across...  ...institutions. As a Vice President - Product Manager, Agent Ready Data in the Chief Data and...  ...frameworks, initiatives, and large language models (LLMs) in a professional setting *... 
    Full time
    Work at office

    JPMorgan Chase & Co.

    New York, NY
    11 hours ago
  • $170k - $280k

    Cresta is looking for a Forward Deployed Product Manager to create and optimize AI Agents for our clients. This role combines product thinking and project leadership, focusing on delivering tangible results. The ideal candidate will lead customer relationships and ensure... 
    Remote job

    Cresta

    New York, NY
    1 day ago
  • $60.8k - $93.6k

    Publicis Groupe Holdings B.V is seeking a Product Manager in New York focused on deploying and managing AI agents. The role requires 4+ years of experience in product management or AI operations, familiarity with LLM tools like Microsoft Copilot, and strong adaptability... 

    Publicis Groupe Holdings B.V

    New York, NY
    2 days ago
  •  ...continuous conversation for every patient. An AI agent that knows who you are, remembers how...  ...— including new specialties, new products, and multi-site rollouts Own strategic...  ...Ruthless prioritization and strong time management across a portfolio of concurrent high-complexity... 
    Work at office
    Flexible hours

    Assort Health Inc.

    New York, NY
    2 days ago
  •  ...disruption by providing both configurable, turnkey, private AI agents based on their own data and an AI agent platform for custom...  ...are looking for a strong individual contributor to join as a product manager on our team. This person will have an outsized impact on the... 
    Remote work

    Squid Cloud, Inc.

    New York, NY
    3 days ago
  • The Cigna Group is seeking a Senior Product Manager for Agent Experience to design AI-powered tools and workflows that help customer service agents and operations teams perform better. You will define product strategy, own roadmaps, partner with engineering and design,... 
    Remote work

    Dormont Manufacturing Co

    New York, NY
    2 days ago
  • Scaled Cognition is looking for a Product Manager for Agent Twin in New York, NY. This role is pivotal in shaping the product strategy and focuses on customer discovery, product requirements, and technical implementation. The ideal candidate has proven experience in managing... 

    Scaled Cognition

    New York, NY
    4 days ago
  • $202k - $230k

    Asana is hiring a Product Manager for Agent Context in New York City. This role involves driving the strategy and execution of AI-powered retrieval systems that enhance productivity for teams globally. The ideal candidate will have over 5 years of experience in product... 

    Asana

    New York, NY
    18 hours ago
  • About Us: At Applied Labs, we are building frontier AI agents and AI applications for growing businesses. We are at an inflection...  ...The Role: We are growing rapidly and looking for an AI Agent Product Manager to join our team. The ideal candidate will have a passion for... 
    Flexible hours

    Applied Labs

    New York, NY
    2 days ago
  • JPMorgan Chase & Co. in New York seeks a product leader to own AI use cases end-to-end—from discovery and framing through requirements...  ...with data science, engineering, and business partners. You’ll manage backlogs and sprints, define success metrics, and ensure governance... 

    JPMorgan Chase & Co.

    New York, NY
    1 day ago
  • $160k - $220k

    Product New York Full-time $160,000 - $220,000 About the Role Own the product strategy and roadmap for our AI agent platform. You'll work closely with engineering, research, and customers...  ...Looking For 4+ years of product management experience Experience with developer... 
    Full time
    Work at office

    Lattice, Inc.

    New York, NY
    1 day ago
  • Dormont Manufacturing Co is seeking an Agent Product Manager to revolutionize how B2B companies engage prospects using AI. You will work closely with enterprise clients to design and implement optimized workflows and AI solutions. This hands-on role requires a mix of product... 

    Dormont Manufacturing Co

    New York, NY
    3 days ago
  • A fast-growing AI service company is seeking an Agent Product Manager to own core product lines and collaborate with cross-functional teams. The role requires 3 to 6 years of product management experience, particularly in B2B SaaS or AI. Responsibilities include defining... 
    Full time

    Avoca

    New York, NY
    18 hours ago
  • Agent Product Manager About Titan Titan is building the AI workforce for IT. We deploy AI agents across our portfolio of Managed Service Providers and enterprise customers: agents that monitor, triage, and resolve work across the service desk, infrastructure, security,... 

    Titan

    New York, NY
    1 day ago
  • JPMorgan Chase & Co. in New York seeks a product manager to own AI use cases end-to-end in a regulated banking environment. You’ll design, ship, and sustain agentic systems powering productivity and automation for bankers, coordinating with data science, engineering, and... 

    慨正橡扯

    New York, NY
    1 day ago
  • A technology company is seeking an experienced Product Manager to help train AI models. You will evaluate chatbots’ performance and implement improvements. Candidates should have strong financial reasoning skills, with a preference for those holding or pursuing advanced... 
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    3 days ago
  • Insider, Inc. is looking for an experienced Product Manager in New York City to own the software platform and agent layer for our AI-driven autonomous lab. You'll directly collaborate with engineers and scientists to define features and enhance product delivery. The ideal... 

    Insider, Inc.

    New York, NY
    2 days ago
  • $150k - $190k

     ...this at the structural level. Our platform deploys Per-Account Agents™ across our customers’ TAM, working 24/7 to research,...  ...Round Capital, and more. About The Role As one of our Agent Product Managers, you'll be at the forefront of how B2B companies transform their... 
    Work at office
    Shift work

    Actively AI

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Product Manager, Agent Harness & Modelling. Be the first to apply!