Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Product Manager, Agent Harness & Modelling

Cohere

Who are we? Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI. We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. We like to work hard and move fast to do what’s best for our customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each person is one of the best in the world at what they do. We believe that a diverse range of perspectives is a requirement for building great products. Join us on our mission and shape the future! About Cohere And North Cohere is revolutionizing enterprise AI with North, an agentic AI platform designed to securely deploy AI agents and automations within organizations' infrastructure. North empowers employees to streamline workflows, automate repetitive tasks, and unlock actionable insights while ensuring data privacy and compliance. North combines cutting‑edge generative and search models with customizable integrations to drive productivity and innovation at scale. Role Overview We are seeking an Agent Harness Product Manager to own the execution layer that makes North agents reliable, capable, and production‑ready. This is a role that sits at the intersection of three domains: Agent Loop and Execution: Own the core agent runtime: tool orchestration, parallel execution, sub‑agent delegation, sandbox code execution, and failure recovery. You will define how North agents plan and act across long, multi‑step workflows and ensure the execution environment is robust enough for the most demanding enterprise tasks. You are expected to engage at the implementation level, contributing to architecture decisions alongside engineering rather than simply handing off requirements. Context Engineering: Own how our Agents manage the context window as a deliberately controlled resource. This includes progressive disclosure of tools and skills, context compaction and summarization, offloading of large payloads to a persistent filesystem, and the instrumentation that keeps agents oriented across extended trajectories. Model‑Scaffolding Co‑evolution: Own the feedback loop between North’s harness and the Modeling Team. This PM is the connective tissue that makes that possible: ensuring harness design decisions are validated by Modeling before they are built, that evals are the shared bridge between both teams, and that as the harness evolves the model evolves with it. Responsibilities Define and own the roadmap for North’s agent harness, including the agent loop, context engineering layer, tool orchestration, sandbox execution, and sub‑agent delegation. Serve as the primary interface between North engineering and Cohere’s Modeling team, ensuring new harness capabilities are validated before being built and that neither team paints itself into a corner. Own North’s agentic evaluation framework, ensuring evals are compatible with both the North harness and Modeling’s training infrastructure, and that they serve as a reliable bridge between product and research. Engage enterprise customers to surface real‑world agentic failures and translate findings into concrete product and model requirements. Stay current with the open‑source and commercial agent ecosystem and drive adoption decisions that keep North’s architecture aligned with emerging standards. Requirements 5+ years of product management experience in agentic AI systems, developer infrastructure, or applied ML products. Deep understanding of modern LLM agent architectures, including multi‑agent systems, tool‑augmented reasoning, memory and retrieval, programmatic orchestration, RAG, and long‑horizon execution. Strong grasp of agentic evaluation design, including how to measure task completion, failure recovery, and long‑horizon reliability, and how to diagnose model vs. scaffolding gaps. Technically deep enough to contribute to architecture decisions at the implementation level: comfortable reviewing and shaping design docs, reasoning about async execution patterns, sandboxed environments, filesystem design, and the tradeoffs that come with building harness capabilities into a production platform. Ability to flex between ML research conversations and engineering architecture discussions with equal fluency. Track record of shipping platform‑layer products with demonstrated impact on reliability, performance, or capability. Nice‑to‑Haves An active practitioner of agent frameworks who regularly builds with and follows the latest developments in open‑source harnesses, coding agents, and orchestration tools in both professional and personal work. Hands‑on experience with enterprise agentic deployments: multi‑tenant orchestration, tool permissioning, audit trails, and compliance requirements. Familiarity with infrastructure constraints relevant to enterprise deployments: on‑premises environments, scalability challenges, and the operational tradeoffs of running complex agent workloads in restricted or air‑gapped settings. Prior work at the intersection of research and product, translating nascent model capabilities into shipped product features. Background working within or closely alongside an ML research or post‑training team. Why Join Cohere? Impact: Shape how Canada’s most important public institutions adopt and deploy frontier AI. Innovation: Work alongside leading researchers and engineers solving complex ML challenges. Growth: Competitive compensation, equity options, and opportunities for professional development. Flexibility: Hybrid work model with offices in key global locations (Toronto, Montreal, New York, San Francisco, London, Paris, and Korea). We value and celebrate diversity and strive to create an inclusive work environment for all. We welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs. Full‑Time Employees At Cohere Enjoy These Perks Open and inclusive culture and work environment. Work closely with a team on the cutting edge of AI research. Weekly lunch stipend, in‑office lunches & snacks. Full health and dental benefits, including a separate budget to take care of your mental health. 100% Parental Leave top‑up for up to 6 months. Personal enrichment benefits towards arts and culture, fitness and well‑being, quality time, and workspace improvement. Remote‑flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co‑working stipend. 6 weeks of vacation (30 working days). If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply! #J-18808-Ljbffr Cohere

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Product Manager, Agent Harness & Modelling in New York, NY vacancy
  • Cohere is looking for an Agent Harness Product Manager in New York to define and manage the roadmap for the North agent platform. This role involves direct collaboration with engineering and modeling teams to ensure reliable, capable AI systems. Candidates should have... 
    Suggested

    Cohere

    New York, NY
    1 day ago
  • $2,000 per month

     ...intermediate or automated by our agent. We are early. RevenueCat...  ...responses (prompt engineering, context management, evaluation) Work directly with the CEO and Head of Product, Platform to define the future...  ...with OpenAI and Anthropic models specifically Familiarity with subscription... 
    Suggested
    Remote work
    Flexible hours

    RevenueCat

    New York, NY
    4 days ago
  •  ...interaction layer — the front end of products that users engage with, and sometimes abuse. Our AI agents, integrated workflows, and deep...  ...is hiring an Agent Product Manager to help design, deploy, and...  ...systems — you don’t need to train models, but you should understand how... 
    Suggested
    Work experience placement

    Cinder

    New York, NY
    11 hours ago
  •  ...Software Engineer, Agent Harness Engineering · Full-time · San Francisco; New York Our mission is to...  ...capabilities that power agent experiences across Cursor products. This spans agent orchestration, tools, guardrails, and model behavior tuning—designed as a platform that... 
    Suggested
    Full time
    Work at office

    Anysphere

    New York, NY
    3 days ago
  • $180k - $210k

     ...building applied AI that drives real productivity gains and transforms how the...  ...entrepreneurial and experienced Product Manager to join as a founding member of the Agents team and help us build the next...  ...products while the underlying model ecosystem continues changing... 
    Suggested
    Temporary work
    Local area
    Flexible hours
    Shift work

    Traba

    New York, NY
    2 days ago
  • $240k - $334k

     ...Group Product Manager, Agent Security Mountain View, California, US; New York City, New York, US; San Francisco, California, US About...  ...of experience, knowledge, backgrounds and perspectives and harness these qualities to create extraordinary impact. We are committed... 
    Full time

    DeepMind

    New York, NY
    3 days ago
  • $168k - $258.75k

     ...Be Doing Collaborating with community model builders to ensure seamless model support...  ...ecosystem impact of new releases. Supporting product marketing in crafting model‑specific...  ...significant work experience in product management or technical partner management. BS or... 
    Work experience placement
    3 days per week

    NVIDIA

    New York, NY
    2 days ago
  •  ...disruption by providing both configurable, turnkey, private AI agents based on their own data and an AI agent platform for custom...  ...are looking for a strong individual contributor to join as a product manager on our team. This person will have an outsized impact on the... 
    Remote work

    Squid Cloud, Inc.

    New York, NY
    1 day ago
  • A global energy services company seeks an experienced Product Specialist to join its Earth Modeling software portfolio. This role focuses on innovation in geosciences and requires proficiency in geostatistical modeling and software development. Ideal candidates will have... 

    Halliburton Energy Services

    New York, NY
    3 days ago
  • A technology company is seeking an experienced Product Manager to help train AI models. You will evaluate chatbots’ performance and implement improvements. Candidates should have strong financial reasoning skills, with a preference for those holding or pursuing advanced... 
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    2 days ago
  • JPMorgan Chase & Co. is seeking a Product Manager for its AI/ML Solutions team in New York. The role involves shaping the future of product innovation through effective model serving strategies. The ideal candidate will have over 5 years of experience in product management... 

    JPMorgan Chase & Co.

    New York, NY
    2 days ago
  • $168k - $258.75k

     ...leading tech company in New York is seeking a seasoned professional with over 7 years in product management or technical partnerships. The role involves collaboration with community model builders, product marketing support, and tracking open model trends. Qualifications... 
    3 days per week

    NVIDIA

    New York, NY
    3 days ago
  • Capital One is seeking a Senior Associate, Product Management - Athena Data Model Lead in New York. This role drives data models for Card servicing, collaborating with diverse teams including analysts and product managers. The ideal candidate has product management experience... 

    Capital One

    New York, NY
    1 day ago
  •  ...humanity. We're training and deploying frontier models for developers and enterprises who are...  ...generation, semantic search, RAG, and agents. We believe that our work is instrumental...  ...is a requirement for building great products. Join us on our mission and shape the... 
    Full time
    Work at office
    Remote work
    Flexible hours

    Cohere

    New York, NY
    3 days ago
  •  ...time Location Type On-site Department Product About the Company Valon is building the...  ...operate our own mortgage servicing business managing $110+ billion in loans. This wasn't the...  ...flows through one system with rich data, AI agents don't just automate tasks, they... 
    Full time
    Live in
    Local area
    Flexible hours
    Weekend work

    Insider, Inc.

    New York, NY
    11 hours ago
  • $159.5k - $191.4k

     ...Constant Contact is seeking a Senior Product Leader to oversee their customer-facing AI experience. This role requires over 8 years of product management experience, ideally in the SaaS sector, along with a strong foundation in AI fluency. Candidates should have proven... 

    Constant Contact

    New York, NY
    4 days ago
  • $124k - $329.2k

     ...GitHub is seeking a Product Manager for the Agent Platform, responsible for defining the product vision and strategy while prioritizing customer needs and market dynamics. The successful candidate will champion enterprise security leaders and developers to ensure impactful... 

    GitHub

    New York, NY
    4 days ago
  •  ...A logistics technology startup is seeking an experienced Product Manager to lead the development of AI-driven solutions. The role involves gathering user feedback, creating product roadmaps, and driving implementations in collaboration with stakeholders. Ideal candidates... 

    Augment

    New York, NY
    4 days ago
  •  ...A high-growth AI company in the United States is seeking a Head of Product to lead the product strategy and execution of its enterprise automation platform. The ideal candidate has over 8 years of experience in B2B SaaS product leadership, with a strong background in security... 
    Remote work

    Discover International

    New York, NY
    4 days ago
  • $202k - $230k

    The Product Management team drives Asana’s product strategy and execution, translating customer needs and opportunities into a compelling roadmap...  ...of teams around the world. As the Product Manager for Agent Context in NYC, you will lead the strategy and execution for... 
    Work at office
    Work from home
    Worldwide

    Asana

    New York, NY
    4 days ago
  • $180k - $210k

    Traba is seeking an entrepreneurial Product Manager to join our team in New York City. You will be responsible for developing AI-driven products that enhance supply chain workflows. The role involves deep customer engagement, rapid prototyping, and collaboration with technical... 

    Traba

    New York, NY
    1 day ago
  •  ...A technology startup in the United States is seeking a Product Manager to develop AI agents and platforms. This role involves crafting roadmaps, engaging with enterprise clients, and providing market education. The ideal candidate will have experience in startup environments... 

    Squid Cloud, Inc.

    New York, NY
    1 day ago
  • A growing AI service solutions company in New York City is seeking an Agent Product Manager to lead a core product line from discovery to deployment. This role requires 3-6 years of product management experience, preferably in B2B SaaS or AI. The successful candidate will... 

    Avoca, Inc.

    New York, NY
    1 day ago
  • $202k - $230k

    Asana is hiring a Product Manager for Agent Context in New York City. This role involves driving the strategy and execution of AI-powered retrieval systems that enhance productivity for teams globally. The ideal candidate will have over 5 years of experience in product... 

    Asana

    New York, NY
    4 days ago
  • $150k - $190k

     ...this at the structural level. Our platform deploys Per-Account Agents™ across our customers’ TAM, working 24/7 to research,...  ...Round Capital, and more. About The Role As one of our Agent Product Managers, you'll be at the forefront of how B2B companies transform their... 
    Work at office
    Shift work

    Actively AI

    New York, NY
    1 day ago
  • Join to apply for the Senior Product Manager, Agentic AI role at Granted Mission The US healthcare system is complex, error‑prone, and financially draining. Medical bills and insurance coverage shouldn’t be this hard to navigate. At Granted, we’re building the one solution... 
    Shift work

    Granted

    New York, NY
    4 days ago
  •  ...companies engage with their customers. Our AI-powered conversational agents handle every high-value inbound call, including booking jobs,...  ...visible impact. About the Role We're looking for an Agent Product Manager to own one of our core product lines and drive it from... 
    Full time
    Work at office
    Immediate start
    Shift work

    Avoca

    New York, NY
    1 day ago
  • $150k - $185k

    Product Manager - AI Agent New York City (HQ) Product In office Full-time Superblocks is reimagining software development for a billion builders. Our mission is to help every team build, deploy, and manage AI-powered software with full control and flexibility. Why... 
    Full time
    Work at office

    Superblocks

    New York, NY
    3 days ago
  • $215k - $300k

    Harvey is seeking a Product Manager, New Verticals to drive AI solutions for strategic customers in New York. This role involves deep customer discovery, translating complex requirements into actionable product definitions, and collaborating with engineering teams. The... 

    Harvey

    New York, NY
    4 days ago
  • $120k - $240k

    Pallet is seeking an Enterprise Agent Product Manager to oversee customer deployments and ensure long-term success. This highly client-facing role involves understanding complex workflows and translating them into executable AI agent workflows. The ideal candidate has over... 

    Pallet

    New York, NY
    11 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Product Manager, Agent Harness & Modelling. Be the first to apply!