Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Product Manager, Agent Harness & Modelling

Cohere

Who are we?Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.We are a global technology company co-headquartered in Toronto and San Francisco, with key offices in London, New York City, Montreal, Seoul, Germany and Paris. Join us!About Cohere and NorthCohere is revolutionizing enterprise AI with North, an agentic AI platform designed to securely deploy AI agents and automations within organizations' infrastructure. North empowers employees to streamline workflows, automate repetitive tasks, and unlock actionable insights while ensuring data privacy and compliance. North combines cutting-edge generative and search models with customizable integrations to drive productivity and innovation at scale.Role OverviewWe are seeking an Agent Harness Product Manager to own the execution layer that makes North agents reliable, capable, and production-ready. This is a role that sits at the intersection of three domains:Agent Loop and Execution: Own the core agent runtime: tool orchestration, parallel execution, sub-agent delegation, sandbox code execution, and failure recovery. You will define how North agents plan and act across long, multi-step workflows and ensure the execution environment is robust enough for the most demanding enterprise tasks. You are expected to engage at the implementation level, contributing to architecture decisions alongside engineering rather than simply handing off requirements.Context Engineering: Own how our Agents manage the context window as a deliberately controlled resource. This includes progressive disclosure of tools and skills, context compaction and summarization, offloading of large payloads to a persistent filesystem, and the instrumentation that keeps agents oriented across extended trajectories.Model-Scaffolding Co-evolution: Own the feedback loop between North's harness and the Modeling Team. This PM is the connective tissue that makes that possible: ensuring harness design decisions are validated by Modeling before they are built, that evals are the shared bridge between both teams, and that as the harness evolves the model evolves with it.ResponsibilitiesDefine and own the roadmap for North's agent harness, including the agent loop, context engineering layer, tool orchestration, sandbox execution, and sub-agent delegationServe as the primary interface between North engineering and Cohere's Modeling team, ensuring new harness capabilities are validated before being built and that neither team paints itself into a cornerOwn North's agentic evaluation framework, ensuring evals are compatible with both the North harness and Modeling's training infrastructure, and that they serve as a reliable bridge between product and researchEngage enterprise customers to surface real-world agentic failures and translate findings into concrete product and model requirementsStay current with the open-source and commercial agent ecosystem and drive adoption decisions that keep North's architecture aligned with emerging standards.Requirements5+ years of product management experience in agentic AI systems, developer infrastructure, or applied ML productsDeep understanding of modern LLM agent architectures, including multi-agent systems, tool-augmented reasoning, memory and retrieval, programmatic orchestration, RAG, and long-horizon executionStrong grasp of agentic evaluation design, including how to measure task completion, failure recovery, and long-horizon reliability, and how to diagnose model vs. scaffolding gapsTechnically deep enough to contribute to architecture decisions at the implementation level: comfortable reviewing and shaping design docs, reasoning about async execution patterns, sandboxed environments, filesystem design, and the tradeoffs that come with building harness capabilities into a production platformAbility to flex between ML research conversations and engineering architecture discussions with equal fluencyTrack record of shipping platform-layer products with demonstrated impact on reliability, performance, or capability.Nice-to-HavesAn active practitioner of agent frameworks who regularly builds with and follows the latest developments in open-source harnesses, coding agents, and orchestration tools in both professional and personal workHands-on experience with enterprise agentic deployments: multi-tenant orchestration, tool permissioning, audit trails, and compliance requirementsFamiliarity with infrastructure constraints relevant to enterprise deployments: on-premises environments, scalability challenges, and the operational tradeoffs of running complex agent workloads in restricted or air-gapped settingsPrior work at the intersection of research and product, translating nascent model capabilities into shipped product featuresBackground working within or closely alongside an ML research or post-training teamWhy Join Cohere?Impact: Shape how Canada's most important public institutions adopt and deploy frontier AI.Innovation: Work alongside leading researchers and engineers solving complex ML challenges.Growth: Competitive compensation, equity options, and opportunities for professional development.Flexibility: Hybrid work model with offices in key global locations (Toronto, Montreal, New York, San Francisco, London, Paris, and Korea)Full-Time Employees at Cohere enjoy these Perks:A weekly lunch stipend of $75/75 or equivalent in your local currency for lunch.Full health and dental benefits, including a separate budget for mental health.RRSP matching, 401K, Pension Scheme.100% Parental Leave top-up for up to 6 months, for either parent.Annual enrichment benefits:Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.Education & learning stipend for conferences, courses, and coaching.6 weeks of paid vacation (30 working days!)Budget for traveling to other offices if you are remote, plus an annual company offsite.How and Where We Work:Cohere is remote-friendly. We have offices in Toronto, San Francisco, New York City, London, Paris, Montreal, and more coming soon.For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.For those not near an office: a co-working benefit so you can work alongside others in your city.Everyone receives a $500 home office stipend to set up your workspace properly.If any of the above doesn’t line up exactly with your experience, we still encourage you to apply. We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers page.LocationToronto; London; Montreal; New YorkEmployment TypeFull timeLocation TypeRemoteDepartmentProduct Management & Program ManagementProduct Management

Vacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the Product Manager, Agent Harness & Modelling in New York, NY vacancy
  • $156k - $195k

     ...real world. As a Sr. PM on the Agent Integrations team, you will...  ...AI integration surface. Lead product strategy for self-hosted AI workloads...  ..., AI agents, MCP servers, and model orchestration tools, so...  ...Sales, and Technology Partner Managers on launches, GTM content (blogs... 
    Suggested
    Work at office

    Datadog

    New York, NY
    4 days ago
  • $205.6k - $257k

     ...exciting advancements in AI, including frontier model training, enterprise adoption, defense applications...  ...most important decisions.We’re looking for an AI Product Manager to own the Healthcare vertical within our Agents Data & Reinforcement Learning Environments team.... 
    Suggested
    Full time

    Scale AI

    New York, NY
    2 days ago
  • $180k - $210k

     ...building applied AI that drives real productivity gains and transforms how the...  ...entrepreneurial and experienced Product Manager to join as a founding member of the Agents team and help us build the next...  ...products while the underlying model ecosystem continues changing... 
    Suggested
    Temporary work
    Local area
    Flexible hours
    Shift work

    Traba

    New York, NY
    1 day ago
  • $192k - $240k

    As the Senior Product Manager for the Actions & Automations team, you will own the ecosystem that...  ...teams to build, deploy, and operate AI agents on Datadog. You will drive the strategy...  ...experience, integrations, and extensibility model that make Datadog the best place to... 
    Suggested
    Work at office

    Datadog

    New York, NY
    2 days ago
  • $192k - $240k

     ...'d be building a zero to one product of what we believe will become...  ...roadmap spanning the Data agent experience, the semantic/context...  ...in B2B SaaS Product Management, with at least some of it spent...  ...applications, infrastructure, data, models, and security into one place,... 
    Suggested
    Live in
    Work at office

    Datadog

    New York, NY
    10 hours ago
  •  ...shaping how artificial intelligence and data products are governed, built, and scaled across...  ....As a Vice President - Product Manager, Agent Ready Data in the Chief Data and Analytics...  ...frameworks, initiatives, and large language models (LLMs) in a professional settingClear... 
    Work at office

    JP Morgan Chase

    New York, NY
    2 days ago
  • $156k - $195k

    As a Product Manager II for Model Lab, you will define and launch Datadog’s experiment tracking platform built for teams training and fine-tuning foundational models. Model Lab centralizes metrics, hyperparameters, datasets, code versions, artifacts, and lineage to help... 
    Work at office

    Datadog

    New York, NY
    2 days ago
  • $127k - $250k

     ...Senior Product Manager – Developer Experience (New York, NY) At BNY, a leading global financial services company, we harness cutting‑edge AI and breakthrough technologies to transform software...  ...Familiarity with large language models (LLMs), prompt engineering, or GenAI... 
    Temporary work
    Work experience placement
    Worldwide
    Flexible hours

    BNY

    New York, NY
    1 day ago
  • Unleash your expertise in product development and optimization by leveraging user research...  ...Security Authentication Platforms and Modelling team, you contribute to the team by leveraging...  ...to execution and blend operational management of product requirements and releases... 
    Work visa

    JP Morgan Chase

    New York, NY
    1 day ago
  •  ...disruption by providing both configurable, turnkey, private AI agents based on their own data and an AI agent platform for custom...  ...are looking for a strong individual contributor to join as a product manager on our team. This person will have an outsized impact on the... 
    Remote work

    Squid Cloud, Inc.

    New York, NY
    14 hours ago
  • $385k

     ...beneficial AI systems. About the role As a Product Manager focused on Developer Productivity, you'...  ...ship code—the foundation on which every model, evaluation, and product feature depends...  ...shift in how software gets built—as AI agents move from autocomplete to autonomous... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours
    Shift work

    Anthropic

    New York, NY
    1 day ago
  • Unleash your expertise in product development and optimization by leveraging user research, analyzing...  ...financial organizations.As a Vice President, Product Manager within the Trust & Security Authentication Platforms and Modeling team, you will leverage your expertise in... 
    Work visa

    JP Morgan Chase

    New York, NY
    1 day ago
  • $113.1k - $232.3k

     ...Summary An Applied AI Product Manager is a senior individual...  ...Applied AI Product Manager harnesses AI and agentic tools to compress...  ...competitive analysis, using AI agents to synthesize research at...  ...Promote a product operating model that emphasizes outcomes over... 
    Work at office
    Local area
    Shift work

    Deloitte

    New York, NY
    2 days ago
  • $205.6k - $257k

     ...advancements in AI, including frontier model training, enterprise...  ...industry measures coding agents. We then extended that foundation...  ...'re looking for a Senior AI Product Manager to own and scale this Coding...  ..., agentic scaffolds and harnesses, and coding benchmarks such... 
    Full time

    Scale AI

    New York, NY
    1 day ago
  • $165k - $187k

     ...of structured finance and quantitative models and methodologies for fixed income securities...  ...of quantitative models and risk management framework for fixed income securities, equities...  ...team to ensure timely releases of the product with enhanced capabilities and the... 
    Full time
    Remote work

    Intercontinental Exchange

    New York, NY
    3 days ago
  •  ...a strategic, execution-oriented Senior Product Manager (Director / Senior Director) to lead Digital...  ...vision, business cases, operating models, and commercialization strategies for new...  ...assets. Every day, our teams harness cutting-edge AI and breakthrough technologies... 
    Work experience placement
    Worldwide
    Flexible hours

    The Bank of New York Mellon

    New York, NY
    10 hours ago
  • $290k - $310k

     ...is responsible for the products that enable...  ...for a Senior Product Manager to own Roku's targeting...  ...this scaleShape Roku's modeled audience strategy — including...  ..., we work with it. AI agents and smart tools help power...  ...toolchain — coding harnesses like Claude Code or Cursor... 
    Work at office
    Local area
    Remote work
    Monday to Thursday
    Flexible hours

    Roku

    New York, NY
    3 days ago
  • $156k - $195k

     ...development and increasingly complex software delivery workflows. As a Product Manager II on the Developer Engagement team, you'll help bring...  ...at scale. It brings applications, infrastructure, data, models, and security into one place, using AI to detect and resolve... 
    Work at office

    Datadog

    New York, NY
    2 days ago
  • You enjoy shaping the future of product innovation as a core leader, driving value...  ...that resonate with clients.As a Product Manager in C360 - World Model, you will be the hands-on owner of...  ...that keeps every team, dataset, and AI agent describing the client the same way.... 
    Contract work

    JP Morgan Chase

    New York, NY
    1 day ago
  • $147.6k - $274k

     ...leveraging data and novel computational models to drive impact. Seamless data sharing and...  ...strategic, unified group whose goal is to harness the transformative power of data and...  ...Senior Machine Learning Scientist building agents for applied small-molecule drug design. You... 
    Full time
    Local area
    Worldwide
    Relocation package

    Genentech

    New York, NY
    4 days ago
  • $340k - $425k

     ...banking with intuitive spend management, bill pay, and travel software...  ...you need to grow your career.Product at BrexThe Product team is at...  ...in creating features, models, and tools that empower our GTM...  ...work in this domain include AI agents for GTM workflows, developing... 
    Work at office
    Remote work
    3 days per week

    Brex

    New York, NY
    2 days ago
  • $159.6k - $231k

     ...platform that helps dealmakers find, manage, and close more deals by...  ...to do business. As a Senior Product Manager , you'll be part of a...  ...we're embracing a hub-hybrid model, designed to balance flexibility...  ...anyone to cultivate and fully harness their network to succeed. #J-1... 
    Work at office
    Remote work
    Worldwide
    Flexible hours
    2 days per week
    3 days per week

    Affinity Inc

    New York, NY
    2 days ago
  •  ...future team member for the role of Senior Product Manager, Collateral & Funding Markets to join...  ..., or secured financing operating models.Deep working knowledge of funding market...  ...investible assets. Every day, our teams harness cutting-edge AI and breakthrough technologies... 
    Worldwide
    Flexible hours

    The Bank of New York Mellon

    New York, NY
    1 day ago
  • $150k - $350k

     ...seeking an exceptional, AI-native Senior+ Product Manager to build and lead the intelligence and...  ...transactions.You will design and scale model-driven infrastructure that continuously...  ...writing prompts, designing evaluation harnesses, or prototyping with LLMs/foundation... 
    Work experience placement
    Local area
    Work from home
    Relocation package
    Shift work

    Hopper

    New York, NY
    3 days ago
  • $127k - $250k

    Director, Technical Product Manager:At BNY, our culture allows us to run our...  ...assets. Every day, our teams harness cutting-edge AI and...  ...aware retrieval systemsMulti-agent coordination modelsBalance innovation...  ...operationalize AI at scale, incorporating model lifecycle management,... 
    Temporary work
    Work at office
    Worldwide
    Flexible hours

    The Bank of New York Mellon

    New York, NY
    2 days ago
  • $125.38k - $261.6k

     ...collaboration—and we need a product leader who can help us...  ...a mid-career product manager to shape how Roku...  ..., we work with it. AI agents and smart tools help power...  ...toolchain — coding harnesses like Claude Code or...  ...testing, marketing mix modeling) and the vendor landscapeTechnical... 
    Work at office
    Local area
    Remote work
    Monday to Thursday
    Flexible hours

    Roku

    New York, NY
    2 days ago
  • $130.6k - $219.5k

     ...depend on physical operations to harness Internet of Things (IoT) data...  ...shaping an exciting array of product solutions, including Video-...  ...looking for a Senior Product Manager to help grow Samsara’s revenue...  ...growth processes. * Champion and model Samsara’s cultural principles... 
    Full time
    Remote work
    Flexible hours

    Samsara

    New York, NY
    3 days ago
  • $216k - $270k

     ...world’s most advanced models — fueling breakthroughs...  ...to bring AI into production that performs when it...  ...Software Engineer on Agent Oversight, you will build...  ...observability tooling, evaluation harnesses, and the pipelines...  ...and necessary to manage applicants’ needs, provide... 
    Full time

    Scale AI

    New York, NY
    2 days ago
  • $140k - $200k

     ...them, we are building applied AI that drives real productivity gains and transforms how the global supply chain...  ..., and General Catalyst.You'll build the AI agents themselves—the harnesses, evals, orchestration, and model strategy the rest of Traba's product runs on. We... 
    Temporary work
    Local area
    Shift work
    Day shift

    Traba

    New York, NY
    1 day ago
  •  ...business has endless whitespace - adjacent product lines, new regions, and new go-to-market...  ...natural path is toward broader general management or product leadership - owning larger...  ...the economics. Build the business case, model unit economics (CAC, LTV, payback, contribution... 
    Flexible hours

    Ethos Life

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Product Manager, Agent Harness & Modelling. Be the first to apply!