Product Manager, AI Observability & Evaluation
LangChain
LangChain is seeking a Product Manager to own key parts of LangSmith. Building AI products is transforming how software teams operate, and LangSmith is the observability, evals and deployment platform enabling reliable AI systems. You will work at the intersection of user experience and production infrastructure, partnering with engineers to deliver intuitive, scalable features for complex prompt chains and evaluation systems.
#J-18808-LjbffrVacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Product Manager, AI Observability & Evaluation in San Francisco, CA vacancy
$175k - $220k
...Together AI is looking for a Product Manager to join our fast-growing team in San Francisco. In this role, you will drive day-to-day product work across our AI infrastructure, focusing on observability and GPU clusters. The ideal candidate will possess strong data skills...SuggestedTogether AI
San Francisco, CA3 days ago$140.3k - $260.5k
...data, analytics, business products, and AI/ML to enable fast, targeted... ...As a Senior Data Product Manager - Analytics & AI , you will... ...including leading build-vs.-buy evaluations for data tooling.... ...proficient in modern data observability, data quality, governance,...SuggestedLocal areaRelocation package3 days per weekGenentech
San Francisco, CA4 days ago- ...are building the future of AI connectivity, empowering developers... ...intelligence. As a Staff Product Manager for AI Management, you will... ..., context, guardrails, and evaluation.Lead cross-departmental... ...AI gateways, LLM routing, AI observability, prompt management, guardrails...Suggested
Kong
San Francisco, CA8 days ago $160k - $262.5k
...tools — model providers, agent SDKs, evaluation and observability platforms, cloud services. Temporal... ...those pieces together and makes them production-grade. That position is a strategic... ...a dedicated owner.As Staff Product Manager, AI Ecosystem, you own Temporal's integrations...SuggestedImmediate startRemote workTemporal Technologies
San Francisco, CA8 days ago- ...Amazon Web Services, Inc. is seeking a Product Marketing Manager for the AWS Observability portfolio in San Francisco. You will translate cloud observability into customer value for AI-driven monitoring and agent observability, partnering with product and GTM teams to...Suggested
Amazon
San Francisco, CA4 days ago - ...us HighLevel is an AI-powered business operating... ...opportunity to build products that support millions... ...The Staff Product Manager – VoiceAI will own the... ...retries, failure handling, observability, and infrastructure... ...prompts, guardrails, prompt evaluation, knowledge retrieval,...Local areaRemote workWorldwide
Logoslabs
San Francisco, CA4 days ago $154.9k - $225.3k
...foundation behind cloud-managed networking experiences... ...with passionate product teams and engineers who... ...the next generation of AI-driven and agentic networking... ...prioritize work and evaluate outcomes.Preferred... ...telemetry platforms, observability products, or large-scale...Full timeTemporary workLocal areaRemote workFlexible hoursCISCO Systems
San Francisco, CA7 days ago- ...IT & Tech, Enterprise Software, AI and Machine Learning, SaaS & PaaS, Product Management, Automation, RPA and BPAJob Type... ...developer empathy, grounded in observing and improving real workflows (e.... ...orchestration, prompt iteration, evaluation, observability)Awareness of how...Permanent employmentFull timeImmediate startRemote workFlexible hours
Chronos Consulting
San Francisco, CA6 days ago - ...Summary Pantomath is hiring a Senior Product Manager for AI with direct, hands‑on experience building... ...trusted to take, how their output is evaluated, and where the boundary sits between... ...for accuracy, latency, cost, observability, and security. Build and own the evaluation...
Pantomath
San Francisco, CA2 days ago - ...delegating to autonomous AI systems those mission-... ...Kevin Weil (Chief Product Officer at OpenAI), Arash... ...the role As a Product Manager working on AI systems,... ...predict Partner on evaluation frameworks to accelerate... ...with engineering on observability and monitoring systems...Work at officeWork from homeWorldwideMonday to Friday
Luminai
San Francisco, CA3 days ago $147k - $185k
...Model: Customer-facing product role, with regular on-... ...is a venture-backed AI security company. Their... ...into production safely: evaluating models and... ...Public Sector AI Product Manager to help shape their platform... ...controls, governance, observability, and agentic systems....Full timeRemote workSitreps
San Francisco, CA3 days ago- ...Product Manager For Ai PlatformEvenUp is on a mission to close the justice gap using technology... ...extraction and analysis services, model evaluation and deployment tools, and more.... ...-term and long-term disability.10 US observed holidays, and Canadian statutory holidays...Temporary workLocal areaHome officeFlexible hours3 days per week
EvenUp Inc.
San Francisco, CA17 hours ago $150k - $200k
...marketers to grow. Today, our AI helps members create... ...to the Head of Product, AI Systems and Core Experience... ...quality definitions, evaluation criteria and... ...not traditional product management conducted through specs... ...comparable evaluation and observability platforms Worked on...Remote workRelocationFlexible hoursFlodesk
San Francisco, CA17 hours ago- ...CoreWeave, the AI Hyperscaler™, acquired Weights... .... W&B can now build products that connect application... ...Director of Product Management, this Staff Product Manager... ..., and infrastructure observability workflows, maintaining... ..., and more. You'll evaluate which new concepts have...Temporary workCasual workWork at officeFlexible hours
Weights & Biases
San Francisco, CA4 days ago $104.9k - $199.07k
...questions. Through our products, education, and... ...healthcare cost and care management.MedInsight is a subsidiary... ...analytics and AI products. This role will... ...deployment workflows, observability, reliability, security... ...experience metrics to evaluate whether platform capabilities...Full timeWork experience placementRemote workFlexible hoursMilliman
San Francisco, CA8 days ago- ...us HighLevel is an AI-powered business operating... ...and assets, create product configurations, invoke... ...a Principal Product Manager to own the long-term product... ..., permissions, and observability. Establish the... ...ranking, caching, latency, evaluation, observability, and...Local areaRemote workWorldwide
Logoslabs
San Francisco, CA4 days ago $161.5k - $285k
...and spreadsheet workflows. AI has changed who gets to build... ...shipping ungoverned software into production grows just as fast. At... ...a dependable way to deploy, manage, observe, secure, and scale it across... ...architecture discussions and evaluate tradeoffs with senior...Retool Inc.
San Francisco, CA4 days ago- ...About us HighLevel is an AI-powered business operating system... ...HighLevel's Conversation AI product is designed to close that... ...information, book and manage appointments, trigger workflows... ...latency, caching, reliability, evaluation, observability, data architecture, and cost...Local areaImmediate startRemote workWorldwide
Logoslabs
San Francisco, CA4 days ago $111.2k - $190.3k
...engagements across the U.S. and the global RSM network. The Product Owner, Assurance Digital, will manage and evolve AI-enabled tools, emerging technologies, and digital... ..., and stakeholder updates.Monitor and evaluate emerging AI, audit technology, and digital capabilities...Full timeWork experience placementInternshipLocal areaFlexible hoursRSM International
San Francisco, CA6 days ago$166k - $228k
...but building what comes next.Job Title:AI Technical Product OwnerCompany:PrologisA day in the... ...-service, support operations, vendor management, and enterprise workflows. This role... ...-the-loop workflows, guardrails, and evaluation frameworks.· Experience managing AI use...Full timeContract workPrologis
San Francisco, CA9 days ago$159k - $305k
...seeking a Senior Lead Digital Product Manager within the Marketing & Sales... ...new enterprise Generative AI capabilities — EMM & Orchestration... ...‑grade reliability, observability, and governance by supporting... ...SLAs, telemetry, red‑teaming, evaluation harnesses, model risk...Full timeWork experience placementRelocation packageWells Fargo
San Francisco, CA4 days ago$142.2k - $264k
...Position Technical Product Owner, RDT Lead – 3PD... ...predictive analytics, and AI/ML capabilities.... ...platforms. Delivery Management: Lead end-to-end technical... ...implement monitoring, observability, and issue‑remediation... ...with the ability to evaluate technical options and...Local areaImmediate startRelocation packageGenentech
San Francisco, CA4 days ago$210k - $240k
...the forefront of transforming product quality and customer satisfaction... .... Our cutting-edge AI-powered platform empowers manufacturers... ...looking for a Senior Product Manager to own the data foundation and... ...data quality, data labeling, or evaluation products.Experience with...Local areaFlexible hoursNight shiftWeekend workAxion Ray
San Francisco, CA8 days ago- ...of developers use to create their own products. Plaid powers the tools millions of people... ..., London, and Amsterdam.As a Product Manager on the AI & Data Foundations team, you will... ...processed and how models are developed, evaluated, deployed, and monitored. You can engage...Work experience placementLocal areaImmediate start
Plaid Financial
San Francisco, CA6 days ago $210k - $240k
...the RoleAnyscale is seeking a Senior / Staff Product Manager to lead Ray Data, our scalable data processing library for ML and AI workloads.This is a uniquely challenging... ...Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion...Work at officeRelocationFlexible hoursAnyscale
San Francisco, CA7 days ago$194.6k - $285.7k
...enterprises use our unified security and observability platform to keep their digital systems... ...external) and field teams to understand product gaps and translate them into clear priorities... ...with SplunkExperience with agentic AI, Model Context Protocol, enterprise RAG...Full timeTemporary workWork experience placementLocal areaFlexible hoursCISCO Systems
San Francisco, CA4 days ago- ...advocacy. Job Title : Software Product Manager Independent Contractor (... ...lines and help identify and evaluate new opportunities to grow... ...device determinations, and AI/ML‑enabled device... ...translate surgeon and OR workflow observations into user needs, requirements...Contract workPart timeFor contractorsWork at officeLocal areaRemote workWorldwide
Logoslabs
San Francisco, CA4 days ago $186.1k - $300.55k
...intelligent agreement management, Docusign unleashes business... ...Commerce Application Product Management group owns... ...for this role is an AI-first product mindset:... ...AI capabilities are evaluated, measured, and improved... ...learningEstablish observability across commerce platforms...Contract workWork at officeLocal areaImmediate startRemote work2 days per weekDocuSign
San Francisco, CA5 days ago$260k - $300k
...Snorkel, we believe meaningful AI doesn’t start with the model,... ..., high performance, and production‑ready systems. We work with some... ...our founding AI Data Product Manager to own Snorkel’s Agentic Data... ...tool‑use and long‑horizon task evaluation) and an informed view on...Local areaShowcify
San Francisco, CA4 days ago$188k - $235k
...Ironclad is the leading AI contracting platform that transforms... ...for Contract Lifecycle Management, a Fortune Great Place to Work... ...make it useful within the core product experience. This includes importing... ...human-in-the-loop controls, evaluation, monitoring, and safe failure...Full timeContract workUS Health Partners, LLC
San Francisco, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Manager, AI Observability & Evaluation. Be the first to apply!
Related searches
- iot product manager San Francisco, CA
- product manager oncology San Francisco, CA
- product compliance manager San Francisco, CA
- manager product development San Francisco, CA
- servicenow product manager San Francisco, CA
- remote associate product manager San Francisco, CA
- product manager remote San Francisco, CA
- senior global product manager San Francisco, CA
- data product manager San Francisco, CA
- product manager lighting San Francisco, CA