Platform PM: LLM Gateway, Cost & Policy
Mercor
Mercor in San Francisco is seeking a Platform Product Manager to own the LLM gateway and shared infrastructure. You’ll drive roadmap, policy, and lifecycle decisions affecting all product surfaces using frontier models. This is a high-leverage role partnering with the infra team and leadership to translate tradeoffs into durable systems. You’ll work with internal PMs and engineers to ensure reliability, cost transparency, and scalable usage policies across surfaces and models, with strong #J-18808-Ljbffr Mercor
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Platform PM: LLM Gateway, Cost & Policy in San Francisco, CA vacancy
- ...Millions of domain experts on the platform are paid over $4 million per... ...Manager, you'll own Mercor's LLM gateway, the shared layer every... ...reliably, affordably, and within policy. This is a high-leverage... ...make about priority queueing, cost attribution, rate limits, and...PlatformPolicyWork at officeRelocation package
$194k - $267k
...are too, let's talk.The Agent Gateway TeamThe Agent Gateway team owns... ...deployments, extending policy semantics beyond tool-level allowlists... ..., an agent framework, or an LLM-facing gateway in production.Prior... ...work on multi-tenant SaaS platforms at Okta or an equivalent enterprise...PlatformPolicyLocal areaWorldwideFlexible hours- ...LLM Application EngineerSoftware Guidance & Assistance, Inc., (... ...with APIs, databases, search platforms, internal services, and third-... ...response times, and operational cost.Partner with product and engineering... ...accordance with our Privacy Policy. Also, to ensure timely...PlatformPolicyFull timeRemote work
SGA
San Francisco, CA1 day ago $185k - $246k
...term customer success.Datadog’s LLM Observability product enables... ...data privacy, compliance, and cost management. As a Product... ...leading observability and security platform for the AI era, providing businesses... .... For information on our AI policy, please visit Interviewing at...PlatformPolicyWork at office$80 - $85 per hour
...client to hire a Senior AI Platform & Production Engineer... ...experience operating LLM and AI applications at... ...and enhance the LLM API Gateway, developer tooling, onboarding... ..., authorization, policy enforcement, and audit... ...latency, scalability, and cost while driving...PlatformPolicyRemote work- ...develop reusable, safe, and low-cost space vehicles and systems... ...in accordance with company's policies, priorities, and budget constraints... ...communications ground RF gateways, from concept through... ...Experience with Linux-based embedded platforms, real-time constraints, boot...PlatformPolicyPermanent employmentContract workTemporary workLocal areaWorldwide
- ...delivers an end-to-end platform that gives public and private... ...), configuration & policy, observability, reporting... ...platform as a business, not a cost center: own the... ...relationships with every product PM and engineering lead.... .... Working fluency in LLM evaluation, agentic design...PlatformPolicyContract workLocal area
$165k - $310k
Senior Research Engineer, LLM Training & Post-Training New York,... ...2019, we build an end-to-end platform for developing, training, and... ...developer-first software with cost-efficient, large-scale compute... ...Equal Employment Opportunity policy,we do not discriminate on the...PlatformPolicyFor contractorsFor subcontractorWork at officeRemote workWork from homeFlexible hours2 days per week$166.6k - $218.7k
...building Mercury's internal AI platform and enablement layer. Your work... ...engineers.Expand and operate our LLM gateway infrastructure: routing, rate limiting, cost attribution, and observability across... ...libraries, guardrails, and policy-as-code so teams can move fast safely...PlatformPolicyRemote workShift workMercury
San Francisco, CA2 days ago$200k - $250k
...integration development, LLM/AI observability... ...pipeline instrumentation, and cost optimization deep dives,... ...briefs, and partner with PM and Engineering to strengthen... ..., and Datadog platform depth.Identify high-value... ...For information on our AI policy, please visit Interviewing...PlatformPolicyFull timeWork at office- ...Our capabilities include program, project, cost, asset and commercial management,... ...ConEst, McCormick, Bluebeam, or similar platforms, with strong familiarity interpreting BIM... ...TwitterInstagramLinkedInIt is strictly against Turner & Townsend policy for candidates to pay any fee in relation...PlatformPolicyFor contractorsFor subcontractorRemote workFlexible hours
$160k - $240k
About the Role As Glean’s PM for Glean Model Hub, you will evaluate LLM models, define the... ...projections of LLM usage, cost, and capacity planning while... ...Ops and external-facing platform capabilities. Having built... ...coverage, generous time‑off policy, and the opportunity to...PlatformPolicyWork at officeHome office3 days per week- ...routing with observability, cost policies, and fallback logic Centralized... ...custom tools, and agents AI Gateway is the control plane, five composable... ...components (Prompts, LLM Gateway, MCP Gateway, Guardrails... ...of the TrueFoundry platform across all components and shape...PlatformPolicyWork at officeFlexible hours2 days per week
TrueFoundry
San Francisco, CA1 day ago $125k - $175k
...mattersSimilarweb’s digital intelligence platform powers thousands of organizations worldwide... ...experience with Large Language Models (LLM)Demonstrated ability to create demand and... ...related to your application in accordance with the Applicant Privacy Policy available here.PlatformPolicyWork at officeWork from homeWorldwideVisa sponsorshipWork visa$197.3k - $313.7k
...technical voice for data on the platform.About the TeamThe... ...to, and architect the LLM- and agent-native layer... ...and online evaluation, cost and latency tuning, hallucination... ...explain trade-offs to a PM in the same hour.A... ...employer and maintains a policy of non-discrimination...PlatformPolicyFull timeContract workLive inWork at office- ...Join us and help build the platform engineers turn to to ship AI... ...together themselves, not because a policy requires it. Platform... ...without you as the bottleneck. Gateway, auth, cost controls, and audit logging... ...own agents without deep LLM expertise. - Establish the...PlatformPolicyFull timeFlexible hours
Baseten
San Francisco, CA17 days ago $133k - $391.5k
...Five9’s AI Agent software platform, which provides... ...or exposure to GenAI / LLM-based systems ~ Experience... ...communication, and API gateways Operational... ...portion of the dependent cost. We also offer Short &... ...View our privacy policy, including our privacy...PlatformPolicyFull timeTemporary workWork at officeWorldwide3 days per week$130k - $150k
...Our capabilities include program, project, cost, asset and commercial management,... ...communications via external project management platforms (e.g., commitment management, change management... ...is strictly against Turner & Townsend policy for candidates to pay any fee in relation...PlatformPolicyFor contractorsWork at officeRemote workFlexible hours$125.5k - $261.6k
...layer of EY’s AI-native platform. These are the systems... ...governance, discovery, cost, and telemetry systems... ...dashboards (Grafana), LLM debugging and evaluation... ...pipelines so releases are policy-compliant by default... ...~ Experience with API gateways and request routing (Envoy...PlatformPolicyFull timeSummer holidayFlexible hours- About the TeamDoorDash’s GenAI Platform team sits within Machine... ...autoscaling GPUs — delivering large cost and latency wins (for example... ...surfaces including the LLM Gateway, Agent Gateway, evals infrastructure... ...with our Candidate Privacy Policy and applicable state laws. In...PlatformPolicyHourly payWork at officeLocal areaRemote workFlexible hours
- ...overseeing a complex ecosystem from Core Compute (Kubernetes) to in‑house storage primitives and security platforms. You will drive roadmaps, ensure reliability, and optimize costs at scale. You’ll collaborate with engineering leadership to align product development with long‑...Platform
$197.3k - $313.7k
...business as the greatest platform for change and in... ...cloud-infrastructure needs, cost (COGS) optimization, and... ...partner closely with Dev, QA, PM, and UX to ensure... ...RAG, vector search, and LLM workflow orchestration,... ...employer and maintains a policy of non-discrimination with...PlatformPolicyFull time$160k - $280k
...Glean: Glean is the Work AI platform that helps everyone work... ...connectors, flexible LLM choice, and robust APIs,... ...vendor lock-in or costly implementation cycles. At... ...experience. As Glean’s PM for Agent Security and Governance... ..., generous time‑off policy, and the opportunity to...PlatformPolicyWork at officeHome officeFlexible hours$274k - $305k
...their work entirely. AI Platform is the group that... ...and provides the model gateway, the tool and MCP registry... ...treating prompts, tools, and policies as production code and... ...systems reliable and cost-aware. Work closely... ...systems work in depth: LLM agents, orchestration,...PlatformPolicyFull timeWork at officeLocal areaRemote work2 days per week3 days per weekgusto
San Francisco, CA11 days ago- ...payments and financial platform for global businesses. Powered... ...such as graph, ML, and LLM, to implement and... ...requirements.Work with PM, Design, Ops, Commercial... ...reliability, scalability, and cost efficiency for real-time... ....Applicant Safety Policy: Fraud and Third-Party RecruitersTo...PlatformPolicyTemporary workLocal areaWorldwideRelocation
$144.5k - $180.6k
...revolutionary cloud-based platform to authoritative figures in... ...AI infrastructure (AI Gateway & Agent Registry) while ensuring... ...AI Gateway to manage LLM API routing, rate limiting, cost controls, and model selection... ...applicable law or company policy.Comprehensive Medical,...PlatformPolicyFull timeTemporary workWork at officeLocal areaRemote workWorldwideHome office3 days per week- PayJoy is seeking a Product Manager for the Lock Platform in our San Francisco office. You will own programs that strengthen the security... ..., and communicate progress to leadership, ensuring readiness for new markets and compliance with policies. #J-18808-Ljbffr PayJoyPlatformPolicyWork at office
$153k - $296k
...accessible to all. Figma’s platform helps teams bring ideas... ...right model based on cost and capability, and the... ...'s product to share gateways and avoid duplicate layers... ...cost, capability, and policy with a full audit trail... ...-on experience with LLM operations: model gateways...PlatformPolicyMinimum wageFull timeLocal areaRemote workFlexible hoursFigma
San Francisco, CA3 days ago$215k - $245k
...and dramatically lower costs (52% fewer ER visits, 26... ...infrastructure we are building — a platform that connects healthcare... ...Opportunity As a Staff PM on Pod-Agents, you will... ...agentic AI systems, LLM-based product... ...package ~ Flexible vacation policy – take the time you need...PlatformPolicyLocal areaFlexible hoursPair Team
San Francisco, CA4 days ago$380k
...integration and API management platform, connecting the world's... ...to bridge traditional API gateways with dynamic LLM routing, runtime traffic enforcement... ...complies with corporate policies and regulatory frameworks.... ...requests to optimize for cost vs. performance, attribute...PlatformPolicy
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Platform PM: LLM Gateway, Cost & Policy. Be the first to apply!
Related searches
- digital platform specialist San Francisco, CA
- platform manager San Francisco, CA
- director of digital platform San Francisco, CA
- platform product manager San Francisco, CA
- power platform San Francisco, CA
- education policy research San Francisco, CA
- public policy intern San Francisco, CA
- health policy San Francisco, CA
- public policy San Francisco, CA
- policy summer internship San Francisco, CA