Product Manager, AI Evaluations & Frontier Models
$160.5k - $200.5kBoxinc
WHAT IS BOX?
Box (NYSE:BOX) is the leader in Intelligent Content Management. Our platform enables organizations to fuel collaboration, manage the entire content lifecycle, secure critical content, and transform business workflows with enterprise AI. We help companies thrive in the new AI-first era of business. Founded in 2005, Box simplifies work for leading global organizations, including JLL, Morgan Stanley, and Nationwide. Box is headquartered in Redwood City, CA, with offices across the United States, Europe, and Asia. By joining Box, you will have the unique opportunity to continue driving our platform forward. Content powers how we work. It’s the billions of files and information flowing across teams, departments, and key business processes every single day: contracts, invoices, employee records, financials, product specs, marketing assets, and more. Our mission is to bring intelligence to the world of content management and empower our customers to completely transform workflows across their organizations. With the combination of AI and enterprise content, the opportunity has never been greater to transform how the world works together and at Box you will be on the front lines of this massive shift.WHY BOX NEEDS YOU
We're looking for a high-agency, deeply AI-fluent Product Manager to own AI Evaluations — a highly cross-functional, highly visible role at the front lines of how Box assesses, launches, and manages the AI models that power our product. You'll run rigorous evaluations of frontier models, own the decision of which models power Box Agents, shape how the world's leading model providers understand enterprise performance, and own the full lifecycle of every model we support. This is a hands-on role for someone who deeply knows the AI landscape and can do their own work: statistically literate, comfortable in code, and able to build the evals, run the analyses, and prototype the pipelines themselves rather than spec them out for someone else. It sits at the intersection of technical depth, go-to-market execution, and external partnerships — connective tissue across Product, Marketing, Partnerships, and Engineering — and it's a fit for someone who thrives in ambiguity, moves fast on tight timelines, and brings order to messy, fast-evolving problem spaces.WHAT YOU'LL DO
Run rigorous evaluations across frontier models (OpenAI, Anthropic, Google/Gemini) and continuously mature the stack, methodology, and process behind them. Define what makes a high-quality evaluation dataset and robust, cost-appropriate graders, and translate what end users care about into measurable criteria. Drive synthetic data generation and data-generation pipelines to ensure they are high-quality, reliable, and scalable. Own online evaluations, turning real production usage into rich insight on how our product is actually used. Lead each model launch end to end, managing the process, the stakeholders, and the timeline. Own the external narrative for each model launch — partnering with Product Marketing on blog, social, and PR content, and creating video demos yourself. Build and manage deep relationships with model providers and AI companies — securing early access to frontier models, delivering technical deep-dives back to providers, and identifying collaboration opportunities on evaluations and benchmarking. Identify, pitch, and structure opportunities to collaborate with providers and other AI companies specifically on evaluations and benchmarking. Run evaluations to decide whether a model is production-ready, and own the decision of which models power agentic products at Box. Assess the compliance posture of production models, partner on model pricing decisions, and define how and when we deprecate models.WHO YOU ARE
We are an AI-first company. This means you approach your work with a growth mindset and find ways to leverage AI to help make faster, smarter decisions that will 10X your impact at Box. You have a minimum of 2 years of product management experience. You know the AI landscape deeply, follow frontier models closely, and can hold your own in a technical conversation with any model provider. You're technical and hands-on : statistically literate and comfortable enough in code (Python, SQL, notebooks) to build your own evals, run your own analyses, and prototype your own data pipelines. You've driven cross-functional launches across Product Marketing, Communications, Developer Relations, and Engineering. You're an excellent written and verbal communicator who can represent Box externally, presenting complex, technical topics simply to senior stakeholders. You operate with extremely high agency, taking ambiguous, undefined problems and driving them to resolution on tight timelines. You're fluent across many stakeholders—from Product Marketing and Sales to Security, Legal, and Compliance—adapting your communication to each audience. You're a natural disambiguator who makes messy, fast-moving AI problems simple and clear. Preferred skills Direct experience with AI/ML products, model evaluation, or benchmarking. Experience managing external partnerships with vendors or providers. Box lives its values, with community and in-person collaboration being a core part of our culture. Boxers are expected to work from their assigned office a minimum of 3 days per week.Your Recruiter will share more about how we work and company culture during the hiring process. At Box, we believe unique and diverse experiences benefit our culture, our products, our customers, our company, and our world. We aim to recruit a passionate, high-performing workforce that reflects the world we live in.If you are head-over-heels about this role but unsure if you meet all the requirements, we encourage you to apply!EQUAL OPPORTUNITY
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, and any other protected ground of discrimination under applicable human rights legislation. Box strives to respect the dignity and independence of people with disabilities and is committed to giving them the same opportunity to succeed as all other employees. Inclusiveness is core to our culture at Box, and we strive to ensure you get the most from your interview experience. Box makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please complete this form . Reasonable accommodations may include scheduling adjustments, document dictation and beyond. Notice to applicants in Los Angeles: Box, Inc and its related branches will consider for employment, qualified applicants with criminal histories in a manner consistent with the Los Angeles Fair Chair Ordinance. The Fair Chance Ordinance is provided here . Notice to applicants in San Francisco: Box, Inc and its related branches will consider for employment, qualified applicants with criminal histories in a manner consistent with the San Francisco Fair Chair Ordinance. The Fair Chance Ordinance is provided here . For details on how we protect your information when you apply, please see our Personnel Privacy Notice. If you are a California-resident, please read our California Applicant & Candidate Privacy Notice here . Box is committed to fair and equitable compensation practices. Actual base salary (or OTE if commissionable role) is dependent upon factors such as: knowledge, skill level, experience, and work location. This role is also eligible for equity and benefits. For more information , check out our benefits and perks . In accordance with OFCCP compliance, here is the Pay Transparency Provision . United States Pay Range $160,500 — $200,500 USD #J-18808-Ljbffr BoxincVacancy posted 19 hours ago
Similar jobs that could be interesting for youBased on the Product Manager, AI Evaluations & Frontier Models in Redwood City, CA vacancy
$170k - $190k
Redwood CityProduct Management - Operations /FT /On-siteProduct... ...Manager, Physical AI (or) Senior Product Growth Manager,... ...Foresight world model, robotics, and Physical... ...teams operate at the frontier of Physical AI innovation... ...deployment outcomes, evaluate ROI, and connect...SuggestedFull timeLocal area$132k - $240k
...At Snorkel, we believe meaningful AI doesn’t start with the model, it starts with the data. We’re on... ..., high performance, and production-ready systems. We work with some of... ...Marketing, the Product Marketing Manager, Frontier Labs will own the GTM execution for...SuggestedLocal area- C3 AI (NYSE: AI), is the Enterprise AI... ...fully integrated products including the C3 Agentic... ...talented Product Manager, Platform - Cloud... ..., cloud tenancy models, and API and data... ...and customers to evaluate and continuously improve... ...where commercial frontier model APIs are not...Suggested
- ...Product Manager, Data EngineDyna Robotics builds general-purpose robots powered by a proprietary embodied AI foundation model with top-in-industry generalization and real-world performance. Already... ...and visualization systems, model evaluation tooling, and task management,...SuggestedLive inRemote workShift work
- C3 AI (NYSE: AI), is the Enterprise AI application... ...of fully integrated products including the C3... ...: 5+ years of product management experience, with a strong... ...infrastructure (ingestion, modeling, pipelines, governance... ...(model development, evaluation, deployment,...Suggested
$190k - $240k
...Snorkel, we believe meaningful AI doesn’t start with the model, it starts with the data.... ..., high performance, and production-ready systems. We work... ...strategic Senior Product Manager with deep AI/ML expertise... ...synthetic data systems, evaluations, and data-acceleration...Temporary workLocal area$188.5k - $255k
...customers worldwide using products such as TurboTax,... ...shift to AI-native, Done-For-You... ...role sits at the frontier of how enterprise... ...defining new interaction models (natural language... ...PDX builds is evaluated against one question... ...to platform-managed, IDE-first developer...WorldwideShift work- Luma seeks an accomplished social media leader to define how frontier AI shows up in culture. You will own that claim—setting strategy, building the team, and leading the content engine to make Luma the most-watched, most-referenced creative tech brand online. You'll own...
$220k - $280k
...Snorkel, we believe meaningful AI doesn’t start with the model, it starts with the data.... ..., high performance, and production-ready systems. We work... ...looking for a Technical Product Manager to own the roadmap and... ...PM who understands and can evaluate these tools' impact on...Full timeLive inLocal area$226.19k - $292.71k
...possible, together.Director, Data/AI Product Owner, ResearchAs part of our... ...Product Owners and Product Managers. Prioritize the product... ...and scale product operating model for consistency in delivery.Translate... ...and financial acumen to evaluate trade‑offs and recommend data...Full timeFor contractorsLocal area$177k - $265k
...Job SummaryDesigns, develops and manages the lifecycle of a product or group of products from concept... ...features.ResponsibilitiesGenerative AI, Cloud, and Data... ...engineering and architecture teams to evaluate large language model architectures, AI agents, cloud deployment...Full timeWork at office- ..., incomplete elevation models, slow refresh cycles, or... ...-resolution 3D data products of the Earth at unprecedented... .... As Product Manager, 3D Geospatial Products... ...matter, how customers evaluate quality, and how we prioritize... .... Familiarity with AI, automation, or machine...Permanent employmentFull timeRemote workNight shift
- ...powers the next generation of AI infrastructure. We address... ...About the Role We are seeking a Product Manager — AI Infrastructure Platform... ..., manage tradeoffs between model performance and operational constraints... ...how these buyers evaluate and adopt infrastructure software...
- Luma is seeking a senior, autonomous product manager to build enterprise AI solutions from the model up, turning frontier multimodal capabilities into scalable customer offerings in marketing, advertising, and entertainment. You’ll operate with a GM mindset and own P&L...
$160k - $175k
...continents. Our leading AI technology is the... ...creativity and productivity, and our solutions... ...Outbound Product Managers (Agentic AI) who... ...guiding them through evaluation and testing of... ...integration of AI models into applications... ...role sits at the frontier of where product innovation...Full timeFor contractorsWorldwideFlexible hours$164k - $323k
...are seeking a highly skilled Staff IT Product Manager for Internal AI to drive the strategy, delivery, and... ...Alto, CA for our hybrid working model.Key ResponsibilitiesAI Product Strategy... ..., requirements gathering, vendor evaluation, prototyping, and implementation to...Local areaWorldwideFlexible hours$200k - $245k
...deliveries across numerous US cities. ‘Autonomy Data Flywheel’ is an internal Data product initiative that leverages on this large scale of real world robots and super-charges our End-End AI model development. It covers the entire data lifecycle starting with the data...Odd jobLive inLocal areaRemote work$228.8k - $403.2k
...believe meaningful AI doesn’t start with the model, it starts with the... ...high performance, and production-ready systems. We... ...directly with frontier AI labs on their hardest... ..., developing evaluation frameworks, and translating... ...roles5+ years managing or leading technical...Local area$138k - $245k
SummaryJoin Guidewire's Product Development &... ...with a strong focus on AI, data, and customer-centricity... ...As an Outbound Product Manager for AI and Workflow Automation... ...agents, tools, memory, evaluation, observability), AI... ...observability, and the Model Context Protocol (MCP)....Full timePart timeFlexible hours- C3 AI (NYSE: AI), is the Enterprise AI application... ...of fully integrated products including the C3 Agentic... ...Senior Director of Product Management to lead our Defense and... ...on a common data model comprised of a diverse... ...product suite.Build and evaluate business cases to support...Work at office
- C3 AI (NYSE: AI), is the Enterprise AI application software company... ...a family of fully integrated products including the C3 Agentic AI... ...an experienced Senior Product Manager to lead the development and growth... ...AI, data pipelines, and model operationalization.Proven experience...Temporary work
$217k - $236k
...compelling goal, define the product strategy and roadmap... ...strategy to improve model performance on simulation... ...build out dedicated evaluations. Drive product landings... ...enable downstream embodied AI use cases.Influence... ...experience in product management or related technical role...$215k - $300k
...harmful, leading to worse models that cost more to... ...Microsoft, Amazon, and AI visionaries like Geoff... ...team has pioneered this frontier research area and has... ...the RoleAs our first Product Manager, you will own the product... ...how ML teams evaluate tools, what makes them...Work at officeWork from homeRelocation package$188.2k - $258.8k
...tissue tests, real-world data and AI analytics. Guardant tests... ...Position Summary:The Senior Product Manager, AI will lead the delivery and... ...the ability to critically evaluate and responsibly leverage AI-enabled... ...quality of work.Hybrid Work Model:This section is applicable to...Full timeWork at officeWork from home$163k - $237k
...safe, fair, and transparent AI, taking novel ideas from... ...way to developer adoption.Manage a broad range of technical... ...scaled processes for GenAI model training, tuning, evaluation, and launch configurations... ...and enhance researcher productivity.Act as a master collaborator...$190k - $261.8k
...open science and AI-powered biology or... ...pioneering work to combine frontier AI with frontier... ...Technical Program Manager with expertise in... ...help shape the product and application... ...security reviews, threat modeling, and incident... ...experience, as evaluated throughout the interview...Work at officeRelocation packageShift work3 days per week- Treasure AI:Treasure AI is the agentic experience platform built... ...:We’re looking for a Lead Product Manager to define and drive the strategy... ..., RAG systems, multimodal models, etc.), prototype quickly, and... ...of AI trends: Continuously evaluate emerging LLMs, multimodal capabilities...Contract workTemporary workWork at officeFlexible hoursNight shift
$140k - $250k
...also built and shaped products used by millions of people... ..., and imagine how AI can fundamentally reinvent... ...using foundation models, agents, retrieval systems... ...controls. Build evaluation frameworks to measure... ...to 9+ years of product management experience, including...Work at office3 days per week$136k - $204k
...About the Team Klaviyo's AI & Analytics pillar is building... ...intelligence layer behind the product — models that optimize send times,... ...looking for a Senior Product Manager to own both what Klaviyo's ML... ...each model family, set the evaluation frameworks, and work with ML...Full timeTemporary work- C3 AI (NYSE: AI), is the Enterprise AI... ...fully integrated products including the C3 Agentic... ...3 AI is seeking a Manager / Senior Manager,... ...foundation-model providers, beginning... ...fine-tuning, RAG, evaluation, and agentic patterns... ...stakeholders at a frontier lab.Working...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Manager, AI Evaluations & Frontier Models. Be the first to apply!
Related searches
- product manager oncology Redwood City, CA
- remote associate product manager Redwood City, CA
- product manager banking Redwood City, CA
- product launch manager Redwood City, CA
- platform product manager Redwood City, CA
- senior director product management Redwood City, CA
- senior manager product engineering Redwood City, CA
- product manager electronics Redwood City, CA
- senior manager product development Redwood City, CA
- product manager beauty Redwood City, CA



