Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Product Manager, AI Evaluations & Frontier Models

$160.5k - $200.5k

Boxinc

WHAT IS BOX?

Box (NYSE:BOX) is the leader in Intelligent Content Management. Our platform enables organizations to fuel collaboration, manage the entire content lifecycle, secure critical content, and transform business workflows with enterprise AI. We help companies thrive in the new AI-first era of business. Founded in 2005, Box simplifies work for leading global organizations, including JLL, Morgan Stanley, and Nationwide. Box is headquartered in Redwood City, CA, with offices across the United States, Europe, and Asia. By joining Box, you will have the unique opportunity to continue driving our platform forward. Content powers how we work. It’s the billions of files and information flowing across teams, departments, and key business processes every single day: contracts, invoices, employee records, financials, product specs, marketing assets, and more. Our mission is to bring intelligence to the world of content management and empower our customers to completely transform workflows across their organizations. With the combination of AI and enterprise content, the opportunity has never been greater to transform how the world works together and at Box you will be on the front lines of this massive shift.

WHY BOX NEEDS YOU

We're looking for a high-agency, deeply AI-fluent Product Manager to own AI Evaluations — a highly cross-functional, highly visible role at the front lines of how Box assesses, launches, and manages the AI models that power our product. You'll run rigorous evaluations of frontier models, own the decision of which models power Box Agents, shape how the world's leading model providers understand enterprise performance, and own the full lifecycle of every model we support. This is a hands-on role for someone who deeply knows the AI landscape and can do their own work: statistically literate, comfortable in code, and able to build the evals, run the analyses, and prototype the pipelines themselves rather than spec them out for someone else. It sits at the intersection of technical depth, go-to-market execution, and external partnerships — connective tissue across Product, Marketing, Partnerships, and Engineering — and it's a fit for someone who thrives in ambiguity, moves fast on tight timelines, and brings order to messy, fast-evolving problem spaces.

WHAT YOU'LL DO

Run rigorous evaluations across frontier models (OpenAI, Anthropic, Google/Gemini) and continuously mature the stack, methodology, and process behind them. Define what makes a high-quality evaluation dataset and robust, cost-appropriate graders, and translate what end users care about into measurable criteria. Drive synthetic data generation and data-generation pipelines to ensure they are high-quality, reliable, and scalable. Own online evaluations, turning real production usage into rich insight on how our product is actually used. Lead each model launch end to end, managing the process, the stakeholders, and the timeline. Own the external narrative for each model launch — partnering with Product Marketing on blog, social, and PR content, and creating video demos yourself. Build and manage deep relationships with model providers and AI companies — securing early access to frontier models, delivering technical deep-dives back to providers, and identifying collaboration opportunities on evaluations and benchmarking. Identify, pitch, and structure opportunities to collaborate with providers and other AI companies specifically on evaluations and benchmarking. Run evaluations to decide whether a model is production-ready, and own the decision of which models power agentic products at Box. Assess the compliance posture of production models, partner on model pricing decisions, and define how and when we deprecate models.

WHO YOU ARE

We are an AI-first company. This means you approach your work with a growth mindset and find ways to leverage AI to help make faster, smarter decisions that will 10X your impact at Box. You have a minimum of 2 years of product management experience. You know the AI landscape deeply, follow frontier models closely, and can hold your own in a technical conversation with any model provider. You're technical and hands-on : statistically literate and comfortable enough in code (Python, SQL, notebooks) to build your own evals, run your own analyses, and prototype your own data pipelines. You've driven cross-functional launches across Product Marketing, Communications, Developer Relations, and Engineering. You're an excellent written and verbal communicator who can represent Box externally, presenting complex, technical topics simply to senior stakeholders. You operate with extremely high agency, taking ambiguous, undefined problems and driving them to resolution on tight timelines. You're fluent across many stakeholders—from Product Marketing and Sales to Security, Legal, and Compliance—adapting your communication to each audience. You're a natural disambiguator who makes messy, fast-moving AI problems simple and clear. Preferred skills Direct experience with AI/ML products, model evaluation, or benchmarking. Experience managing external partnerships with vendors or providers. Box lives its values, with community and in-person collaboration being a core part of our culture. Boxers are expected to work from their assigned office a minimum of 3 days per week.Your Recruiter will share more about how we work and company culture during the hiring process. At Box, we believe unique and diverse experiences benefit our culture, our products, our customers, our company, and our world. We aim to recruit a passionate, high-performing workforce that reflects the world we live in.If you are head-over-heels about this role but unsure if you meet all the requirements, we encourage you to apply!

EQUAL OPPORTUNITY

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, and any other protected ground of discrimination under applicable human rights legislation. Box strives to respect the dignity and independence of people with disabilities and is committed to giving them the same opportunity to succeed as all other employees. Inclusiveness is core to our culture at Box, and we strive to ensure you get the most from your interview experience. Box makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please complete this form . Reasonable accommodations may include scheduling adjustments, document dictation and beyond. Notice to applicants in Los Angeles: Box, Inc and its related branches will consider for employment, qualified applicants with criminal histories in a manner consistent with the Los Angeles Fair Chair Ordinance. The Fair Chance Ordinance is provided here . Notice to applicants in San Francisco: Box, Inc and its related branches will consider for employment, qualified applicants with criminal histories in a manner consistent with the San Francisco Fair Chair Ordinance. The Fair Chance Ordinance is provided here . For details on how we protect your information when you apply, please see our Personnel Privacy Notice. If you are a California-resident, please read our California Applicant & Candidate Privacy Notice here . Box is committed to fair and equitable compensation practices. Actual base salary (or OTE if commissionable role) is dependent upon factors such as: knowledge, skill level, experience, and work location. This role is also eligible for equity and benefits. For more information , check out our benefits and perks . In accordance with OFCCP compliance, here is the Pay Transparency Provision . United States Pay Range $160,500 — $200,500 USD #J-18808-Ljbffr Boxinc

Vacancy posted 19 hours ago
Similar jobs that could be interesting for youBased on the Product Manager, AI Evaluations & Frontier Models in Redwood City, CA vacancy
  • $170k - $190k

    Redwood CityProduct Management - Operations /FT /On-siteProduct...  ...Manager, Physical AI (or) Senior Product Growth Manager,...  ...Foresight world model, robotics, and Physical...  ...teams operate at the frontier of Physical AI innovation...  ...deployment outcomes, evaluate ROI, and connect... 
    Suggested
    Full time
    Local area

    Dexterity

    Redwood City, CA
    2 days ago
  • $132k - $240k

     ...At Snorkel, we believe meaningful AI doesn’t start with the model, it starts with the data. We’re on...  ..., high performance, and production-ready systems. We work with some of...  ...Marketing, the Product Marketing Manager, Frontier Labs will own the GTM execution for... 
    Suggested
    Local area

    Snorkel AI

    Redwood City, CA
    5 days ago
  • C3 AI (NYSE: AI), is the Enterprise AI...  ...fully integrated products including the C3 Agentic...  ...talented Product Manager, Platform - Cloud...  ..., cloud tenancy models, and API and data...  ...and customers to evaluate and continuously improve...  ...where commercial frontier model APIs are not... 
    Suggested

    C3 IoT

    Redwood City, CA
    4 days ago
  •  ...Product Manager, Data EngineDyna Robotics builds general-purpose robots powered by a proprietary embodied AI foundation model with top-in-industry generalization and real-world performance. Already...  ...and visualization systems, model evaluation tooling, and task management,... 
    Suggested
    Live in
    Remote work
    Shift work

    DYNA Robotics Inc

    Redwood City, CA
    2 days ago
  • C3 AI (NYSE: AI), is the Enterprise AI application...  ...of fully integrated products including the C3...  ...: 5+ years of product management experience, with a strong...  ...infrastructure (ingestion, modeling, pipelines, governance...  ...(model development, evaluation, deployment,... 
    Suggested

    C3 IoT

    Redwood City, CA
    2 days ago
  • $190k - $240k

     ...Snorkel, we believe meaningful AI doesn’t start with the model, it starts with the data....  ..., high performance, and production-ready systems. We work...  ...strategic Senior Product Manager with deep AI/ML expertise...  ...synthetic data systems, evaluations, and data-acceleration... 
    Temporary work
    Local area

    Snorkel AI

    Redwood City, CA
    3 days ago
  • $188.5k - $255k

     ...customers worldwide using products such as TurboTax,...  ...shift to AI-native, Done-For-You...  ...role sits at the frontier of how enterprise...  ...defining new interaction models (natural language...  ...PDX builds is evaluated against one question...  ...to platform-managed, IDE-first developer... 
    Worldwide
    Shift work

    Intuit

    Mountain View, CA
    5 hours ago
  • Luma seeks an accomplished social media leader to define how frontier AI shows up in culture. You will own that claim—setting strategy, building the team, and leading the content engine to make Luma the most-watched, most-referenced creative tech brand online. You'll own... 

    Luma

    Redwood City, CA
    5 days ago
  • $220k - $280k

     ...Snorkel, we believe meaningful AI doesn’t start with the model, it starts with the data....  ..., high performance, and production-ready systems. We work...  ...looking for a Technical Product Manager to own the roadmap and...  ...PM who understands and can evaluate these tools' impact on... 
    Full time
    Live in
    Local area

    Snorkel AI

    Redwood City, CA
    1 day ago
  • $226.19k - $292.71k

     ...possible, together.Director, Data/AI Product Owner, ResearchAs part of our...  ...Product Owners and Product Managers. Prioritize the product...  ...and scale product operating model for consistency in delivery.Translate...  ...and financial acumen to evaluate trade‑offs and recommend data... 
    Full time
    For contractors
    Local area

    GILEAD Sciences

    Foster, CA
    1 day ago
  • $177k - $265k

     ...Job SummaryDesigns, develops and manages the lifecycle of a product or group of products from concept...  ...features.ResponsibilitiesGenerative AI, Cloud, and Data...  ...engineering and architecture teams to evaluate large language model architectures, AI agents, cloud deployment... 
    Full time
    Work at office

    Equinix

    Redwood City, CA
    4 days ago
  •  ..., incomplete elevation models, slow refresh cycles, or...  ...-resolution 3D data products of the Earth at unprecedented...  .... As Product Manager, 3D Geospatial Products...  ...matter, how customers evaluate quality, and how we prioritize...  .... Familiarity with AI, automation, or machine... 
    Permanent employment
    Full time
    Remote work
    Night shift

    Array Labs

    Redwood City, CA
    more than 2 months ago
  •  ...powers the next generation of AI infrastructure. We address...  ...About the Role We are seeking a Product Manager — AI Infrastructure Platform...  ..., manage tradeoffs between model performance and operational constraints...  ...how these buyers evaluate and adopt infrastructure software... 

    Hammerhead AI

    Redwood City, CA
    more than 2 months ago
  • Luma is seeking a senior, autonomous product manager to build enterprise AI solutions from the model up, turning frontier multimodal capabilities into scalable customer offerings in marketing, advertising, and entertainment. You’ll operate with a GM mindset and own P&L... 

    Luma

    Redwood City, CA
    5 days ago
  • $160k - $175k

     ...continents. Our leading AI technology is the...  ...creativity and productivity, and our solutions...  ...Outbound Product Managers (Agentic AI) who...  ...guiding them through evaluation and testing of...  ...integration of AI models into applications...  ...role sits at the frontier of where product innovation... 
    Full time
    For contractors
    Worldwide
    Flexible hours

    IFS

    Palo Alto, CA
    29 days ago
  • $164k - $323k

     ...are seeking a highly skilled Staff IT Product Manager for Internal AI to drive the strategy, delivery, and...  ...Alto, CA for our hybrid working model.Key ResponsibilitiesAI Product Strategy...  ..., requirements gathering, vendor evaluation, prototyping, and implementation to... 
    Local area
    Worldwide
    Flexible hours

    MongoDB

    Palo Alto, CA
    4 days ago
  • $200k - $245k

     ...deliveries across numerous US cities. ‘Autonomy Data Flywheel’ is an internal Data product initiative that leverages on this large scale of real world robots and super-charges our End-End AI model development. It covers the entire data lifecycle starting with the data... 
    Odd job
    Live in
    Local area
    Remote work

    Serve Robotics

    Redwood City, CA
    5 hours ago
  • $228.8k - $403.2k

     ...believe meaningful AI doesn’t start with the model, it starts with the...  ...high performance, and production-ready systems. We...  ...directly with frontier AI labs on their hardest...  ..., developing evaluation frameworks, and translating...  ...roles5+ years managing or leading technical... 
    Local area

    Snorkel AI

    Redwood City, CA
    2 days ago
  • $138k - $245k

    SummaryJoin Guidewire's Product Development &...  ...with a strong focus on AI, data, and customer-centricity...  ...As an Outbound Product Manager for AI and Workflow Automation...  ...agents, tools, memory, evaluation, observability), AI...  ...observability, and the Model Context Protocol (MCP).... 
    Full time
    Part time
    Flexible hours

    Guidewire Software, Inc.

    San Mateo, CA
    4 days ago
  • C3 AI (NYSE: AI), is the Enterprise AI application...  ...of fully integrated products including the C3 Agentic...  ...Senior Director of Product Management to lead our Defense and...  ...on a common data model comprised of a diverse...  ...product suite.Build and evaluate business cases to support... 
    Work at office

    C3 IoT

    Redwood City, CA
    1 day ago
  • C3 AI (NYSE: AI), is the Enterprise AI application software company...  ...a family of fully integrated products including the C3 Agentic AI...  ...an experienced Senior Product Manager to lead the development and growth...  ...AI, data pipelines, and model operationalization.Proven experience... 
    Temporary work

    C3 IoT

    Redwood City, CA
    3 days ago
  • $217k - $236k

     ...compelling goal, define the product strategy and roadmap...  ...strategy to improve model performance on simulation...  ...build out dedicated evaluations. Drive product landings...  ...enable downstream embodied AI use cases.Influence...  ...experience in product management or related technical role... 

    Google

    Mountain View, CA
    3 days ago
  • $215k - $300k

     ...harmful, leading to worse models that cost more to...  ...Microsoft, Amazon, and AI visionaries like Geoff...  ...team has pioneered this frontier research area and has...  ...the RoleAs our first Product Manager, you will own the product...  ...how ML teams evaluate tools, what makes them... 
    Work at office
    Work from home
    Relocation package

    DatologyAI

    Redwood City, CA
    3 days ago
  • $188.2k - $258.8k

     ...tissue tests, real-world data and AI analytics. Guardant tests...  ...Position Summary:The Senior Product Manager, AI will lead the delivery and...  ...the ability to critically evaluate and responsibly leverage AI-enabled...  ...quality of work.Hybrid Work Model:This section is applicable to... 
    Full time
    Work at office
    Work from home

    Guardant Health

    Palo Alto, CA
    1 day ago
  • $163k - $237k

     ...safe, fair, and transparent AI, taking novel ideas from...  ...way to developer adoption.Manage a broad range of technical...  ...scaled processes for GenAI model training, tuning, evaluation, and launch configurations...  ...and enhance researcher productivity.Act as a master collaborator... 

    Google

    Mountain View, CA
    5 hours ago
  • $190k - $261.8k

     ...open science and AI-powered biology or...  ...pioneering work to combine frontier AI with frontier...  ...Technical Program Manager with expertise in...  ...help shape the product and application...  ...security reviews, threat modeling, and incident...  ...experience, as evaluated throughout the interview... 
    Work at office
    Relocation package
    Shift work
    3 days per week

    Chan Zuckerberg Initiative

    Redwood City, CA
    4 days ago
  • Treasure AI:Treasure AI is the agentic experience platform built...  ...:We’re looking for a Lead Product Manager to define and drive the strategy...  ..., RAG systems, multimodal models, etc.), prototype quickly, and...  ...of AI trends: Continuously evaluate emerging LLMs, multimodal capabilities... 
    Contract work
    Temporary work
    Work at office
    Flexible hours
    Night shift

    Arm Treasure Data

    Mountain View, CA
    3 days ago
  • $140k - $250k

     ...also built and shaped products used by millions of people...  ..., and imagine how AI can fundamentally reinvent...  ...using foundation models, agents, retrieval systems...  ...controls. Build evaluation frameworks to measure...  ...to 9+ years of product management experience, including... 
    Work at office
    3 days per week

    Stealth-Hc

    San Mateo, CA
    1 day ago
  • $136k - $204k

     ...About the Team Klaviyo's AI & Analytics pillar is building...  ...intelligence layer behind the product — models that optimize send times,...  ...looking for a Senior Product Manager to own both what Klaviyo's ML...  ...each model family, set the evaluation frameworks, and work with ML... 
    Full time
    Temporary work

    Klaviyo

    Palo Alto, CA
    2 days ago
  • C3 AI (NYSE: AI), is the Enterprise AI...  ...fully integrated products including the C3 Agentic...  ...3 AI is seeking a Manager / Senior Manager,...  ...foundation-model providers, beginning...  ...fine-tuning, RAG, evaluation, and agentic patterns...  ...stakeholders at a frontier lab.Working... 

    C3 IoT

    Redwood City, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Product Manager, AI Evaluations & Frontier Models. Be the first to apply!