Senior Product Ops Lead, AI Evaluation & Scale
jobr.pro
Jobr.pro is seeking a technical, systems-minded operator to build and scale the evaluation engine behind its platform. This role involves collaborating with cross-functional teams to ensure model performance and operationalize methodologies. The candidate should have 4-7+ years in technical program management and be comfortable with ML/AI evaluations. Responsibilities include managing evaluation systems, intake processes, and documentation of methodologies. Strong communication skills and a detail-oriented mindset are essential. #J-18808-Ljbffr jobr.pro
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Product Ops Lead, AI Evaluation & Scale in San Francisco, CA vacancy
- Sieve in San Francisco is looking for a Product & Ops Lead to interface with top AI labs. This role combines technical fluency with relationship management to drive revenue and customer satisfaction. The ideal candidate will have a strong understanding of ML/AI, excellent...Suggested
$172.5k - $260.1k
...SalesforceSalesforce is the #1 AI CRM, where humans... ...at the company leading workforce... ...Salesforce.About Scale TestToday, customers... ...that scans your production org to generate AI... ...'re looking for a Senior Product Manager to... ...recruiters assess and evaluate candidates’...SeniorFull timeSeasonal work$222k - $308k
Senior Product and Business Strategy Lead, AI Subscriptions Google Mountain View, CA, USA; San Francisco, CA, USA Advanced Experience owning outcomes and... ...products execute optimally. Our team pushes Google to scale at key points that refine our products and infrastructure...Senior$190k - $270k
...embedded finance at a global scale.Proudly founded in... ...and backed by world-leading investors including T.... ...to‑one ideas into real products, and you “get stuff done” end-to-end. You use AI to work smarter and solve... ...ML systems are trained, evaluated, deployed, and monitored...SuggestedTemporary workLocal areaWorldwide- ...About the roleRippling AI helps businesses manage... ...easy for any Rippling product team to teach the assistant... ...new capabilities and scaling it to customers of all... ...quality bar.Define the evaluation and improvement strategy... ...perspectives often lead to the most innovative...SuggestedWork at office3 days per week
- Harvey is seeking a senior operator to own the quality bar behind human evaluations as we scale globally. You will define what good looks like, author guidelines... ...work with Evaluation Operations, ALR, Product, Engineering, and AI Research to ensure rigorous, reproducible...Senior
- Whatnot is seeking a Senior Backend Engineer for the Horizontal Ops Platform to build world-class... ...will design, implement, and scale platform components, and... ...emphasizes ownership, product instinct, and the ability... ...solutions with automation and AI-powered #J-18808-Ljbffr...SeniorRemote job
$350k
...models at their San Francisco location. This role focuses on large-scale reinforcement learning (RL) model training and requires a solid... ..., implement performance optimizations, and develop evaluation frameworks. A competitive salary of $350,000-$500,000 USD and equity...Senior$180k - $250k
...revolution in remittances. Our core product is an AI-powered chatbot built on... ...re looking for an AI Product Lead to lead the product AI Agents... ..., as well as with Biz Dev, Ops, and Marketing to ship great... ...-conceptualizing, launching, evaluating and iterating. Responsibilities...Felix Technologies, Inc.
San Francisco, CA5 days ago$152.5k - $205k
...one of the world’s leading internet financial... ...trusted, internet-scale financial innovation... ...responsible for:As a Senior Site Reliability... ...critical digital-assets, AI, and application... ...mindset to production operations: writing... ...number: JR101085Profession: Tech Ops & ITSeniorFlexible hours$77k - $202k
...processes, improve productivity, and drive... ...experiences you need to lead and deliver value... ...healthcare payers. As a Senior Associate, you... ...operating dbt at scale on Databricks- Prior... ...- Designing AI agent systems for... ...team members. We evaluate these factors thoughtfully...SeniorFull timeH1b- ...business software into products people can... ...trust, and use. As a Lead Product Designer on the AI Platform team, you will... ...product experiences that scale across Rippling. The... ...model capabilities, evaluations, agentic workflows,... ...initiatives as a senior IC, principal designer...Work at office3 days per week
$216.2k - $270.25k
Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative... ..., inference, evaluation, and more. We are seeking a strong Senior Full-Stack Engineer to... ...our rapidly growing product. The ideal candidate... ...that power the world's leading models, and help enterprises...SeniorFull time- Morpheus Talent Solutions is hiring a Strategic Project Lead to own data development end-to-end for frontier AI initiatives in San Francisco or New York City. You will bridge lab researchers, data experts, and engineers to deliver measurable, high-quality projects. You’...
- Binti, Inc. in San Francisco is seeking a Product Lead for AI & Platform. This role involves driving the strategy and execution for the platform, focusing on AI tools that support social work. The ideal candidate has 5+ years in product management with a background in B...Work at office
- Fulcrum, based in San Francisco, seeks a Product Lead to guide product vision and strategy for transforming insurance brokerages. You will partner with founders and cross‑functional teams to shape strategy, deepen customer understanding, and drive execution from discovery...
- Google seeks a Product Content Manager to own and deliver scaled external support content for YouTube users and creators. You will develop content across formats... ...scale. You’ll collaborate with Operations to pilot AI-driven workflows and optimize content processes. Strong...
- Asana is seeking a Product Manager to lead the Core Agents team in San Francisco, shaping AI-powered agents that plan, execute, and coordinate work inside Asana's work graph. You will translate customer needs into a compelling roadmap and collaborate across engineering,...Senior
$205.6k - $257k
Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including... ...decisions.We’re looking for a Senior AI Product Manager to own and scale Scale’s SEAL... ...operational excellence of Scale’s evaluation products, benchmarks, and public/private...SeniorFull time$127k - $223k
...Description Job Description Waabi, founded by AI visionary Raquel Urtasun, is the leader... ...way. To learn more visit: The Evaluation Algorithms team is responsible for building... ...analyses of driving performance scale. - Implement metrics and tags to provide...SeniorFull timeWork at officeWork from homeFlexible hoursWaabi
San Francisco, CA28 days ago- ...About the Team The Applied AI team works across research, engineering, product, and design to bring... ...Role In this role, you’ll lead development of the systems we use to evaluate the quality of our AI models... ...Work with a small, senior team of engineers and researchers...SeniorFull timeWork at officeRelocation package
OpenAI
San Francisco, CA16 hours ago $240k - $280k
A leading software monitoring company is seeking a Senior Software Engineer on its AI/ML team to build evaluation infrastructure for measuring the performance of AI systems. This role involves designing datasets, creating benchmarks, and ensuring AI features behave reliably...SeniorSentry
San Francisco, CA1 day ago- OpenAI is seeking a senior GTM Strategy & Operations professional to build and scale the operating system for our Professional Services business in San Francisco. The role blends business strategy, finance, GTM, and delivery, turning ambiguity into repeatable processes...Senior
$205.6k - $257k
Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including... ...important decisions.We’re looking for an AI Product Manager to own the Healthcare... ...workflows that labs use to train and evaluate agents) and the “data as a product” strategy...SeniorFull time$217k - $275k
We're looking for a Senior Manager, Product Lead to lead, grow, and empower a team... ...managers building for our AI-powered litigation platform... ...understand and act on data at scale with AI-assisted workflows... ...processes. As part of the evaluation process, we provide Gem with...SeniorFull timeWork at officeLocal areaRemote workWork from homeVisa sponsorshipWork visa$270k - $340k
Principal AI Research Scientist, Research Director... ...to all.About the Scaling Research TeamThe Databricks... ...- AI Scaling, you will lead a team of world‑class researchers... ..., working closely with product, data, and engineering... ...of‑the‑art methods and evaluating trade‑offs in quality,...Local areaWorldwide$116.2k - $229.1k
...Position SummaryJoin our AI & Engineering team... ...to coaching from senior colleagues, and... ...Consultant, you will lead Commercial Banking... ...workstreams on large-scale banking... ...transform how clients sell products, deliver services,... ...architecture diagrams, and evaluate design trade-...Local areaImmediate start$202k - $230k
...We’re looking for a Senior Product Manager to lead AI Studio, Asana's AI workflow builder, in San Francisco... ...to build, govern, and deploy AI at scale across their organizations. You will... ...engineering, agentic workflows, tool use, and evaluations, with the ability to reason about...SeniorFull timeWork at officeWork from homeWorldwideAsana
San Francisco, CA1 day ago$165k - $200k
Ironclad Inc. is looking for a Senior Manager of Recruiting Operations based in San Francisco. This role requires a... ...at least 8 years in Recruiting Operations, focusing on scaling a recruiting engine and leveraging AI and automation to enhance hiring practices....Senior- A tech startup in San Francisco seeks a Senior/Staff Backend Engineer to architect and build large-scale systems for AI agents. The role focuses on developing reliable, event-driven, and scalable infrastructure, ensuring integration with LLMs while collaborating within...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Product Ops Lead, AI Evaluation & Scale. Be the first to apply!
Related searches
- product lead San Francisco, CA
- senior operations associate San Francisco, CA
- senior safety specialist San Francisco, CA
- senior technology project manager San Francisco, CA
- remote senior business analyst San Francisco, CA
- senior director fp&a San Francisco, CA
- senior manager clinical operations San Francisco, CA
- senior supervisor San Francisco, CA
- senior researcher San Francisco, CA
- senior leadership San Francisco, CA