AI Benchmarks & Evaluations Program Manager
Mercor
A leading AI development firm situated in San Francisco is looking for a Research Program Manager to coordinate the development and evaluation of AI benchmarks. You will collaborate across teams to ensure rigorous evaluation processes are upheld and results shared with the community. The ideal candidate should possess 2-3 years of experience in consulting or tech, strong analytical skills, and enjoy process optimization. The position offers a competitive salary and generous perks, including relocation and housing bonuses. #J-18808-Ljbffr Mercor
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Benchmarks & Evaluations Program Manager in San Francisco, CA vacancy
- Overview CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers,... ...and enterprise customers. As a Technical Program Manager, you will lead complex, cross-functional programs across Performance & Benchmarking within our AI/ML Platform Services organization...SuggestedTemporary workCasual workWork at officeFlexible hours
- ...team is in need of a Technical Program Manager (TPM) to streamline our... ...and key safety practices and evaluations with our key partner (i.e. Microsoft... ..., standards, datasets and benchmarks with the public. You might... ...About OpenAI OpenAI is an AI research and deployment...SuggestedWork at officeRelocation package
- Technical Program Manager, Central Operations Location Employment Type Full... ..., and geographic location, benchmarked against similar stage growth... ...above. About Handshake AI Handshake is building the career... ...domain-specific data and evaluation at scale. This is a unique...SuggestedFull timeFor contractorsWork at officeLocal areaRemote workWorldwideFlexible hours
$207k - $230k
...Evals team designs and builds evaluations that measure the... ...About The Role As a Technical Program Manager on Frontier Evals, you will... ...research questions to delivered benchmarks. Partner with researchers and... .... About OpenAI OpenAI is an AI research and deployment company...SuggestedWork at officeRelocation packagePMs for Hire
San Francisco, CA22 hours ago$211.2k - $264k
...As a Technical Program Manager for the Platform team, you will partner... ...maturity of the Scale Generative AI Platform (SGP). We are... ...clear SLOs and performance benchmarks to guarantee production-grade... ...utilization, or model training/evaluation setups. Masterful Communication...SuggestedFull timeNeura Market
San Francisco, CA1 day ago$184k - $236k
...build the world's most advanced AI infrastructure ecosystem.... ...is hiring a Technical Program Manager to coordinate datacenter deployments... ...approval, establishing benchmarks and structures based on industry... ...updating risk registers to evaluate contingencies and drive...Contract workFor contractorsWork at office3 days per week$177k - $237k
...Description CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers,... ...enterprise customers. As a Technical Program Manager, you will lead complex, cross-functional programs across Performance & Benchmarking within our AI/ML Platform Services organization...Permanent employmentTemporary workCasual workWork at officeFlexible hours$147.68k - $236.28k
...AI/Technology Evangelist – Program Manager (Corporate AI Team) Axon's Corporate AI Team sits within the Enterprise Data organization and focuses on internal... ...into actionable guidance for the organization. Evaluate new AI tools and vendors; make recommendations about what...Work experience placementWork at officeAccreditation Council For Graduate Medical Education
San Francisco, CA22 hours ago$207k - $285k
OpenAI is seeking a Technical Program Manager in San Francisco to lead initiatives that ensure the safety and robustness of its AI models. The role involves collaborating with diverse teams to turn risks into actionable plans. Ideal candidates will have experience in technical...- ...deeper understanding in healthcare. Our AI‑powered platform was purpose‑built for medical... .... The Role As the AI Enablement Program Manager, you will own Abridge’s company‑wide strategy... ...& Approval: Own the AI tool intake and evaluation process, the single front door for any...Hourly payFull timeFlexible hours
$162k - $240k
...OpenAI needs to build frontier AI models. We run high-impact data acquisition programs, such as our web crawler and our... ...the Role We are hiring a Program Manager to join our team. In this role,... ...engagements for data sourcing - including evaluating suppliers, negotiating...- ...strive to seamlessly blend high-level AI capabilities with the physical constraints... ...Role We are looking for an Operations Program Manager - Robotics Data Acquisition to own the... ...maintained, and ready for rollouts and evaluations. Lead root cause analysis for recurring...
$365k
...reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial... ...systems. About The Role As a Technical Program Manager on the Compute team, you will help drive... ...on which every model training run, evaluation, and inference workload depends. You’ll...Work at officeVisa sponsorshipFlexible hoursAnthropic
San Francisco, CA3 days ago$241.6k - $302k
...Director of TPM, Enterprise, you are not just managing programs; you are the architect of a new... ...efficiency, and the seamless integration of AI capabilities across all business units.... ...including LLM fine‑tuning, performance evaluation, and the infrastructure requirements...Full timeShift workScale AI
San Francisco, CA1 day ago$180.8k - $226k
...Scale AI is the data engine for the entire AI industry. Our mission is to accelerate... ..., highly collaborative Technical Program Manager (TPM) to serve as the critical bridge between... ...architecture reviews and credibly challenge/evaluate technical trade‑offs with both HW and SW...Shift workScale AI
San Francisco, CA3 days ago- ...Sector team is focused on using AI to address critical challenges... .... Navigate global compliance: Manage the technical lifecycle within... ...to ensure a fair and thorough evaluation of all applicants. We are... ...with our internal policies and programs designed to protect personal data...
AI Chopping Block, Inc.
San Francisco, CA22 hours ago $180k - $215k
...global scale. We are looking for a Senior Technical Program Manager to manage the development of one of Rondo’s core product... ...and inclusion while mitigating bias. Rondo may use AI‑assisted tools to help screen and evaluate applications. All hiring decisions are made by...Flexible hoursRondo Energy
San Francisco, CA3 days ago- ...world data is the competitive edge in AI. HumanSignal is a human data partner... ...datasets from scratch, recruit and manage the domain experts who evaluate model output, and run everything... ...Required Qualifications 8+ years in program/technical program management or delivery...Worldwide
HumanSignal
San Francisco, CA1 day ago $125k - $180k
...reliable signals for training and evaluation. We design and run end‑to‑end programs that capture the depth of human intent... .... About the Role As a Program Manager (PGM) in the Human Data team you will... ...between our external vendors and AI trainers, ensuring human data...Full timeWork at officeLocal areaRelocation packageFlexible hoursShift workDormont Manufacturing Company
San Francisco, CA5 days ago- mpathic is seeking a Program Manager, Human Data Operations to lead complex AI safety, evaluation, human data, and red-teaming programs. You will coordinate cross-functional pods, manage timelines, staffing, risk, and stakeholder communication, ensuring high-quality delivery...
$120k - $200k
...Technical Program Manager Help us solve fraud asap with Casap — where we're building the world's first AI-native disputes automation and fraud prevention platform. Our mission... ...includes a competitive base salary benchmarked against real-time market data, as well...Full timeWork at officeImmediate startHome officeMonday to FridayFlexible hoursCASAP
San Francisco, CA1 day ago- ...San Francisco, seeks a technical operator to drive the evaluation engine behind its AI platform. This high-responsibility role involves... ...ideal candidate has 4-7 years of experience in technical program management or product operations, and must possess strong communication...
$196k - $242k
...across 15+ U.S. states. Waymo's Technical Program Managers and Program Managers are accountable... ...programs within the Simulation and ML Evaluation domain, translating technical roadmaps... ...a technical field, ideally related to AI/ML. Salary Range The expected base salary...Full timeRemote work$290k - $365k
...reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial... ...systems. About the Role As a Technical Program Manager on the Compute team, you will help drive... ...on which every model training run, evaluation, and inference workload depends. You’ll...Visa sponsorship$85 - $98 per hour
...motivated and technically skilled Technical Program Manager (TPM) to lead and oversee data annotation programs that power our cutting-edge AI research initiatives. This role sits at... ...customers and research partners on evaluation workshops, pilots, and feedback sessions...Hourly payContract work3 days per week- ...human customer experiences with AI. We are primarily an in-person... ...of Google's earliest product managers and co-creator of Google Maps.... ...complex, cross-functional programs spanning cloud infrastructure,... ...job description. We strive to evaluate all applicants consistently without...Full timeFlexible hours
Sierra
San Francisco, CA19 days ago - ...development and operation of efficient AI infrastructure across Asia... ...cooling systems, energy management, AI software orchestration,... ...a versatile Senior Technical Program Manager (TPM) to lead the end... ...architecture, GPU performance and benchmarking, and infrastructure...Permanent employmentFull timeInterim role
- Anthropic is seeking a Program Manager to own the operations behind the Responsible Scaling Policy (RSP), driving the cycle of evaluations, risk reports, and governance reviews to keep model launches on track. You will build program infrastructure, including source-of-truth...
- ...reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial... ...of AI development. As a Technical Program Manager for Research, you'll define and build the... ...ideally with hands‑on exposure to training, evaluation, or large‑scale distributed systems Are...Visa sponsorshipShift work
Gravity Engineering Services Pvt Ltd.
San Francisco, CA1 day ago $285k - $355k
...groundbreaking research. Our work enhances and evaluates our flagship models and products like... ...teams. About the Role As a Technical Program Manager (TPM) in the Human Data team you will... ...our research roadmap, external vendors, AI trainers, and the Human Data engineering...Interim roleWork at officeLocal areaRelocation packageFlexible hoursDormont Manufacturing Company
San Francisco, CA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Benchmarks & Evaluations Program Manager. Be the first to apply!
Related searches
- program director San Francisco, CA
- national program manager San Francisco, CA
- cloud program manager San Francisco, CA
- privacy program manager San Francisco, CA
- technical program manager San Francisco, CA
- customer project program manager San Francisco, CA
- senior program manager San Francisco, CA
- staff program manager San Francisco, CA
- research program manager San Francisco, CA
- global program director San Francisco, CA