AI Benchmarks & Evaluations Program Manager
Mercor
A leading AI development firm situated in San Francisco is looking for a Research Program Manager to coordinate the development and evaluation of AI benchmarks. You will collaborate across teams to ensure rigorous evaluation processes are upheld and results shared with the community. The ideal candidate should possess 2-3 years of experience in consulting or tech, strong analytical skills, and enjoy process optimization. The position offers a competitive salary and generous perks, including relocation and housing bonuses. #J-18808-Ljbffr Mercor
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the AI Benchmarks & Evaluations Program Manager in San Francisco, CA vacancy
- Overview CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers,... ...and enterprise customers. As a Technical Program Manager, you will lead complex, cross-functional programs across Performance & Benchmarking within our AI/ML Platform Services organization...SuggestedTemporary workCasual workWork at officeFlexible hours
$70 - $110 per hour
...technical talent with leading AI research labs. Headquartered... ...Francisco, our investors include Benchmark , General Catalyst ,... ...Position: General and Operations Managers Type: Contract... ...Role Responsibilities Evaluate AI-generated operational plans...SuggestedHourly payContract workSummer workImmediate startRemote workMercor
San Francisco, CA5 days ago$207.4k - $372.7k
AIML - Senior Operations Program Manager - Responsible AI and Safety San Francisco Bay Area, California... ...data operations behind our Safety Evaluation and Red Teaming programs, scaling the... ...goldsets that underpin safety benchmarking and LLM-judge validation, and how those...SuggestedRelocation- ...team is in need of a Technical Program Manager (TPM) to streamline our... ...and key safety practices and evaluations with our key partner (i.e. Microsoft... ..., standards, datasets and benchmarks with the public. You might... ...About OpenAI OpenAI is an AI research and deployment...SuggestedWork at officeRelocation package
- Artificial Analysis in San Francisco is seeking a Product Manager to lead AI image and video benchmarking initiatives. You will shape product strategy,... ...leaderboards. You'll run human preference studies, curate evaluation frameworks, and partner with leading labs to...Suggested
$211.2k - $264k
...As a Technical Program Manager for the Platform team, you will partner... ...maturity of the Scale Generative AI Platform (SGP) . We are... ...clear SLOs and performance benchmarks to guarantee production-grade... ...utilization, or model training/evaluation setups. Masterful...Full timeUnited States Digital Space LLC
San Francisco, CA21 hours ago$128k - $249k
...and impactful work lead to the same place.We are seeking a AI Program Manager to join the firm. The AI Program Manager leads critical technology... ...lifecycles and technical architectures, effectively evaluating technical risks and conveying impacts to senior stakeholders...Full timeContract workTemporary workFor contractorsLocal areaRemote work$147.68k - $236.28k
...AI/Technology Evangelist – Program Manager (Corporate AI Team) Axon's Corporate AI Team sits within the Enterprise Data organization and focuses on internal... ...into actionable guidance for the organization. Evaluate new AI tools and vendors; make recommendations about what...Work experience placementWork at officeOut in Science, Technology, Engineering, and Mathematics
San Francisco, CA3 days ago$140k - $158k
...HoneyBook is the leading AI-powered business management platform for service-based business owners. Designed... ...About the role As an AI Content Program Manager , you'll sit within the... ...updated, or restructured next, and help evaluate whether a single-platform or multi-platform...Full timeFor contractors- Artificial Analysis in San Francisco is hiring a Product Manager for AI hardware benchmarks, designing and running performance tests across GPUs, TPUs, and custom silicon. You will extend our hardware benchmarking stack, build cost and throughput models, and work directly...
$207k - $285k
OpenAI is seeking a Technical Program Manager in San Francisco to lead initiatives that ensure the safety and robustness of its AI models. The role involves collaborating with diverse teams to turn risks into actionable plans. Ideal candidates will have experience in technical...$150k - $175k
...San Francisco | Stealth Startup | Video AI | 5 Days Onsite We’re a startup at the... ...financial backing. We are hiring a Technical Program Manager to improve how product and engineering... ...across product and engineering. Evaluate developer workflow tools through structured...Full timeWork at officeVisa sponsorship$116k - $145k
...seeking a motivated and experienced Technical Program Manager II to join Datadog’s Technical Solutions... ...plans as circumstances change.Apply AI tools to streamline your own program... ...confidently in day-to-day program work and can evaluate where AI can be responsibly and...Work at office$128k - $150k
...Scale AI’s customer-facing engineering organization is one of the fastest-growing... ...enablement function to support them. As Program Manager, Technical Enablement, you will build that... ...allows us to ensure a fair and thorough evaluation of all applicants. About Us:...Full time$180.8k - $226k
Scale AI is the data engine for the entire AI industry. Our mission is to accelerate... ..., highly collaborative Technical Program Manager (TPM) to serve as the critical bridge between... ...architecture reviews and credibly challenge/evaluate technical trade-offs with both HW and SW...Full timeShift work- ...deeper understanding in healthcare. Our AI‑powered platform was purpose‑built for medical... .... The Role As the AI Enablement Program Manager, you will own Abridge’s company‑wide strategy... ...& Approval: Own the AI tool intake and evaluation process, the single front door for any...Hourly payFull timeFlexible hours
- ...strive to seamlessly blend high‑level AI capabilities with the physical constraints... ...Role We are looking for an Operations Program Manager - Robotics Data Acquisition to own the... ...maintained, and ready for rollouts and evaluations. Lead root cause analysis for recurring...
$180.8k - $226k
As a Technical Program Manager, you will partner with our Frontier Agent Engineering teams on enterprise... ...Operating in a hyper-growth, demanding AI environment, you will translate... ...tasks, model fine-tuning, and performance evaluation.Masterful Communication: Proven track record...Full time- ...Technical Recruiter and Program Manager, Emerging Talent About the Team At OpenAI, we are... ...make a lasting impact on the future of AI. Your Responsibilities: Lead end... ...experience, onboarding, performance and evaluation process. Collaborate with mentors and...Full timeInternshipWork at officeRelocation packageShift work
OpenAI
San Francisco, CA1 day ago - ...world data is the competitive edge in AI. HumanSignal is a human data partner... ...datasets from scratch, recruit and manage the domain experts who evaluate model output, and run everything... ...Required Qualifications 8+ years in program/technical program management or delivery...Worldwide
HumanSignal
San Francisco, CA2 hours ago - ...Technical Program Manager, ComputeSan Francisco, CA | New York City, NY | Seattle, WAAbout AnthropicAnthropic... ...reliable, interpretable, and steerable AI systems. We want AI to be safe and... ...on which every model training run, evaluation, and inference workload depends.You'll...Work at officeVisa sponsorshipFlexible hours
Anthropic
San Francisco, CA4 days ago $241.6k - $302k
...Director of TPM, Enterprise, you are not just managing programs; you are the architect of a new... ...efficiency, and the seamless integration of AI capabilities across all business units.... ...including LLM fine‑tuning, performance evaluation, and the infrastructure requirements...Full timeShift workScale AI
San Francisco, CA15 hours ago- ...Senior Technical Program ManagerCornelis Networks delivers the world... ...out networking solutions for AI and HPC datacenters. Our... ...seasoned Senior Technical Program Manager with deep technical... ...system validation; performance benchmarking; technical communications and...Full timeWork at officeRemote workFlexible hours
Cornelis Networks
San Francisco, CA4 days ago $120k - $200k
...Technical Program ManagerHelp us solve fraud asap with Casap — where... ...building the world's first AI-native disputes automation and... ...talented Technical Program Managers to join our teams in San Francisco... ...a competitive base salary benchmarked against real-time market data...Full timeWork at officeImmediate startHome officeMonday to FridayCASAP
San Francisco, CA4 days ago$120k - $160k
...healthcare organizations. Our AI platform streamlines critical... ...and sources of truth (Linear, program reviews) that keep work legible... ...slowing down. Orchestration: Manage the technical roadmap from early... ...that keep delivery healthy — evaluation, onboarding, quality — and keep...Charta Health
San Francisco, CA2 days ago- ...instead of things they had to do. Powerful AI will be the biggest lever for human... ...systems that make agentic work observable and evaluated are what turn agents into something the... ...Run the rollout, onboarding, and training programs that take a team from first demo to living...Local area
FluidStack
San Francisco, CA2 hours ago - mpathic is seeking a Program Manager, Human Data Operations to lead complex AI safety, evaluation, human data, and red-teaming programs. You will coordinate cross-functional pods, manage timelines, staffing, risk, and stakeholder communication, ensuring high-quality delivery...
$173k - $215k
...Komodo grows.This Senior TPM owns programs that span multiple teams and... ...Engineering Leads, Product Managers, and platform teams. Your... ...level reporting.Expectations of AI Use in this role (required):... ...exposure to AI/ML cycles: model evaluation, data quality gates,...Contract workFor contractorsWork experience placementWork at officeLocal areaFlexible hours$145.75k - $300.07k
...career you love? It’s Possible.At Pinterest, AI isn't just a feature, it's a powerful... ...on.What you'll do:As a Staff Technical Program Manager for Measurement, you'll have the rare... ...grade tooling.Lead cost optimization and evaluation for our LLM and GenAI systems — building...Work at officeLocal areaRemote workRelocationRelocation package$200k - $240k
...the only vertically integrated AI infrastructure company built... ...design through IaaS products to managed inference at scale, enabling... ...platform. You will own end-to-end program delivery across multi-quarter... ...are served, optimized, and evaluated in production -- is essential...Temporary work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Benchmarks & Evaluations Program Manager. Be the first to apply!
Related searches
- program manager part time San Francisco, CA
- aba program supervisor San Francisco, CA
- staff program manager San Francisco, CA
- privacy program manager San Francisco, CA
- healthcare program manager San Francisco, CA
- executive program director San Francisco, CA
- design program manager San Francisco, CA
- research program manager San Francisco, CA
- head of program management San Francisco, CA
- program director San Francisco, CA