Head of AI Evaluation & Benchmarks
Vibehackers
Vals AI in San Francisco seeks a Head of Research to define and advance evaluation methodologies for large language models and AI systems. You will set research direction across the portfolio, publish influential work, and recruit a research team while partnering with enterprise customers and lab partners. The role emphasizes real‑world deployment impact, collaboration with AI labs, and leadership of a high‑caliber team. #J-18808-Ljbffr Vibehackers
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Head of AI Evaluation & Benchmarks in San Francisco, CA vacancy
- ...Head of AI About the Company Rapidly growing investor-backed software company automating unstructured financial and regulatory document... ...teams to align AI initiatives with business goals and evaluating and implementing modern AI approaches. The ideal candidate for...Suggested
- ...advancement as exponential progress in AI converges with central advances in other... ...hands-on work. This is a building role: the Head of Bio AI will personally drive early... ...data pipelines, validation frameworks, and evaluation benchmarks. Evolve capabilities from early...SuggestedH1bVisa sponsorship3 days per week
$200k - $400k
You'll own the evaluation pipeline for our prompt injection red-teaming line: what we test, how... .... About us Our mission is to automate AI safety , to pave the way for a future where... ...something rigorously : an eval, a benchmark, a grading pipeline, or quality assurance...SuggestedRemote workVisa sponsorshipShift work- ...The Role Cloudflare is building one of the most differentiated AI inference platforms in the market. We need a leader to own the go... ...Partner directly with Workers AI prospects and high‑value accounts evaluating Cloudflare for GPU capacity and inference workloads. Lead...SuggestedTemporary workFlexible hoursShift work
- ...platform for brand growth in the age of AI search. As consumers shift from traditional... ...and Montevideo. The Role We are hiring a Head of AI Ads to define, invent, and lead... ...teams to map out early-adopter strategies, evaluating channel tradeoffs, testing mechanisms, and...SuggestedFlexible hoursShift work
$157k - $191k
...and over USD 4 billion in revenue. Based in San Francisco, the AI Hub sits at the intersection of a global media group and the world... ...of all backgrounds and identities. Qualified applicants are evaluated without regard to race, color, religion, age, ethnicity, national...Work at officeLocal areaNight shift$430k
AI is already changing how people work, learn, and access care. It has the potential to... ...sciences program. You will work closely with the Head of Life Sciences and Curing Diseases to... ...Foundation’s approach over time Source, evaluate, and recommend grants and other funding...Flexible hours$15k
...raised a $250M Series C to build the search engine for AIs. Led by a16z, with existing investors Benchmark, Lightspeed, and YC doubling down, the round brings... ...last problems worth getting right. We are looking for a Head of Developer Relations to make Exa the search layer...Work at officeLocal areaVisa sponsorshipDay shiftExa Corporation
San Francisco, CA3 days ago$200k - $300k
...built. As the team behind Next.js, v0, and AI SDK, we create products that help... ...Marketing organization. You will report to the Head of Marketing Programs & Vercel Media and... ...Experience managing sponsorship investments and evaluating ROI. Proven conference speaking...Work from homeWorldwideFlexible hours$294k - $367k
...G12V-selective inhibitor, are currently in clinical development. The Opportunity: Reporting to the Head of Corporate Development, the VP, Head of Search & Evaluation is a senior leader within the Corporate Development organization responsible for setting the strategy...Full timeLocal area- ...businesses. A core part of our strategy is using AI to automate how work gets done across the... ...drives revenue. Position Summary The Head of AI Agent Systems owns the design,... ...loss, and context limitations Design evaluation systems to measure success rates, failure...Immediate startShift work
- ...the Role We’re looking for a Head of Competitive Intelligence to... .... Develop frameworks that evaluate competitors across... ...understanding of enterprise software, AI platforms, SaaS, or cloud technologies... .... Familiarity with benchmarking methodologies, win/loss programs...
OpenAI
San Francisco, CA3 days ago $275k - $305k
...Learn more about ourTotal Rewards philosophy.AI is a fundamental part of how work gets... ...internal systems.We are seeking a strategic Head of AI/MLE to lead this next chapter. In... ...you will define how Gusto builds, deploys, evaluates, and scales AI/ML systems across the company...Full timeWork at officeLocal areaRemote work2 days per week3 days per week- ...The Sei Foundation is seeking an innovative and strategic Head of Artificial Intelligence to spearhead the growth and integration of AI-focused applications within the Sei blockchain ecosystem. This role will be pivotal in advancing use cases such as machine learning,...
Sei Foundation
San Francisco, CA2 days ago $350k
...Head of AI Type: Full-time Base Salary: $350,000 - $450,000 (Plus Bonus & Equity) Base Pay Range: $350,000.00/yr - $450,000.00/yr About the Role: Work with a company who are building AI systems with general physical ability — systems that do not merely analyze data, but...Full timeDeepRec.ai
San Francisco, CA1 day ago- ...Innovaccer Inc. seeks an exceptional product leader to build and scale an AI-native contact center and customer operations platform. You will own the product vision, strategy, and execution across voice, virtual agents, agent assist, and analytics to transform operations...
- ...Innovaccer Inc. is seeking an exceptional product leader to build and scale our AI-powered Contact Center and Customer Operations platform. This role owns vision, strategy, and execution to transform contact centers into autonomous operations, integrating conversational...
- ...prototypes to production-ready AI agents that teams can rely on.... ...a platform for building, evaluating, deploying, and operating agents... ...at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures... ...land. We're looking for a Head of Narratives to own how LangChain...Full time
LangChain
San Francisco, CAa month ago $292.03k - $343.57k
...Position Summary Gametime is seeking a Head of Applied Machine Learning to lead the... ...modeling approaches, feature strategy, evaluation metrics, and offline and online experimentation... ...jobs according to 3rd party salary benchmark surveys. Individual pay within that range...Gametime United
San Francisco, CA5 days ago- ...Head of AI & Machine Learning About the Company A fast-growing technology business transforming complex workflows through intelligent automation. Industry Computer Software Type Privately Held, VC-backed About the Role The Company is seeking a...
- BuildOps is seeking a Head of Enablement to drive the multi-year strategy for Revenue, Marketing, BD, PS, CS, and the AI Center of Excellence. You’ll own the BuildOps Academy, reduce implementation time-to-value, and accelerate customer product adoption while leading a...
- ...the open-source future of intelligence: AI aligned with humanity and never controlled... ...building. Sound technical judgment for evaluating projects, for sourcing and vetting grant... ..., model fine‑tuning, evaluation/benchmarking, or decentralized/crypto ecosystems. Experience...
- Invoca is seeking a Director of Product, AI Platform to own the Agentic AI domain, oversee two PMs (Data Intelligence and Speech AI), and set the strategic direction for platform capabilities spanning data intelligence, speech AI, and agentic AI. You will shape external...
- Canva is seeking a senior ML leader to define and drive the algorithmic strategy for content intelligence and discovery. You will partner with senior leadership to shape an ambitious roadmap that affects how content is created, understood and personalized for 260+ million...
- ...regulators, and judicial bodies across the US and globally. You will craft the engagement strategy, build a credible policy voice for AI governance in legal services, and lead a growing team as the function scales. You will report to the Chief Strategy Officer and own...
- AIOS is hiring a Head of Information Security & Systems to build a secure foundation enabling global scale. You will own cybersecurity across AIOS’ healthcare, technology, and pharmacy platforms, shaping strategy, governance, controls, and tooling. In this fully remote...Remote job
- Pinterest is hiring a Director, Marketing Technology & Innovation to lead a hybrid team of TPMs, AI Solutions Engineers, and partner engineers. You will own the AI roadmap, evolve the MarTech stack, and ensure alignment with legal, IT, and security. The role combines hands...
- Sourcerer is the autonomous procurement platform. Our AI agents discover suppliers across the globe underwrite them with proprietary... ...build the company-defining systems — not maintain someone else's. Head of AI This is the rare role where the AI is the company Most "...
$210k - $230k
...prototypes to production‑ready AI agents that teams can rely on.... ...a platform for building, evaluating, deploying, and operating agents... ...at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures... ...land. We're looking for a Head of Narratives to own how LangChain...Work at officeFlexible hoursShift work- Assembled (United States) is hiring a Head of Deployments to lead our Deployments function end to end, including WFM onboarding, AI deployments, and time-to-value for customers. You will own the team of Deployment Strategists and build scalable playbooks from a structured...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Head of AI Evaluation & Benchmarks. Be the first to apply!
Related searches
- head of rewards San Francisco, CA
- head of seo San Francisco, CA
- head credit administration San Francisco, CA
- head of portfolio management San Francisco, CA
- head golf professional San Francisco, CA
- head San Francisco, CA
- head of architecture San Francisco, CA
- head cleaner
- head of mortgage
- head women's lacrosse coach