Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

CS PhD AI Benchmark Specialist

$66 - $84 per hour
Full-time

Mercor

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey .

Position: Applied Computer Science Benchmark Specialist

Type: Contract

Compensation: $66$84/hour

Location: Remote

Commitment: 10 hours/week

Role Responsibilities

  • Author original computer science questions that test deep conceptual understanding.
  • Ensure questions are unambiguous self-contained and precisely defined.
  • Rate each questions difficulty: Medium Hard or Expert.
  • Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.
  • Write step-by-step Chain-of-Thought solutions in markdown format.
  • Supply 15 academic references per question from reputable sources.
  • For verification tasks: flag issues with clarity completeness precision or solvability.

Qualifications

Must-Have

  • PhD or doctoral candidate in Computer Science Electrical Engineering or a closely related field.
  • Masters degree considered for candidates with exceptional depth in a specific subdomain.
  • Strong command of graduate-level CS theory algorithms systems design and/or machine learning .
  • Excellent written English and ability to express complex ideas clearly and concisely.

Preferred

  • Research publications industry experience at top tech companies or competitive programming background.

Application Process (Takes 2030 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information please check:
  • For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the CS PhD AI Benchmark Specialist in San Francisco, CA vacancy
  • $66 - $84 per hour

     ...technical talent with leading AI research labs....  ...our investors include Benchmark , General Catalyst ,...  ...Computer Science Benchmark Specialist Type: Contract...  ...Qualifications Must-Have PhD or doctoral candidate...  ...of graduate-level CS theory , algorithms... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    11 days ago
  • $50 per hour

    A leading AI research organization is seeking PhDs in Chemistry or related fields for a remote contract. The role involves designing...  ...developing solutions, evaluating AI outputs, and refining benchmarks. The pay rate is $50+/hour, depending on expertise. This flexibly... 
    For phd
    Contract work
    Remote work

    Turing

    San Francisco, CA
    10 hours ago
  •  ...AI Research Engineering Lead Zürich • San Francisco AI & Software In office...  ...to align data collection efforts with benchmarking of trained models and stable real-world...  ...What You Bring: Research Background: PhD in CS/ML or equivalent PhD-level industry research... 
    For phd
    Full time
    Work at office
    Relocation
    Relocation package

    Software Engineering, Data Science· Full-time

    San Francisco, CA
    7 days ago
  • $60 - $120 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam...  ...evaluation. Qualifications Must-Have PhD or advanced degree in Medicine Healthcare... 
    For phd
    Full time
    Contract work
    Summer work
    Remote work
    Flexible hours

    Mercor

    San Francisco, CA
    3 days ago
  • $84 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam...  .... Qualifications Must-Have PhD in Inorganic Chemistry Materials Chemistry... 
    For phd
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    4 days ago
  • $200k - $400k

     ...Do you have experience in AI research across LLMs, agents, evaluations, benchmarking, AI safety, alignment, agent understanding, RL environments or post-training...  ...improve model reasoning and agent performance. Fresh PhD graduates can be considered. Salary on offer is $20... 
    For phd
    Internship

    TTN Talent

    San Francisco, CA
    5 days ago
  • $70 - $110 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam...  .... Qualifications Must-Have ~ PhD in materials science, materials engineering,... 
    For phd
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    9 days ago
  • $211k - $290.5k

     ...work, or public writing on search and recommender systems.MS or PhD in CS, Statistics, or a related field.Salary RangeUS: the pay range for...  ...: We invest in what matters, including the latest enterprise AI tools, to help you work smarter and get more out of every day.Best... 
    For phd
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire

    San Francisco, CA
    5 days ago
  • $65 - $105 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ..., our investors include Benchmark , General Catalyst , Peter...  ...Collaborate with client researchers and specialists to maintain consistent...  ...or a related field. MS or PhD preferred. ~4+ years of professional... 
    For phd
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    22 days ago
  •  ...Description Job Description About JazzX AI:   Vision: Enterprises operating on...  ...Evaluation & Monitoring: Define frameworks for benchmarking, continuous evaluation, and feedback-...  ...teams. Preferred Qualifications PhD in Computer Science, Machine Learning, Robotics... 
    For phd
    Worldwide

    JazzX AI

    San Francisco, CA
    10 days ago
  • $60 - $90 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam...  .... Qualifications Must-Have ~ MSc or PhD in a STEM field or equivalent practical... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    29 days ago
  •  ...Description Job Description About Origin Origin is building Physical AI for the built world - starting with autonomous robots for...  ...safety layers enforce constraints. Requirements BS/MS/PhD in CS, Robotics, ML, or equivalent experience shipping learned systems... 
    For phd

    Origin

    San Francisco, CA
    2 days ago
  • $100k - $300k

     ...AI Research EngineerCogent Research is the applied AI lab at the heart of Cogent's mission. As an AI Research Engineer, you will work...  ...Computer Science or a closely related technical field (BS, MS, or PhD)Independence: A highly self-directed, proactive, and self-... 
    For phd

    Cogent Security, Inc.

    San Francisco, CA
    4 days ago
  • Back to Careers Selected Role AI Research Scientist Position LevelSenior Level Employment TypeFull-Time LocationSan Francisco...  ...AI features. Required Technical Skills & Qualifications PhD or Masters in CS, AI, or related field. Strong publication record or open-... 
    For phd
    Remote work

    Codiora Tech

    San Francisco, CA
    3 days ago
  •  ...~ We're looking for an AI Engineer who possesses a deep understanding of large-scale information retrieval systems, deep learning,...  ...data types and sources. What We Need to See Master's or PhD degree in Computer Science, Machine Learning, Statistics, or a related... 
    For phd

    Renaissance Academy

    San Francisco, CA
    2 days ago
  •  ...Build research and develop AI systems that enhance human agency. Focus on ethical AI, user privacy, and meaningful human-AI collaboration...  ...ethical and responsible AI development Requirements PhD or equivalent in Computer Science, AI, or related field Strong... 
    For phd
    Home office
    Flexible hours

    Akolades, Inc.

    San Francisco, CA
    3 days ago
  • $55 - $80 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'...  ...improve AI model performance . Qualifications PhD or advanced degree in Medicine / Healthcare ,... 
    For phd
    Contract work
    Summer work
    Remote work

    mercor

    San Francisco, CA
    4 days ago
  • $70 - $150 per hour

     ...About the Role As a Clinical Medicine AI Specialist, you will directly improve the accuracy and safety of AI in clinical reasoning, diagnostic...  ...degree (MD, MBBS, or equivalent), or an advanced degree (MSc / PhD) in a clinical or biomedical field. Board certification or... 
    For phd
    Hourly pay
    Part time

    RemoExperts

    San Francisco, CA
    1 day ago
  •  ...promised to change everything across a business—until generative AI. Today, AI is the number one driver of business reinvention. And...  ...following programming languages: Python, C++, Java, R, SQLMS or PhD in related field preferred (computer science, engineering, etc.)Compensation... 
    For phd
    Full time
    Work experience placement
    Live in
    Work at office
    Local area
    Shift work

    Accenture

    San Francisco, CA
    6 days ago
  • $77 - $98 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ..., our investors include Benchmark , General Catalyst , Peter...  ...Economics & Finance Benchmark Specialist Type: Contract Compensation...  ...Must-Have PhD or doctoral candidate in Economics... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  •  ...your career, and the financial world.The role:SoFi’s SeniorStaff AI Engineer is a hands-on AI engineering role in SoFi’s growing independent...  ...Science, Data Science, AI, Machine Learning, or a related field. PhD is a plus.8+ years software development experience, with 3+ years... 
    For phd
    Remote work

    SoFi

    San Francisco, CA
    7 days ago
  •  ...Description Job Description BEARCloud's client is seeking an AI Compiler Engineer developing next-generation AI inference...  ...MS in Computer Science, Electrical Engineering, or related field; PhD a plus. ~ Open-source AI/compiler contributions and technical leadership... 
    For phd
    Remote job

    BEARCloud, Inc.

    San Francisco, CA
    19 days ago
  • $8 - $65 per hour

     ...Job Application for Physics Specialist - Freelance AI Trainer Project at Meridial Back to jobs Physics Specialist - Freelance AI Trainer Project...  ...prompt engineering and evaluation metrics. A master’s or PhD in physics or a closely related physical science field is... 
    For phd
    Hourly pay
    Contract work
    Part time
    For contractors
    Freelance
    Immediate start
    Remote work

    Invisible Technologies

    San Francisco, CA
    1 day ago
  •  ...Staff AI Engineer This role will be based in Sunnyvale, San Francisco, or New York City. At LinkedIn, our approach to flexible work...  ...~6+ years of relevant AI/Machine Learning experience ~ MS or PhD in Computer Science or related technical discipline ~ Experience... 
    For phd
    For contractors
    Work at office
    Immediate start
    Flexible hours

    LinkedIn

    San Francisco, CA
    4 days ago
  •  ...review our Privacy Policy. Please review your choices. Accept All Customize Settings Reject All Employers Job seekers Career centers AI Skills Studio Handshake AI Research Log in Sign up INTELLIGENCE EXPERT (BACHELOR'S, MASTER'S AND PHDS) - AI TRAINER Sign up now Up to... 
    For phd
    Hourly pay
    Part time
    Immediate start
    Remote work
    10 hours per week
    Flexible hours

    Handshake

    San Francisco, CA
    1 day ago
  • $211k - $290.5k

     ...like Amazon and big box stores. Our highly skilled team of Applied AI/ML Scientists specialize in developing algorithmic solutions for...  ...-functional team Great to HavesHighly recommended: Master's or PhD in Computer Science, Statistics, or related STEM fields.Previous... 
    For phd
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire

    San Francisco, CA
    4 days ago
  •  ...Francisco, California | Primarily On-site We are seeking an AI Evaluation Engineer – Reinforcement Learning & Agents to build the...  ...stacks based on system requirements. Candidate Profile A PhD is not required. Strong engineering and shipped environment or evaluation... 
    For phd

    MaxIT Consulting - Max Corporate Group

    San Francisco, CA
    7 days ago
  • $211k - $290.5k

     ...like Amazon and big box stores. Our highly skilled team of Applied AI/ML Scientists specialize in developing algorithmic solutions for...  ...-functional team.Great to Haves:Highly recommended: Master's or PhD in Computer Science, Statistics, or related STEM fields.Previous... 
    For phd
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire

    San Francisco, CA
    3 days ago
  • $126.2k - $234.4k

     ...Solutions (DEPCS) team, the innovative digital, AI, and tech function within Roche Product...  ...AI.Who you areYou hold an MSc or PhD (preferred) in Computer Science, Machine...  .../test design, leakage prevention, robust benchmarking, uncertainty and error analysis, external... 
    For phd
    Full time
    Local area
    Relocation package

    Genentech

    South San Francisco, CA
    5 days ago
  • $50 per hour

    A leading AI research accelerator in San Francisco is looking for PhD candidates in Chemistry or related fields for a fully remote contract role. You will design and evaluate advanced chemistry problems to enhance AI performance, collaborating with researchers. Strong problem... 
    For phd
    Contract work
    Remote work
    Flexible hours

    Turing

    San Francisco, CA
    10 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to CS PhD AI Benchmark Specialist. Be the first to apply!