CS PhD - AI Benchmark Specialist
$66 - $84 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Applied Computer Science Benchmark Specialist
Type: Contract
Compensation: $66–$84/hour
Location: Remote
Commitment: 10+ hours/week
Role Responsibilities
- Author original computer science questions that test deep conceptual understanding.
- Ensure questions are unambiguous, self-contained, and precisely defined.
- Rate each question's difficulty: Medium, Hard, or Expert.
- Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.
- Write step-by-step Chain-of-Thought solutions in markdown format.
- Supply 1–5 academic references per question from reputable sources.
- For verification tasks: flag issues with clarity, completeness, precision, or solvability.
Qualifications
Must-Have
- PhD or doctoral candidate in Computer Science , Electrical Engineering , or a closely related field.
- Master's degree considered for candidates with exceptional depth in a specific subdomain.
- Strong command of graduate-level CS theory , algorithms , systems design , and/or machine learning .
- Excellent written English and ability to express complex ideas clearly and concisely.
Preferred
- Research publications, industry experience at top tech companies, or competitive programming background.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 9 days ago
Similar jobs that could be interesting for youBased on the CS PhD - AI Benchmark Specialist in San Francisco, CA vacancy
- Logoslabs is seeking a highly skilled Computer Science Specialist fluent in Portuguese (Portugal) to guide AI training and evaluation. You will work remotely on... ...your work, and improving prompts. A Master’s or PhD in CS is ideal, with strong publications or hands‑on ML projects...For phdRemote jobContract work
$50 per hour
A leading AI research organization is seeking PhDs in Chemistry or related fields for a remote contract. The role involves designing... ...developing solutions, evaluating AI outputs, and refining benchmarks. The pay rate is $50+/hour, depending on expertise. This flexibly...For phdRemote jobContract work$66 - $84 per hour
...technical talent with leading AI research labs.... ...our investors include Benchmark , General Catalyst , Peter... ...Computer Science Benchmark Specialist Type: Contract... ...Qualifications Must-Have PhD or doctoral candidate in... ...command of graduate-level CS theory , algorithms ,...For phdContract workSummer workRemote work$70 - $100 per hour
...technical talent with leading AI research labs. Headquartered in... ...our investors include Benchmark General Catalyst Peter Thiel... ...Position: Genomics & Cell Biology Specialist Type: Contract... ...Qualifications Must-Have PhD in molecular biology cell...For phdFull timeContract workSummer workRemote workWeekday workMercor
San Francisco, CA19 days ago$1,350 per unit
...Help evaluate how AI systems approach scientific and clinical work. Use your subject... ...you’ll work on Develop Linux-terminal benchmarking tasks grounded in your field, such as interpreting... .... Requirements A completed PhD in a relevant scientific field, or an MD...For phdBraintrust
San Francisco, CA3 days ago$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel ,... ...writing benchmark or evaluation questions. PhD in ML , CS , or physics , or an MSc with strong...For phdContract workSummer workRemote work- ...elite creative and technical talent with leading AI research labs, seeks an Applied Chemistry Benchmark Specialist for a remote contract role. You will craft chemistry... ...is 10+ hours/week. Requirements include a PhD or doctoral candidate in Chemistry or closely related...For phdRemote jobContract work
$61 - $77 per hour
...elite creative and technical talent with leading AI research labs. The company seeks an Applied Mathematics Benchmark Specialist on a remote, contract basis, offering $61-$77/... ...solutions and references. You should hold a PhD or be a doctoral candidate with strong proof-...For phdRemote jobContract work10 hours per week- ...Description Job Description About JazzX AI: Vision: Enterprises operating on... ...Evaluation & Monitoring: Define frameworks for benchmarking, continuous evaluation, and feedback-... ...teams. Preferred Qualifications PhD in Computer Science, Machine Learning, Robotics...For phdWorldwide
JazzX AI
San Francisco, CAa month ago - ...molecule design and synthesis, with projects in reaction prediction benchmarking or molecular property prediction. Collaboration with public and... .... The role emphasizes a graduate student pursuing MSc or PhD, with bonus points for Python, RDKit, and chemistry knowledge,...For phd
- Mercor is seeking a contract Applied Business & Commerce Benchmark Specialist for a remote, part-time engagement. The role centers on crafting... ...difficulty and comprehensive solutions. The ideal candidate holds a PhD/DBA or MBA with strong graduate-level strategy,...For phdRemote jobContract workPart timeFlexible hours
$60 - $75 per hour
...connects elite creative and technical talent with leading AI research labs. The Applied Biology Benchmark Specialist position is a remote contract opportunity offering... ...and references. Ideal candidates hold a PhD in Biology or related fields, with strong graduate-...For phdRemote jobContract work10 hours per week- ...AI Research Scientist Location: San Francisco or remote · Full-time About us... ...success. We aren't chasing existing GeoAI benchmarks. You'll help decide what we measure.... ...broader community. Requirements ~ PhD degree in computer science, engineering, a...For phdFull timeRemote work
Humai
San Francisco, CA4 days ago $61 - $77 per hour
...technical talent with leading AI research labs. Headquartered in... ..., our investors include Benchmark , General Catalyst , Peter Thiel... ...Applied Mathematics Benchmark Specialist Type: Contract Compensation: $... ...made. Qualifications Must-Have PhD or doctoral candidate in Mathematics...For phdContract workSummer workRemote work- ...AI Research Engineering Lead Zürich • San Francisco AI & Software In office... ...to align data collection efforts with benchmarking of trained models and stable real-world... ...What You Bring: Research Background: PhD in CS/ML or equivalent PhD-level industry research...For phdFull timeWork at officeRelocationRelocation package
- Remote is seeking a Kannada Language Specialist to engage with AI language models, verify factual accuracy, and document error traces. You will help... ...analysis and metacognitive reasoning. A master’s or PhD in Kannada language or linguistics is ideal, with peer‑reviewed...For phdRemote jobContract work
$30 - $50 per hour
...Job Application for ML Engineer Specialist - Freelance AI Trainer Project at Meridial Back to jobs... ...failure modes. Design new benchmark tasks : identify datasets, analyze... ...cloud-based workflows. Master’s or PhD in CS/ML/data science preferred; peer-reviewed...For phdHourly payContract workPart timeFor contractorsFreelanceImmediate startRemote workInvisible Technologies
San Francisco, CAa month ago- Remote is seeking a Chinese Language Specialist to help shape the future of AI by evaluating and guiding language models with Chinese expertise. You will... ...failure modes and improve model reasoning. With a master’s or PhD in Chinese language or linguistics, you will converse...For phdRemote jobHourly payContract work
- Logoslabs is seeking a Swedish Language Specialist to train and evaluate AI language models. You will test linguistic phenomena, verify factual and logical... ...to education-grade language data quality. A master’s or PhD in Swedish language, linguistics, or related field is...For phdRemote jobContract work
- Remote is seeking a Latvian Language Specialist - AI Trainer to help shape the future of multilingual AI. You will test model outputs, analyze... ...failure modes to improve reasoning and prompts. A Master’s or PhD in Latvian language or linguistics is ideal; strong...For phdRemote jobHourly payContract workFor contractors
- Remote is seeking an Afrikaans Language Specialist - AI Trainer to guide large language models using deep linguistic knowledge. You will work... ...in model evaluation. Ideal candidates hold a Master’s or PhD in Afrikaans language or linguistics and can document when models...For phdRemote jobFor contractors
- Remote is seeking a Croatian Language Specialist - AI Trainer to help shape the future of AI from a remote location. You will challenge language... ...improvements to prompts and evaluation metrics. A Master’s or PhD in Croatian language or linguistics is preferred. #J-18808-...For phdRemote job
- Remote is seeking a Neuroscience Specialist - AI Trainer to help shape the future of AI by guiding neural models with rigorous neuroscience... ...evaluation metrics. This contract role requires a master’s or PhD in neuroscience and strong, metacognitive communication. #J-1...For phdRemote jobContract work
$80 - $130 per hour
...technical talent with leading AI research labs. Headquartered in... ...our investors include Benchmark General Catalyst Peter Thiel... ...Position: Formal Mathematics Specialist (Lean / Coq / Isabelle)... ...computer science or logic ( MS PhD or PhD candidate ) or equivalent...For phdContract workSummer workRemote workWeekday work- Remote seeks Bengali language specialists to help train and evaluate AI language models. You will test model outputs, challenge grammar, semantics, and translation... ...failures to improve model reasoning. A master’s or PhD in Bengali language or linguistics is ideal, with...For phdRemote jobFor contractors
$8 - $65 per hour
...language expert eager to shape the future of AI? Large-scale language models are evolving... .... We’re looking for Afrikaans language specialists who live and breathe Afrikaans grammar,... ...and evaluation metrics. A master’s or PhD in Afrikaans language, linguistics, or a...For phdHourly payContract workFor contractorsRemote work- ...the forefront of a new era in enterprise AI — one defined not by model capability alone... ...opportunity.Design and execute rigorous benchmarking and evaluation methodologies scoped to... ...and evaluate them critically.Master's or PhD in Computer Science, Computer Engineering...For phdWork experience placementLive inWork at officeLocal areaRelocation
Accenture
San Francisco, CA1 day ago - ...Qualifications Prior paid experience training, evaluating, benchmarking, or improving AI systems on mathematical or technical tasks. Strong... ...AI trainers’ technical submissions. A master’s degree, PhD, or equivalent record of substantial computational work....For phdPart timeImmediate start
micro1
San Francisco, CA4 days ago $60 - $120 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam... ...evaluation. Qualifications Must-Have PhD or advanced degree in Medicine Healthcare...For phdFull timeContract workSummer workRemote workFlexible hours$50 - $55 per hour
A leading consulting platform is seeking expert consultants with a PhD in French Studies for part-time remote work supporting AI research. This role offers flexible hours and competitive compensation starting at $50-$55 per hour, scaling up to $100 for top performers. Candidates...For phdRemote jobHourly payPart timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to CS PhD - AI Benchmark Specialist. Be the first to apply!
Related searches