Philosophy PhD Benchmark Specialist
$50 - $63 per hourFull-time
Mercor
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey .
Position: Applied Philosophy Benchmark Specialist
Type: Contract
Compensation: $50$63/hour
Location: Remote
Commitment: 10 hours/week
Role Responsibilities
- Author original philosophy questions that test deep conceptual understanding not surface-level recall.
- Ensure questions are unambiguous self-contained and precisely defined. Include all necessary information in the problem statement.
- Rate each questions difficulty: Medium (intro undergraduate) Hard (advanced undergraduate) or Expert (post-graduate and above).
- Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers.
- Write step-by-step Chain-of-Thought solutions with clear concise reasoning in markdown format.
- Supply 15 academic references per question from reputable sources like peer-reviewed journals or university repositories.
- For verification tasks: flag issues with clarity completeness precision or solvability and justify any edits made.
Qualifications
Must-Have
- PhD or doctoral candidate in Philosophy or a closely related field.
- Masters degree considered for candidates with exceptional depth in a specific subdomain.
- Strong command of philosophical argumentation formal logic and canonical texts across traditions.
- Research publications or teaching experience in philosophy is a strong plus.
- Excellent written English and ability to express complex ideas clearly and concisely.
Application Process (Takes 2030 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information please check:
- For any help or support reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Philosophy PhD Benchmark Specialist in New York, NY vacancy
$77 - $98 per hour
...in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel ,... ...Applied Economics & Finance Benchmark Specialist Type: Contract Compensation:... ...made. Qualifications Must-Have PhD or doctoral candidate in Economics ,...For phdContract workSummer workRemote workMercor
New York, NY2 days ago$61 - $77 per hour
...in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel ,... ...Position: Applied Mathematics Benchmark Specialist Type: Contract Compensation:... ...made. Qualifications Must-Have PhD or doctoral candidate in Mathematics...For phdContract workSummer workRemote work$50 per hour
...well AI solves them, and work with researchers to build better benchmarks. Responsibilities Design advanced chemistry problems to test... ...with researchers to refine benchmarks across undergraduate to PhD-level chemistry topics. Requirements PhD (pursuing or...For phdContract workRemote workFlexible hoursTuring Inc
New York, NY1 day ago- Agency is seeking a Pure Mathematics and Lean 4 Specialist for a freelance AI trainer project. The role emphasizes rigorous... ...in Lean 4, and collaboration to improve evaluation benchmarks. Ideal candidates hold a PhD or PostDoc in pure mathematics and bring deep...For phdFreelance
$50 per hour
...well AI solves them, and work with researchers to build better benchmarks. Responsibilities Design advanced chemistry problems to test AI... ...with researchers to refine benchmarks across undergraduate to PhD-level chemistry topics. Requirements PhD (pursuing or completed...For phdRemote jobContract workFlexible hours$70 per hour
...AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology Expert (PhD) — AI Safety Type: Contract Compensation: $65-$70/hour Location: Remote...For phdRemote jobContract workPart timeSummer workImmediate start$98 per hour
...in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam... ...: Applied Business & Commerce Benchmark Specialist Type: Contract Compensation: $77-$98/hour... ...any edits made. Qualifications Must-Have PhD , DBA , or doctoral candidate in...For phdRemote jobContract workSummer work$84 per hour
...research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry... ...TEM , XPS , ellipsometry , etc.). An advanced degree ( PhD/MS ) or equivalent hands-on experience in materials science,...For phdContract workSummer workRemote workMercor
New York, NY8 days ago- ...Obsidian is seeking advanced Physics Researchers and PhD Students to contribute to a groundbreaking project focused on physics reasoning... .... This role involves designing and validating challenging benchmark tasks that diagnose reasoning gaps in AI models. The ideal candidate...For phd
Obsidian
New York, NY13 hours ago $61 - $77 per hour
...in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel ,... ...Position: Applied Chemistry Benchmark Specialist Type: Contract Compensation:... ...made. Qualifications Must-Have PhD or doctoral candidate in Chemistry ,...For phdContract workSummer workRemote workMercor
New York, NY2 days ago$190 per hour
...research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry... ...required; 10–25 years preferred. ~ MD , PharmD , PhD , or equivalent. ~ Experience authoring aggregate safety reports...For phdRemote jobContract workSummer workMercor
New York, NY26 days ago$70 - $100 per hour
...research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry... ...Have Graduate-level training in a relevant STEM field ( MS, PhD, or equivalent research experience ). Proven proficiency with...For phdContract workSummer workRemote workMercor
New York, NY2 days ago$50 per hour
A leading AI research accelerator is looking for remote PhD candidates in Chemistry, Chemical Engineering, or related fields. You... ...to evaluate AI performance and collaborate with researchers on benchmarks. This role offers flexible hours and a pay rate of over $50/hour...For phdHourly payRemote workFlexible hoursTuring
New York, NY13 hours ago- Mercor is seeking PhD and Master's scientists to author AI evaluation tasks for a new benchmark in scientific computing. You will craft original, executable research problems that current frontier models cannot solve. Responsibilities include sourcing materials, writing...For phdPart time
- Mercor is hiring PhD and Master's scientists to author AI evaluation tasks and participate in a new benchmark for scientific computing. You will author original, executable research problems that frontier models cannot solve, focusing on materials science and related subdomains...For phdPart timeImmediate start
- ...with PySCF and related tools to test AI systems. Applicants should have MS or PhD level, strong Python skills, and proven experience with quantum chemistry libraries. You will publish benchmarks and contribute to scalable problem design for evaluation. #J-18808-Ljbffr...For phd
- Mercor is seeking an Applied Engineering Benchmark Specialist for a remote contract role. The position involves crafting advanced engineering questions... ...and self-contained problem statements. The role requires PhD candidacy or doctorate, strong graduate-level engineering...For phdRemote jobContract work
- Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code) for a new benchmark in scientific computing. You will author original, executable research problems that today's frontier models cannot solve. Requirements include a PhD in chemistry...For phdRemote job
$100 per hour
...models using physics expertise. You will design problems, evaluate AI reasoning, and collaborate with AI researchers to build robust benchmarks. Work is remote with flexible weekly hours; compensation starts at $100+ per hour and depends on role and candidate expertise....For phdRemote jobHourly payContract workFlexible hours- ...-choice questions across core history and political science domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned two task types: Question Authoring and Question Verification, with responsibilities...Remote job
- Mercor is seeking an Applied Biology Benchmark Specialist for a remote contract role, offering 10+ hours per week. You will author original biology questions spanning Pharmaceutical Manufacturing, Industrial and Synthetic Biology, Medical Research & Drug Discovery, and...Remote jobContract work10 hours per week
$83 - $105 per hour
...for an AI research initiative. In this role, you will contribute your legal expertise to the development of rigorous evaluation benchmarks designed to assess how effectively AI systems understand and reason about complex legal concepts. You may contribute through one...Hourly payContract workFor contractorsH1bRemote work10 hours per weekFlexible hoursWeekday work$50 - $90 per hour
...Back Chemistry Specialist Life Science Available in All Countries About the Role We are looking for chemists with deep... ...quality consistent. Required Qualifications Master’s or PhD in chemistry with demonstrated expertise in at least one subdiscipline...For phdHourly payFor contractorsRemote workAI Trainer Jobs
New York, NY1 day ago- ...company continues we grow we are seeking a Regulatory and Start Up Specialist to join our growing team. Essential functions of the job... ...meet deadlines Advanced degree in medical or life sciences (MD, PhD, PharmD)/RAC certification/Masters in Regulatory Science. We invite...For phdContract workWork experience placementLocal area
Precision for Medicine
New York, NY1 day ago - ...Chemistry Specialist (Masters/PhDs) - AI Training About the Role What if your years of chemistry expertise could directly shape... ...the world? We're looking for Chemistry Specialists - Masters and PhD-level experts - to design, solve, and evaluate advanced...For phdHourly payOngoing contractContract workFreelanceRemote workFlexible hours
Alignerr
New York, NY1 day ago - Meridial is seeking a Mathematics Specialist fluent in Swedish for a freelance AI Trainer project. As a remote role, you will engage in discussions... ...and proposing enhancements. The role requires a master's or PhD in mathematics and expertise in subjects like algebra and...For phdRemote jobHourly payFreelance
- Invisible Technologies is seeking a Mathematics Specialist fluent in Arabic to train AI and challenge large language models on advanced mathematics... ...a remote contractor role. Ideal candidates hold a Master’s or PhD in mathematics with a track record in mathematical modeling or...For phdRemote jobFor contractors
- ...Biology Specialist (Masters/PhDs) - AI Training About the Role What if your years of biology expertise could directly shape how... ...entirely on your own schedule Who You Are Master's or PhD in Biology or a closely related field - Genetics, Molecular Biology...For phdHourly payOngoing contractContract workFreelanceRemote workFlexible hours
Alignerr
New York, NY13 hours ago - A remote technology firm is seeking a Computer Science Specialist to research advanced questions and curate educational resources. Candidates should have either a PhD in computer science or experience in the International Olympiad in Informatics. Responsibilities include...For phdRemote jobFlexible hours
- About the role We're hiring PhD‑level chemists to help make advanced AI models safer. You'll apply your scientific expertise to evaluate and strengthen how these models handle specialized chemistry topics. No prior AI/ML experience is required — we'll train you on the workflow...For phdPart timeImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Philosophy PhD Benchmark Specialist. Be the first to apply!
Related searches
- addiction specialist New York, NY
- youth engagement specialist New York, NY
- denials specialist New York, NY
- mathematics specialist New York, NY
- configuration specialist New York, NY
- enterprise solutions specialist New York, NY
- member outreach specialist New York, NY
- vetting specialist New York, NY
- occupancy specialist New York, NY
- creative specialist New York, NY