Philosophy PhD - Benchmark Specialist
$50 - $63 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Applied Philosophy Benchmark Specialist
Type: Contract
Compensation: $50–$63/hour
Location: Remote
Commitment: 10+ hours/week
Role Responsibilities
- Author original philosophy questions that test deep conceptual understanding, not surface-level recall.
- Ensure questions are unambiguous, self-contained, and precisely defined. Include all necessary information in the problem statement.
- Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above).
- Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers.
- Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format.
- Supply 1–5 academic references per question from reputable sources like peer-reviewed journals or university repositories.
- For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made.
Qualifications
Must-Have
- PhD or doctoral candidate in Philosophy or a closely related field.
- Master's degree considered for candidates with exceptional depth in a specific subdomain.
- Strong command of philosophical argumentation, formal logic, and canonical texts across traditions.
- Research publications or teaching experience in philosophy is a strong plus.
- Excellent written English and ability to express complex ideas clearly and concisely.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 26 days ago
Similar jobs that could be interesting for youBased on the Philosophy PhD - Benchmark Specialist in New York, NY vacancy
$50 - $63 per hour
...rigorous multiple-choice questions across core philosophy domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will... ...any edits made Ideal Qualifications PhD or doctoral candidate in Philosophy or a closely...For phdHourly payRemote work$77 - $98 per hour
...in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel ,... ...Applied Economics & Finance Benchmark Specialist Type: Contract Compensation:... ...made. Qualifications Must-Have PhD or doctoral candidate in Economics ,...For phdContract workSummer workRemote workMercor
New York, NY20 days ago- ...research initiative. You will write and verify rigorous multiple-choice questions across core philosophy domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned one of two task types: Question...SuggestedRemote job10 hours per week
$50 per hour
...well AI solves them, and work with researchers to build better benchmarks.ResponsibilitiesDesign advanced biology questions to test AI performance... ...with researchers to refine benchmarks across undergraduate to PhD-level biology topics.RequirementsPhD (pursuing or completed) in...For phdContract workRemote workFlexible hoursTuring Inc
New York, NY1 day ago- Agency is seeking a Pure Mathematics and Lean 4 Specialist for a freelance AI trainer project. The role emphasizes rigorous... ...in Lean 4, and collaboration to improve evaluation benchmarks. Ideal candidates hold a PhD or PostDoc in pure mathematics and bring deep...For phdFreelance
$77 - $98 per hour
...in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel ,... ...Applied Economics & Finance Benchmark Specialist Type: Contract Compensation:... ...made. Qualifications Must-Have PhD or doctoral candidate in Economics ,...For phdContract workSummer workRemote workMercor
New York, NY5 days ago$190 per hour
...research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry... ...required; 10–25 years preferred. ~ MD , PharmD , PhD , or equivalent. ~ Experience authoring aggregate safety reports...For phdRemote jobContract workSummer workMercor
New York, NY14 days ago$140 per hour
...research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry... ...AI model performance . Qualifications Must-Have PhD in biochemistry , molecular or cell biology , genetics ,...For phdRemote jobContract workSummer workMercor
New York, NY3 days ago$85 per hour
...research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry... ...Have Graduate-level training in a relevant STEM field ( MS, PhD, or equivalent research experience ). Proven proficiency with...For phdRemote jobContract workSummer workMercor
New York, NY12 days ago$70 - $100 per hour
...research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry... ...Have Graduate-level training in a relevant STEM field ( MS, PhD, or equivalent research experience ). Proven proficiency with...For phdContract workSummer workRemote workMercor
New York, NY20 days ago$50 per hour
...well AI solves them, and work with researchers to build better benchmarks. Responsibilities Design advanced chemistry problems to test AI... ...with researchers to refine benchmarks across undergraduate to PhD-level chemistry topics. Requirements PhD (pursuing or completed...For phdRemote jobContract workFlexible hours$85 per hour
...research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry... ...Graduate-level training in a relevant STEM field ( MS , PhD , or equivalent research experience). Proven proficiency...For phdRemote jobContract workSummer workFlexible hoursMercor
New York, NY20 days ago$84 per hour
...research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry... ...TEM , XPS , ellipsometry , etc.). An advanced degree ( PhD/MS ) or equivalent hands-on experience in materials science,...For phdContract workSummer workRemote workMercor
New York, NY26 days ago- ...improvements into their golf game. At the foundation of our movement philosophy is Postural Restoration, with a particular focus on skeletal... ...field - Advanced credentials such as DPT, ATC, DC, MS, or PhD in biomechanics are welcome but not required - At least one...For phdPart timeWeekend workAfternoon shift3 days per week
SSWING
New York, NY1 day ago - Crossing Hurdles is seeking aContract chemist for AI benchmarking in chemistry. You will design and critique chemistry problems, provide expert... ...for accuracy and reproducibility. The role requires a PhD in chemistry or related field, hands-on or simulation-heavy research...For phdRemote job
- Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code) for a new benchmark in scientific computing. You will author original, executable research problems that today's frontier models cannot solve. Requirements include a PhD in chemistry...For phdRemote job
- Remotebridge is seeking a Computational Biology & Bioinformatics Expert (PhD) for a remote, contract role. You will apply your deep expertise... ...inputs. You will design workflows, analyze genomic data, benchmark pipelines, optimize parameters, and document methods to enable...For phdRemote jobContract work
$61 - $77 per hour
...in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel ,... ...Position: Applied Mathematics Benchmark Specialist Type: Contract Compensation:... ...made. Qualifications Must-Have PhD or doctoral candidate in Mathematics...For phdContract workSummer workRemote workMercor
New York, NY11 days ago- AuraOne, Inc. is seeking an Applied Scientist — Machine Learning specialist operations contractor to review AI outputs and evaluate workflow adherence. This remote role targets MSc or PhD holders, with US eligibility, to work on evaluating governance and operational risk...For phdRemote jobFor contractors
$63 per hour
...San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel... ...Jack Dorsey . Position: Applied Philosophy Benchmark Specialist Type: Contract Compensation:... ...made. Qualifications Must-Have PhD or doctoral candidate in Philosophy...For phdRemote jobContract workSummer workMercor
New York, NY16 days ago- ...with a strong background in music for the Music Audio Captioning Specialist role. This remote, short-term project involves evaluating audio... ...captions and summaries. Candidates must have a Masters or PhD in music-related field, plus at least one year of experience in...For phdRemote jobTemporary work
- A remote technology firm is seeking a Computer Science Specialist to research advanced questions and curate educational resources. Candidates should have either a PhD in computer science or experience in the International Olympiad in Informatics. Responsibilities include...For phdRemote jobFlexible hours
- ...Engage in knowledge-sharing sessions with interdisciplinary experts, contributing to the enrichment of project outcomes. Requirements PhD in biology or a closely related life science discipline. Demonstrated expertise in core biological principles with the ability to...For phdRemote job
- ...will combine language skills with subject-area expertise to improve manuscripts to standard scientific English. Requirements include a PhD in the relevant field and excellent English. Prior editing experience is a plus, and the role offers telecommuting from anywhere with...For phdRemote jobWorldwideFlexible hours
- ...continued growth we are seeking a Regulatory and Site Start Up Specialist . The Regulatory and Start Up Specialist (RSS) is an experienced... ...deadlines. Advanced degree in medical or life sciences (MD, PhD, PharmD)/RAC certification/Masters in Regulatory Science Any data...For phdContract workLocal area
- ...power the next generation of AI. We’re looking for mathematics specialists who live and breathe algebra, calculus, number theory, linear algebra... ...our prompt engineering and evaluation metrics. A master’s or PhD in mathematics or a closely related quantitative field is ideal...For phdHourly payContract workFor contractorsFreelanceRemote work
- ...applications for the Department Chair of History, Anthropology, and Philosophy in the Katherine Reese Pamplin College of Arts, Humanities, and... ...at Professor or higher, anticipated to begin July 2027, with a PhD and strong leadership in undergraduate programs. Reporting to...For phd
- ...Analytical Chemistry Specialist - AI Trainer, New Grad (Remote) Join to apply for the Analytical Chemistry Specialist - AI Trainer,... ...engineering and evaluation metrics Qualifications: Required: • PhD in analytical chemistry or a closely related chemical science...For phdFull timeContract workFreelanceH1bRemote workWorldwide
jobright.com
New York, NY16 hours ago $50 per hour
A leading research accelerator for AI is seeking PhDs in Biology, Biotechnology, or related fields for a remote contract role. You will help fine-tune large language models, design advanced biology questions, and collaborate with researchers on cutting-edge AI projects....For phdRemote jobContract workFlexible hours- ...conjunction with the central procurement team, select the most appropriate supplier, negotiate costing and time-scales for each job, manage benchmark information and ensure that internal procedures are followed at all times. Orders will be processed in the most efficient manner...Full timeWork experience placement
Tag
New York, NY3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Philosophy PhD - Benchmark Specialist. Be the first to apply!
Related searches
- eye specialist New York, NY
- reentry specialist New York, NY
- crisis specialist New York, NY
- technology integration specialist New York, NY
- deployment specialist New York, NY
- recovery specialist New York, NY
- qc specialist New York, NY
- parts specialist New York, NY
- crisis intervention specialist New York, NY
- traffic specialist New York, NY