Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Philosophy PhD Benchmark Specialist

$50 - $63 per hour
Full-time

Mercor

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey .

Position: Applied Philosophy Benchmark Specialist

Type: Contract

Compensation: $50$63/hour

Location: Remote

Commitment: 10 hours/week

Role Responsibilities

  • Author original philosophy questions that test deep conceptual understanding not surface-level recall.
  • Ensure questions are unambiguous self-contained and precisely defined. Include all necessary information in the problem statement.
  • Rate each questions difficulty: Medium (intro undergraduate) Hard (advanced undergraduate) or Expert (post-graduate and above).
  • Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers.
  • Write step-by-step Chain-of-Thought solutions with clear concise reasoning in markdown format.
  • Supply 15 academic references per question from reputable sources like peer-reviewed journals or university repositories.
  • For verification tasks: flag issues with clarity completeness precision or solvability and justify any edits made.

Qualifications

Must-Have

  • PhD or doctoral candidate in Philosophy or a closely related field.
  • Masters degree considered for candidates with exceptional depth in a specific subdomain.
  • Strong command of philosophical argumentation formal logic and canonical texts across traditions.
  • Research publications or teaching experience in philosophy is a strong plus.
  • Excellent written English and ability to express complex ideas clearly and concisely.

Application Process (Takes 2030 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information please check:
  • For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Philosophy PhD Benchmark Specialist in New York, NY vacancy
  • $50 - $63 per hour

     ...San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel...  ...Jack Dorsey . Position: Applied Philosophy Benchmark Specialist Type: Contract Compensation:...  ...made. Qualifications Must-Have PhD or doctoral candidate in Philosophy... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    7 days ago
  • Truelancer AI seeks PhD professionals in Molecular & Cellular Life Sciences to contribute expert benchmarking insights for a Life Sciences Research & Benchmarking study. Candidates should have a strong publication record and familiarity with benchmarking practices across... 
    For phd

    Truelancer AI

    New York, NY
    2 days ago
  • [Contract] Applied Computer Science Benchmark Specialist Mercor Remote Role Overview We are seeking expert computer scientists to author and review...  ...solvability and justify any edits made Ideal Qualifications PhD or doctoral candidate in Computer Science, Electrical... 
    For phd
    Contract work
    For contractors
    Remote work

    Mercor

    New York, NY
    2 days ago
  • $77 - $98 per hour

     ...in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel ,...  ...Applied Economics & Finance Benchmark Specialist Type: Contract Compensation:...  ...made. Qualifications Must-Have PhD or doctoral candidate in Economics ,... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    1 day ago
  • $77 - $98 per hour

     ...in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel ,...  ...Applied Economics & Finance Benchmark Specialist Type: Contract Compensation:...  ...made. Qualifications Must-Have PhD or doctoral candidate in Economics ,... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    3 days ago
  • $50 per hour

     ...well AI solves them, and work with researchers to build better benchmarks. Responsibilities Design advanced chemistry problems to test...  ...with researchers to refine benchmarks across undergraduate to PhD-level chemistry topics. Requirements PhD (pursuing or... 
    For phd
    Contract work
    Remote work
    Flexible hours

    Turing Inc

    New York, NY
    3 days ago
  • $35 - $60 per hour

     ...corrections to refine model outputs. Help define new evaluation benchmarks aligned with STEM curricula across levels. Collaborate remotely...  ...quality. Candidate Requirements Advanced degree (Master’s/PhD/Postdoc) in Chemistry or related discipline. Strong analytical,... 
    For phd
    Contract work
    For contractors
    Freelance
    Remote work

    Crossing Hurdles

    New York, NY
    13 hours ago
  • $70 - $100 per hour

     ...research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers,...  ...-HaveGraduate-level training in a relevant STEM field (MS, PhD, or equivalent research experience).Proven proficiency with scientific... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor Inc

    New York, NY
    4 days ago
  • $177k - $237k

     ...a regulated industry. As a GTM Solution Specialist for Healthcare & Life Sciences, you open...  ...deal structures, technical playbooks, and benchmark narratives that help sales and SA teams...  ....Advanced technical degree (MS or PhD in Computational Biology, Bioinformatics... 
    For phd
    Permanent employment
    Full time
    Contract work
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    3 days ago
  • $1,350 per unit

     ...quality of reasoning. What you’ll work on Develop Linux-terminal benchmarking tasks grounded in your field, such as interpreting evidence,...  ...behind your assessment. Requirements A completed PhD in a relevant scientific field, or an MD with a clinical specialization... 
    For phd

    Braintrust

    New York, NY
    3 days ago
  •  ...develop precise reference solutions, and design research-level benchmarks. Responsibilities include identifying errors in reaction mechanisms...  ...with researchers to establish clear evaluation criteria. A PhD and US-based work are required. #J-18808-Ljbffr Synthires
    For phd
    Remote job
    Hourly pay
    Contract work

    Synthires

    New York, NY
    3 days ago
  •  ...States. You will apply advanced chemistry expertise to evaluate AI-generated outputs, design research benchmarks, and develop reference solutions. The role requires a PhD and senior research experience, with emphasis on accuracy, spectral interpretation, and... 
    For phd
    Remote job
    Hourly pay
    Contract work

    Synthires

    New York, NY
    5 days ago
  • Remotebridge is seeking a Computational Biology & Bioinformatics Expert (PhD) for a remote, contract role. You will apply your deep expertise...  ...inputs. You will design workflows, analyze genomic data, benchmark pipelines, optimize parameters, and document methods to enable... 
    For phd
    Remote job
    Contract work

    Remotebridge

    New York, NY
    2 days ago
  • Zekai is seeking a Computational Biology & Bioinformatics Expert (PhD) for a 100% remote contractor role. You will design and critique workflows to benchmark AI capabilities, analyze genomic, transcriptomic, and proteomic data, and optimize pipelines for accuracy and reproducibility... 
    For phd
    Remote job
    For contractors

    Confidential

    New York, NY
    2 days ago
  •  ...both English and Arabic Collaborate with the team to refine prompts, evaluation methods, and domain-specific guidelines Requirements PhD in Chemistry or a closely related field Fluency in Arabic (Egyptian Arabic preferred) Demonstrated expertise in teaching, research, or... 
    For phd

    Agency.com

    New York, NY
    13 hours ago
  •  ...initiative. You will write and verify rigorous multiple-choice questions, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. This fully remote role offers asynchronous work and a commitment of 10+ hours per week, with... 
    Remote job
    10 hours per week

    Mercor Inc

    New York, NY
    2 days ago
  • $50 - $90 per hour

     ...Back Chemistry Specialist Life Science Available in All Countries About the Role We are looking for chemists with deep expertise in a specific...  ...keep quality consistent. Required Qualifications Master’s or PhD in chemistry with demonstrated expertise in at least one... 
    For phd
    Hourly pay
    For contractors
    Remote work

    RemoExperts

    New York, NY
    3 days ago
  • $25.49 per hour

     ...which align with the needs of the individual. Associate Enrollment Specialists utilize consultative relationship building skills focused on a...  ...inquiries will be focused on our degree (Bachelor, Master, or PhD) programs. A variety of service standards are measured such as... 
    For phd
    Work experience placement
    Work at office
    Remote work

    Strategic Education

    New York, NY
    2 days ago
  •  ...with a strong background in music for the Music Audio Captioning Specialist role. This remote, short-term project involves evaluating audio...  ...captions and summaries. Candidates must have a Masters or PhD in music-related field, plus at least one year of experience in... 
    For phd
    Remote job
    Temporary work

    Innodata India

    New York, NY
    3 days ago
  •  ...improvements into their golf game. At the foundation of our movement philosophy is Postural Restoration, with a particular focus on skeletal...  ...field - Advanced credentials such as DPT, ATC, DC, MS, or PhD in biomechanics are welcome but not required - At least one... 
    For phd
    Weekend work
    Afternoon shift
    3 days per week

    SSWING

    New York, NY
    26 days ago
  • $95 per hour

    Position: Top STEM PhD - Math or Physics Type: Hourly contract Compensation: $75-$95/hour Location: Remote Commitment: 10-40 hours/week Role Responsibilities Craft, solve, and review high-quality, challenging math or physics problems with real-world applicability. Apply... 
    For phd
    Remote job
    Hourly pay
    Contract work

    Crossing Hurdles

    New York, NY
    2 days ago
  • $55k - $60k

     ...research articles as a first author. PI’s philosophy is to encourage independent work,...  ...Minimum Qualifications Applicants have a PhD degree in cell biology, pharmacology, bioengineering...  ...Name: Rachel Poole Title: HR Specialist Email: ****@*****.*** Phone: 716-... 
    For phd

    State University of New York at Buffalo

    New York, NY
    3 days ago
  •  ...Chemistry SME to contribute to ground-breaking AI research, applying deep laboratory expertise in synthetic chemistry to design benchmarks and evaluate AI models for chemistry tasks. The role is part-time and involves collaboration with leading AI labs through an international... 
    Part time
    Weekday work

    Mercor

    New York, NY
    2 days ago
  •  ...Chemistry Specialist (Masters/PhDs) - AI Training About The Role What if your years of chemistry expertise could directly shape how AI reasons...  ...assignments at your own pace Who You Are Holds a Master's or PhD in Chemistry or a closely related field Deep expertise in one... 
    For phd
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Remote work
    Flexible hours

    Alignerr Corp.

    New York, NY
    2 days ago
  •  ...Biology Specialist (Masters/PhDs) - AI Training About the Role What if your years of biology expertise could directly shape how...  ...entirely on your own schedule Who You Are Master's or PhD in Biology or a closely related field - Genetics, Molecular Biology... 
    For phd
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Remote work
    Flexible hours

    Alignerr

    New York, NY
    4 days ago
  •  ...and provide informed recommendations. Helpful qualifications include an MSW, social‑work credential, counseling or therapy license, PhD or PsyD, or advanced training in HCI, communication, anthropology, sociology, or qualitative research. English fluency is required. Open... 
    For phd
    Contract work
    Part time
    For contractors
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    2 days ago
  • $115k - $125k

     ...which makes everything possible.The Senior Mechanistic Modeling Specialist (d/f/m) is responsible for supporting customers in advancing...  ...conference presentations, webinars, white papers, etc.).Who you are:PhD or Master’s degree in biotechnology, bioprocess/biomedical... 
    For phd
    Full time
    Remote work
    Work from home
    Flexible hours
    Night shift

    Danaher Corporation

    New York, NY
    22 hours ago
  •  ...will combine language skills with subject-area expertise to improve manuscripts to standard scientific English. Requirements include a PhD in the relevant field and excellent English. Prior editing experience is a plus, and the role offers telecommuting from anywhere with... 
    For phd
    Remote job
    Worldwide
    Flexible hours

    Cactus Communications

    New York, NY
    1 day ago
  • $190 per hour

     ...research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry...  ...required; 10–25 years preferred. ~ MD , PharmD , PhD , or equivalent. ~ Experience authoring aggregate safety reports... 
    For phd
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    25 days ago
  • $61 - $77 per hour

     ...in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel ,...  ...Position: Applied Chemistry Benchmark Specialist Type: Contract Compensation:...  ...made. Qualifications Must-Have PhD or doctoral candidate in Chemistry ,... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Philosophy PhD Benchmark Specialist. Be the first to apply!