Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Philosophy PhD - Assessment Specialist

Mercor

Role Overview We are seeking expert philosophers to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core philosophy domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned one of two task types: Question Authoring — Create original, challenging multiple-choice questions in your area of philosophy expertise, rate their difficulty, and submit them for review. Question Verification — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made. Philosophy Domains Covered Formal Ontology & Knowledge Representation, AI Ethics, Applied Epistemology, Philosophy of Technology & Robotics, Philosophy of Science. Key Responsibilities Author original philosophy questions that test deep conceptual understanding, not surface-level recall Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above) Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, university repositories) For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made Ideal Qualifications PhD or doctoral candidate in Philosophy or a closely related field Master's degree considered for candidates with exceptional depth in a specific subdomain Strong command of philosophical argumentation, formal logic, and canonical texts across traditions Research publications or teaching experience in philosophy is a strong plus Excellent written English and ability to express complex ideas clearly and concisely More About the Opportunity Expected commitment: 10+ hours/week Asynchronous, fully remote work #J-18808-Ljbffr Mercor

Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Philosophy PhD - Assessment Specialist in New York, NY vacancy
  • Obsidian is seeking expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous questions, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI... 
    For phd
    Remote job

    Obsidian

    New York, NY
    3 days ago
  • Mercor seeks expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions, evaluate solution quality, and help establish gold-standard benchmarks for advancing... 
    For phd
    Remote job
    Flexible hours

    Mercor

    New York, NY
    5 days ago
  •  ...seeking expert chemists to author and review high-quality academic assessment content for an AI research initiative. You will write and...  ...solvability and justify any edits made Ideal Qualifications PhD or doctoral candidate in Chemistry, Biochemistry, Chemical Engineering... 
    For phd
    Remote work

    Mercor

    New York, NY
    9 hours ago
  • $50 - $63 per hour

     ...and Jack Dorsey . Position: Applied Psychology Benchmark Specialist Type: Contract Compensation: $50–$63/hour Location...  ...and justify any edits made. Qualifications Must-Have PhD , PsyD , or doctoral candidate in Psychology or a closely related... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    7 days ago
  • $85 per hour

    [Mercor] Chemistry Specialist | $85/hr Remote Join to apply for the [Mercor] Chemistry Specialist...  ...: Mercor Position: Chemistry Expert (PhD) Referral Partner: Crossing Hurdles Type:...  ...hours/week Role Responsibilities Create and Assess Complex Chemistry Problems: Develop and... 
    For phd
    Hourly pay
    Contract work
    Remote work

    Crossing Hurdles

    New York, NY
    2 days ago
  •  ...Opportunity: Chemistry Expert (PhD) - Frontier AI Evaluation I am currently partnering with an innovative organization at the forefront...  ...across undergraduate to PhD-level topics. Model Evaluation: Assess AI-generated responses for scientific accuracy, chemical... 
    For phd
    Hourly pay
    Contract work
    Part time
    Remote work
    Flexible hours

    Antal International

    New York, NY
    3 days ago
  • $50 per hour

     ...with researchers to refine benchmarks across undergraduate to PhD-level chemistry topics. Requirements PhD (pursuing or completed...  ...Pay rate: $50+/hour (depends on role and candidate expertise). Assessment: Shortlisted experts complete an evaluation before selection. Assignments... 
    For phd
    Remote job
    Contract work
    Flexible hours

    Turing

    New York, NY
    2 days ago
  • $52.5 per hour

    Computer Science Specialist | $52.5/hr Remote Get AI-powered advice on this job and more exclusive...  ...: Computer Science Expert (Olympiad or PhD) Type: Hourly contract Compensation: $5...  ...in computer science. Proven ability to assess rigor, complexity, and correctness of... 
    For phd
    Remote job
    Hourly pay
    Contract work

    Crossing Hurdles

    New York, NY
    2 days ago
  • $50 per hour

     ...with researchers to refine benchmarks across undergraduate to PhD-level biology topics. Requirements PhD (pursuing or completed)...  ...Pay rate: $50+/hour (depends on role and candidate expertise). Assessment: Shortlisted experts complete an evaluation before selection. Assignments... 
    For phd
    Remote job
    Contract work
    Flexible hours

    Turing

    New York, NY
    3 days ago
  • $88.97k - $119k

     ...organization, including core account executives, specialist license sales, Sales Productivity,...  ...Experience:B.S., M.S. or PhD in Computer Science, Software Engineering...  ...intelligence (AI) tools to help our recruiters assess and evaluate candidates’ resumes and qualifications... 
    For phd
    Full time
    Work experience placement
    Work at office

    Salesforce

    New York, NY
    1 day ago
  • $110k - $130k

     ...relevant experience to a new industry, join our team as we help shape a brighter way forward. Job Title: Technical Services Site Assessment SpecialistWhat this job involves:This client-facing role combines technical expertise with consulting services to deliver comprehensive... 
    Full time
    Work at office
    Local area
    Remote work

    Jones Lang LaSalle

    New York, NY
    1 day ago
  • $82.42k - $107.81k

     ...Brooklyn, seeks a Middle School Learning Specialist within a dynamic community of colleagues...  ...accommodations for all middle school assessments. Provide academic support to students with...  ...Bachelor’s degree required (MA or PhD in related field preferred) Commitment... 
    For phd
    Full time
    Work at office
    Local area

    Brooklyn Friends School

    New York, NY
    2 days ago
  • $57.7k

     ...population and uses clinical and motivational interviewing skills to assess members’ needs and establish mutually agreeable short and long‑...  ...Counselor (LPC) Licensed Marriage and Family Therapist (LMFT) PhD. Preferred Certifications Case Management Certification... 
    For phd
    Remote job
    Temporary work
    For contractors
    Work at office
    Local area

    Highmark Health

    New York, NY
    4 days ago
  • $121.79k - $162.05k

     ...changemanagement, and deprecation processes, ensuring release notes, impact assessments, and backwardcompatibility Establish metadata quality...  .../ SQL, NoSQL MongoDB etc.) Preferred Qualifications PhD degree Demonstrated track record of successfully applying metadata... 
    For phd
    Local area

    NYU Langone Health

    New York, NY
    2 days ago
  • Remote Biology Specialist (Master’s/PhD) - 34880 Remote Biology Specialist (Master’s/PhD) - 34880 1 week ago Be among the first 25 applicants...  ...clear the challenge, you will be redirected to a Biology assessment (approximately 30 minutes) followed by a language proficiency... 
    For phd
    Remote job
    Hourly pay
    Contract work
    Temporary work
    For contractors
    Freelance

    Turing

    New York, NY
    2 days ago
  •  ...instructional materials, and maintain academic integrity. The ideal candidate holds a PhD or PsyD in Clinical Psychology with clinical experience emphasizing objective personality assessment. Proficiency in educational technology and a commitment to multicultural education... 
    For phd
    Part time

    Touro College & University System

    New York, NY
    1 day ago
  • $8 - $65 per hour

    Coding Specialist (Fluent in Dutch) - Freelance AI Trainer Project World Wide - Remote Are you...  ...logical accuracy and coding fluency, assess naturalness and correctness of Dutch language...  ...A bachelor’s, master’s, or PhD in computer science, software engineering... 
    For phd
    Hourly pay
    Contract work
    For contractors
    Freelance
    Remote work

    Meridial

    New York, NY
    4 days ago
  • A language assessment company seeks a Product Manager to lead product roadmaps for assessment products. The role involves managing product...  ...are essential. This position requires 25% to 35% travel, and a PhD is preferred. #J-18808-Ljbffr Language Testing International
    For phd

    Language Testing International

    New York, NY
    2 days ago
  •  ...planning multiple queries or experiments, and interpreting multi-step results against state-of-the-art AI models. Ideal candidates hold MS/PhD-level training, have hands-on experience with the specified libraries, and can write research-grade code for problem setups, oracle... 
    For phd

    Obsidian

    New York, NY
    2 days ago
  •  ...Mercor is seeking a Biology Expert (PhD) for a remote contract position focusing on AI Safety. The role involves writing expert prompts, evaluating model responses for accuracy, and ensuring responsible handling of dual-use information. Candidates should possess a PhD... 
    For phd
    Contract work
    Remote work

    Mercor Inc

    New York, NY
    2 days ago
  • $102.8k - $164.5k

     ...optimizing novel assays, including feasibility assessments and protocol development.Maintaining...  ...of a core facility. Key Qualifications: PhD in Molecular Biology, Biochemistry, or a...  ...Leadership Helpful Links: Compensation Philosophy Benefits Pay Range: $102,800.00 - $164,5... 
    For phd
    Full time
    Monday to Friday

    Memorial Sloan-Kettering

    New York, NY
    3 days ago
  •  ...United States is seeking Licensed Psychologists to conduct autism assessments for adults via telehealth. This role offers flexibility in...  ...and accessible diagnostic services. The ideal candidate holds a PhD or PsyD and has the desire to assist autistic adults. Comprehensive... 
    For phd
    Full time
    Part time

    Prosper Health

    New York, NY
    2 days ago
  •  ...seeking expert chemists to author and review high-quality academic assessment content for an AI research initiative. You will create and...  ...demands strong English communication. Ideal candidates hold a PhD or are doctoral candidates, with deep knowledge across core chemistry... 
    For phd
    Remote job

    Obsidian

    New York, NY
    3 days ago
  • $65k - $80k

     ...arguing and start collaborating. We were built from scratch with PhD data scientists and award-winning creatives working on the same...  ...Data Science team continues to grow and so does our need for a Specialist, Search. This position is responsible for the creation,... 
    For phd
    Full time

    Known

    New York, NY
    4 days ago
  •  ...specialized software in this domain will also be considered. What Makes a Strong Candidate You have graduate-level expertise (MS or PhD preferred) in the domain above, with real hands-on experience using these tools — not just theoretical knowledge. You've written code... 
    For phd
    Remote work

    Obsidian

    New York, NY
    2 days ago
  • NADAP is seeking an Assessment Specialist (CASAC) in New York, NY. The role focuses on conducting assessments, applying clinical judgment, and linking clients to appropriate treatment and harm-reduction services. The position is Monday-Friday, 9am-5pm in the Union Square... 
    Work at office
    Monday to Friday

    NADAP (National Association on Drug Abuse Problems)

    New York, NY
    2 days ago
  • Duties/Responsibilities Provide comprehensive assessment service to a caseload of homeless men referred to BRC’S Reaching New Heights. Assessment Specialists primary duties will involve completing a comprehensive intake assessment of clients new to the shelter. Responsible... 
    Full time
    Monday to Friday
    Flexible hours

    Bowery Residents' Committee

    New York, NY
    4 days ago
  • A healthcare provider in Georgia is seeking an Assessment Specialist to coordinate pre-admission assessments and provide clinical evaluations. Candidates should possess a relevant Master’s degree and state licensure, along with 3 years of clinical experience in behavioral... 
    Shift work
    Weekend work
    Weekday work

    Piedmont Healthcare

    New York, NY
    9 hours ago
  •  ...Health, LLC in New York City seeks a Clinical Psychometrist to administer, score, and document psychological and neuropsychological assessments, using paper-pencil and computerized formats, and to deliver cognitive remediation sessions. You will coordinate clinical... 

    PAX Health, LLC

    New York, NY
    1 day ago
  • A leading assessment organization is seeking a CAS Assessor to arrange, conduct, and complete thorough assessments using a person-centered approach. The role requires at least one year of experience working with individuals with intellectual and/or developmental disabilities... 

    Equiliem

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Philosophy PhD - Assessment Specialist. Be the first to apply!