Philosophy PhD - Assessment Specialist
Mercor
Role Overview We are seeking expert philosophers to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core philosophy domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned one of two task types: Question Authoring — Create original, challenging multiple-choice questions in your area of philosophy expertise, rate their difficulty, and submit them for review. Question Verification — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made. Philosophy Domains Covered Formal Ontology & Knowledge Representation, AI Ethics, Applied Epistemology, Philosophy of Technology & Robotics, Philosophy of Science. Key Responsibilities Author original philosophy questions that test deep conceptual understanding, not surface-level recall Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above) Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, university repositories) For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made Ideal Qualifications PhD or doctoral candidate in Philosophy or a closely related field Master's degree considered for candidates with exceptional depth in a specific subdomain Strong command of philosophical argumentation, formal logic, and canonical texts across traditions Research publications or teaching experience in philosophy is a strong plus Excellent written English and ability to express complex ideas clearly and concisely More About the Opportunity Expected commitment: 10+ hours/week Asynchronous, fully remote work #J-18808-Ljbffr Mercor
- Obsidian is seeking expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous questions, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI...For phdRemote job
- Mercor seeks expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions, evaluate solution quality, and help establish gold-standard benchmarks for advancing...For phdRemote jobFlexible hours
- ...seeking expert chemists to author and review high-quality academic assessment content for an AI research initiative. You will write and... ...solvability and justify any edits made Ideal Qualifications PhD or doctoral candidate in Chemistry, Biochemistry, Chemical Engineering...For phdRemote work
$50 - $63 per hour
...and Jack Dorsey . Position: Applied Psychology Benchmark Specialist Type: Contract Compensation: $50–$63/hour Location... ...and justify any edits made. Qualifications Must-Have PhD , PsyD , or doctoral candidate in Psychology or a closely related...For phdContract workSummer workRemote work$85 per hour
[Mercor] Chemistry Specialist | $85/hr Remote Join to apply for the [Mercor] Chemistry Specialist... ...: Mercor Position: Chemistry Expert (PhD) Referral Partner: Crossing Hurdles Type:... ...hours/week Role Responsibilities Create and Assess Complex Chemistry Problems: Develop and...For phdHourly payContract workRemote work- ...Opportunity: Chemistry Expert (PhD) - Frontier AI Evaluation I am currently partnering with an innovative organization at the forefront... ...across undergraduate to PhD-level topics. Model Evaluation: Assess AI-generated responses for scientific accuracy, chemical...For phdHourly payContract workPart timeRemote workFlexible hours
$50 per hour
...with researchers to refine benchmarks across undergraduate to PhD-level chemistry topics. Requirements PhD (pursuing or completed... ...Pay rate: $50+/hour (depends on role and candidate expertise). Assessment: Shortlisted experts complete an evaluation before selection. Assignments...For phdRemote jobContract workFlexible hours$52.5 per hour
Computer Science Specialist | $52.5/hr Remote Get AI-powered advice on this job and more exclusive... ...: Computer Science Expert (Olympiad or PhD) Type: Hourly contract Compensation: $5... ...in computer science. Proven ability to assess rigor, complexity, and correctness of...For phdRemote jobHourly payContract work$50 per hour
...with researchers to refine benchmarks across undergraduate to PhD-level biology topics. Requirements PhD (pursuing or completed)... ...Pay rate: $50+/hour (depends on role and candidate expertise). Assessment: Shortlisted experts complete an evaluation before selection. Assignments...For phdRemote jobContract workFlexible hours$88.97k - $119k
...organization, including core account executives, specialist license sales, Sales Productivity,... ...Experience:B.S., M.S. or PhD in Computer Science, Software Engineering... ...intelligence (AI) tools to help our recruiters assess and evaluate candidates’ resumes and qualifications...For phdFull timeWork experience placementWork at office$110k - $130k
...relevant experience to a new industry, join our team as we help shape a brighter way forward. Job Title: Technical Services Site Assessment SpecialistWhat this job involves:This client-facing role combines technical expertise with consulting services to deliver comprehensive...Full timeWork at officeLocal areaRemote work$82.42k - $107.81k
...Brooklyn, seeks a Middle School Learning Specialist within a dynamic community of colleagues... ...accommodations for all middle school assessments. Provide academic support to students with... ...Bachelor’s degree required (MA or PhD in related field preferred) Commitment...For phdFull timeWork at officeLocal area$57.7k
...population and uses clinical and motivational interviewing skills to assess members’ needs and establish mutually agreeable short and long‑... ...Counselor (LPC) Licensed Marriage and Family Therapist (LMFT) PhD. Preferred Certifications Case Management Certification...For phdRemote jobTemporary workFor contractorsWork at officeLocal area$121.79k - $162.05k
...changemanagement, and deprecation processes, ensuring release notes, impact assessments, and backwardcompatibility Establish metadata quality... .../ SQL, NoSQL MongoDB etc.) Preferred Qualifications PhD degree Demonstrated track record of successfully applying metadata...For phdLocal area- Remote Biology Specialist (Master’s/PhD) - 34880 Remote Biology Specialist (Master’s/PhD) - 34880 1 week ago Be among the first 25 applicants... ...clear the challenge, you will be redirected to a Biology assessment (approximately 30 minutes) followed by a language proficiency...For phdRemote jobHourly payContract workTemporary workFor contractorsFreelance
- ...instructional materials, and maintain academic integrity. The ideal candidate holds a PhD or PsyD in Clinical Psychology with clinical experience emphasizing objective personality assessment. Proficiency in educational technology and a commitment to multicultural education...For phdPart time
$8 - $65 per hour
Coding Specialist (Fluent in Dutch) - Freelance AI Trainer Project World Wide - Remote Are you... ...logical accuracy and coding fluency, assess naturalness and correctness of Dutch language... ...A bachelor’s, master’s, or PhD in computer science, software engineering...For phdHourly payContract workFor contractorsFreelanceRemote work- A language assessment company seeks a Product Manager to lead product roadmaps for assessment products. The role involves managing product... ...are essential. This position requires 25% to 35% travel, and a PhD is preferred. #J-18808-Ljbffr Language Testing InternationalFor phd
- ...planning multiple queries or experiments, and interpreting multi-step results against state-of-the-art AI models. Ideal candidates hold MS/PhD-level training, have hands-on experience with the specified libraries, and can write research-grade code for problem setups, oracle...For phd
- ...Mercor is seeking a Biology Expert (PhD) for a remote contract position focusing on AI Safety. The role involves writing expert prompts, evaluating model responses for accuracy, and ensuring responsible handling of dual-use information. Candidates should possess a PhD...For phdContract workRemote work
$102.8k - $164.5k
...optimizing novel assays, including feasibility assessments and protocol development.Maintaining... ...of a core facility. Key Qualifications: PhD in Molecular Biology, Biochemistry, or a... ...Leadership Helpful Links: Compensation Philosophy Benefits Pay Range: $102,800.00 - $164,5...For phdFull timeMonday to Friday- ...United States is seeking Licensed Psychologists to conduct autism assessments for adults via telehealth. This role offers flexibility in... ...and accessible diagnostic services. The ideal candidate holds a PhD or PsyD and has the desire to assist autistic adults. Comprehensive...For phdFull timePart time
- ...seeking expert chemists to author and review high-quality academic assessment content for an AI research initiative. You will create and... ...demands strong English communication. Ideal candidates hold a PhD or are doctoral candidates, with deep knowledge across core chemistry...For phdRemote job
$65k - $80k
...arguing and start collaborating. We were built from scratch with PhD data scientists and award-winning creatives working on the same... ...Data Science team continues to grow and so does our need for a Specialist, Search. This position is responsible for the creation,...For phdFull time- ...specialized software in this domain will also be considered. What Makes a Strong Candidate You have graduate-level expertise (MS or PhD preferred) in the domain above, with real hands-on experience using these tools — not just theoretical knowledge. You've written code...For phdRemote work
- NADAP is seeking an Assessment Specialist (CASAC) in New York, NY. The role focuses on conducting assessments, applying clinical judgment, and linking clients to appropriate treatment and harm-reduction services. The position is Monday-Friday, 9am-5pm in the Union Square...Work at officeMonday to Friday
- Duties/Responsibilities Provide comprehensive assessment service to a caseload of homeless men referred to BRC’S Reaching New Heights. Assessment Specialists primary duties will involve completing a comprehensive intake assessment of clients new to the shelter. Responsible...Full timeMonday to FridayFlexible hours
- A healthcare provider in Georgia is seeking an Assessment Specialist to coordinate pre-admission assessments and provide clinical evaluations. Candidates should possess a relevant Master’s degree and state licensure, along with 3 years of clinical experience in behavioral...Shift workWeekend workWeekday work
- ...Health, LLC in New York City seeks a Clinical Psychometrist to administer, score, and document psychological and neuropsychological assessments, using paper-pencil and computerized formats, and to deliver cognitive remediation sessions. You will coordinate clinical...
- A leading assessment organization is seeking a CAS Assessor to arrange, conduct, and complete thorough assessments using a person-centered approach. The role requires at least one year of experience working with individuals with intellectual and/or developmental disabilities...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Philosophy PhD - Assessment Specialist. Be the first to apply!
- junk removal specialist New York, NY
- correspondence specialist New York, NY
- measurement specialist New York, NY
- disclosure specialist New York, NY
- partnership specialist New York, NY
- absence management specialist New York, NY
- continuous improvement specialist New York, NY
- loss prevention specialist New York, NY
- hospitality specialist New York, NY
- learning management system specialist New York, NY


