Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

History PhD - Assessment Specialist - AI Trainer

Mercor

Role Overview We are seeking experts in history and political science to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core history and political science domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned one of two task types: Question Authoring — Create original, challenging multiple-choice questions in your area of expertise, rate their difficulty, and submit them for review. Question Verification — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made. History & Political Science Domains Covered National Security, Public Policy, Business History, Environmental History, Latin American History. Key Responsibilities Author original history and political science questions that test deep conceptual understanding, not surface-level recall Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post‑graduate and above) Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format Supply 1–5 academic references per question from reputable sources (peer‑reviewed journals, university repositories) For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made Ideal Qualifications PhD or doctoral candidate in History, Political Science, International Relations, or a closely related field Master's degree considered for candidates with exceptional depth in a specific subdomain Strong command of historiographical methods, political theory, and comparative analysis Research publications or policy experience is a strong plus Excellent written English and ability to express complex ideas clearly and concisely More About the Opportunity Expected commitment: 10+ hours/week Asynchronous, fully remote work #J-18808-Ljbffr Mercor

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the History PhD - Assessment Specialist - AI Trainer in San Francisco, CA vacancy
  • Mercor is seeking experts in history and political science to author and review high-quality academic assessment content for an AI research initiative. You will create and verify rigorous MCQs, rate difficulty, and help establish gold-standard benchmarks used to advance... 
    Suggested
    Remote job
    Part time

    Mercor

    San Francisco, CA
    5 days ago
  • Obsidian is seeking experts in history and political science to author and review rigorous academic assessment content for an AI research initiative. You will write and verify challenging questions, evaluate solution quality, and help establish gold-standard benchmarks... 
    Suggested
    Remote job
    10 hours per week

    Obsidian

    San Francisco, CA
    3 days ago
  • $155k - $189k

     ...Total Rewards philosophy. AI is a fundamental part of how work...  ...vary by role and will be assessed during the interview process....  ...craft across the team. ~ BS/MS/PhD in a quantitative field (Statistics...  ...applicants with criminal histories, consistent with applicable federal... 
    For phd
    Full time
    Work at office
    Local area
    2 days per week
    3 days per week

    Gusto

    San Francisco, CA
    18 hours ago
  •  ...Population Health Division (PHD) provides core public health...  ...other physicians, including specialists in other fields. Surgical specialist...  ...Civil Service Commission, assesses medical or physical...  ...condition (associated with cancer, a history of cancer, or genetic characteristics... 
    For phd
    Permanent employment
    Full time
    Part time
    Work experience placement
    Second job

    City and County of San Francisco

    San Francisco, CA
    2 days ago
  • $150 per hour

    We are partnering with a leading AI research organisation to develop a clinician-informed...  ...systems. Advise on best practices for assessing AI behaviour across key mental health domains...  ...health. Required Qualifications MD, DO, PhD, PsyD, or equivalent qualification in Psychiatry... 
    For phd
    Remote job
    Hourly pay
    Traineeship
    10 hours per week

    Obsidian

    San Francisco, CA
    4 days ago
  • Overview Get AI-powered advice on this job and more exclusive features. Turing is one of...  ..., particularly at the level expected in PhD-level programs. You should be able to break...  ...Shortlisted experts may be asked to complete an assessment. If you clear the assessment, you will be... 
    For phd
    Remote job
    Contract work

    Turing

    San Francisco, CA
    1 day ago
  • $50 per hour

     ...fields. Work on cutting‑edge projects with top AI labs while earning $50+/hour, fully remote...  ...refine benchmarks across undergraduate to PhD‑level math topics. Requirements PhD (...  ...depends on role and candidate expertise) Assessment Shortlisted experts complete an evaluation... 
    For phd
    Remote job
    Contract work
    Flexible hours

    Turing

    San Francisco, CA
    2 days ago
  • $190k - $210k

     ...Industrial-Organizational Psychologist in San Francisco to innovate AI-driven assessment solutions and lead high-impact client engagements. The role...  ...extensive experience in assessment science and a Master's or PhD in Industrial-Organizational Psychology. This position allows... 
    For phd

    BTS

    San Francisco, CA
    2 days ago
  •  ...California is seeking a qualified psychologist to provide mental health assessment and treatment services. The successful candidate will develop...  ...assessments, and collaborate with a multidisciplinary team. A PhD/PsyD in psychology and a California Psychologist License are... 
    For phd

    Kaiser Permanente

    San Francisco, CA
    1 day ago
  •  ...Francisco seeks a Psychologist - ASD to provide mental health assessment, treatment, and crisis intervention services. Responsibilities...  ...collaborating with healthcare teams. Applicants should have a PhD in Clinical Counseling and experience in mental health. This full... 
    For phd
    Full time

    Kaiser Permanente

    San Francisco, CA
    5 days ago
  • $78.3k - $201.7k

    Pownall Lab - Associate/Full Specialist Biochemistry and Biophysics UC San FranciscoThe Pownall Lab at UCSF is seeking a full or associate...  ..., and support of other researchers.Preferred Qualifications:PhD degree in molecular biology or a closely related field (e.g., genetics... 
    For phd

    University of California, San Francisco

    San Francisco, CA
    2 days ago
  • $110k - $130k

     ...forward. Job Title: Technical Services Site Assessment SpecialistWhat this job involves:This...  ...harness the power of artificial intelligence (AI) to efficiently accelerate meaningful...  ...Applicants, including those with Criminal Histories, in a manner consistent with the... 
    Full time
    Work at office
    Local area
    Remote work

    Jones Lang LaSalle

    San Francisco, CA
    1 day ago
  • $164.7k - $339.08k

     ...career you love? It’s Possible.At Pinterest, AI isn't just a feature, it's a powerful...  ...statistics/econometrics; advanced degree (MS or PhD) preferred.Expertise in at least one...  ...qualified applicants regardless of criminal histories, consistent with legal requirements. If you... 
    For phd
    Work at office
    Local area
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    3 days ago
  •  ...flexible hours. Responsibilities include creating, evaluating, and refining AI-generated presentations across lecture decks, course materials, conference talks, and visual explanations. A PhD or terminal degree with 4+ years of teaching and expert PowerPoint skills are... 
    For phd
    Remote job
    Flexible hours

    Ethos

    San Francisco, CA
    3 days ago
  • Obsidian is seeking expert physicists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous physics questions, evaluate solution quality, and help establish gold-standard benchmarks used to advance... 
    For phd
    Remote work
    10 hours per week

    Obsidian

    San Francisco, CA
    4 days ago
  • $93.2k - $194.8k

    Full Specialist- Krogan Lab Quantitative Biosciences Institute University of California, San FranciscoThe Quantitative Biosciences Institute...  ...skills. Preferred Qualifications: The applicant must have a PhD in systems biology, biochemistry, or a related field. Extensive... 
    For phd

    University of California, San Francisco

    San Francisco, CA
    3 days ago
  • $55k - $194.8k

    Bose Lab - SpecialistThe lab of Rohit Bose, MD, PhD at UCSF ( ) is searching for exceptionally motivated and enthusiastic research specialists. A practicing physician-scientist runs the lab, focusing on understanding how tumors evolve in different therapeutic environments... 
    For phd
    Full time
    Remote work

    University of California, San Francisco

    San Francisco, CA
    2 days ago
  •  ...decades. Speak is building a human-level, AI-powered tutor in your pocket: a...  ...this role We’re hiring an ML Engineer, Assessments to help build best-in-class assessment systems...  ...closely related scoring/evaluation domains) ~ PhD is helpful but not required Proven... 
    For phd
    Full time
    Live in
    Immediate start

    Speak

    San Francisco, CA
    18 hours ago
  •  ...content designer to develop high-quality mechanical engineering assessment questions for AI training and validation. You will document rationales and...  ...assurance in a fast-paced environment in San Francisco. A PhD or MS in Mechanical Engineering is preferred. #J-18808-... 
    For phd
    Remote job

    YO IT Consulting

    San Francisco, CA
    1 day ago
  • $239.54k - $345.67k

     ...Population Health Division (PHD) provides core public health...  ...other physicians, including specialists in other fields. Surgical...  ...the Civil Service Commission, assesses medical or physical competence...  ...condition (associated with cancer, a history of cancer, or genetic... 
    For phd
    Permanent employment
    Full time
    Temporary work
    Part time
    Work experience placement
    Second job
    Monday to Friday

    City and County of San Francisco

    San Francisco, CA
    6 days ago
  • University of California, San Francisco (UCSF) is seeking an Associate Specialist for the Yackle Lab in San Francisco, CA. The role involves...  ...s degree or five to ten years of experience in the specialization; PhD in #J-18808-Ljbffr University of California, San Francisco
    For phd

    University of California, San Francisco

    San Francisco, CA
    5 days ago
  • $93.2k - $194.8k

    Full Specialist Microbiome of Rheumatic DiseasesThe Nayak Lab (nayak.ucsf.edu) is seeking a Full Specialist with expertise in microbiome...  ...successful candidate will report directly to Dr. Renuka Nayak, MD, PhD but will work closely with collaborators within and outside of... 
    For phd
    Traineeship

    University of California, San Francisco

    San Francisco, CA
    2 days ago
  •  ...: 2233-Supervising Physician Specialist Fill Type: Permanent Civil Service...  ...Population Health Division (PHD) provides core public health...  .... Training and Experience Assessment (T&E): (Weight 100%) The T&E...  ...condition (associated with cancer, a history of cancer, or genetic... 
    For phd
    Permanent employment
    Full time
    Work experience placement
    Second job
    Local area
    Monday to Friday

    Zuckerberg San Francisco General

    San Francisco, CA
    4 days ago
  •  ...Population Health Division (PHD) provides core public health...  ...Senior Psychiatric Physician Specialists perform the following example...  ...psychiatric care and consultation Assess, diagnose and provide...  ...condition (associated with cancer, a history of cancer, or genetic... 
    For phd
    Permanent employment
    Full time
    Part time
    Work experience placement

    City and County of San Francisco

    San Francisco, CA
    4 days ago
  • $55k - $58.6k

     ...Junior Specialist - Berendzen Lab Job #JPF06013 Psychiatry / SCHOOL OF MEDICINE / UC San Francisco Application Window Open date...  ...to applicants interested in pursuing a biomedical sciences PhD or MD/PhD. Applicants must apply online with a CV, cover letter... 
    For phd
    Local area

    UCSF

    San Francisco, CA
    1 day ago
  • $75.6k - $88k

    Position Description Associate Specialist Position - Yackle Lab The Yackle Lab at UCSF is currently seeking an Associate Specialist. The...  ...experience in the relevant specialization. Preferred Qualifications PhD degree in Neuroscience and 3 or more years of Postdoctoral... 
    For phd
    Local area

    University of California, San Francisco

    San Francisco, CA
    5 days ago
  •  ...Description This is a full‑time on‑site role for a Probabilistic Risk Assessment Engineer , based in San Francisco, CA . This senior position is...  .... Qualifications & Skillsets Bachelor's, Master's, or PhD in Nuclear Engineering or a related field 5+ years of experience... 
    For phd
    Full time
    Remote work

    Hadron Energy, Inc.

    San Francisco, CA
    5 days ago
  • $130.2k - $393.2k

     ...scientists or scientists in the field of Cancer Research. UCSF has had a history of strong clinical productivity and additionally has several...  ..., San Francisco. Required qualifications for Scientists:PhD degree, MD degree, or equivalent degree with research expertise... 
    For phd
    Traineeship

    University of California, San Francisco

    San Francisco, CA
    2 days ago
  • $239k - $270k

     ...move, health plan, and life stage. Our AI-native platform helps us deliver personalized...  ...improvements ~ Advanced degree (MS/PhD) in Computer Science, Machine Learning, or...  ...qualified applicants regardless of criminal histories, consistent with applicable legal requirements... 
    For phd
    Temporary work
    Work at office
    Immediate start
    Worldwide
    Relocation
    Sleeping nights
    2 days per week
    3 days per week

    Spring Health

    San Francisco, CA
    6 days ago
  • $207k - $300k

     ...USA . Minimum qualifications: PhD in Economics, Philosophy, or a...  ...research experience in frontier AI safety or governance (e.g., in...  ...deployment. Frontier AI risk assessment is still nascent, and we are...  ...applicants regardless of criminal histories, consistent with legal... 
    For phd
    Shift work

    Google DeepMind

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to History PhD - Assessment Specialist - AI Trainer. Be the first to apply!