Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

History PhD - Assessment Specialist - AI Trainer

Mercor

Role Overview We are seeking experts in history and political science to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core history and political science domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned one of two task types: Question Authoring — Create original, challenging multiple-choice questions in your area of expertise, rate their difficulty, and submit them for review. Question Verification — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made. History & Political Science Domains Covered National Security, Public Policy, Business History, Environmental History, Latin American History. Key Responsibilities Author original history and political science questions that test deep conceptual understanding, not surface-level recall Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post‑graduate and above) Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format Supply 1–5 academic references per question from reputable sources (peer‑reviewed journals, university repositories) For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made Ideal Qualifications PhD or doctoral candidate in History, Political Science, International Relations, or a closely related field Master's degree considered for candidates with exceptional depth in a specific subdomain Strong command of historiographical methods, political theory, and comparative analysis Research publications or policy experience is a strong plus Excellent written English and ability to express complex ideas clearly and concisely More About the Opportunity Expected commitment: 10+ hours/week Asynchronous, fully remote work #J-18808-Ljbffr Mercor

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the History PhD - Assessment Specialist - AI Trainer in San Francisco, CA vacancy
  • Mercor is seeking experts in history and political science to author and review high-quality academic assessment content for an AI research initiative. You will create and verify rigorous MCQs, rate difficulty, and help establish gold-standard benchmarks used to advance... 
    Suggested
    Remote job
    Part time

    Mercor

    San Francisco, CA
    4 days ago
  • $155k - $189k

     ...about ourTotal Rewards philosophy.AI is a fundamental part of how...  ...vary by role and will be assessed during the interview process.About...  ...craft across the team.BS/MS/PhD in a quantitative field (Statistics...  ...applicants with criminal histories, consistent with applicable federal... 
    For phd
    Full time
    Work at office
    Local area
    2 days per week
    3 days per week

    Gusto

    San Francisco, CA
    1 day ago
  • $50 per hour

     ...fields. Work on cutting-edge projects with top AI labs while earning up to $50+/hour, fully...  ...refine benchmarks across undergraduate to PhD-level chemistry topics. Requirements:...  ...on role and candidate expertise). Assessment: Shortlisted experts complete an evaluation... 
    For phd
    Contract work
    Remote work
    Flexible hours

    Turing

    San Francisco, CA
    4 days ago
  • $100 per hour

     ...scale benchmark to test how well advanced AI systems can solve hard scientific and engineering...  ...You have graduate-level expertise (MS or PhD preferred) in the domain above, with real...  ...Notes This application includes a coding assessment as part of the evaluation process. #J-188... 
    For phd
    Remote job

    Obsidian

    San Francisco, CA
    4 days ago
  • $50 per hour

     ...fields. Work on cutting‑edge projects with top AI labs while earning $50+/hour. No AI...  ...refine benchmarks across undergraduate to PhD‑level math topics. Requirements PhD (pursuing...  ...on role and candidate expertise). Assessment Shortlisted experts complete an evaluation... 
    For phd
    Remote job
    Contract work
    Flexible hours

    Turing

    San Francisco, CA
    1 day ago
  • $110k - $130k

     ...forward. Job Title: Technical Services Site Assessment SpecialistWhat this job involves:This...  ...harness the power of artificial intelligence (AI) to efficiently accelerate meaningful...  ...Applicants, including those with Criminal Histories, in a manner consistent with the... 
    Full time
    Work at office
    Local area
    Remote work

    Jones Lang LaSalle

    San Francisco, CA
    19 hours ago
  • Overview Get AI-powered advice on this job and more exclusive features. Turing is one of...  ..., particularly at the level expected in PhD-level programs. You should be able to break...  ...Shortlisted experts may be asked to complete an assessment. If you clear the assessment, you will be... 
    For phd
    Remote job
    Contract work

    Turing

    San Francisco, CA
    5 days ago
  • $78.3k - $201.7k

    Pownall Lab - Associate/Full Specialist Biochemistry and Biophysics UC San FranciscoThe Pownall Lab at UCSF is seeking a full or associate...  ..., and support of other researchers.Preferred Qualifications:PhD degree in molecular biology or a closely related field (e.g., genetics... 
    For phd

    University of California, San Francisco

    San Francisco, CA
    1 day ago
  • $164.7k - $339.08k

     ...career you love? It’s Possible.At Pinterest, AI isn't just a feature, it's a powerful...  ...statistics/econometrics; advanced degree (MS or PhD) preferred.Expertise in at least one...  ...qualified applicants regardless of criminal histories, consistent with legal requirements. If you... 
    For phd
    Work at office
    Local area
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    2 days ago
  • $190k - $210k

     ...Industrial-Organizational Psychologist in San Francisco to innovate AI-driven assessment solutions and lead high-impact client engagements. The role...  ...extensive experience in assessment science and a Master's or PhD in Industrial-Organizational Psychology. This position allows... 
    For phd

    BTS

    San Francisco, CA
    1 day ago
  •  ...California is seeking a qualified psychologist to provide mental health assessment and treatment services. The successful candidate will develop...  ...assessments, and collaborate with a multidisciplinary team. A PhD/PsyD in psychology and a California Psychologist License are... 
    For phd

    Kaiser Permanente

    San Francisco, CA
    5 days ago
  •  ...Francisco seeks a Psychologist - ASD to provide mental health assessment, treatment, and crisis intervention services. Responsibilities...  ...collaborating with healthcare teams. Applicants should have a PhD in Clinical Counseling and experience in mental health. This full... 
    For phd
    Full time

    Kaiser Permanente

    San Francisco, CA
    4 days ago
  •  ...Physician Specialist (2230) - Citywide - (EXEMPT) The Department of Public Health prioritizes...  ...centers. The Population Health Division (PHD) provides core public health services for...  ...by the Civil Service Commission, assesses medical or physical competence of staff to... 
    For phd
    Permanent employment
    Full time
    Part time
    Work experience placement

    City and County of San Francisco

    San Francisco, CA
    5 days ago
  • $78.3k - $201.7k

    Associate or Full Specialist - Diaz labSpecialist Series (Associate or Full Specialist), full-time, one-year appointment, Department of Neurological...  ...) qualifications upon submission.Preferred Qualifications:PhD or equivalent research experience in computational biology,... 
    For phd
    Full time

    University of California, San Francisco

    San Francisco, CA
    19 hours ago
  • $93.2k - $194.8k

    Full Specialist- Krogan Lab Quantitative Biosciences Institute University of California, San FranciscoThe Quantitative Biosciences Institute...  ...skills. Preferred Qualifications: The applicant must have a PhD in systems biology, biochemistry, or a related field. Extensive... 
    For phd

    University of California, San Francisco

    San Francisco, CA
    2 days ago
  • $239.54k - $345.67k

     ...Population Health Division (PHD) provides core public health...  ...other physicians, including specialists in other fields. Surgical...  ...the Civil Service Commission, assesses medical or physical competence...  ...condition (associated with cancer, a history of cancer, or genetic... 
    For phd
    Permanent employment
    Full time
    Temporary work
    Part time
    Work experience placement
    Second job
    Monday to Friday

    City and County of San Francisco

    San Francisco, CA
    26 days ago
  • $239.54k - $345.67k

     ...Population Health Division (PHD) provides core public health...  ...other physicians, including specialists in other fields. Surgical...  ...the Civil Service Commission, assesses medical or physical competence...  ...Hiring Process Conviction History Employee Benefits Overview... 
    For phd
    Permanent employment
    Full time
    Temporary work
    Part time
    Work experience placement
    Second job
    Monday to Friday

    City and County of San Francisco

    San Francisco, CA
    25 days ago
  • $55k - $194.8k

    Bose Lab - SpecialistThe lab of Rohit Bose, MD, PhD at UCSF ( ) is searching for exceptionally motivated and enthusiastic research specialists. A practicing physician-scientist runs the lab, focusing on understanding how tumors evolve in different therapeutic environments... 
    For phd
    Full time
    Remote work

    University of California, San Francisco

    San Francisco, CA
    1 day ago
  • $284.21k - $400.09k

     ...Population Health Division (PHD) provides core public health...  .... ✅ START with this Required Assessment forms.gle/pL5Nj3BE61ewXNmo6 Then...  ...and supervision of physician specialists, other health professionals,...  ...condition (associated with cancer, a history of cancer, or genetic... 
    For phd
    Permanent employment
    Full time
    Work experience placement
    Second job
    Local area
    Monday to Friday

    City and County of San Francisco

    San Francisco, CA
    18 days ago
  •  ...research teams — whether in an academic lab, AI research organization, or industry...  ...both technical and non-technical audiencesA PhD or equivalent depth of industry research experience...  ...applicants regardless of criminal histories, consistent with applicable law.Are you an... 
    For phd
    For contractors
    Remote work

    Autodesk

    San Francisco, CA
    5 days ago
  •  ...decades. Speak is building a human-level, AI-powered tutor in your pocket: a...  ...this role We’re hiring an ML Engineer, Assessments to help build best-in-class assessment systems...  ...closely related scoring/evaluation domains) ~ PhD is helpful but not required Proven... 
    For phd
    Full time
    Live in
    Immediate start

    Speak

    San Francisco, CA
    19 hours ago
  • $93.2k - $194.8k

    Full Specialist Microbiome of Rheumatic DiseasesThe Nayak Lab (nayak.ucsf.edu) is seeking a Full Specialist with expertise in microbiome...  ...successful candidate will report directly to Dr. Renuka Nayak, MD, PhD but will work closely with collaborators within and outside of... 
    For phd
    Traineeship

    University of California, San Francisco

    San Francisco, CA
    1 day ago
  • $93.2k - $194.8k

     ...UCSF’s Parnassus Heights Campus is seeking to hire a Research Specialist with expertise in IVF, reproductive biology, small RNA biology,...  ...embryogenesis, and reproductive aging. We welcome applications from PhD-trained scientists with postdoctoral experience and extensive... 
    For phd
    Traineeship

    University of California, San Francisco

    San Francisco, CA
    4 days ago
  •  ...flexible hours. Responsibilities include creating, evaluating, and refining AI-generated presentations across lecture decks, course materials, conference talks, and visual explanations. A PhD or terminal degree with 4+ years of teaching and expert PowerPoint skills are... 
    For phd
    Remote job
    Flexible hours

    Ethos

    San Francisco, CA
    2 days ago
  • University of California, San Francisco (UCSF) is seeking an Associate Specialist for the Yackle Lab in San Francisco, CA. The role involves...  ...s degree or five to ten years of experience in the specialization; PhD in #J-18808-Ljbffr University of California, San Francisco
    For phd

    University of California, San Francisco

    San Francisco, CA
    4 days ago
  •  ...Population Health Division (PHD) provides core public health...  ...Senior Psychiatric Physician Specialists perform the following example...  ...psychiatric care and consultation Assess, diagnose and provide...  ...condition (associated with cancer, a history of cancer, or genetic... 
    For phd
    Permanent employment
    Full time
    Part time
    Work experience placement

    City and County of San Francisco

    San Francisco, CA
    1 day ago
  • $55k - $58.6k

     ...Junior Specialist - Berendzen Lab Job #JPF06013 Psychiatry / SCHOOL OF MEDICINE / UC San Francisco Application Window Open date...  ...to applicants interested in pursuing a biomedical sciences PhD or MD/PhD. Applicants must apply online with a CV, cover letter... 
    For phd
    Local area

    UCSF

    San Francisco, CA
    19 hours ago
  • $164.7k - $339.08k

     ...models on web-scale data. We need a proven history of delivering flexible, well-calibrated,...  ...; an advanced degree such as an MS or PhD is preferred. We require strong proficiency...  ...and coaching. Technologies: AI Airflow Hive Support Python... 
    For phd
    Full time
    Remote work
    Relocation package
    Flexible hours

    Pinterest, Inc.

    San Francisco, CA
    5 days ago
  • $40 per hour

    AI Trainer - Materials Science Specialists (Remote Advisory) We are seeking AI Trainers - Materials Science Specialists to join our expert B2B and AI research...  ...: A verifiable LinkedIn presence or professional history. Strong attention to detail and the ability to... 
    Remote job

    Prolific

    San Francisco, CA
    3 days ago
  • University of California, San Francisco seeks a Research Specialist with extensive experience in IVF, reproductive biology, and small RNA...  ...reproductive aging using preclinical mouse models. The role requires PhD training with postdoctoral experience and hands-on skills in... 
    For phd

    University of California, San Francisco

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to History PhD - Assessment Specialist - AI Trainer. Be the first to apply!