History and Political Science Question Author for AI Benchmarks

Role Overview

Create and evaluate rigorous academic assessment content that helps advance AI research in history and political science. This remote role focuses on producing gold-standard multiple-choice benchmarks across National Security, Public Policy, Business History, Environmental History, and Latin American History.

Key Responsibilities

• Complete one of two assignment types: author original, challenging multiple-choice questions in your specialty and submit them for review, or verify existing questions for accuracy, clarity, and rigor.
• Develop questions that assess deep conceptual understanding rather than surface-level recall.
• Ensure every question is unambiguous, self-contained, precisely defined, and includes all information needed to solve it.
• Assign a difficulty rating of Medium, for introductory undergraduate level, Hard, for advanced undergraduate level, or Expert, for postgraduate level and above.
• Provide one correct answer and nine plausible, subtly incorrect answer choices designed to challenge expert-level solvers.
• Write clear, concise, step-by-step solution reasoning in Markdown format.
• Provide one to five academic references for each question from reputable sources, such as peer-reviewed journals and university repositories.
• For verification assignments, identify and correct issues involving clarity, completeness, precision, or solvability, and document the rationale for each edit.

Qualifications

• PhD or current doctoral candidacy in History, Political Science, International Relations, or a closely related discipline.
• A master''s degree may be considered for candidates with exceptional depth in a particular subdomain.
• Strong knowledge of historiographical methods, political theory, and comparative analysis.
• Research publications or policy experience is a strong advantage.
• Excellent written English and the ability to communicate complex ideas clearly and concisely.

Work Terms

• Fully remote, asynchronous hourly work.
• Expected commitment of 10 or more hours per week.

Compensation

$44 to $56 per hour.