Researcher for AI Model Evaluation

Role Overview

Apply advanced research expertise to help train and evaluate next-generation AI systems by creating rigorous, real-world assessment material. This remote contract role focuses on developing high-quality evaluations that shape how AI models learn, reason, and perform. Prior AI experience is not required.

Key Responsibilities

• Create original, high-difficulty question-and-answer pairs in your discipline to assess AI model capabilities.
• Research, verify, and document answers using primary sources and authoritative references, with clear citations and reasoning.
• Design questions that require advanced reasoning, methodological nuance, or synthesis across multiple sources and cannot be solved through shortcuts.
• Test questions against AI systems, identify insufficiently challenging items, and increase complexity while preserving accuracy.
• Write precise, unambiguous questions and defensible answers.
• Incorporate reviewer feedback and follow all project guidelines and quality standards.

Qualifications

• Completed PhD, active PhD candidacy, or equivalent research experience as a specialist, researcher, or professor in your field.
• Demonstrated scholarly research experience, deep subject-matter expertise, and familiarity with primary literature.
• Strong analytical thinking, research and source-triangulation skills, attention to detail, written precision, and English communication skills.
• Ability to work independently and reliably in a remote setting.
• Experience developing original, challenging, methodologically sound questions.
• AI training or evaluation experience is a plus, but not required.

Work Terms

• Remote, independent contractor engagement.
• Compensation is output-based and paid per task that meets project specifications; completion time varies by experience and workflow.
• Minimum submission requirements apply, including a minimum number of tasks submitted each week.
• Selected candidates are expected to begin their first tasks within 24 to 48 hours after completing onboarding.

Compensation

$40 to $90 per hour.

Application Process

Apply using email or a Google account, then complete the required onboarding steps and agree to the applicable terms and privacy policies.