Research Evaluation Specialist (PhD or Masters / Researcher / Professor)

Researchers and academics write very hard original questions and verified answers to stress-test advanced AI models. Each item needs citations to primary sources, must resist shortcuts, and is tried on AI systems then made harder if too easy. Reviewer feedback is folded in throughout. The listing states that prior AI training, labeling or evaluation experience is required.

What you would do

• Write original, very difficult question and answer pairs in your discipline
• Source and cite answers from primary sources and authoritative references
• Test questions on AI systems and raise difficulty where they are too easy
• Revise items using reviewer feedback and project guidelines

What the listing asks for

• Preferred: Master's or PhD, doctoral candidacy, or comparable research experience
• Preferred: scholarly research record and familiarity with primary literature
• Preferred: strong analytical thinking and written English
• Prior AI training, labeling or model evaluation work is required
• A weekly minimum of tasks applies; start within 24 to 48 hours of onboarding

Suits professionals who hold advanced research credentials, have prior model evaluation work behind them, and can write rigorous questions independently.

The listing does not state a rate. Where: Remote, worldwide. Time: About 15 hours a week. Contract work for micro1, a company that hires experts for AI training projects.

Applications go through micro1's own site. AI Trainer Guide is an independent guide to AI training work, not micro1 or its recruiter. The apply link on our page is a referral link: micro1 may pay us if it hires you, at no cost to you.