AI Model Evaluation Specialist

Help train next-generation AI systems by creating rigorous, real-world evaluations that test how well advanced models learn, reason, and perform. This remote contract opportunity is open to recent graduates, advanced-degree holders, and professionals from any background with strong research and writing expertise. Prior AI experience is not required. Key Responsibilities

• Develop original, challenging question-and-answer pairs across diverse subject areas.
• Conduct in-depth research and triangulate multiple sources to produce accurate, comprehensive, well-documented answers.
• Create multi-step questions that require synthesis and analytical reasoning rather than simple single-source lookups.
• Test questions against AI models, analyze results, and refine difficulty when needed.
• Document research with clear citations and logical explanations.
• Revise content in response to reviewer feedback while following project guidelines and quality standards.

• Strong independent research skills and the ability to critically assess information from multiple sources.
• Exceptional attention to detail and precise written English. English fluency is required, but it does not need to be your first language.
• Ability to craft nuanced, well-structured questions that assess deep understanding.
• Analytical thinking, self-direction, reliability, accountability, and comfort working independently in a remote setting.
• Interest in advanced AI and in testing the limits of current model capabilities.
• Experience in AI training, evaluation, or content creation is helpful but not required.

• Remote independent-contractor engagement.
• Work is task-based, and the time needed may vary based on your experience and workflow.
• Minimum submission requirements apply, including a minimum number of tasks each week.

• Compensation is output-based and paid per task that meets project specifications.
• Pay range: $20 to $60 per hour.

• Roles are typically filled within 48 hours, so candidates should be prepared to begin promptly.
• If selected, complete the required onboarding and be ready to start your first tasks within 24 to 48 hours afterward.