AI Evaluation Specialist, Recent Grad

Help improve next-generation AI systems by creating rigorous, research-backed evaluations that test how well advanced models learn, reason, and perform across diverse subjects. This remote contract opportunity welcomes recent graduates and professionals with strong research and writing expertise. Prior AI experience is not required. Key Responsibilities

• Develop original, challenging question-and-answer pairs spanning a range of subjects.
• Conduct in-depth research and triangulate multiple sources to produce accurate, comprehensive, well-documented answers.
• Create multi-step questions that require synthesis and analytical reasoning rather than simple single-source lookups.
• Test questions with AI models, assess results, and refine difficulty as needed.
• Document research methods with clear citations and logical explanations.
• Revise content in response to reviewer feedback while following project guidelines and quality standards.

• Strong independent research skills and the ability to critically evaluate information from multiple sources.
• Excellent attention to detail, analytical thinking, and precise English writing. English fluency is required; it does not need to be your first language.
• Ability to craft nuanced, well-structured questions that assess deep understanding.
• Demonstrated self-direction, reliability, and accountability in independent remote work.
• Interest in AI and in evaluating the limits of current model capabilities.
• Recent graduates, advanced-degree holders, and candidates from any academic or professional background are welcome when they can demonstrate research and writing expertise.
• Experience in AI training, evaluation, or content creation is beneficial but not required.

• Remote, independent contractor engagement.
• Work is submitted on a task basis, with minimum weekly task-submission requirements.
• Selected candidates should be prepared to begin their first tasks within 24 to 48 hours after completing the required setup process.

• Advertised pay range: $20 to $60 per hour.
• Compensation is output-based and paid per task that meets project specifications. Time to complete tasks may vary based on experience and workflow.