AI Output Evaluator

Role Overview

Apply your professional expertise to help train and improve next-generation AI systems. As an independent contractor, you will provide high-quality real-world input that shapes how AI models learn, reason, and perform. Prior AI experience is not required; your domain knowledge and written analysis are central to the work.

Key Responsibilities

• Review and critically assess AI-generated outputs for accuracy, logical soundness, and alignment with best practices in your field.
• Create and refine prompts that test AI reasoning through realistic, domain-relevant scenarios.
• Provide clear, concise, constructive written feedback to improve AI responses and performance.
• Evaluate and annotate data carefully to support robust training and validation datasets.
• Conduct quality reviews of AI outputs, documentation, and feedback submitted by other experts.
• Collaborate remotely with a global professional community, sharing insights that support continuous improvement.
• Apply ethical awareness and thoughtful critique throughout AI development work.

Qualifications

• At least 3 years of experience in a field such as software engineering, finance, data science, or legal.
• A demonstrated record of exceptional written work, such as technical documentation, investment memos, legal memoranda, research papers, or strategy presentations.
• Excellent written English and the ability to explain complex analysis, deliver nuanced feedback, and communicate effectively in a remote setting.
• Strong critical-thinking and analytical skills, including experience reviewing, critiquing, or editing high-stakes documents.
• Exceptional attention to detail, professional writing skills, and adaptability as project requirements evolve.
• Ability to work both independently and collaboratively in remote or distributed environments.
• Experience with data annotation, prompt engineering, or AI-output evaluation is advantageous but not required.
• Experience at leading technology companies, top consulting firms, elite financial institutions, premier law firms, or world-renowned universities is valued but not required.

Work Terms

• Remote, part-time independent contractor engagement.

Compensation

• $140 to $200 per hour.