AI Evaluation Specialist | $50/Task

Domain Expert – AI Prompt Design & Evaluation

If you want to know about the requirements for this role, read on for all the relevant information.

Experience: Professional / Domain Expertise Required

Job Type: Contractor

Schedule: Flexible

Compensation: $50 per approved task

Role Overview

We are looking for Domain Experts, Professionals, and Knowledge Workers from diverse fields to participate in a paid AI research study. You will turn a complex real-world workflow from your area of expertise into a challenging AI prompt , test it in ChatGPT, identify where the model fails, and create a structured grading rubric to evaluate AI-generated outputs.

Key Responsibilities

• Convert a familiar, complex workflow into a challenging AI prompt
• Test the prompt using ChatGPT and identify incomplete or incorrect outputs.
• Refine the task to better test the model's reasoning capabilities.
• Record your screen, camera, and microphone while completing the task.
• Create a clear and comprehensive grading rubric
• Submit the final prompt, failure notes, rubric, and generated output file.

Key Requirements

• Strong expertise in a specialized professional or technical workflow
• Ability to quickly evaluate the quality and accuracy of outputs in your domain.
• Strong reasoning, analytical, and problem-solving skills
• Access to a laptop or desktop computer.
• Active ChatGPT account ; free tier is acceptable. xhyhwjd
• Comfortable completing a screen-recorded session with audio and video

Selection Process

Step 1 – Application / Profile Submission

Step 2 – Paid Trial Assessment

Step 3 – Submission Review

Step 4 – Payment & Future Opportunities