AI Evaluation Specialist | $50/Task

Job Description

Domain Expert – AI Prompt Design & Evaluation

\n

\n

Experience: Professional / Domain Expertise Required

\n

Job Type: Contractor

\n

Schedule: Flexible

\n

Compensation: $50 per approved task

\n

\n

Role Overview

\n

We are looking for Domain Experts, Professionals, and Knowledge Workers from diverse fields to participate in a paid AI research study. You will turn a complex real-world workflow from your area of expertise into a challenging AI prompt , test it in ChatGPT, identify where the model fails, and create a structured grading rubric to evaluate AI-generated outputs.

\n

\n

Key Responsibilities

\n

\n
• Convert a familiar, complex workflow into a challenging AI prompt .
\n
• Test the prompt using ChatGPT and identify incomplete or incorrect outputs.
\n
• Refine the task to better test the model’s reasoning capabilities.
\n
• Record your screen, camera, and microphone while completing the task.
\n
• Create a clear and comprehensive grading rubric .
\n
• Submit the final prompt, failure notes, rubric, and generated output file.
\n

\n

\n

Key Requirements

\n

\n
• Strong expertise in a specialized professional or technical workflow .
\n
• Ability to quickly evaluate the quality and accuracy of outputs in your domain.
\n
• Strong reasoning, analytical, and problem-solving skills .
\n
• Access to a laptop or desktop computer.
\n
• Active ChatGPT account ; free tier is acceptable.
\n
• Comfortable completing a screen-recorded session with audio and video .
\n

\n

\n

Selection Process

\n

Step 1 – Application / Profile Submission

\n

Step 2 – Paid Trial Assessment

\n

Step 3 – Submission Review

\n

Step 4 – Payment & Future Opportunities