Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Model Evaluator: Remote Contract

$17 per hour

Workada

Data Labeling Specialist: Remote Contract Remote Flexible Hours Contract Data Labeling PAY RATE $17/hr (USD) At Workada, we're not just labeling data, we're helping improve the technology people use every day. Our work creates the examples and feedback that make advanced systems more accurate, consistent, and useful. What You'll Do Evaluate outputs from AI models, text, images, video, and documents against detailed criteria. Assess quality, spot errors and inconsistencies, and write clear, well-reasoned justifications for your judgments. Every evaluation you complete helps these systems perform better in the real world. Who We're Looking For People who write clearly, think critically, and can back up a judgment call with a clear explanation. This role suits people who've done work built around precise written evaluation, UI/UX design, graphic design, photography, video production, editorial or research work, or writing technical specs and requirements. Strong readers and writers with sound judgment Comfortable evaluating creative or technical work against a set of criteria Takes quality seriously and catches what others miss Can follow detailed written guidelines independently Qualifications Bachelor's degree, completed or in progress Excellent written English — clear, precise, well-organized Strong attention to detail At least 1 year of experience in a role built around evaluating or reviewing work against a standard e.g., UI/UX design, graphic design, photography, video production, editorial, research, QA, or technical writing. Equivalent experience will be considered. Must be based in the US or Canada Technical Requirements Desktop or laptop running Windows 10 (or later) or a recent version of macOS. Chromebooks, Linux-based systems, and tablets (e.g., iPad, Surface in tablet mode) are not supported. Stable, high-speed internet (minimum 25 Mbps download / 5 Mbps upload) What We Offer Remote, flexible contract work Clear guidelines and training Performance feedback and opportunities to grow A mission-driven team focused on accuracy and quality Some of our most reliable, high-performing contributors have grown into roles where they guide and support others, with compensation that reflects the added responsibility. These opportunities depend on performance and how the work is evolving, and we're glad to support people who are a strong fit. Ready to apply? Join a team helping build the data foundation behind better technology. Workada is an Equal Opportunity Employer. We welcome applicants from all backgrounds.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Model Evaluator: Remote Contract in Wilkes Barre, PA vacancy
  •  ...Mercor is seeking an AI Safety Practitioner for a remote contract role. You will evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality, working with AI researchers and safety teams. The ideal candidate has a Bachelor's... 
    Contract work
    Remote work

    Mercor Inc

    United States
    4 days ago
  • $17 per hour

     ...Data Labeling Specialist: Remote Contract Remote Flexible Hours Contract Data Labeling PAY RATE $17/hr (USD)...  ...accurate, consistent, and useful. What You'll Do Evaluate outputs from AI models, text, images, video, and documents against detailed criteria... 
    Contract work
    Remote work
    Flexible hours

    Workada

    Norman, OK
    2 days ago
  • $15 per hour

     ...Outlier is an AI training platform owned and operated...  ...generating training data to evaluating the performance of models. About the opportunity:...  ...looked or sounded wrong, all remotely and on your own schedule....  ...note: This is a 1099 contract opportunity on the Outlier... 
    Contract work
    Remote work
    Hourly pay
    For contractors
    Work experience placement
    Freelance
    Internship
    Night shift

    Scale AI

    Detroit, MI
    2 days ago
  •  ...elite creative and technical talent with leading AI research labs. The company is headquartered in San...  .... They are hiring a AI Safety Practitioner for a contract role with remote work options. The role focuses on evaluating AI-generated responses for safety, accuracy, and... 
    Contract work
    Remote job
    Summer work

    Mercor Inc

    New York, NY
    4 days ago
  • $50 - $60 per hour

    A technology company specializing in AI and finance is seeking a Wealth Advisor to help train AI models. In this independent contract role, you will measure the effectiveness of AI...  ...This position offers flexibility to work remotely and competitive hourly pay starting at $5... 
    Contract work
    Remote job
    Hourly pay

    DataAnnotation

    Brooklyn, NY
    2 days ago
  • $85 per hour

     ...technical talent with leading AI research labs....  ...Experience) Type: Contract Compensation: $85/hour Location: Remote Role Responsibilities...  ...agents to complete and evaluate complex infrastructure...  ...engineering tasks. Review model-generated implementations... 
    Contract work
    Remote work
    Summer work

    Mercor

    San Francisco, CA
    18 days ago
  • $18 per hour

     ...Outlier helps the world's most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with...  ...AI voice, image, and video modelsThis freelance opportunity is remote and hours are flexible, so you can work whenever is best for... 
    Remote work
    Hourly pay
    Freelance
    Flexible hours

    Scale AI

    East Lansing, MI
    8 hours ago
  •  ...Mercor is seeking a Free Video Editor for small businesses and creators. This remote contract role involves evaluating AI-generated video edits and reviewing briefs to ensure client specifications are met. Responsibilities include providing feedback to AI teams and... 
    Contract work
    Remote work

    Mercor Inc

    United States
    3 days ago
  •  ...Associate to work onsite in the United States. You will evaluate AI outputs, perform audits of data and model behavior, and contribute to improving evaluation...  .... This is a 100% onsite position with a 1-year contract and 40 hours per week. Applicants must be located... 
    Contract work

    Welo Global

    Sunnyvale, CA
    5 days ago
  •  ...Alignerr is seeking a Social Media Content Evaluator (AI Training) to review AI-generated posts, captions, and comments. You will...  ...engaging, and appropriate for real audiences. This is a fully remote, hourly contract role with 10–40 hours per week. No marketing or content... 
    Contract work
    Remote work
    Hourly pay
    10 hours per week

    Alignerr Corp.

    United States
    2 days ago
  •  ...ESR Healthcare is seeking a Physics Expert (PhD / Postdoc) for a remote contractor role. The position involves solving advanced physics problems, providing rigorous derivations, and documenting results with LaTeX, using SymPy, Python, and Jupyter for verification. You... 
    Contract work
    Remote work
    For contractors
    10 hours per week
    Flexible hours

    Executive Staff Recruiters / ESR Healthcare

    United States
    2 days ago
  •  ...Anyone AI Inc. is seeking multilingual coding experts to evaluate AI-generated responses on a part-time remote contract lasting up to 3 months. This opportunity supports frontier AI model improvement by providing precise feedback and evaluations. You will review AI... 
    Contract work
    Remote work
    Part time

    Anyone AI Inc.

    United States
    10 hours ago
  •  ...Mercor is recruiting a Football (Soccer) Fan – Live Match AI Evaluator for the UK and Spain. This remote contract role involves evaluating AI assistants during Premier League, Champions League, or La Liga matches and asking fans questions about live scores and stats.... 
    Contract work
    Remote work

    Mercor Inc

    United States
    5 days ago
  •  ...Seeking PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content and contribute to the evaluation of advanced AI models in a flexible, remote contract role. Key Responsibilities Assessing the factuality and... 
    Contract work
    Remote work
    Full time
    Flexible hours

    Virtual Vocations Inc

    United States
    1 day ago
  •  ...Braintrust is seeking PhD-level quantitative finance experts for remote, flexible contract work to train and evaluate AI models on financial reasoning and quantitative problems. This short-term engagement runs through the end of June with potential extension. You will... 
    Contract work
    Remote work
    Temporary work
    Flexible hours

    Brain Trust Inc

    United States
    3 days ago
  •  ...SaidGig seeks a remote contractor to evaluate AI-generated legal and technical content. You will assess clarity, tone, and instruction compliance,...  ...written communication, and experience editing or drafting legal materials. Remote, contract-based engagement. #J-18808-Ljbffr... 
    Contract work
    Remote work
    For contractors

    SaidGig

    New York, NY
    2 days ago
  •  ...Mercor, based in San Francisco, connects elite talent with leading AI labs and seeks an evaluator for nonprofit programs. This remote contract role requires 5+ years in nonprofit work, strong English, and proficiency with MS Office and Google Workspace, especially Slides... 
    Contract work
    Remote work

    Mercor Inc

    United States
    4 days ago
  •  ...is seeking a UI/UX Design Expert for a remote, contract-based role. You will design grading criteria...  ...for real-world digital products and evaluate AI-generated and human work samples...  ...feedback, and iterate quickly to improve AI model performance. Strong written communication... 
    Contract work
    Remote work

    Mercor Inc

    San Francisco, CA
    4 days ago
  •  ...Mercor is seeking an evaluator for nonprofit/philanthropy programs in a remote, contract role. You will assess AI-generated artifacts against quality rubrics, identify factual...  ...meet tight deadlines while helping improve model performance. Ideal candidates have 5+ years... 
    Contract work
    Remote work
    Work at office

    Mercor Inc

    San Francisco, CA
    4 days ago
  • $50 per hour

     ...Mercor is seeking a Spanish (Mexico) Audio Generalist Evaluator for a contract role. The position is remote and requires 10–20 hours per week at $50/hour. You...  ...transcribe, evaluate, and provide feedback to improve AI language tasks in Spanish and English. The role focuses... 
    Contract work
    Remote work
    10 hours per week

    Mercor Inc

    New York, NY
    3 days ago
  • $50 - $150 per hour

     ...+ 6 more We're hiring PhD-level quantitative finance experts to help train and evaluate advanced AI models on financial and quantitative reasoning. This is remote, flexible contract work where your specialized expertise directly shapes how cutting-edge models handle... 
    Contract work
    Remote work
    Temporary work
    Flexible hours

    Brain Trust Inc

    United States
    4 days ago
  •  ...connects elite creative and technical talent with leading AI research labs. The Physics Expert contract role involves writing physics problems with detailed systems and reference answers for model grading, and evaluating model-derived solutions for accuracy and scaling.... 
    Contract work
    Remote work

    Mercor Inc

    United States
    9 hours ago
  •  ...AI Trainer Jobs is seeking qualified professionals for a remote AI safety evaluation project focused on explosives and energetic materials. Tier 1 annotators review prompts...  ...work and validate complex cases, all under contract terms. The role requires a STEM degree (Bachelor... 
    Contract work
    Remote work

    Pasiflora AI LLC

    United States
    4 days ago
  • $15 per hour

     ...Outlier is an AI training platform owned and operated...  ...generating training data to evaluating the performance of models. About the opportunity:...  ...looked or sounded wrong, all remotely and on your own schedule....  ...note: This is a 1099 contract opportunity on the Outlier... 
    Contract work
    Remote work
    Hourly pay
    For contractors
    Work experience placement
    Freelance
    Internship
    Night shift

    Scale AI

    Amherst, MA
    2 days ago
  •  ...Mercor is seeking an AI Session Annotator (English) for a remote, contract role. You will review recorded sessions where users interact with an AI assistant...  ...precise writing, strong attention to detail, and prior experience in data annotation or AI model #J-18808-Ljbffr... 
    Contract work
    Remote work

    Mercor Inc

    San Francisco, CA
    3 days ago
  •  ...Anyone AI is seeking multilingual coding experts to evaluate AI-generated responses. This part-time remote contract lasts up to 3 months and supports frontier AI model improvement. What you'll do: Review AI-generated customer service and technical content for clarity,... 
    Contract work
    Remote work
    Part time
    For contractors

    Anyone AI Inc.

    United States
    8 hours ago
  • $80 - $120 per hour

     ...Mercor is seeking a Data quality / CRM operations Evaluator to assess AI-generated artifacts against domain-specific rubrics. This remote contract role requires strong English fluency and 5+ years in data quality/CRM operations. The ideal candidate will provide structured... 
    Contract work
    Remote work
    Hourly pay
    Flexible hours

    Mercor Inc

    New York, NY
    3 days ago
  •  ...Mercor is seeking a seasoned Business Domain Expert to pilot AI model evaluation across admin, marketing, HR and accounting workflows. This remote contractor role focuses on judging outputs with evidence-based rationales and delivering structured feedback within tight... 
    Contract work
    Remote work
    For contractors

    Mercor Inc

    United States
    3 days ago
  •  ...Mercor is seeking a contract Legal / Compliance Evaluator to assess AI-generated artifacts against domain rubrics. This remote role requires strong English fluency and 5+ years in legal...  ...structured written feedback and help improve AI model performance while working... 
    Contract work
    Remote work
    Hourly pay
    Flexible hours

    Mercor Inc

    San Francisco, CA
    4 days ago
  • $15 per hour

     ...Outlier is an AI training platform owned and operated...  ...generating training data to evaluating the performance of models. About the opportunity:...  ...looked or sounded wrong, all remotely and on your own schedule....  ...note: This is a 1099 contract opportunity on the Outlier... 
    Contract work
    Remote work
    Hourly pay
    For contractors
    Work experience placement
    Freelance
    Internship
    Night shift

    Scale AI

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Model Evaluator: Remote Contract. Be the first to apply!