Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Model Evaluator: Remote Contract (37315)

$17 per hour

Workada

Data Labeling Specialist: Remote Contract

Remote

Flexible Hours

Contract

Data Labeling

PAY RATE

$17/hr (USD)

At Workada, we're not just labeling data, we're helping improve the technology people use every day. Our work creates the examples and feedback that make advanced systems more accurate, consistent, and useful.

What You'll Do

Evaluate outputs from AI models, text, images, video, and documents against detailed criteria. Assess quality, spot errors and inconsistencies, and write clear, well-reasoned justifications for your judgments. Every evaluation you complete helps these systems perform better in the real world.

Who We're Looking For

People who write clearly, think critically, and can back up a judgment call with a clear explanation. This role suits people who've done work built around precise written evaluation, UI/UX design, graphic design, photography, video production, editorial or research work, or writing technical specs and requirements.

Strong readers and writers with sound judgment

Comfortable evaluating creative or technical work against a set of criteria

Takes quality seriously and catches what others miss

Can follow detailed written guidelines independently

Qualifications

Bachelor's degree, completed or in progress

Excellent written English — clear, precise, well-organized

Strong attention to detail

At least 1 year of experience in a role built around evaluating or reviewing work against a standard e.g., UI/UX design, graphic design, photography, video production, editorial, research, QA, or technical writing. Equivalent experience will be considered.

Must be based in the US or Canada

Technical Requirements

Desktop or laptop running Windows 10 (or later) or a recent version of macOS. Chromebooks, Linux-based systems, and tablets (e.g., iPad, Surface in tablet mode) are not supported.

Stable, high-speed internet (minimum 25 Mbps download / 5 Mbps upload)

What We Offer

Remote, flexible contract work

Clear guidelines and training

Performance feedback and opportunities to grow

A mission-driven team focused on accuracy and quality

Some of our most reliable, high-performing contributors have grown into roles where they guide and support others, with compensation that reflects the added responsibility. These opportunities depend on performance and how the work is evolving, and we're glad to support people who are a strong fit.

Ready to apply? Join a team helping build the data foundation behind better technology.

Workada is an Equal Opportunity Employer. We welcome applicants from all backgrounds.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Model Evaluator: Remote Contract (37315) in Collegedale, TN vacancy
  •  ...elite creative and technical talent with leading AI research labs. The company is headquartered in San...  .... They are hiring a AI Safety Practitioner for a contract role with remote work options. The role focuses on evaluating AI-generated responses for safety, accuracy, and... 
    Contract work
    Remote job
    Summer work

    Mercor Inc

    New York, NY
    1 day ago
  • $50 - $60 per hour

    A technology company specializing in AI and finance is seeking a Wealth Advisor to help train AI models. In this independent contract role, you will measure the effectiveness of AI...  ...This position offers flexibility to work remotely and competitive hourly pay starting at $5... 
    Contract work
    Remote job
    Hourly pay

    DataAnnotation

    Brooklyn, NY
    4 days ago
  • $85 per hour

     ...technical talent with leading AI research labs....  ...Experience) Type: Contract Compensation: $85/hour Location: Remote Role Responsibilities...  ...agents to complete and evaluate complex infrastructure...  ...engineering tasks. Review model-generated implementations... 
    Contract work
    Remote work
    Summer work

    Mercor

    New York, NY
    15 days ago
  • Obsidian is seeking an independent contractor for a remote role focused on benchmark dataset projects that evaluate AI models on visual document understanding in the Energy/Utilities domain. The role requires authoring complex tasks and providing objective rubrics to assess... 
    Remote job
    For contractors
    Flexible hours

    Obsidian

    San Francisco, CA
    2 days ago
  •  ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers... 
    Contract work
    Remote work
    Temporary work
    Immediate start

    MERIT Beauty

    New York, NY
    4 days ago
  •  ...Seeking PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content and contribute to the evaluation of advanced AI models in a flexible, remote contract role. Key Responsibilities Assessing the factuality and... 
    Contract work
    Remote work
    Full time
    Flexible hours

    Virtual Vocations Inc

    United States
    3 days ago
  •  ...Population Health Informaticist to help shape AI systems that reason about health data, trends, and outcomes. You’ll evaluate AI outputs and review data pipelines,...  ...ability to communicate complex findings clearly in a remote, hourly contract setting. #J-18808-Ljbffr
    Contract work
    Remote work
    Hourly pay

    Alignerr Corp.

    Cincinnati, OH
    15 hours ago
  •  ...Alignerr is seeking a Population Health Informaticist (AI Training) to evaluate AI-generated population health analyses and data pipelines...  ...on population health concepts. The role is fully remote, hourly contract, and offers flexible scheduling (10–40 hours/week). You... 
    Contract work
    Remote work
    Hourly pay
    Flexible hours

    Alignerr Corp.

    Raleigh, NC
    15 hours ago
  • Draft labs is seeking remote AI Model Evaluators and AI Trainers in the United States. This role involves reviewing AI outputs, ranking responses, and providing detailed feedback to improve model performance. No prior professional experience is required, and the position... 
    Remote job
    Part time
    For contractors
    Flexible hours

    Draft labs

    Miami, FL
    15 hours ago
  • $20 per hour

     ...Job Description Job Description We are hiring remote AI Model Evaluators and AI Trainers to support multiple ongoing AI training projects. We are building an in-house contributor team for work across AI model evaluations, computer-use tasks, response ranking, red... 
    Remote work
    Part time
    For contractors
    Work experience placement
    Flexible hours

    Draft labs

    Miami, FL
    9 days ago
  • $150 per hour

     ...based company working with frontier AI labs and global enterprises, is...  ...Experts to help fine-tune AI models. You will apply your U.S. legal background to evaluate and improve how AI reasons about the law. This remote 4-week contract requires 40 hours of work across... 
    Contract work
    Remote job

    Benture

    San Francisco, CA
    4 days ago
  • Alignerr is seeking Wildlife and Habitat Conservation Scientists to evaluate AI-trained biodiversity protection content. This remote, hourly contract role offers flexible hours (10-40 per week) and a chance to shape how AI understands ecological challenges on a global scale... 
    Contract work
    Remote job
    Hourly pay
    Flexible hours

    Alignerr Corp.

    Miami, FL
    3 days ago
  •  ...seeking a native or near-native Korean speaker to remotely evaluate healthcare front desk conversations with an AI, role-playing as a patient and recording dialogue...  ...provide structured feedback and timestamps. This contract-based role offers flexible hours and a quiet home... 
    Contract work
    Remote job
    Flexible hours

    Alignerr Corp.

    New York, NY
    15 hours ago
  •  ...Media / journalism / communications Evaluator to assess AI-generated artifacts against domain rubrics...  ...on a strong media background. This remote contract role requires clear, precise feedback...  ...and independent work to help improve model outputs. Responsibilities include... 
    Contract work
    Remote job

    mercor

    San Francisco, CA
    1 day ago
  • Turing is seeking detail-oriented AI Analysts based in the United States for a Google Wallet evaluation project. This role allows you...  ...of AI. You will evaluate model responses, review output quality...  .... The position is a full-time contract lasting 10 weeks. Candidates should... 
    Contract work
    Remote job
    Full time

    Turing

    Seattle, WA
    1 day ago
  • Mercor offers a remote contract opportunity for a Media/Journalism/Communications Evaluator. You will assess AI-generated artifacts, identify errors, and provide structured feedback to improve model outputs. The role requires 5+ years in media or related fields, native... 
    Contract work
    Remote job

    mercor

    New York, NY
    1 day ago
  • Mercor seeks a Humanities / arts / culture Evaluator for a remote contract role. You will assess AI-generated artifacts using domain rubrics, spot errors, and provide structured feedback to improve model outputs. Must have 5+ years in humanities or culture, native or professional... 
    Contract work
    Remote job
    Work at office

    mercor

    San Francisco, CA
    2 days ago
  • $60 - $80 per hour

     ...Selected experts may support leading AI labs and companies by helping...  ...Responsibilities Train and evaluate AI models in chemistry. Create tasks...  ...to work independently in a remote environment. Work Terms Remote, hourly contract work. Project scope and duration... 
    Contract work
    Remote work
    Hourly pay

    SaidGig

    New York, NY
    15 hours ago
  • Mercor is seeking a contract Evaluator for nonprofit/philanthropy programs. This remote role focuses on assessing AI-generated artifacts and providing structured feedback to improve quality and rigor. You will identify factual and presentation errors, work with teams asynchronously... 
    Contract work
    Remote job
    Work at office

    mercor

    San Francisco, CA
    2 days ago
  • Alignerr is seeking a Social Media Content Evaluator (AI Training) to review AI-generated posts, captions, and comments. You will...  ...engaging, and appropriate for real audiences. This is a fully remote, hourly contract role with 10-40 hours per week. No marketing or content... 
    Contract work
    Remote job
    Hourly pay
    10 hours per week

    Alignerr Corp.

    New York, NY
    4 days ago
  • $80 - $120 per hour

     ...connects elite creative and technical talent with leading AI research labs. This contract role evaluates AI-generated artifacts in humanities/arts/culture, delivering clear feedback to improve model outputs. Remote work, English fluency required, 5+ years of domain... 
    Contract work
    Remote job
    Work at office

    mercor

    San Francisco, CA
    1 day ago
  • Mercor is hiring a contract Customer success / support operations Evaluator to assess AI-generated artifacts against domain-specific quality rubrics, identify errors in documents, spreadsheets, and slide decks, and provide structured feedback to improve AI outputs. You... 
    Contract work
    Remote job

    mercor

    San Francisco, CA
    2 days ago
  •  ...a life sciences task designer to help train future AI systems by creating expert-level evaluation tasks from authentic research artifacts. You will craft...  ...; strong scientific foundation matters most. Remote contract engagement with payment tied to task quality and project... 
    Contract work
    Remote job

    SaidGig

    New York, NY
    4 days ago
  • Mercor connects elite creative and technical talent with leading AI research labs. The remote contract role evaluates AI-generated artifacts against domain-specific quality rubrics and provides clear, structured feedback to ensure accuracy and high presentation standards... 
    Contract work
    Remote job

    mercor

    San Francisco, CA
    1 day ago
  • $70 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...: Generalist Expert Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to ensure...  ...written feedback to improve AI model outputs. Identify nuances, implicit... 
    Contract work
    Remote work
    Summer work

    mercor

    San Francisco, CA
    2 days ago
  • $30 per hour

    Type: Hourly contract Compensation: $20-$30/hour Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent systems using defined rubrics...  ...in LLM evaluation, AI output analysis, QA/testing,... 
    Contract work
    Remote job
    Hourly pay

    Crossing Hurdles

    New York, NY
    15 hours ago
  • Mercor is seeking an evaluator for nonprofit/philanthropy programs in a remote, contract role. You will assess AI-generated artifacts against quality rubrics, identify factual and...  ...tight deadlines while helping improve model performance. Ideal candidates have 5+ years... 
    Contract work
    Remote job
    Work at office

    mercor

    San Francisco, CA
    2 days ago
  • Mercor seeks a General business strategy / management evaluator for a remote, contract role. You will assess AI-generated artifacts, apply quality rubrics, and identify issues to help improve model performance. This role requires 5+ years in strategy/management, native... 
    Contract work
    Remote job
    For contractors
    Work at office

    mercor

    San Francisco, CA
    2 days ago
  •  ...elite creative and technical talent with leading AI research labs. A remote contract role focuses on evaluating AI-generated artifacts against quality rubrics, identifying...  ...and delivering structured feedback to support AI model improvements. Applicants should have 5+ years in... 
    Contract work
    Remote job
    Work at office

    Mercor Inc

    San Francisco, CA
    2 days ago
  • Mercor is seeking an Internet-Native Bilingual Evaluator Expert (French) for a remote contract role. You will evaluate AI outputs for linguistic accuracy and cultural relevance in French and English, drawing on experience with online communities across French-speaking... 
    Contract work
    Remote job
    10 hours per week

    mercor

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Model Evaluator: Remote Contract (37315). Be the first to apply!