Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Image & Video Evaluator (Remote)

$18 per hour

Scale AI

Outlier helps the world's most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models? About the opportunity:

Outlier is looking for talented, detail-oriented English speakers to help train generative AI voice, image, and video models

This freelance opportunity is remote and hours are flexible, so you can work whenever is best for you

You may contribute your expertise by… Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded

Comparing pairs of AI-generated images and videos and judging which one better follows the prompt

Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video

Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard

Examples of desirable expertise:

Fluent English speaker with strong, clear written communication and comfortable with natural, everyday conversational speech

Pursuing or holding a Bachelor's degree or above

Strong attention to detail, with the patience to look and listen closely, and to replay or zoom in when something seems off

Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way

Experience writing short, evidence-based explanations or reviews

Comfortable making a clear decision when both options have flaws

What you'll need:

A computer with a reliable internet connection and headphones

A quiet place to talk for projects that involve live conversation

Your ratings and written explanations must be your own work; AI tools can't be used to write them

Getting started includes a short screening and onboarding, which may include a brief spoken English check

Payment:

Project work:

Earn up to USD $18 per hour for core project work

Additional incentives:

On average, Outlier Contributors earn an additional 7.5% on top of the core project rates through Missions — Outlier's version of surge pricing. The top quartile of contributors boost their earnings by an average of 11%.

Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates apply. Additional incentives data is based on payments made in the past six months and is updated quarterly. Certain projects offer incentive payments. Please review the payment terms for each project.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Image & Video Evaluator (Remote) in United States vacancy
  • $18 per hour

     ...the world’s most innovative companies improve their AI models by providing human feedback. Are you a...  ...English speakers to help train generative AI voice, image, and video models This freelance opportunity is remote and hours are flexible, so you can work whenever is... 
    Remote work
    Video
    Hourly pay
    Freelance
    Flexible hours

    Scale AI

    Yuma, AZ
    2 days ago
  • $17 per hour

     ...Data Labeling Specialist: Remote Contract Remote Flexible Hours Contract Data Labeling PAY RATE...  ...accurate, consistent, and useful. What You'll Do Evaluate outputs from AI models, text, images, video, and documents against detailed criteria. Assess... 
    Remote work
    Video
    Contract work
    Flexible hours

    Workada

    United States
    17 hours ago
  • $18 per hour

     ...the world's most innovative companies improve their AI models by providing human feedback. Are you a...  ...English speakers to help train generative AI voice, image, and video modelsThis freelance opportunity is remote and hours are flexible, so you can work whenever is... 
    Remote work
    Video
    Hourly pay
    Freelance
    Flexible hours

    Scale AI

    Detroit, MI
    2 days ago
  • $15 per hour

     ...Outlier is an AI training platform owned and operated by Scale...  ...generating training data to evaluating the performance of models....  ...exchange, compare generated images and videos to judge which follows the...  ...looked or sounded wrong, all remotely and on your own schedule.... 
    Remote work
    Video
    Hourly pay
    Contract work
    For contractors
    Work experience placement
    Freelance
    Internship
    Night shift

    Scale AI

    Amherst, MA
    22 hours ago
  •  ...Outlier is an AI training platform owned and operated by Scale...  ...generating training data to evaluating the performance of models....  ...exchange, compare generated images and videos to judge which follows the...  ...looked or sounded wrong, all remotely and on your own schedule.... 
    Remote work
    Video
    Work experience placement

    Scale AI

    United States
    1 day ago
  • micro1 is seeking an AI Image & Video Evaluation Specialist (remote, contractor) to generate and compare AI-generated visuals across platforms. You will assess realism, composition, lighting, color, anatomy, and text rendering, delivering structured analyses. No formal... 
    Remote job
    Video
    For contractors

    Aiworkexpert

    Brooklyn, NY
    4 days ago
  • $9 per hour

     ...seeking a web-savvy, online search evaluator to help improve AI data for major search engines. You...  ...and provide feedback on text, audio, images, and videos while working from home. The role...  ...freelancers, students, or anyone seeking a remote, balanced schedule. #J-18808-Ljbffr... 
    Remote work
    Video
    Hourly pay
    Part time
    Freelance
    Work from home
    Flexible hours

    RWS TrainAI

    United States
    5 days ago
  • $30 per hour

     ...RWS Group is seeking a web-savvy evaluator to refine search results by reviewing text, audio, images and videos, helping to improve AI data used by major search engines. This flexible, part-time, remote role requires English and Italian proficiency, and residence in... 
    Remote work
    Video
    Part time
    Freelance
    Flexible hours

    OpenKrill

    United States
    22 hours ago
  • $18 per hour

     ...RWS is seeking a flexible, web-savvy evaluator to test how search engines respond to everyday queries...  ...You will provide feedback on text, audio, images, and videos to improve AI data used by major search platforms. Work is remote from Belgium with a part-time schedule of... 
    Remote work
    Video
    Hourly pay
    Part time
    Flexible hours

    RWS

    United States
    17 hours ago
  •  ...Outlier is an AI training platform owned and operated by Scale...  ...generating training data to evaluating the performance of models....  ...exchange, compare generated images and videos to judge which follows the...  ...looked or sounded wrong, all remotely and on your own schedule.... 
    Remote work
    Video
    Work experience placement
    Freelance

    Scale AI

    United States
    5 hours ago
  • RWS Group is seeking a remote evaluator to help improve AI search results by providing detailed feedback on text, audio, images, and videos. You’ll work from home, simulating everyday searches to influence how major search engines respond to real users. Ideal candidates... 
    Remote job
    Video
    Work from home

    RWS

    New York, NY
    17 hours ago
  • $15 per hour

     ...Outlier is an AI training platform owned and operated by Scale...  ...generating training data to evaluating the performance of models....  ...exchange, compare generated images and videos to judge which follows the...  ...looked or sounded wrong, all remotely and on your own schedule.... 
    Remote work
    Video
    Hourly pay
    Contract work
    For contractors
    Work experience placement
    Freelance
    Internship
    Night shift

    Scale AI

    Washington DC
    2 days ago
  • RWS is seeking a part-time Search Quality Evaluator to help improve AI-driven search results. You will test how search engines respond to everyday...  ...from regular users, provide feedback on text, audio, images, and videos, and help refine data used by major platforms. Ideal... 
    Remote job
    Video
    Part time
    Work from home
    Flexible hours

    RWS

    New York, NY
    17 hours ago
  • RWS TrainAI is seeking a web-savvy evaluator to improve AI search data from real users. You will test search results and provide feedback on text, audio, images, and videos to refine AI data used by major search engines and platforms. Requirements include residing in Austria... 
    Remote job
    Video
    Part time

    RWS TrainAI

    New York, NY
    17 hours ago
  • $13 per hour

     ...seeking a flexible, part-time Search Quality Evaluator to help improve AI-driven search results. You will test...  ...and provide feedback on text, audio, images, and videos from users across major search engines and platforms. This remote role is open to freelancers, students,... 
    Remote job
    Video
    Extra income
    Part time
    Freelance
    Flexible hours

    RWS TrainAI

    New York, NY
    17 hours ago
  • $15 per hour

     ...Outlier is an AI training platform owned and operated by Scale...  ...generating training data to evaluating the performance of models....  ...exchange, compare generated images and videos to judge which follows the...  ...looked or sounded wrong, all remotely and on your own schedule.... 
    Remote work
    Video
    Hourly pay
    Contract work
    For contractors
    Work experience placement
    Freelance
    Internship
    Night shift

    Scale AI

    Anaheim, CA
    2 days ago
  • $15 per hour

    Outlier is an AI training platform owned and operated by Scale...  ...generating training data to evaluating the performance of models....  ...exchange, compare generated images and videos to judge which follows the...  ...looked or sounded wrong, all remotely and on your own schedule. At... 
    Remote job
    Video
    Hourly pay
    Contract work
    For contractors
    Work experience placement
    Freelance
    Internship
    Night shift

    Scale AI

    Columbus, OH
    2 days ago
  • Embedded Shishya is seeking English-speaking Image Quality Evaluators based in South Korea to support AI training and evaluation projects. You will review images, assess quality, and provide English descriptions while considering South Korean culture and local context.... 
    Remote job
    For contractors
    Local area

    Embedded Shishya

    New York, NY
    2 days ago
  •  ...Mercor is seeking a Free Video Editor for small businesses and creators. This remote contract role involves evaluating AI-generated video edits and reviewing briefs to ensure client specifications are met. Responsibilities include providing feedback to AI teams and... 
    Remote work
    Video
    Contract work

    Mercor Inc

    United States
    3 days ago
  •  ...Partner Company, a fully remote creative team producing high volumes of photorealistic visual content for brand campaigns, is seeking a skilled AI image and video specialist. You will generate, refine, and automate batch workflows, harness prompt engineering, and push... 
    Remote work
    Video
    Home office

    Partner Engineering and Science

    United States
    4 days ago
  •  ...YO AI Labs is seeking a Creative & Design Specialist for remote, worldwide collaboration. You will review AI-generated creative outputs, apply your design expertise...  ...As a contractor, you will handle graphic design, video editing, motion graphics, and UI/UX tasks across... 
    Remote work
    Video
    For contractors
    Worldwide

    YO AI Labs

    United States
    41 minutes ago
  •  ...YO AI Labs seeks a Creative & Design Specialist for a remote, contractor role. You will review AI-generated designs, provide high-quality human feedback, and...  ...Resolve, and related tools is required. You will evaluate typography, layout, motion, and overall user experience... 
    Remote work
    Video
    For contractors

    YO AI Labs

    United States
    41 minutes ago
  •  ...Mercor is seeking an AI Session Annotator (English) for a remote, contract role. You will review recorded sessions where users interact with an AI assistant via voice and video, compare responses to visible content, and score sessions on visual interpretation, accuracy... 
    Remote work
    Video
    Contract work

    Mercor Inc

    San Francisco, CA
    3 days ago
  •  ...WITHIN is a remote role-based opportunity in Colombia for an AI Creative Specialist, joining the AI Creative team to produce...  ...with Motion Graphics Designers, Video Editors, and Graphic Designers to...  ...with Flux, Midjourney, Gemini image models, and ComfyUI is expected. #J... 
    Remote work
    Video

    Within

    New York, NY
    2 days ago
  • $18 per hour

     ...the world’s most innovative companies improve their AI models by providing human feedback. Are you a...  ...English speakers to help train generative AI voice, image, and video models This freelance opportunity is remote and hours are flexible, so you can work whenever is... 
    Remote work
    Video
    Hourly pay
    Freelance
    Flexible hours

    Scale AI

    United States
    2 days ago
  •  ...Image Segmentation Evaluator is a remote evaluation track for reviewing image segmentation evaluation prompts and...  ...retrain. Why this role matters AI data reviewers help turn image segmentation...  ...vision Spatial reasoning Video QA Image Segmentation Work... 
    Remote job
    Video
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    18 days ago
  • $15 per hour

     ...Outlier is an AI training platform owned and operated by Scale...  ...generating training data to evaluating the performance of models....  ...exchange, compare generated images and videos to judge which follows the...  ...looked or sounded wrong, all remotely and on your own schedule.... 
    Remote work
    Video
    Hourly pay
    Contract work
    For contractors
    Work experience placement
    Freelance
    Internship
    Night shift

    Scale AI

    Plymouth, IN
    17 hours ago
  • $19 per hour

     ...seeking a flexible, detail-oriented Search Quality Evaluator to improve online search results for major platforms...  ...transfer for payments. You will assess text, audio, images, and videos, provide feedback to refine AI data used by search engines and social platforms,... 
    Remote work
    Video
    Hourly pay
    Part time
    Freelance
    Work from home
    Flexible hours

    RWS TrainAI

    United States
    17 hours ago
  • $20 per hour

    **Job Type:** Remote / Contract / Flexible Hours **Pay Rate:** $20.00 / hour...  ...) ### About the Role Datatricks AI is actively hiring remote evaluators for **Project Edgehog**, a specialized...  ...model generations, perform side-by-side image evaluations, and rate system... 
    Remote work
    Hourly pay
    Contract work
    Flexible hours

    Datatricksai

    Toccoa, GA
    a month ago
  • $21 per hour

     ...RWS Group is seeking a web-savvy evaluator to test and refine how search engines respond to everyday queries. You will provide feedback on text, audio, images, and videos to improve AI data used by major search engines and platforms. This is a flexible, part-time, work... 
    Remote work
    Video
    Hourly pay
    Part time
    Work from home
    Flexible hours

    Openkrill

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Image & Video Evaluator (Remote). Be the first to apply!