Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Image & Video Evaluator (Remote)

$18 per hour

Scale AI

Outlier helps the world’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models?

About the opportunity:

  • Outlier is looking for talented, detail-oriented English speakers to help train generative AI voice, image, and video models
  • This freelance opportunity is remote and hours are flexible, so you can work whenever is best for you

You may contribute your expertise by…

  • Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded
  • Comparing pairs of AI-generated images and videos and judging which one better follows the prompt
  • Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video
  • Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard

Examples of desirable expertise:

  • Fluent English speaker with strong, clear written communication and comfortable with natural, everyday conversational speech
  • Pursuing or holding a Bachelor's degree or above
  • Strong attention to detail, with the patience to look and listen closely, and to replay or zoom in when something seems off
  • Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way
  • Experience writing short, evidence-based explanations or reviews
  • Comfortable making a clear decision when both options have flaws

What you'll need:

  • A computer with a reliable internet connection and headphones
  • A quiet place to talk for projects that involve live conversation
  • Your ratings and written explanations must be your own work; AI tools can't be used to write them
  • Getting started includes a short screening and onboarding, which may include a brief spoken English check

Payment:

  • Project work: Earn up to USD $18 per hour for core project work
  • Additional incentives: On average, Outlier Contributors earn an additional 7.5% on top of the core project rates through Missions — Outlier’s version of surge pricing. The top quartile of contributors boost their earnings by an average of 11%.
  • Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates apply. Additional incentives data is based on payments made in the past six months and is updated quarterly. Certain projects offer incentive payments. Please review the payment terms for each project.
Vacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the AI Image & Video Evaluator (Remote) in Detroit, MI vacancy
  • $18 per hour

     ...the world’s most innovative companies improve their AI models by providing human feedback. Are you a...  ...English speakers to help train generative AI voice, image, and video models This freelance opportunity is remote and hours are flexible, so you can work whenever is... 
    Remote work
    Video
    Hourly pay
    Freelance
    Flexible hours

    Scale AI

    Sioux Falls, SD
    7 hours ago
  • $17 per hour

     ...Data Labeling Specialist: Remote Contract Remote Flexible Hours Contract Data Labeling PAY RATE...  ...accurate, consistent, and useful. What You'll Do Evaluate outputs from AI models, text, images, video, and documents against detailed criteria. Assess... 
    Remote work
    Video
    Contract work
    Flexible hours

    Workada

    Sunset, LA
    2 days ago
  • micro1 is seeking an AI Image & Video Evaluation Specialist (remote, contractor) to generate and compare AI-generated visuals across platforms. You will assess realism, composition, lighting, color, anatomy, and text rendering, delivering structured analyses. No formal... 
    Remote job
    Video
    For contractors

    Aiworkexpert

    Brooklyn, NY
    2 days ago
  • $18 per hour

     ...the world’s most innovative companies improve their AI models by providing human feedback. Are you a...  ...English speakers to help train generative AI voice, image, and video models This freelance opportunity is remote and hours are flexible, so you can work whenever is... 
    Remote work
    Video
    Hourly pay
    Freelance
    Work from home
    Flexible hours

    Scale AI

    Iowa City, IA
    7 hours ago
  • $18 per hour

     ...the world’s most innovative companies improve their AI models by providing human feedback. Are you a...  ...English speakers to help train generative AI voice, image, and video models This freelance opportunity is remote and hours are flexible, so you can work whenever is... 
    Remote work
    Video
    Hourly pay
    Freelance
    Flexible hours

    Scale AI

    New York, NY
    7 hours ago
  • RWS Group is seeking a remote evaluator to help improve AI search results by providing detailed feedback on text, audio, images, and videos. You’ll work from home, simulating everyday searches to influence how major search engines respond to real users. Ideal candidates... 
    Remote job
    Video
    Work from home

    RWS

    New York, NY
    3 days ago
  • RWS is seeking a part-time Search Quality Evaluator to help improve AI-driven search results. You will test how search engines respond to everyday...  ...from regular users, provide feedback on text, audio, images, and videos, and help refine data used by major platforms. Ideal... 
    Remote job
    Video
    Part time
    Work from home
    Flexible hours

    RWS

    New York, NY
    3 days ago
  • RWS is seeking a part-time, remote Search Quality Rater to help improve AI-driven search results. You will evaluate queries and provide feedback on text, audio, images, and videos to refine data used by leading search engines and platforms. This role offers a flexible schedule... 
    Remote job
    Video
    Part time
    Flexible hours

    RWS

    New York, NY
    3 days ago
  • $18 per hour

    RWS is seeking a flexible, web-savvy evaluator to test how search engines respond to everyday queries...  ...You will provide feedback on text, audio, images, and videos to improve AI data used by major search platforms. Work is remote from Belgium with a part-time schedule of... 
    Remote job
    Video
    Hourly pay
    Part time
    Flexible hours

    RWS

    New York, NY
    3 days ago
  • RWS TrainAI is seeking a web-savvy evaluator to improve AI search data from real users. You will test search results and provide feedback on text, audio, images, and videos to refine AI data used by major search engines and platforms. Requirements include residing in Austria... 
    Remote job
    Video
    Part time

    RWS TrainAI

    New York, NY
    3 days ago
  • $30 per hour

    RWS Group is seeking a web-savvy evaluator to refine search results by reviewing text, audio, images and videos, helping to improve AI data used by major search engines. This flexible, part-time, remote role requires English and Italian proficiency, and residence in Switzerland... 
    Remote job
    Video
    Part time
    Freelance
    Flexible hours

    OpenKrill

    New York, NY
    4 days ago
  • $13 per hour

     ...seeking a flexible, part-time Search Quality Evaluator to help improve AI-driven search results. You will test...  ...and provide feedback on text, audio, images, and videos from users across major search engines and platforms. This remote role is open to freelancers, students,... 
    Remote job
    Video
    Extra income
    Part time
    Freelance
    Flexible hours

    RWS TrainAI

    New York, NY
    3 days ago
  • Embedded Shishya is seeking English-speaking Image Quality Evaluators based in South Korea to support AI training and evaluation projects. You will review images, assess quality, and provide English descriptions while considering South Korean culture and local context.... 
    Remote job
    For contractors
    Local area

    Embedded Shishya

    New York, NY
    5 days ago
  • YO AI Labs is seeking a Creative & Design Specialist for remote, worldwide collaboration. You will review AI-generated creative outputs, apply your design expertise...  ...As a contractor, you will handle graphic design, video editing, motion graphics, and UI/UX tasks across... 
    Remote job
    Video
    For contractors
    Worldwide

    YO AI Labs

    New York, NY
    3 days ago
  • YO AI Labs is seeking a Creative & Design Specialist to evaluate AI-generated outputs, provide high-quality human feedback, and improve creative workflows. You will work remotely, collaborating on graphic design, UI/UX, motion graphics, and multimedia tasks across a range... 
    Remote job
    Video
    Flexible hours

    YO AI Labs

    San Francisco, CA
    2 days ago
  •  ...Image Segmentation Evaluator is a remote evaluation track for reviewing image segmentation evaluation prompts and...  ...retrain. Why this role matters AI data reviewers help turn image segmentation...  ...vision Spatial reasoning Video QA Image Segmentation Work... 
    Remote job
    Video
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    15 days ago
  • $20 per hour

    **Job Type:** Remote / Contract / Flexible Hours **Pay Rate:** $20.00 / hour...  ...) ### About the Role Datatricks AI is actively hiring remote evaluators for **Project Edgehog**, a specialized...  ...model generations, perform side-by-side image evaluations, and rate system... 
    Remote work
    Hourly pay
    Contract work
    Flexible hours

    Datatricksai

    Toccoa, GA
    a month ago
  • $37.5 per hour

     ...create a golden data set for AI generated ad copy for various...  ...role you will be responsible for evaluating advertising copy generated by...  ...advertised brand/product and Prime Video contentCreativity and...  ...Workplace TypeThis is a fully remote position.Application DeadlineThis... 
    Remote work
    Video
    Contract work
    Temporary work

    TEKsystems

    New York, NY
    2 days ago
  • RWS Group is seeking a part-time online evaluator to improve search engine results. You will work remotely from Ireland, testing how search engines respond...  ...providing feedback across text, audio, images, and videos to refine AI data. Ideal candidates will have strong... 
    Remote job
    Video
    Part time

    RWS

    New York, NY
    3 days ago
  • Social Media Content Evaluator What if your social media instincts...  ...directly influence how AI communicates with millions...  ...audiences. This is a fully remote, flexible contract role open...  ...platforms — including short-form video, microblogging, or image-based formats Background in... 
    Remote work
    Video
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Flexible hours

    Alignerr

    New York, NY
    4 days ago
  •  ...Quality Rater to help improve AI-driven search results from everyday queries. You will evaluate how client search engines respond...  ...on content across text, audio, images, and video to refine AI data used by major platforms. The role is remote from Switzerland, with 5-20... 
    Remote job
    Video
    Part time
    Work from home

    RWS

    New York, NY
    3 days ago
  •  ...Group is seeking a flexible, part-time Search Quality Evaluator based in India to test and improve how search engines respond...  ...queries. You will provide feedback on text, audio, images, and videos, helping refine AI data used by major platforms. Ideal candidates are... 
    Remote job
    Video
    Part time
    Work from home
    Flexible hours

    RWS TrainAI

    New York, NY
    3 days ago
  • RWS Group is seeking a web-savvy evaluator to improve search results. You will work remotely from Israel, testing searches and giving feedback on text, images, and videos to refine AI data used by global platforms. The role requires English and Hebrew proficiency, 5-20... 
    Remote job
    Video
    Work from home
    Flexible hours

    RWS Group

    New York, NY
    3 days ago
  • $30 per hour

    RWS Group is seeking a part-time, remote evaluator to test and refine how search engines respond to everyday queries. You will contribute by assessing text, audio, images and videos to improve AI data used by major search engines and platforms. Ideal for freelancers or... 
    Remote job
    Video
    Hourly pay
    Part time
    Freelance
    Work from home
    Flexible hours

    OpenKrill

    New York, NY
    4 days ago
  • $8 per hour

     ...TrainAI is seeking a web-savvy research evaluator to help improve AI data for major search engines. You...  ...provide feedback on text, audio, images, and videos from a home-based role. This...  ...flexible, part-time position is conducted remotely from Argentina, with 5-20 hours per... 
    Remote job
    Video
    Hourly pay
    Part time
    Work from home
    Flexible hours

    RWS TrainAI

    New York, NY
    3 days ago
  • RWS Group is seeking a web-savvy evaluator to test and refine how search engines respond...  ...provide feedback on text, audio, images, and videos to improve AI data used by major search platforms,...  ..., students, or anyone seeking remote work with a focus on quality and accuracy... 
    Remote job
    Video
    Part time
    Freelance
    Work from home
    Flexible hours

    RWS

    New York, NY
    3 days ago
  • RWS Group is seeking a freelance Evaluator to test and interpret how search results respond to everyday queries. You will review text, audio, images, and videos and provide precise feedback to refine AI data used by major search engines and platforms. This flexible, part... 
    Remote job
    Video
    Part time
    Freelance
    Work from home
    Flexible hours

    OpenKrill

    New York, NY
    4 days ago
  • RWS Group is seeking a part-time, remote Search Quality Evaluator to improve AI data by reviewing search results across text, audio, images and video. You will assess relevance and quality based on guidelines and provide actionable feedback to refine AI models used by major... 
    Remote job
    Video
    Part time
    Freelance
    Flexible hours

    OpenKrill

    New York, NY
    4 days ago
  • $19 per hour

     ...seeking a flexible, detail-oriented Search Quality Evaluator to improve online search results for major platforms...  ...transfer for payments. You will assess text, audio, images, and videos, provide feedback to refine AI data used by search engines and social platforms, and... 
    Remote job
    Video
    Hourly pay
    Part time
    Freelance
    Work from home
    Flexible hours

    RWS TrainAI

    New York, NY
    3 days ago
  • RWS Group seeks a web-savvy search evaluator to test how major search engines respond...  ...provide feedback on text, audio, images, and videos to improve AI data used to refine search results. This flexible, part-time role is remote from South Korea, requires 5-20 hours... 
    Remote job
    Video
    Part time
    Flexible hours

    Dorado

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Image & Video Evaluator (Remote). Be the first to apply!