Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Annotation Specialist - Fully Remote | Upto $30/hr

$30 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: AI Session Annotator (English)
Type: Contract
Compensation: $24–$30/hour
Location: Remote

Role Responsibilities

  • Review recorded sessions where users interact with an AI assistant via voice and camera.
  • Compare the assistant's responses to visible video content. Identify hallucinated or fabricated visual details.
  • Score sessions on visual interpretation, accuracy, relevance, response timing, and spatial language use.
  • Evaluate if the assistant appropriately warned users about health, safety, or financial risks.
  • Write detailed comments supporting scores with concrete session evidence.
  • Capture conversation turns in the intake form.

Qualifications

Must-Have

  • Native or native-level English , spoken and written.
  • Clear, precise written English.
  • An Android phone with a working camera and microphone .
  • Attention to detail and consistent rubric application.

Preferred

  • Experience in data annotation, linguistic QA, content moderation, or AI model evaluation.
  • Training in linguistics, translation, or interpreting.
  • Ability to recognize unnatural or non-native English.

Start Date

  • Immediate ; high volume of work expected between 26 to 31 Aug .

Application Process (Takes 20–30 mins to complete)

  • Submit your resume or relevant background.
  • Complete a short calibration task on sample sessions, assessed on scoring consistency and comment usefulness.

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Annotation Specialist - Fully Remote | Upto $30/hr in New York, NY vacancy
  • $25 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...$17–$25/hour Location: Remote Role Responsibilities Red...  ...high-quality human data by annotating failures, classifying vulnerabilities...  ...Application Process (Takes 20–30 mins to complete) Upload... 
    Remote work
    Contract work
    Summer work

    Mercor

    New York, NY
    4 days ago
  • $62 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...$48–$62/hour Location: Remote Role Responsibilities Red...  ...Generate high-quality human data. Annotate failures, classify vulnerabilities...  ...Application Process (Takes 20–30 mins to complete) Upload... 
    Remote work
    Contract work
    Summer work

    Mercor

    New York, NY
    4 days ago
  • $22 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...$20–$22/hour Location: Remote Role Responsibilities Red...  ...high-quality human data by annotating failures, classifying vulnerabilities...  ...Application Process (Takes 20–30 mins to complete) Upload... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    15 days ago
  • $62 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Contract Compensation: $48-$62/hour Location: Remote Role Responsibilities Red team...  ...exploitation. Generate high-quality human data by annotating failures, classifying vulnerabilities, and... 
    Remote job
    Contract work
    Summer work

    mercor

    San Francisco, CA
    3 days ago
  • $22 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...ContractCompensation:$20-$22/hourLocation:Remote Role Responsibilities Red team conversational...  .... Generate high-quality human data. Annotate failures, classify vulnerabilities, and flag... 
    Remote job
    Summer work

    United States Digital Space LLC

    New York, NY
    4 days ago
  • $80 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $55–$80/hour Location: Remote Role Responsibilities Develop high-quality...  ...Complete a short interview and task (20–30 mins ). Paid for up to 1 hour of onboarding... 
    Remote work
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    4 days ago
  • $35 per hour

    Location : Remote Fluent Language Skills Required: English & Thai. Native fluency in English...  ...Exists At Mercor, we believe the safest AI is the one that’s already been attacked —...  ...Generate high-quality human data: annotate failures, classify vulnerabilities, and flag... 
    Remote job

    Obsidian

    San Francisco, CA
    4 days ago
  • $20 per hour

     ...As an AI Training Specialist (Data Annotation), you’ll play a key role in helping train and improve artificial...  ...ideal candidate will have: This is a fully remote position, but you must be located...  ...available Competitive hourly pay from $20/hr Training provided for all... 
    Remote work
    Hourly pay
    Full time
    Part time

    Remote Talent Cloud

    San Diego, CA
    3 days ago
  • $84 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $70–$84/hour Location: Remote Role Responsibilities Design adversarial...  ...scientific safety. Application Process (Takes 20–30 mins to complete) Upload resume AI... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    21 days ago
  • $70 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated...  ...content. Application Process (Takes 20–30 mins to complete) Upload resume AI interview... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    18 days ago
  • $90 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities Design... 
    Remote work
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    4 days ago
  • $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities...  .... Application Process (Takes 20–30 mins to complete) Upload resume AI interview... 
    Remote work
    Contract work
    Summer work

    Mercor

    New York, NY
    7 days ago
  • MERIT Beauty is looking for a Science Specialist fluent in Hindi to join as an AI Trainer in New York. The role involves training AI models through data annotation, ensuring accuracy in AI-generated content, and applying scientific knowledge in various fields. Candidates... 
    Remote job
    Hourly pay

    MERIT Beauty

    New York, NY
    4 days ago
  • $55 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $45–$55/hour Location: Remote Role Responsibilities Act as a day-to...  ...or Amazon. Application Process (Takes 20–30 mins to complete) Upload resume AI interview... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    5 days ago
  • $110 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $90–$110/hour Location: Remote Commitment: 40 hours/week Role Responsibilities...  ...payroll. Application Process (Takes 20–30 mins to complete) Upload resume AI... 
    Remote job
    Weekly pay
    Contract work
    Summer work
    Shift work
    Weekday work

    Mercor

    New York, NY
    12 days ago
  • Cohere is seeking a Data Annotation Specialist to join our distributed team and help improve the quality of AI models through structured evaluation across...  ...contractor, you will work remotely from Canada for 16 hours per week at a CAD 30/hour rate, with a flexible schedule... 
    Remote job
    Hourly pay
    16 hours
    Part time
    For contractors
    Flexible hours

    Dorado

    New York, NY
    2 days ago
  • $90 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities Design... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    20 days ago
  • $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities...  ...weekly Application Process (Takes 20–30 mins to complete) Upload resume AI... 
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work

    Mercor

    New York, NY
    21 days ago
  • $40 - $50 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...$40–$50/hour Location: Remote Commitment: ~5 hours/week...  ...platform responsibilities. Prior annotation, labelling, or model-...  ...Application Process (Takes 20–30 mins to complete) Upload resume... 
    Remote work
    Contract work
    Summer work

    Mercor

    Los Angeles, CA
    4 days ago
  • $25 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...$20–$25/hour Location: Remote Duration: Approximately...  ...consistent application of detailed annotation guidelines. Strong written...  ...Application Process (Takes 20–30 mins to complete) Upload... 
    Remote job
    Contract work
    Summer work
    Day shift

    Mercor

    New York, NY
    16 days ago
  • $30 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Contract Compensation: $24–$30/hour Location: Remote Role Responsibilities Review recorded...  .... Preferred Experience in data annotation, linguistic QA, content moderation,... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    San Francisco, CA
    4 days ago
  • $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities...  ...Connect Application Process (Takes 20–30 mins to complete) Upload resume AI... 
    Remote work
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work

    Mercor

    New York, NY
    8 days ago
  • $30 per hour

     ...to join their Expert Network to assist in training and evaluating AI models using legal expertise. This role requires advanced Korean and...  ...and a reliable internet connection. Participants can earn up to $30 per hour for paid tasks that may take one hour or less. Joining... 
    Remote work
    Hourly pay
    Work from home

    Prolific

    Dallas, TX
    2 days ago
  • AuraOne seeks a Hebrew Bilingual Expert — AI Evaluation & Annotation (Remote) to review Hebrew prompts and responses against AuraOne's quality rubric, labeling edge cases and providing structured feedback to retrain models. In this remote contractor role, you will compare... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    2 days ago
  • $18 per hour

    A tech-focused annotation company is seeking annotators to review and label data for AI development projects. This role involves carefully evaluating various types of content based on specific guidelines. Applicants should have a bachelor's degree and advanced English... 
    Remote job
    Part time
    Freelance
    Flexible hours

    Toloka Annotators

    New York, NY
    19 hours ago
  • AuraOne is seeking an Indonesian Bilingual Expert for AI Evaluation & Annotation on a remote basis. You will review model outputs, apply a versioned rubric, and provide structured feedback to help retrain the system. You will compare paired responses, label errors, and... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    2 days ago
  • $25 per hour

    Prolific is hiring an AI Training Expert in Colorado Springs to assist in training and evaluating AI models. This role involves tasks such as analyzing and writing annotations and judging AI performance. Candidates must have relevant experience and be detail-oriented, with... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Colorado Springs, CO
    2 days ago
  • $30 per hour

    Prolific is seeking Advanced Portuguese Speakers for AI training tasks that involve analyzing, editing, and judging AI performance based on Portuguese prompts. This role offers competitive pay at $30/hr and flexibility to work from home. Successful candidates will take... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    New York, NY
    3 days ago
  • $25 per hour

    Prolific is seeking an AI Training Expert to help train and evaluate advanced AI models. This position offers competitive pay rates...  ...various tasks including analyzing, editing, and providing annotations while judging AI performance. Candidates must possess strong attention... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Dallas, TX
    1 day ago
  • $30 per hour

     ...seeking Advanced Traditional Chinese/Cantonese-Fluent Speakers to participate in AI training tasks. In this role, you will analyze and improve AI models while being compensated at a rate of $30 per hour for tasks you complete. The position offers the flexibility to work... 
    Remote job
    Hourly pay
    Work from home

    Prolific

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Annotation Specialist - Fully Remote | Upto $30/hr. Be the first to apply!