Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

English Language Expert (Great Britain) — Remote AI Evaluation

AuraOne Human Data

Remote
  • Remote job

English Language Expert (Great Britain) — Remote AI Evaluation is a remote evaluation track for reviewing english language evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.

Why this role matters

AI data reviewers help turn english language evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.

Responsibilities

  • Evaluate english language evaluation model outputs against a versioned rubric and assign severity tags for English Language Expert (Great Britain) — Remote AI Evaluation assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
  • Document recurring failure modes so the modeling team can target them in the next training run.

Qualifications

  • Prior evaluation, annotation, or human-rater experience on english language evaluation or adjacent content for English Language Expert (Great Britain) — Remote AI Evaluation work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Compare two english language evaluation model responses to the same prompt and pick the stronger one with rationale.
  • Tag an unsafe response with the correct policy category and severity.
  • Audit a 50-row batch for rubric consistency and report drift to the program lead.
  • Propose a rubric clarification after spotting a recurring failure mode.

Nice to have

  • Background in linguistics, content moderation, or trust & safety review.
  • Experience with inter-rater agreement metrics and calibration cycles.
  • Domain expertise that lets you spot subject-matter errors automated checks miss.

Skills

  • Model output evaluation
  • Rubric-based annotation
  • Severity tagging
  • Inter-rater calibration
  • English Language evaluation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the English Language Expert (Great Britain) — Remote AI Evaluation in Remote vacancy
  •  ...Description Job Description Job Description: English Language Expert – Great Britain Role Type: Contractor Location: Remote, Great Britain About the Role We are...  ...use your language expertise to help improve AI systems through accurate audio analysis, transcription... 
    Remote job
    English language skills
    For contractors

    YO AI Labs

    New York, NY
    2 days ago
  • $24 per hour

     ...QuickBooks experience to help improve AI responses to real small-business and financial questions. In this remote freelance project, you'll evaluate accuracy, identify gaps and help...  ...consistently. ~ Excellent written English, analytical thinking and attention to... 
    Remote work
    English language skills
    Part time
    Freelance

    Braintrust

    New York, NY
    1 day ago
  • OpenTrain AI, Inc. is seeking an Education Expert for AI Evaluation (English) to remotely assess AI-generated teaching guidance. You will craft teaching scenarios, write reference answers, and rate model outputs for accuracy, practicality, and age-appropriateness. The role... 
    Remote job
    English language skills
    Part time
    For contractors
    Flexible hours

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  •  ...Mental Health Professionals in Nashville, TN, to help train and evaluate AI models. Candidates will review AI-generated responses, complete...  ...pay rates, and the ability to work from home, making it a great opportunity for professionals looking to influence future AI developments... 
    Remote work
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Nashville, TN
    4 days ago
  • $35 - $70 per hour

    Education Expert for AI Evaluation (English) Use classroom expertise to create teaching scenarios, write reference answers, and evaluate AI-generated educational guidance. This remote contractor role pays $35 to $70 per hour and requires 20 or more hours per week. Remote... 
    Remote work
    English language skills
    Hourly pay
    Contract work
    Part time
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  • Remotebridge is seeking a German Bilingual Expert for a remote contractor role focused on evaluating German language input for AI model training. Apply linguistic expertise...  ...and linguistic authenticity, providing clear English feedback and justifications. Ideal... 
    Remote job
    English language skills
    For contractors

    Remotebridge

    New York, NY
    2 days ago
  • Employment and Labor Law AI Evaluation Expert Review AI-generated answers to U.S. employment law scenarios...  ...S. law degree and bar admission. 100% Remote Contract, part-time The work Review...  ...to detail, and ethical judgment. English: Fluency in English. Helpful experience... 
    Remote work
    English language skills
    Contract work
    Part time
    Freelance
    Flexible hours
    Shift work

    OpenTrain AI, Inc.

    New York, NY
    4 days ago
  •  ...seeking an HR & People Operations Expert for AI training projects, fully remote on a contractor basis. You will craft...  ..., and establish objective evaluation criteria to assess outcomes. The role...  ...within AI evaluation projects. Strong English and hands-on HR experience are... 
    Remote job
    English language skills
    For contractors

    Elitebrain

    Tallahassee, FL
    1 day ago
  • RemoteJobsOne is seeking a Financial Expert contractor to help train AI systems by developing...  ...prompts and structured evaluation rubrics. You will review...  ...emphasizes clear written English and independent work, with...  ...and expectations in a fully remote setting. #J-18808-Ljbffr... 
    Remote job
    English language skills
    For contractors

    RemoteJobsOne

    New York, NY
    3 days ago
  • $40 - $80 per hour

    Military Operations AI Evaluation Expert (English) Review AI-generated military scenarios for tactical accuracy...  ..., with pay of $40 to $80 per hour. Remote Hourly · $40-$80/hr $40-$80/hr...  ...Africa, Asia, and the Middle East. Language: Professional fluency in English. Experience... 
    Remote work
    English language skills
    Hourly pay
    Contract work
    Part time
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  • $21 - $70 per hour

     ...your editing decisions. OpenTrain AI needs experienced audio editors to evaluate practical AI-training work. You will...  ...schedule for flexible, part-time remote contract work Fully remote and...  ...and sharing your screen Fluent in English; communicate clearly and bring strong... 
    Remote job
    English language skills
    Hourly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    OpenTrain AI

    New York, NY
    4 days ago
  • $50 - $90 per hour

     ...international humanitarian law expertise to evaluate AI systems, build conflict-risk frameworks,...  ...defense and humanitarian scenarios remotely for $50 to $90 per hour. Remote Hourly ·...  ...in the countries specified for the role. English fluency is required for the written and... 
    Remote work
    English language skills
    Hourly pay
    Contract work
    Part time
    Worldwide

    OpenTrain AI, Inc.

    New York, NY
    3 days ago
  • $20 - $45 per hour

    Coding & Software Remote Hourly · $20-$45/hr $20-$45/hr Compensation...  ...The work You will help evaluate AI systems by reviewing software...  ...codebases across several programming languages. Compare long-form responses...  ...: Strong written and verbal English communication. Location:... 
    Remote work
    English language skills
    Hourly pay
    Contract work
    Part time
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  •  ...professionals and subject-matter experts based in the Philippines to participate in an AI training and evaluation project focused on creating...  ...; Have excellent written English skills and can communicate effectively...  ...3-5 tasks . This is a remote opportunity . Applicants... 
    Remote work
    English language skills
    Work experience placement
    Freelance
    Work at office

    TransPerfect

    New York, NY
    3 days ago
  • $35 - $42 per hour

    Location: U.S Candidates Only (Remote) Compensation: $35.00 - $42.00 USD...  ...markets. In this role, you will evaluate AI-generated financial content and provide expert feedback to improve financial...  ...thinkingskills. Excellent written English communication skills. Ability... 
    Remote work
    English language skills
    Hourly pay
    Extra income
    Permanent employment
    Contract work
    Temporary work
    Part time
    Immediate start
    Flexible hours

    Volga Partners

    New York, NY
    18 hours ago
  • $50 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: English Language and Literature Expert Type: Contract Compensation...  ...: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of... 
    Remote work
    English language skills
    Contract work
    Summer work

    Mercor

    San Jose, CA
    10 days ago
  • $100 - $120 per unit

     ...technical talent with leading AI research labs....  ...Fan – Live MLB Game AI Evaluator (US) Type: Contract...  ...per task Location: Remote Commitment: Event...  ..., highlights, and expert-style analysis. Run...  ...search. ~ Strong written English and sharp attention to... 
    Remote work
    English language skills
    Contract work
    Work experience placement
    Summer work

    Mercor

    New York, NY
    14 days ago
  • $150 per hour

     ...technical talent with leading AI research labs....  ...Clinician (MD/DO) - HLS Expert Pool Type: Contract...  ...0/hour Location: Remote Role...  ...model response grading. Evaluate clinical dialogues for...  ...~ Written and spoken English fluency ~ Minimum 20... 
    Remote work
    English language skills
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    11 days ago
  • $70 - $85 per hour

    Fraud Investigator Expert for AI Evaluation Use your fraud investigation experience to write realistic...  ...cases and evaluate AI responses. This remote, asynchronous role pays $70 to $85 per...  ...20+ hours weekly plus strong written English. Remote Hourly $70-$85/hr $70-$85/hr Compensation... 
    Remote work
    English language skills
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    OpenTrain AI, Inc.

    New York, NY
    2 days ago
  • $18 - $45 per hour

     ...Spain Market Expertise | Remote Freelance Opportunity...  ...Help Shape the Future of AI in Finance Are you a...  ...Income Subject Matter Experts (SMEs) to support a specialized AI evaluation pilot focused on the financial...  ...and qualifications Language: English Schedule: Based on... 
    Remote work
    English language skills
    Extra income
    Temporary work
    For contractors
    Freelance
    Flexible hours

    Volga Partners

    New York, NY
    1 day ago
  • $35 - $42 per hour

     ...Compliance Location: USA (Remote) Compensation: $35.00-$...  ...Shape the Future of AI in Finance, Audit & Risk...  ...network of on-call AI Evaluation Specialists supporting...  ...network of subject matter experts. As client projects...  ...skills. Excellent written English communication skills.... 
    Remote work
    English language skills
    Hourly pay
    Extra income
    Permanent employment
    Contract work
    Temporary work
    Flexible hours

    Volga Partners

    Washington DC
    1 day ago
  • $90 per hour

     ...technical talent with leading AI research labs....  ...0/hour Location: Remote Role Responsibilities...  ...merely look correct. Evaluate responsive behavior and...  ...importance in precise language. Flag ties, ambiguous...  ...setup. ~ Strong written English and discipline to... 
    Remote work
    English language skills
    Contract work
    Summer work
    Local area

    Mercor

    San Francisco, CA
    a month ago
  • AI Ethics & Evaluation Associate (R&D Projects) Seniority level...  .... This role is a great opportunity for...  ...work We're a fully remote team, spread across...  ...reinforce each other. English is our working language. Who we are looking...  ..., covering expert and predictive systems... 
    Remote work
    English language skills
    Full time

    Eticas.AI

    Union, NJ
    1 day ago
  • $40 - $70 per hour

    Special Education Teacher AI Evaluation Expert Create IEP and intervention scenarios, explain decisions...  ...for educational and legal fit. Remote contract work pays $40 to $70 per hour,...  ...differentiated instruction; clear written English; ability to explain instructional and legal... 
    Remote work
    English language skills
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    4 days ago
  • $150 - $180 per hour

     ...Prolific is recruiting Mental Health Professionals to train and evaluate AI models. You’ll complete tasks that may pay $150–$180 per hour,...  ...assess suitability. Successful candidates join as Domain Experts and are paid for AI tasks, many of which require one hour of uninterrupted... 
    Remote work
    Hourly pay
    Work from home

    Prolific

    United States
    2 days ago
  • $30 - $65 per hour

    OpenTrain AI, Inc. is seeking a remote contractor to review Tamil audio for fluency, pronunciation, intonation,...  ...linguistic authenticity. You will provide clear, English-language feedback explaining language factors behind each evaluation and ensure consistency with evaluation... 
    Remote job
    English language skills
    Hourly pay
    Part time
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    2 days ago
  • $8 - $65 per hour

     ...for Mental Health Professionals to help train and evaluate AI models in Phoenix, Arizona. As a Domain Expert participant, you'll review AI-generated psychological...  ...completed task, with flexible hours that allow for remote work. Applicants need verified professional status... 
    Remote work
    Flexible hours

    Prolific

    United States
    3 days ago
  •  ...Prolific is seeking Mental Health Professionals in Indianapolis, Indiana, to assist in training and evaluating AI models. Ideal candidates will have a verified status as a Mental Health Professional, an understanding of psychological theory, and the ability to focus on... 
    Remote work
    Hourly pay
    Flexible hours

    Prolific

    Indianapolis, IN
    2 days ago
  • $166.4k - $228.8k

     ...About the Role Support the evaluation and improvement of AI systems by reviewing realistic US-law tasks and documents. This expert-review role focuses on legal accuracy, clear feedback...  ...and seniority. Location Fully remote. US legal training and practice are important... 
    Remote work
    Hourly pay
    Full time
    Flexible hours

    Clera

    Remote
    2 days ago
  • $60 per hour

    Prolific is seeking Biology Experts and Life Science Professionals to evaluate AI-generated science and ensure compliance with scientific standards. Responsibilities include reviewing biological inquiries, validating technical claims from public databases, and critiquing... 
    Remote work
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    San Jose, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to English Language Expert (Great Britain) — Remote AI Evaluation. Be the first to apply!