English Language Expert (Great Britain) — Remote AI Evaluation
AuraOne Human Data
- Remote job
English Language Expert (Great Britain) — Remote AI Evaluation is a remote evaluation track for reviewing english language evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.
Why this role matters
AI data reviewers help turn english language evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.
Responsibilities
- Evaluate english language evaluation model outputs against a versioned rubric and assign severity tags for English Language Expert (Great Britain) — Remote AI Evaluation assignments.
- Compare paired responses and pick the stronger answer with a written rationale.
- Label hallucinations, instruction-following failures, and unsafe content with structured tags.
- Capture ambiguous prompts and route them back to the program team for rubric updates.
- Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
- Document recurring failure modes so the modeling team can target them in the next training run.
Qualifications
- Prior evaluation, annotation, or human-rater experience on english language evaluation or adjacent content for English Language Expert (Great Britain) — Remote AI Evaluation work.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the issue and the rubric clause being applied.
- Strong attention to detail and the ability to flag when a prompt itself is the problem.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Compare two english language evaluation model responses to the same prompt and pick the stronger one with rationale.
- Tag an unsafe response with the correct policy category and severity.
- Audit a 50-row batch for rubric consistency and report drift to the program lead.
- Propose a rubric clarification after spotting a recurring failure mode.
Nice to have
- Background in linguistics, content moderation, or trust & safety review.
- Experience with inter-rater agreement metrics and calibration cycles.
- Domain expertise that lets you spot subject-matter errors automated checks miss.
Skills
- Model output evaluation
- Rubric-based annotation
- Severity tagging
- Inter-rater calibration
- English Language evaluation
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
- ...Description Job Description Job Description: English Language Expert – Great Britain Role Type: Contractor Location: Remote, Great Britain About the Role We are... ...use your language expertise to help improve AI systems through accurate audio analysis, transcription...Remote jobEnglish language skillsFor contractors
$24 per hour
...QuickBooks experience to help improve AI responses to real small-business and financial questions. In this remote freelance project, you'll evaluate accuracy, identify gaps and help... ...consistently. ~ Excellent written English, analytical thinking and attention to...Remote workEnglish language skillsPart timeFreelance- OpenTrain AI, Inc. is seeking an Education Expert for AI Evaluation (English) to remotely assess AI-generated teaching guidance. You will craft teaching scenarios, write reference answers, and rate model outputs for accuracy, practicality, and age-appropriateness. The role...Remote jobEnglish language skillsPart timeFor contractorsFlexible hours
- ...Mental Health Professionals in Nashville, TN, to help train and evaluate AI models. Candidates will review AI-generated responses, complete... ...pay rates, and the ability to work from home, making it a great opportunity for professionals looking to influence future AI developments...Remote workHourly payWork from homeFlexible hours
$35 - $70 per hour
Education Expert for AI Evaluation (English) Use classroom expertise to create teaching scenarios, write reference answers, and evaluate AI-generated educational guidance. This remote contractor role pays $35 to $70 per hour and requires 20 or more hours per week. Remote...Remote workEnglish language skillsHourly payContract workPart timeFor contractors- Remotebridge is seeking a German Bilingual Expert for a remote contractor role focused on evaluating German language input for AI model training. Apply linguistic expertise... ...and linguistic authenticity, providing clear English feedback and justifications. Ideal...Remote jobEnglish language skillsFor contractors
- Employment and Labor Law AI Evaluation Expert Review AI-generated answers to U.S. employment law scenarios... ...S. law degree and bar admission. 100% Remote Contract, part-time The work Review... ...to detail, and ethical judgment. English: Fluency in English. Helpful experience...Remote workEnglish language skillsContract workPart timeFreelanceFlexible hoursShift work
- ...seeking an HR & People Operations Expert for AI training projects, fully remote on a contractor basis. You will craft... ..., and establish objective evaluation criteria to assess outcomes. The role... ...within AI evaluation projects. Strong English and hands-on HR experience are...Remote jobEnglish language skillsFor contractors
- RemoteJobsOne is seeking a Financial Expert contractor to help train AI systems by developing... ...prompts and structured evaluation rubrics. You will review... ...emphasizes clear written English and independent work, with... ...and expectations in a fully remote setting. #J-18808-Ljbffr...Remote jobEnglish language skillsFor contractors
$40 - $80 per hour
Military Operations AI Evaluation Expert (English) Review AI-generated military scenarios for tactical accuracy... ..., with pay of $40 to $80 per hour. Remote Hourly · $40-$80/hr $40-$80/hr... ...Africa, Asia, and the Middle East. Language: Professional fluency in English. Experience...Remote workEnglish language skillsHourly payContract workPart timeFor contractors$21 - $70 per hour
...your editing decisions. OpenTrain AI needs experienced audio editors to evaluate practical AI-training work. You will... ...schedule for flexible, part-time remote contract work Fully remote and... ...and sharing your screen Fluent in English; communicate clearly and bring strong...Remote jobEnglish language skillsHourly payContract workPart timeFor contractorsFlexible hours$50 - $90 per hour
...international humanitarian law expertise to evaluate AI systems, build conflict-risk frameworks,... ...defense and humanitarian scenarios remotely for $50 to $90 per hour. Remote Hourly ·... ...in the countries specified for the role. English fluency is required for the written and...Remote workEnglish language skillsHourly payContract workPart timeWorldwide$20 - $45 per hour
Coding & Software Remote Hourly · $20-$45/hr $20-$45/hr Compensation... ...The work You will help evaluate AI systems by reviewing software... ...codebases across several programming languages. Compare long-form responses... ...: Strong written and verbal English communication. Location:...Remote workEnglish language skillsHourly payContract workPart timeFor contractors- ...professionals and subject-matter experts based in the Philippines to participate in an AI training and evaluation project focused on creating... ...; Have excellent written English skills and can communicate effectively... ...3-5 tasks . This is a remote opportunity . Applicants...Remote workEnglish language skillsWork experience placementFreelanceWork at office
$35 - $42 per hour
Location: U.S Candidates Only (Remote) Compensation: $35.00 - $42.00 USD... ...markets. In this role, you will evaluate AI-generated financial content and provide expert feedback to improve financial... ...thinkingskills. Excellent written English communication skills. Ability...Remote workEnglish language skillsHourly payExtra incomePermanent employmentContract workTemporary workPart timeImmediate startFlexible hours$50 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: English Language and Literature Expert Type: Contract Compensation... ...: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of...Remote workEnglish language skillsContract workSummer work$100 - $120 per unit
...technical talent with leading AI research labs.... ...Fan – Live MLB Game AI Evaluator (US) Type: Contract... ...per task Location: Remote Commitment: Event... ..., highlights, and expert-style analysis. Run... ...search. ~ Strong written English and sharp attention to...Remote workEnglish language skillsContract workWork experience placementSummer work$150 per hour
...technical talent with leading AI research labs.... ...Clinician (MD/DO) - HLS Expert Pool Type: Contract... ...0/hour Location: Remote Role... ...model response grading. Evaluate clinical dialogues for... ...~ Written and spoken English fluency ~ Minimum 20...Remote workEnglish language skillsContract workSummer work$70 - $85 per hour
Fraud Investigator Expert for AI Evaluation Use your fraud investigation experience to write realistic... ...cases and evaluate AI responses. This remote, asynchronous role pays $70 to $85 per... ...20+ hours weekly plus strong written English. Remote Hourly $70-$85/hr $70-$85/hr Compensation...Remote workEnglish language skillsHourly payWeekly payContract workPart timeFor contractorsFlexible hours$18 - $45 per hour
...Spain Market Expertise | Remote Freelance Opportunity... ...Help Shape the Future of AI in Finance Are you a... ...Income Subject Matter Experts (SMEs) to support a specialized AI evaluation pilot focused on the financial... ...and qualifications Language: English Schedule: Based on...Remote workEnglish language skillsExtra incomeTemporary workFor contractorsFreelanceFlexible hours$35 - $42 per hour
...Compliance Location: USA (Remote) Compensation: $35.00-$... ...Shape the Future of AI in Finance, Audit & Risk... ...network of on-call AI Evaluation Specialists supporting... ...network of subject matter experts. As client projects... ...skills. Excellent written English communication skills....Remote workEnglish language skillsHourly payExtra incomePermanent employmentContract workTemporary workFlexible hours$90 per hour
...technical talent with leading AI research labs.... ...0/hour Location: Remote Role Responsibilities... ...merely look correct. Evaluate responsive behavior and... ...importance in precise language. Flag ties, ambiguous... ...setup. ~ Strong written English and discipline to...Remote workEnglish language skillsContract workSummer workLocal area- AI Ethics & Evaluation Associate (R&D Projects) Seniority level... .... This role is a great opportunity for... ...work We're a fully remote team, spread across... ...reinforce each other. English is our working language. Who we are looking... ..., covering expert and predictive systems...Remote workEnglish language skillsFull time
$40 - $70 per hour
Special Education Teacher AI Evaluation Expert Create IEP and intervention scenarios, explain decisions... ...for educational and legal fit. Remote contract work pays $40 to $70 per hour,... ...differentiated instruction; clear written English; ability to explain instructional and legal...Remote workEnglish language skillsHourly payWeekly payContract workPart timeFor contractors$150 - $180 per hour
...Prolific is recruiting Mental Health Professionals to train and evaluate AI models. You’ll complete tasks that may pay $150–$180 per hour,... ...assess suitability. Successful candidates join as Domain Experts and are paid for AI tasks, many of which require one hour of uninterrupted...Remote workHourly payWork from home$30 - $65 per hour
OpenTrain AI, Inc. is seeking a remote contractor to review Tamil audio for fluency, pronunciation, intonation,... ...linguistic authenticity. You will provide clear, English-language feedback explaining language factors behind each evaluation and ensure consistency with evaluation...Remote jobEnglish language skillsHourly payPart timeFor contractors$8 - $65 per hour
...for Mental Health Professionals to help train and evaluate AI models in Phoenix, Arizona. As a Domain Expert participant, you'll review AI-generated psychological... ...completed task, with flexible hours that allow for remote work. Applicants need verified professional status...Remote workFlexible hours- ...Prolific is seeking Mental Health Professionals in Indianapolis, Indiana, to assist in training and evaluating AI models. Ideal candidates will have a verified status as a Mental Health Professional, an understanding of psychological theory, and the ability to focus on...Remote workHourly payFlexible hours
$166.4k - $228.8k
...About the Role Support the evaluation and improvement of AI systems by reviewing realistic US-law tasks and documents. This expert-review role focuses on legal accuracy, clear feedback... ...and seniority. Location Fully remote. US legal training and practice are important...Remote workHourly payFull timeFlexible hours$60 per hour
Prolific is seeking Biology Experts and Life Science Professionals to evaluate AI-generated science and ensure compliance with scientific standards. Responsibilities include reviewing biological inquiries, validating technical claims from public databases, and critiquing...Remote workHourly payWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to English Language Expert (Great Britain) — Remote AI Evaluation. Be the first to apply!




