Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote English Language Evaluation & QA Specialist

AuraOne

New York, NY
  • Remote job

AuraOne is seeking an English Language Evaluation Specialist to remotely review evaluation prompts and responses against a quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback for retraining the modeling team. This contractor role emphasizes careful annotation, labeling of hallucinations and policy violations, and clear written rationale. Ideal candidates have prior evaluation experience and can commit at least 10 hours per week on a flexible #J-18808-Ljbffr AuraOne

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote English Language Evaluation & QA Specialist in New York, NY vacancy
  •  ...This Role In this hourly, remote contractor role, you will...  ...Kannada content and trainer/QA work, evaluate output quality against project...  ...requires strong Kannada and English skills, excellent attention...  ...Strong grasp of the English language to follow project guidelines... 
    Remote work
    English language skills
    Hourly pay
    For contractors

    SuperAnnotate AI

    United States
    2 days ago
  • $20 - $30 per hour

     ...this role In this hourly, remote contractor role, you will...  ...Gujarati content and trainer/QA work, evaluate output quality against project...  ...strong Gujarati and English skills, excellent attention...  ...Strong grasp of the English language to follow project guidelines... 
    Remote work
    English language skills
    Hourly pay
    For contractors

    Brain Trust Inc

    United States
    1 day ago
  • AuraOne seeks a Visual Creative Expert to remotely evaluate prompts and model outputs against its quality rubric. You will compare paired responses, label edge cases, and write structured feedback for retraining. The role focuses on labeling hallucinations, instruction-... 
    Remote job
    Hourly pay
    For contractors
    Flexible hours

    AuraOne

    New York, NY
    1 day ago
  •  ...firm is seeking a detail-oriented Business Analyst to support evaluation and annotation workflows. The role involves performing evaluations...  ...and attention to detail, and be comfortable working in a remote environment. The position offers competitive compensation and flexible... 
    Remote job
    Flexible hours

    Turing

    Boston, MA
    1 day ago
  •  ...A leading recruitment agency is seeking an English and Spanish Language Bilingual Expert for a remote opportunity. This role involves reviewing AI-generated Spanish translations to ensure accuracy and cultural relevance. Ideal candidates will have near-native proficiency... 
    Remote work
    English language skills
    Hourly pay
    10 hours per week
    Flexible hours

    Keystone Recruitment

    New York, NY
    5 days ago
  •  ...company is seeking a detail-oriented Business Analyst to support evaluation and annotation workflows with clear tasks around quality and...  ...competitive compensation, flexible working hours, and a fully remote environment, committing to at least 30 hours per week. #J-18808... 
    Remote job
    Flexible hours

    Turing

    Los Angeles, CA
    1 day ago
  •  ...bilingual experts to contribute to language and AI training projects. In...  ..., you will listen to audio, evaluate nativeness and fluency, and provide concise feedback in English to guide model learning. You...  ...or audio analysis is valued. Remote work with flexible deadlines and... 
    Remote job
    English language skills
    Contract work
    Flexible hours

    micro1

    New York, NY
    1 day ago
  •  ...Dutch bilingual expert for a remote contractor role. You will listen...  ...Dutch speakers with strong English communication (B2+), exceptional...  ...and experience in linguistic evaluation or related fields. You will document...  ...and collaborate with QA leads. #J-18808-Ljbffr Remotebridge
    Remote job
    English language skills
    For contractors

    Remotebridge

    New York, NY
    1 day ago
  • Morley is hiring a remote French bilingual product quality assurance agent. You will handle calls from French-speaking dealers, document information in English, and deliver French-language resolutions using established processes. The role emphasizes quality, responsiveness... 
    Remote job
    English language skills
    Home office

    Morley

    Brooklyn, NY
    11 hours ago
  •  ...culture, and context, working with Korean and English. As a contractor, you’ll translate in both directions...  ...cultural nuances, and suggest prompts and evaluation methods. Remote work, entry to mid-level, with strong language and communication skills preferred. #J-18808-Ljbffr... 
    Remote job
    English language skills
    For contractors

    Invisible Technologies Inc.

    New York, NY
    3 days ago
  •  ...independent contractor experts to evaluate AI-generated outputs focusing...  .... Applicants will complete a language fluency introduction and a JSON...  ...recorded speaking responses in English and the chosen language of the cohort. This is a remote contractor role in the United States... 
    Remote work
    English language skills
    Contract work
    For contractors

    Meridial

    New York, NY
    1 day ago
  • A multilingual education platform is seeking an English & Turkish Language Specialist who will review and refine AI-generated STEM content in both languages. This remote position requires a strong STEM background and fluency in Turkish and English. Ideal candidates will... 
    Remote job
    English language skills
    10 hours per week

    Crossing Hurdles

    Turkey, NC
    1 day ago
  • $40 - $55 per hour

     ...this role In this hourly, remote contractor role, you will...  ...Japanese content and trainer/QA work, evaluate output quality against project...  ...Communications, Journalism, English, Education, Quality...  ...Strong grasp of the English language to follow project guidelines... 
    Remote work
    English language skills
    Hourly pay
    Contract work
    For contractors
    Immediate start

    Braintrust

    San Francisco, CA
    a month ago
  • $50 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: English Language and Literature Expert Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated English text... 
    Remote work
    English language skills
    Contract work
    Summer work

    Mercor

    New York, NY
    4 days ago
  • RWS Group is seeking a web-savvy evaluator to enhance search engine results. You will...  ...engines and platforms. This flexible remote role in Taiwan offers part-time hours (roughly 5-20 per week), English and Chinese Traditional language requirements, and a straightforward... 
    Remote job
    English language skills
    Part time
    Flexible hours

    Rws

    Tallahassee, FL
    3 days ago
  •  ...seeking a Tamil bilingual expert for a remote contractor role focused on language and AI training. Your domain knowledge will help train models by evaluating Tamil audio, assessing...  ...authenticity, and providing precise English-language feedback. The position emphasizes... 
    Remote job
    English language skills
    Contract work
    For contractors

    Remotebridge

    New York, NY
    3 days ago
  •  ...Meme Context Evaluation Dataset QA Specialist is a remote evaluation track for reviewing meme context evaluation dataset qa evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  • English Language Evaluation Specialist is a remote evaluation track for reviewing english language evaluation evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback... 
    Remote work
    English language skills
    Hourly pay
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    1 day ago
  • $20.3 per hour

    Welo Data is seeking a Maps Visual Design Relevance Evaluator (US) to review digital map designs for readability, aesthetic...  ...helpful user experiences. The role is freelance with English (US) language requirements. Remote work is available, with an hourly rate around $20.30... 
    Remote job
    English language skills
    Hourly pay
    Freelance

    Welo Data

    Kansas City, MO
    1 day ago
  • Create challenging prompts and evaluate large language model responses for accuracy, reasoning, and usefulness...  ..., part-time role requires strong English writing, analytical thinking, and team management experience. 100% Remote Contract, part-time Engagement Remote Location... 
    Remote work
    English language skills
    Contract work
    Part time
    For contractors
    Worldwide

    OpenTrain AI, Inc.

    New York, NY
    3 days ago
  • $35 - $40 per hour

    A leading evaluation organization seeks a Generalist Evaluator Expert for a remote, flexible contract role. This position involves designing prompts for language model evaluations, defining standards, and conducting assessments. Ideal candidates should have strong writing... 
    Remote job
    Contract work
    Flexible hours

    Crossing Hurdles

    New York, NY
    11 hours ago
  • Crossing Hurdles is seeking a Personal Account Generalist Raters for a remote contractor assignment. You will review AI-generated prompts and responses in English, evaluate relevance and accuracy, and provide clear ratings and feedback to help improve next‑generation AI... 
    Remote job
    English language skills
    Contract work
    For contractors

    Crossing Hurdles

    New York, NY
    1 day ago
  • $20 - $160 per hour

     ...Health AI Conversation Quality Evaluation Type: Contract...  ...20–$160/hour Location: Remote Role Responsibilities Evaluate...  ...the question in understandable language for non-experts. Detect...  ...Must-Have Strong written English skills. Ability to explain... 
    Remote work
    English language skills
    Contract work
    Summer work

    Mercor

    Abbeville, GA
    22 days ago
  •  ...to contribute to advanced AI research and evaluation projects. In this role, you will evaluate...  ...degree from a recognized university, native English fluency, strong written communication, ability to work independently in a remote environment, and strict adherence to... 
    Remote job

    Synthires

    New York, NY
    2 days ago
  • $70 per hour

     ...Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and rigor...  ...work entirely without AI writing tools . Native English fluency required. Application Process (Takes 20–30... 
    Remote work
    Contract work
    Summer work

    Mercor

    Abbeville, GA
    22 days ago
  • YO AI Labs in the United States is seeking a native English-speaking contractor to contribute to language data and AI training projects. You will evaluate audio content for nativeness, fluency, and pronunciation, and provide structured written feedback to improve AI models... 
    Remote job
    English language skills
    For contractors

    YO AI Labs

    New York, NY
    1 day ago
  • $70 per hour

    Synthires is seeking evaluators to join our AI research and evaluation team. You will assess...  ...systems. Required skills include native English fluency, strong writing, critical...  ...and meticulous attention to detail. This remote, project-based role offers flexible hours... 
    Remote job
    Flexible hours

    Synthires

    Sacramento, CA
    1 day ago
  •  ...Evaluation Specialist UN - United Nations Remote | Multiple locations CON level Speaks English, French Application deadline: December 31, 2026 (3 months) The Evaluation Specialist...  ...in conducting evaluation is required. Language: English and French are the two working... 
    Remote work
    English language skills
    Work at office
    Shift work

    UN - United Nations

    United States
    1 day ago
  •  ...contribute to advanced AI research and evaluation projects. You will evaluate AI-generated...  ...Requirements include a Bachelor's degree, native English fluency, strong written communication,...  ...the ability to work independently in a remote, project-based role. #J-18808-Ljbffr... 
    Remote job
    Flexible hours

    Synthires

    Sacramento, CA
    2 days ago
  • $18 per hour

    We are looking for AI Linguistic Evaluators to assess how effectively an AI application...  .... Job Type: Freelance Location: Remote from the United States Work...  ...speaker of Telugu with strong English skills and a keen eye for language quality?Join a remote AI project where... 
    Remote work
    English language skills
    Freelance
    Immediate start
    Flexible hours

    RWS Group

    Dallas, TX
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote English Language Evaluation & QA Specialist. Be the first to apply!