Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

English Linguistic Expert - Evaluator

$50 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: English Language and Literature Expert
Type: Contract
Compensation: $50/hour
Location: Remote

Role Responsibilities

  • Evaluate the quality and accuracy of LLM-generated English text across various use cases such as summarization, dialogue, grammar correction, rewriting, and reasoning.
  • Edit, refine, or rewrite English content to meet high linguistic, stylistic, and cultural standards.
  • Annotate English text for grammatical, syntactic, semantic, and stylistic features to enhance model understanding.
  • Identify model errors, inconsistencies, and language gaps, providing feedback to improve LLM performance .
  • Provide detailed linguistic feedback and analysis to guide ongoing model training efforts .

Qualifications

Must-Have

  • Native or near-native fluency in English, with an excellent command of grammar, syntax, vocabulary, and stylistics.
  • Professional experience in editing, proofreading, writing, linguistic annotation, language evaluation, or NLP data work in English.
  • Strong understanding of linguistic nuances, regional variations, tone, and context-appropriate English usage.
  • Excellent ability to identify subtle grammatical errors, awkward phrasing, ambiguity, and unnatural language.
  • Strong attention to detail, analytical judgment, and written communication skills.
  • Ability to work independently in a distributed, remote environment .

Preferred

  • Interest in AI and LLM-driven language technologies .

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 10 days ago
Similar jobs that could be interesting for youBased on the English Linguistic Expert - Evaluator in New York, NY vacancy
  • $50 per hour

     ...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: English Linguistic Experts Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated English text across... 
    English language skills
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    21 days ago
  • Synthires is seeking a Film & Video Craft Expert to remotely evaluate AI-generated videos across lighting, framing, color, and performance. This...  ...strong written communication. Applicants should be fluent in English and have access to a quality display and headphones for... 
    English language skills
    Remote job
    Part time

    Synthires

    New York, NY
    5 days ago
  • $40 per hour

     ...content Write prompts and reasoning examples, including data and logic questions What you need Native-level Maltese and professional English Strong writing and grammar Research and fact-checking habits Attention to detail across many tasks Contract Remote, hourly contract... 
    English language skills
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    Vettedlance

    New York, NY
    3 days ago
  • $90 per hour

     ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use...  ...in a terminal for local server setup. ~ Strong written English and discipline to justify judgments. Preferred Prior RLHF... 
    English language skills
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    New York, NY
    a month ago
  • Agency is seeking a linguistic evaluation specialist to review AI-generated text for accuracy, idiomatic use, and cultural relevance. You will...  ...evaluation guidelines. Ideal candidates will be fluent in Basque and English, + proficient in another language, with strong attention to... 
    English language skills
    Remote work

    Agency

    New York, NY
    4 days ago
  • Inworld AI is seeking a voice evaluation specialist who will listen to paired or grouped speech samples, judge...  ...localization efforts. A trained ear from audio production, linguistics, or related fields and strong written English are essential, with #J-18808-Ljbffr Inworld AI
    English language skills
    Remote job

    Inworld AI

    New York, NY
    4 days ago
  • Remotebridge is seeking a Tamil bilingual expert for a remote contractor role focused on...  ...knowledge will help train models by evaluating Tamil audio, assessing pronunciation and linguistic authenticity, and providing precise English-language feedback. The position emphasizes... 
    English language skills
    Remote job
    Contract work
    For contractors

    Remotebridge

    New York, NY
    2 days ago
  •  ...content to support AI training datasets. LLM evaluation: reviewing AI-generated responses for...  ...quality, coherence, and cultural/linguistic appropriateness. Localization QA: ensuring...  ...exclusively seeks native speakers of American English born and raised in the United States.... 
    English language skills
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    CNTXT, Inc.

    New York, NY
    5 days ago
  • $30 - $60 per hour

    Bilingual Expert (French) for Audio Evaluation Evaluate French audio and model speech for pronunciation, fluency...  ...professional French plus B2 English. You will review French audio clips...  ...audio clips and evaluate fluency and linguistic authenticity. Assess pronunciation,... 
    English language skills
    Hourly pay
    Part time
    For contractors
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    4 days ago
  • $30 - $65 per hour

     ...fluency, pronunciation, intonation, and linguistic authenticity. This remote contractor role...  ...and requires professional Tamil plus B2 English. Remote Hourly · $30-$65/hr $30-$65/hr...  ...understand and generate Tamil. You will use evaluation guidelines consistently, explain your... 
    English language skills
    Hourly pay
    Contract work
    Part time
    For contractors
    Work at office
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    5 days ago
  • $30 - $65 per hour

     ...contractor to review Tamil audio for fluency, pronunciation, intonation, and linguistic authenticity. You will provide clear, English-language feedback explaining language factors behind each evaluation and ensure consistency with evaluation guidelines. This part-time,... 
    English language skills
    Remote job
    Hourly pay
    Part time
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    5 days ago
  • Remotebridge is seeking a German Bilingual Expert for a remote contractor role focused on evaluating German language input for AI model training. Apply linguistic expertise to assess nativeness,...  ...authenticity, providing clear English feedback and justifications. Ideal... 
    English language skills
    Remote job
    For contractors

    Remotebridge

    New York, NY
    5 days ago
  • micro1 Inc. is seeking Swiss German Transcription Experts for a remote contractor role. You will transcribe audio samples in Swiss German (and English) with precision, follow project guidelines, and annotate linguistic nuances. Collaboration with project managers and experts... 
    English language skills
    Remote job
    For contractors

    micro1 Inc.

    New York, NY
    2 days ago
  • micro1 is seeking a Korean Bilingual Expert on a remote contractor basis to support...  ..., and provide detailed feedback in English. Your linguistic expertise will guide pronunciation, intonation...  ...and experience in linguistic quality evaluation or translation. #J-18808-Ljbffr... 
    English language skills
    Remote job
    For contractors

    micro1 Inc.

    New York, NY
    2 days ago
  • NCR Eduservices is seeking an enthusiastic English Evaluator to join our remote team. You will review recorded reading and pronunciation sessions...  ...standards. A Bachelor’s degree in Education, English, or Linguistics is required. Freshers are eligible; strong English grammar,... 
    English language skills
    Remote job

    NCR Eduservices

    New York, NY
    2 days ago
  • Role Title: Dutch Bilingual Expert Role Type: Contractor Location: Remote...  ...of speech generated by AI models. Evaluate pronunciation, grammar, and overall linguistic authenticity in alignment with...  ...communication skills in both Dutch and English (B2+ required). Demonstrated... 
    English language skills
    For contractors
    Remote work

    Remotebridge

    New York, NY
    3 days ago
  • $50 per hour

    English Linguistic Experts is a remote evaluation track for reviewing english linguistic experts evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling... 
    English language skills
    For contractors
    Remote work
    10 hours per week

    AuraOne, Inc.

    New York, NY
    4 days ago
  •  ...Hurdles is seeking a French bilingual expert to evaluate audio samples for nativeness and fluency...  ...(10-40 per week) and is ideal for linguists or voice specialists. You will assess...  ...established guidelines, and provide concise English feedback with detailed justifications.... 
    English language skills
    Remote job
    Contract work
    Flexible hours

    Crossing Hurdles

    New York, NY
    6 days ago
  • $25 - $30 per hour

     ...accurate transcripts from Swiss German and English audio for AI training. The work includes...  ..., regional accents, speaker changes, linguistic details, and contextual cues. Review and...  ...project stakeholders and other language experts. Give practical feedback that improves transcription... 
    English language skills
    Hourly pay
    Part time
    For contractors
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    5 days ago
  • Big Language Solutions is seeking a highly skilled English → Yiddish Translator to support ongoing translation, editing, proofreading, and review projects in the General and Human Rights domains. The role focuses on producing accurate, culturally nuanced Yiddish texts for... 
    English language skills

    BIG Language Solutions, Inc.

    New York, NY
    3 days ago
  • $39 per hour

     ...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - English (US) Type: Contract Compensation: $39/hour...  ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output for lyrics, voice generation, and other musical... 
    English language skills
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    9 days ago
  • $50 per hour

     ...Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract...  ...in Hindi, with supporting work in English. Establish and document evaluation...  ...or recent graduates. Background in linguistics, humanities, social sciences, journalism... 
    English language skills
    Contract work
    Summer work
    10 hours per week

    Mercor

    New York, NY
    10 days ago
  • $15 per hour

     ...Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract...  ...+ hours/week Role Responsibilities Evaluate AI-generated music across various genres....  ...follow detailed written instructions in English . Experience as a songwriter, lyricist... 
    English language skills
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    16 days ago
  •  ...language specialist to collaborate with AI models on real-world ASL scenarios and linguistic theory. You will verify linguistic accuracy and cultural appropriateness, challenge models on ASL-to-English translation and spatial grammar, and document error traces and failure... 
    English language skills

    Agency

    New York, NY
    2 days ago
  • $100 - $120 per unit

     ...Position: Baseball Fan – Live MLB Game AI Evaluator (US) Type: Contract Compensation...  ...schedules, broadcasts, highlights, and expert-style analysis. Run the same question...  ...and web search. ~ Strong written English and sharp attention to detail. Preferred... 
    English language skills
    Contract work
    Work experience placement
    Summer work
    Remote work

    Mercor

    New York, NY
    12 days ago
  • $14 per hour

     ...Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation...  ...+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice...  ...native proficiency in both Telugu and English . Preferred Evidence of understanding... 
    English language skills
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    9 days ago
  • $70 - $110 per hour

     ...+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product...  ...handling, and post-sale support. Provide expert feedback. Work independently and...  ...20+ hours per week . ~ Strong written English communication skills. Start Date ~... 
    English language skills
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    20 days ago
  • $70 - $110 per hour

     ...+ hours/week Role Responsibilities Evaluate AI-generated sales strategies , quota plans...  ...complaint resolution. Provide expert feedback on sales-performance analysis to...  ...20+ hours per week . ~ Strong written English communication skills. Start Date ~... 
    English language skills
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    23 days ago
  •  ...seeking data annotators for its Welo Data program. You will work remotely to label and evaluate data for AI training, contributing to diverse linguistic tasks across Cantonese and English. The role offers flexible hours and a global teaming environment. Ideal candidates... 
    English language skills
    Remote job
    Flexible hours

    Welocalize, Inc.

    New York, NY
    5 days ago
  • $50 per hour

     ...Larry Summers and Jack Dorsey . Position: German Linguistic Experts Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated German text across... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    18 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to English Linguistic Expert - Evaluator. Be the first to apply!