English Linguistic Expert - Evaluator
$50 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: English Language and Literature Expert
Type: Contract
Compensation: $50/hour
Location: Remote
Role Responsibilities
- Evaluate the quality and accuracy of LLM-generated English text across various use cases such as summarization, dialogue, grammar correction, rewriting, and reasoning.
- Edit, refine, or rewrite English content to meet high linguistic, stylistic, and cultural standards.
- Annotate English text for grammatical, syntactic, semantic, and stylistic features to enhance model understanding.
- Identify model errors, inconsistencies, and language gaps, providing feedback to improve LLM performance .
- Provide detailed linguistic feedback and analysis to guide ongoing model training efforts .
Qualifications
Must-Have
- Native or near-native fluency in English, with an excellent command of grammar, syntax, vocabulary, and stylistics.
- Professional experience in editing, proofreading, writing, linguistic annotation, language evaluation, or NLP data work in English.
- Strong understanding of linguistic nuances, regional variations, tone, and context-appropriate English usage.
- Excellent ability to identify subtle grammatical errors, awkward phrasing, ambiguity, and unnatural language.
- Strong attention to detail, analytical judgment, and written communication skills.
- Ability to work independently in a distributed, remote environment .
Preferred
- Interest in AI and LLM-driven language technologies .
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$50 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: English Linguistic Experts Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated English text across...English language skillsContract workSummer workRemote work- Synthires is seeking a Film & Video Craft Expert to remotely evaluate AI-generated videos across lighting, framing, color, and performance. This... ...strong written communication. Applicants should be fluent in English and have access to a quality display and headphones for...English language skillsRemote jobPart time
$40 per hour
...content Write prompts and reasoning examples, including data and logic questions What you need Native-level Maltese and professional English Strong writing and grammar Research and fact-checking habits Attention to detail across many tasks Contract Remote, hourly contract...English language skillsRemote jobHourly payWeekly payContract workPart timeFor contractorsFlexible hours$90 per hour
...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use... ...in a terminal for local server setup. ~ Strong written English and discipline to justify judgments. Preferred Prior RLHF...English language skillsContract workSummer workLocal areaRemote work- Agency is seeking a linguistic evaluation specialist to review AI-generated text for accuracy, idiomatic use, and cultural relevance. You will... ...evaluation guidelines. Ideal candidates will be fluent in Basque and English, + proficient in another language, with strong attention to...English language skillsRemote work
- Inworld AI is seeking a voice evaluation specialist who will listen to paired or grouped speech samples, judge... ...localization efforts. A trained ear from audio production, linguistics, or related fields and strong written English are essential, with #J-18808-Ljbffr Inworld AIEnglish language skillsRemote job
- Remotebridge is seeking a Tamil bilingual expert for a remote contractor role focused on... ...knowledge will help train models by evaluating Tamil audio, assessing pronunciation and linguistic authenticity, and providing precise English-language feedback. The position emphasizes...English language skillsRemote jobContract workFor contractors
- ...content to support AI training datasets. LLM evaluation: reviewing AI-generated responses for... ...quality, coherence, and cultural/linguistic appropriateness. Localization QA: ensuring... ...exclusively seeks native speakers of American English born and raised in the United States....English language skillsHourly payFor contractorsRemote workFlexible hours
$30 - $60 per hour
Bilingual Expert (French) for Audio Evaluation Evaluate French audio and model speech for pronunciation, fluency... ...professional French plus B2 English. You will review French audio clips... ...audio clips and evaluate fluency and linguistic authenticity. Assess pronunciation,...English language skillsHourly payPart timeFor contractorsRemote work$30 - $65 per hour
...fluency, pronunciation, intonation, and linguistic authenticity. This remote contractor role... ...and requires professional Tamil plus B2 English. Remote Hourly · $30-$65/hr $30-$65/hr... ...understand and generate Tamil. You will use evaluation guidelines consistently, explain your...English language skillsHourly payContract workPart timeFor contractorsWork at officeRemote work$30 - $65 per hour
...contractor to review Tamil audio for fluency, pronunciation, intonation, and linguistic authenticity. You will provide clear, English-language feedback explaining language factors behind each evaluation and ensure consistency with evaluation guidelines. This part-time,...English language skillsRemote jobHourly payPart timeFor contractors- Remotebridge is seeking a German Bilingual Expert for a remote contractor role focused on evaluating German language input for AI model training. Apply linguistic expertise to assess nativeness,... ...authenticity, providing clear English feedback and justifications. Ideal...English language skillsRemote jobFor contractors
- micro1 Inc. is seeking Swiss German Transcription Experts for a remote contractor role. You will transcribe audio samples in Swiss German (and English) with precision, follow project guidelines, and annotate linguistic nuances. Collaboration with project managers and experts...English language skillsRemote jobFor contractors
- micro1 is seeking a Korean Bilingual Expert on a remote contractor basis to support... ..., and provide detailed feedback in English. Your linguistic expertise will guide pronunciation, intonation... ...and experience in linguistic quality evaluation or translation. #J-18808-Ljbffr...English language skillsRemote jobFor contractors
- NCR Eduservices is seeking an enthusiastic English Evaluator to join our remote team. You will review recorded reading and pronunciation sessions... ...standards. A Bachelor’s degree in Education, English, or Linguistics is required. Freshers are eligible; strong English grammar,...English language skillsRemote job
- Role Title: Dutch Bilingual Expert Role Type: Contractor Location: Remote... ...of speech generated by AI models. Evaluate pronunciation, grammar, and overall linguistic authenticity in alignment with... ...communication skills in both Dutch and English (B2+ required). Demonstrated...English language skillsFor contractorsRemote work
$50 per hour
English Linguistic Experts is a remote evaluation track for reviewing english linguistic experts evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling...English language skillsFor contractorsRemote work10 hours per week- ...Hurdles is seeking a French bilingual expert to evaluate audio samples for nativeness and fluency... ...(10-40 per week) and is ideal for linguists or voice specialists. You will assess... ...established guidelines, and provide concise English feedback with detailed justifications....English language skillsRemote jobContract workFlexible hours
$25 - $30 per hour
...accurate transcripts from Swiss German and English audio for AI training. The work includes... ..., regional accents, speaker changes, linguistic details, and contextual cues. Review and... ...project stakeholders and other language experts. Give practical feedback that improves transcription...English language skillsHourly payPart timeFor contractorsRemote work- Big Language Solutions is seeking a highly skilled English → Yiddish Translator to support ongoing translation, editing, proofreading, and review projects in the General and Human Rights domains. The role focuses on producing accurate, culturally nuanced Yiddish texts for...English language skills
$39 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - English (US) Type: Contract Compensation: $39/hour... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output for lyrics, voice generation, and other musical...English language skillsContract workSummer workImmediate startRemote work$50 per hour
...Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract... ...in Hindi, with supporting work in English. Establish and document evaluation... ...or recent graduates. Background in linguistics, humanities, social sciences, journalism...English language skillsContract workSummer work10 hours per week$15 per hour
...Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract... ...+ hours/week Role Responsibilities Evaluate AI-generated music across various genres.... ...follow detailed written instructions in English . Experience as a songwriter, lyricist...English language skillsContract workSummer workImmediate startRemote work- ...language specialist to collaborate with AI models on real-world ASL scenarios and linguistic theory. You will verify linguistic accuracy and cultural appropriateness, challenge models on ASL-to-English translation and spatial grammar, and document error traces and failure...English language skills
$100 - $120 per unit
...Position: Baseball Fan – Live MLB Game AI Evaluator (US) Type: Contract Compensation... ...schedules, broadcasts, highlights, and expert-style analysis. Run the same question... ...and web search. ~ Strong written English and sharp attention to detail. Preferred...English language skillsContract workWork experience placementSummer workRemote work$14 per hour
...Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation... ...+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice... ...native proficiency in both Telugu and English . Preferred Evidence of understanding...English language skillsContract workSummer workImmediate startRemote work$70 - $110 per hour
...+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product... ...handling, and post-sale support. Provide expert feedback. Work independently and... ...20+ hours per week . ~ Strong written English communication skills. Start Date ~...English language skillsHourly payContract workSummer workImmediate startRemote work$70 - $110 per hour
...+ hours/week Role Responsibilities Evaluate AI-generated sales strategies , quota plans... ...complaint resolution. Provide expert feedback on sales-performance analysis to... ...20+ hours per week . ~ Strong written English communication skills. Start Date ~...English language skillsHourly payContract workSummer workImmediate startRemote work- ...seeking data annotators for its Welo Data program. You will work remotely to label and evaluate data for AI training, contributing to diverse linguistic tasks across Cantonese and English. The role offers flexible hours and a global teaming environment. Ideal candidates...English language skillsRemote jobFlexible hours
$50 per hour
...Larry Summers and Jack Dorsey . Position: German Linguistic Experts Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated German text across...Full timeContract workSummer workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to English Linguistic Expert - Evaluator. Be the first to apply!
- technology expert New York, NY
- subject matter expert New York, NY
- guest service support expert New York, NY
- sql expert New York, NY
- fulfillment expert New York, NY
- evaluator New York, NY
- work from home web search evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- work from home social media evaluator New York, NY

