Linguist for AI Quality Evaluation

Role Overview

Apply linguistic and analytical expertise to assess written content and AI-generated responses, helping improve the accuracy, reliability, and performance of advanced AI systems. Prior AI experience is not required.

Key Responsibilities

• Review written content and AI-generated responses for accuracy, clarity, coherence, and completeness.
• Assess whether outputs follow detailed instructions, guidelines, and defined evaluation criteria.
• Identify subtle issues in grammar, usage, context, meaning, and consistency.
• Provide concise, constructive, and actionable written feedback focused on objective quality assessment.
• Document findings systematically using provided evaluation tools, guidelines, and reporting formats.

Qualifications

• Native proficiency in U.S. English is required.
• Advanced academic training or extensive professional experience in linguistics, language analysis, writing, editing, or a related field.
• Strong written communication skills and the ability to make nuanced linguistic assessments.
• Exceptional attention to detail, including the ability to detect subtle errors and inconsistencies.
• Strong analytical judgment and the ability to provide concise, constructive feedback.
• Ability to follow detailed guidelines and apply evaluation criteria consistently across a high volume of work.

Work Terms

• Independent contractor engagement.
• Remote role open to candidates located in the United States and Western Europe.
• Immediate availability required, with a minimum commitment of 20 hours per week while maintaining consistently high-quality work.

Compensation

$40 to $50 per hour.