Journalist/Writer for AI Writing Evaluation

Role Overview

Apply your journalism and editorial expertise to evaluate AI-generated writing and help improve how next-generation AI systems learn, reason, and perform. This remote contract role focuses on producing careful, high-quality assessments of written content. Prior AI experience is not required.

Key Responsibilities

• Review and compare multiple AI-generated responses to writing prompts for clarity, tone, helpfulness, and adherence to instructions.
• Assign analytical quality scores and provide concise, well-reasoned written explanations for evaluation decisions.
• Identify persuasive writing that contains inaccuracies, insufficient support, or departures from the intended brief.
• Detect factual errors, logical inconsistencies, and internal-coherence issues in written content.
• Document evaluations thoroughly using project-provided digital content review tools.
• Collaborate asynchronously with project managers and reviewers to maintain consistent evaluation standards.
• Work independently and complete assigned evaluations within project timelines.

Qualifications

• Native or near-native written English fluency and a completed university degree from an institution in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.
• Professional experience as a journalist, reporter, editor, copy editor, sub-editor, fact-checker, ghostwriter, or published author.
• Demonstrated technical writing, content evaluation, critical analysis, editing, and written communication skills.
• Experience editing or fact-checking others'' work against a style guide or editorial standards.
• Strong attention to detail and sound judgment of accuracy, clarity, and audience suitability.
• Comfort working independently in a remote, virtual-collaboration environment.
• Experience with annotation, AI model evaluation, or digital content review platforms is helpful but not required.

Work Terms

• Remote contract engagement.

Compensation

• $90 to $140 per hour.