Linguist - Rater Guidelines Specialist

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: AI Rater Guidelines Writer (Linguist / Instructional Designer)
Type: Contract
Compensation: $45–$65/hour
Location: Remote

Role Responsibilities

• Guide research and program teams to close the gap between ambiguous program requirements and rater-ready instructions across various domains.
• Design clear, non-contradictory rating guidelines and rubrics for consistent application by raters, including in edge cases.
• Evaluate draft guidelines for ambiguity, contradictions, and coverage gaps, revising until raters can apply them without escalation.
• Translate program specifications from domains such as finance, retail, insurance, legal, and sports into precise rater instructions.
• Collaborate with subject matter experts and program leads to ensure consistency and accuracy across guideline sets.

Qualifications

Must-Have

• 3+ years of professional experience in linguistics, instructional design, technical writing, or a related field.
• Experience writing or refining guidelines/rubrics for human raters in a GenAI/RLHF context.
• Ability to work across multiple domains (e.g., finance, retail, insurance, legal, sports) and translate domain-specific nuances.
• Strong track record of resolving ambiguity and contradiction in written specifications.
• Ability to engage reliably for at least 35 hours/week during weekdays.
• Strong written communication skills for explaining complex guidance clearly.

Application Process (Takes 20–30 mins to complete)

• Upload resume
• AI interview based on your resume
• Submit form

Resources & Support

• For details about the interview process and platform information, please check:
• For any help or support, reach out to: View email address on ziprecruiter.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.