Linguist - AI Rater Guidelines Expert
$45 - $65 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: AI Rater Guidelines Writer (Linguist / Instructional Designer)
Type: Contract
Compensation: $45–$65/hour
Location: Remote
Role Responsibilities
- Guide research and program teams to close the gap between ambiguous program requirements and rater-ready instructions across various domains.
- Design clear, non-contradictory rating guidelines and rubrics for consistent application, including under edge cases.
- Evaluate and revise draft guidelines for ambiguity, contradiction, and coverage gaps to ensure raters can apply them without escalation.
- Translate program specifications from domains such as finance, retail, insurance, legal, and sports into precise, discipline-specific rater instructions.
- Collaborate with subject matter experts and program leads to ensure consistency and accuracy across guideline sets.
Qualifications
Must-Have
- 3+ years of professional experience in linguistics, instructional design, technical writing, or a related field.
- Direct experience writing or refining guidelines/rubrics for human raters in a GenAI/RLHF context.
- Ability to work across multiple domains (e.g., finance, retail, insurance, legal, sports) and translate domain-specific nuances.
- Strong track record of resolving ambiguity and contradiction in written specifications.
- Ability to engage reliably for at least 35 hours/week during weekdays.
- Strong written communication skills to explain complex guidance clearly.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 11 days ago
Similar jobs that could be interesting for youBased on the Linguist - AI Rater Guidelines Expert in San Francisco, CA vacancy
$130k - $180k
...will own the execution and delivery of high-impact AI data generation and model improvement projects in... ...distributed teams of clinical and life sciences experts. Maintain high quality standards through strong guidelines and QA processes. Improve operational systems...SuggestedFull timeWork at officeRemote work3 days per week$77 - $81 per hour
...English & Norwegian) to help make advanced AI models safer. You'll apply your... ...you on the workflow. What you'll do Write expert-level prompts in Norwegian across specialized... ...handling of sensitive content. Apply structured guidelines to classify prompts and conversations....SuggestedPart timeImmediate start$18 - $22 per hour
...speakers (English & Thai) to help make advanced AI models safer. You'll apply your language... ...on the workflow. What you'll do Write expert-level prompts in Thai across a range of sensitive subject areas. Apply structured guidelines to classify prompts and conversations....SuggestedPart timeImmediate start$16 - $22 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: AI Safety Experts — English & Kannada Type: Contract... ...and inconsistencies. Ability to work to guidelines and quality standards consistently. Clear...SuggestedContract workSummer workRemote work$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...of AI-generated conversations and provide expert judgment to calibrate automated evaluation... ...therapeutics. Experience developing clinical guidelines, assessment frameworks, or educational...SuggestedContract workTraineeshipSummer workRemote work- ...Job Description Job Description Developer & Infrastructure Expert Role Type: Contractor Location: Remote Job Overview We are... ...experienced Developer & Infrastructure Experts to evaluate AI-powered workflows across software development, cloud infrastructure...Remote jobFor contractors
YO AI Labs
San Francisco, CA3 days ago $106.4k - $230.6k
...Alpharetta, GA; or San Francisco, CA. The Expert Applications Architect will be... ...and development teams on best practices, guidelines and standards as well as evangelizing Technology... ...technologies, including artificial intelligence (AI) platforms and services, and the ability...Full timeH1bWork at officeLocal area$90 - $150 per hour
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workRemote work$48 - $62 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., Larry Summers , and Jack Dorsey . Position: AI Safety Experts — English & Finnish Type: Contract Compensation: $48–...Contract workSummer workRemote work$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location:...Contract workSummer workImmediate startRemote work$145 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications) Type: Contract...Remote jobContract workSummer work$120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...'Angelo , Larry Summers , and Jack Dorsey . Position: Expert Software Engineer – Scala / COBOL / ABAP / Verilog / Fortran / Slang...Hourly payWeekly payFull timeContract workFor contractorsSummer workRemote work$48 - $62 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., Larry Summers , and Jack Dorsey . Position: AI Safety Experts — English & Danish Type: Contract Compensation: $48–$...Contract workSummer workRemote work$70 - $84 per hour
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workRemote work$60 - $100 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., Larry Summers , and Jack Dorsey . Position: Marketing Expert — Social Media (AI Agent Environments) Type: Contract Compensation...Contract workSummer workRemote work$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Work as a team by sharing insights with researchers and fellow experts to continually improve the benchmark. Qualifications Must-...Remote jobContract workSummer work$60 - $90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Enterprise Sales Domain Expert Type: Contract Compensation: $60–$90/hour Location:...Contract workSummer workWork at officeRemote work- ...Job Description Job Description Job Title: AI Consulting Domain Remote Job Type: Contractor (Part-Time) Location: Remote... ...Job Overview We are seeking experienced AI Consulting Domain Experts to contribute their consulting expertise to an innovative project...Remote jobPart timeFor contractors
$100 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...and Jack Dorsey . Position: Software & Firmware Engineering Experts Type: Contract Compensation: $100–$120/hour Location...Contract workSummer workRemote work- ...are seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments... ...submission requirements may apply. Availability Selected experts should be prepared to begin their first tasks within 24–48 hours...Remote jobFor contractors
$60 - $90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...working researcher would catch. Collaborate with researchers and experts to maintain consistent and accurate evaluations....Contract workSummer workRemote work$70 - $90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Trainium (NKI) Kernel Expert Type: Contract Compensation: $70–$90/hour Location:...Contract workSummer workRemote work$65 - $75 per unit
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...technical reasoning for correct responses. Collaborate with experts to ensure models correctly judge misuse potential while answering...Contract workSummer workRemote work$45 - $55 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...generated tasks and solutions. Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets....Contract workSummer workRemote work$60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Dorsey . Position: Application Users - Windows 11 Professional Expert - Professionals Type: Contract Compensation: $60–$70/hour...Contract workSummer workRemote work$133k - $238k
...Functional Collaboration Partner closely with subject matter experts in transmission operations, inspection, engineering, wildfire... ...frameworks Time-to-event / hazard models Explainable AI / interpretable models Scenario analysis and Monte Carlo...Full timeWork at officeRemote work2 days per week$60 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...generated educational content . Collaborate with subject matter experts to ensure task relevance and accuracy. Work independently...Contract workSummer workRemote work$60k - $74k
...sleep well so they live well is at the core of what we do. The right mattress matters, and so does the right career. Our Sleep Experts® are at the heart of what we do: helping customers find their dream mattress and get better sleep. By joining our team, you'll get...Local areaMattress Firm
Daly City, CA2 days ago$50 - $60 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...D'Angelo , Larry Summers , and Jack Dorsey . Position: Expert Interviewer Type: Contract Compensation: $50–$60/hour...Contract workSummer workRemote workWeekday work- ...Remote Job Overview We are seeking experienced GPU Programmers / Software Engineers to design and optimize GPU-based tasks for AI and LLM applications. You will apply your expertise in GPU programming, performance optimization, and C++ development to build high-performance...Remote jobFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Linguist - AI Rater Guidelines Expert. Be the first to apply!
