Linguist - Rater Guidelines Specialist
$45 - $65 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: AI Rater Guidelines Writer (Linguist / Instructional Designer)
Type: Contract
Compensation: $45–$65/hour
Location: Remote
Role Responsibilities
- Guide research and program teams to close the gap between ambiguous program requirements and rater-ready instructions across various domains.
- Design clear, non-contradictory rating guidelines and rubrics for consistent application by raters, including in edge cases.
- Evaluate draft guidelines for ambiguity, contradictions, and coverage gaps, revising until raters can apply them without escalation.
- Translate program specifications from domains such as finance, retail, insurance, legal, and sports into precise rater instructions.
- Collaborate with subject matter experts and program leads to ensure consistency and accuracy across guideline sets.
Qualifications
Must-Have
- 3+ years of professional experience in linguistics, instructional design, technical writing, or a related field.
- Experience writing or refining guidelines/rubrics for human raters in a GenAI/RLHF context.
- Ability to work across multiple domains (e.g., finance, retail, insurance, legal, sports) and translate domain-specific nuances.
- Strong track record of resolving ambiguity and contradiction in written specifications.
- Ability to engage reliably for at least 35 hours/week during weekdays.
- Strong written communication skills for explaining complex guidance clearly.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 15 days ago
Similar jobs that could be interesting for youBased on the Linguist - Rater Guidelines Specialist in San Francisco, CA vacancy
$45 - $65 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Rater Guidelines Writer (Linguist / Instructional Designer) Type: Contract Compensation: $45–$65/hour Location: Remote Role...SuggestedContract workSummer workRemote workWeekday work- ...& Partner Collaboration: Coordinate with vendor and outsourcing partners executing at scale, keeping quality high through clear guidelines and feedback loops. Cross-Functional Partnership: Work closely with Engineering and Research teams to align on top-priority data...SuggestedWork at officeRemote workFlexible hours
Twelve-Labs
San Francisco, CA5 days ago $15 per hour
# Italian Translator / Linguist (Contract)Wikimedia FoundationDigital Rights & Internet FreedomEducation Access & Learning EquityCommunications & MarketingLocationRemoteWork ModeRemoteFound9 hours agoExperienceMid-Level---For the full description, pleasevisit the official...SuggestedContract workRemote workSocial Impact Guide
San Francisco, CA2 days ago- POSITION SUMMARY: The Safety Specialist supports the the People Operations, Security, Emergency and facilities teams to facilitate compliance with federal and state regulatory requirements and guidelines related to workplace safety. The Safety Specialist plays a key role...SuggestedLocal area
$94.6k - $181.4k
...The OpportunityAdobe is seeking a hardworking and upbeat Legal Specialist to provide legal support for Adobe Legal’s Antitrust team.... ...email ****@*****.*** or call (***) ***-****. AI Use Guidelines for Interviews:Our interviews are designed to reflect your own...SuggestedFull timeTemporary workLocal areaWorldwide$136k - $196k
...effectively resolve issues.Develop and launch scalable policies and guidelines for handling large volumes of requests, based on different... ..., spam and account hijacking. A team of Analysts, Policy Specialists, Engineers, and Program Managers, we work to reduce risk and...- ...profitable manner and according to authority level and established guidelines, and drive projects having an impact on the business. Assigned... ....The national average salary range for the Underwriting Specialist position is $104,480k - $143,660k with a 25% bonus potential.Who...Full timeWork at officeLocal areaWork from homeFlexible hours
$1,000 - $2,000 per month
...Recovery Engagement Specialist (PT, 11p-7a) Why join Connections If you’re passionate about making a meaningful impact, working in a mission... ...throughout the sobering process, ensuring adherence to guidelines and general well‑being. Respond promptly to participant needs...Full timeTemporary workPart timeWork experience placementLocal areaImmediate startFlexible hoursConnections Health Solutions
San Francisco, CA3 days ago- ...young people. HART is composed of a team of three Intervention Specialists (Case Managers/Advocates), a therapist, Program Manager, and... ...with each assigned client, in accordance with program guidelines.Advocate and support for the youth when interfacing with the...Hourly payWork at officeTrial periodShift workAfternoon shift
Huckleberry Youth Programs
San Francisco, CA4 days ago - ...Information Specialist (INFOSPC)On Lok 30th Street Senior Center is San Francisco's largest multipurpose senior center with eight programs... ...work and follow Aging and Disability Resource Center grant guidelines.Establish contacts and maintain good working relationships with...
On Lok
San Francisco, CA3 days ago $132.26k - $155.6k
...requirements of FINRA, NMLS registration, Reg Z, Reg G, OFAC, the NFA, the FCPA, the Bank Secrecy Act, the SAFE Act, and/or federal guidelines applicable to an agreement, such as those related to ethics, safety, or operational procedures.Applicants must be able to comply...Work experience placementBank staffWork at officeLocal area3 days per weekU.S. Bank
San Francisco, CA1 day ago- Key QualificationsKnowledge of machine learning fundamentals such as feature extraction, learning algorithms, training and evaluation. Experience with NLP a plus (parsing, word-embeddings, entity linking, etc.) You can execute experiments that accurately measure the quality...
- A federal contractor in San Francisco is seeking Spanish Linguists to provide operational support for translation and transcription duties related to federal law enforcement investigations. Responsibilities include live monitoring, summarizing communications, and assisting...For contractorsFlexible hoursNight shift
- Overview SOSi is seeking Spanish Linguists in San Francisco, California to support our federal law enforcement customer. The Spanish Analytic Linguist will provide operational support to support linguist and translator duties as assigned by the PMO. The role will involve...Permanent employmentFor contractorsWork at officeImmediate startFlexible hoursShift workNight shiftDay shift
- We are looking for a Computational Linguist to help develop, maintain and refine instructions and labeled data for our language processing models, through automated and manual methods. At Infinitus, we encourage engineers to take ownership over technical and product decisions...
- Infinitus Systems, Inc. is seeking a Computational Linguist to improve and maintain language processing models. You will be instrumental in analyzing conversational data and defining data labels, while collaborating closely with various stakeholders. With a focus on AI...
$22.67 - $32.01 per hour
...Overview The Case Specialist I works as part of the Rally Family Visitation team providing direct services to families referred through... ...assigned. Document all client interactions according to program guidelines. Compile, write, and edit assigned visitation reports in...Hourly payDaily paidWork experience placementWorldwideAfternoon shiftWeekday workUniversity of California , San Francisco
San Francisco, CA2 days ago$55 - $120 per hour
Legal Interpreters - San Francisco, CA JTG is actively seeking freelance Legal Interpreters fluent in English and one of the following languages: Amharic, Arabic, Azeri, Bahasa, Chinese, French, German, Hindi, Indonesian, Korean, Mandarin, Norwegian, Spanish, Wolof....Hourly payFor contractorsFreelanceJTG
San Francisco, CA2 days ago$18 - $20 per hour
...experience as a great place to live, work and be. The Role The Leasing Specialist is responsible for leasing, marketing, and maintaining... .... Adherence to Property Management Rules, Regulations and Guidelines Conduct all business in accordance with company policies and procedures...Immediate startFlexible hoursAfternoon shiftBrightHaven
San Francisco, CA4 days ago$32.26 - $43.07 per hour
...success. Overview The Technical Services Building Systems Specialist II (BSS II) is skilled member of the Technical Services (TS)... ...duties in accordance with ENFRA policies, procedures, safety guidelines. • Documentation, collaboration, and communication regarding...Full timeWork at officeRemote workENFRA
San Francisco, CA5 days ago$55k - $67.5k
...Housing Specialist Established in 1973, Young Community Developers (YCD) is a nonprofit organization who serves residents of all ages... ...: Attendance- Reporting to work regularly within timekeeping guidelines. Planning and notifying for most absences. Arrives and departs...Full timeWork at officeAfternoon shiftYoung Community Developers
San Francisco, CA4 days ago$24 - $25 per hour
...Job Title: Housing Specialist Location: San Francisco, California Type: Contract To Hire Compensation: $24-$25/Hour Contractor... ...and community partners regarding housing policies and program guidelines. Review documentation to verify income, household...Full timeContract workFor contractorsInterim roleWork at officeLocal areaSystem One
San Francisco, CA4 days ago$78.3k - $201.7k
Pownall Lab - Associate/Full Specialist Biochemistry and Biophysics UC San FranciscoThe Pownall Lab at UCSF is seeking a full or associate specialist interested in understanding the molecular mechanisms controlling chromatin structure and function in developing zebrafish...- ...Office Specialist This job classification is the senior, most experienced level in... ...independent judgment within established guidelines. Operate standard office equipment,... ...multitude of culturally, ethnically, and linguistically diverse communities. The County of San...Work at officeImmediate start
GovernmentJobs.com
Daly City, CA2 days ago $72.11k - $141.69k
...Education Specialist (Credential Sponsorship Program) Intern We are now accepting applications for the 26-27 School Year in Aspire'... ...mobility needs, etc. Utilizes Aspire's Alternate Curriculum guidelines to inform student programming Daily oversight of paraprofessional...InternshipLocal areaRemote workAspire Public Schools
San Francisco, CA3 days ago$75.6k
...of California's Tuberculosis (TB) Control Branch, the Program Specialist (PS) applies high-level professional skills and subject matter... .../ project staff. Leads development of recommendations and guidelines and designs new systems for programs and initiatives. Participates...Temporary workWork experience placementWork at officeLocal areaRemote workWorldwide1 day per weekUniversity of California , San Francisco
San Francisco, CA4 days ago- ...transportation to visit allocated stores.Ability to work in pet stores, veterinary offices and pet grooming offices or related environments that have dogs, cats, and other animals in close proximity.All your information will be kept confidential according to EEO guidelines....Weekly payPermanent employmentPart timeLocal areaWeekend work
CROSSMARK
Daly City, CA4 days ago $105.61k - $128.36k
...Test Work Hours: Regular Job Code and Title: 2916-Social Work Specialist Fill Type: Permanent Civil Service Eligible List Type: Combined... ...home visits to referred families, according to established guidelines. Participate in regular case consultations to discuss client...Extra incomePermanent employmentFull timeTemporary workWork experience placementLocal area$156k
...Office of Cybersecurity, the Disaster Recovery and Resilience Specialist plays a key role in preparing and executing the Technology Disaster... ...your information will be kept confidential according to EEO guidelines. The Office of the City Administrator is committed to...Work experience placementWork at office- ...VASPs with non-face-to-face customers. Strong knowledge of the AML regulation (e.g. the AML Directives, the FM-GwG, the ESAs AML/CFT Guidelines); Knowledge of the cryptocurrencies field, with proven experience in digital assets compliance and experience working with at...InternshipRemote workWorldwideShift workDay shiftEarly shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Linguist - Rater Guidelines Specialist. Be the first to apply!
Related searches
- linguistic researcher San Francisco, CA
- computational linguist San Francisco, CA
- linguist San Francisco, CA
- appraiser San Francisco, CA
- rater San Francisco, CA
- cost specialist San Francisco, CA
- strategic sourcing specialist San Francisco, CA
- absence management specialist San Francisco, CA
- authorization specialist San Francisco, CA
- treasury specialist San Francisco, CA