User Research Expert - Evaluator
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to enhance AI work products.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines and improve AI model performance .
Qualifications
Must-Have
- 5+ years of relevant professional experience in User/customer research and feedback synthesis .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the User Research Expert - Evaluator in San Francisco, CA vacancy
- ...connect them with exceptional professionals for this role. Mercor is seeking a Hindi Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research lab. In this role, you will work on transcription, annotation, and...SuggestedTemporary workPart time10 hours per week
Mercor
San Francisco, CA9 days ago $50 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...and Jack Dorsey. Position Spanish (Spain) Audio Generalist Evaluator Expert Type Contract Compensation $50/hour Location Remote...SuggestedContract workSummer workRemote work- Mercor is looking for a Humanities / arts / culture Evaluator who will evaluate AI-generated artifacts against specific quality rubrics. You will identify errors and provide feedback to enhance AI model outputs. The ideal candidate has over 5 years of experience in the...SuggestedRemote jobWork at officeFlexible hours
- Obsidian is seeking expert Evaluators in FP&A / corporate finance to assess AI-generated work products for accuracy and quality. This role entails deep expertise to grade outputs and provide structured feedback. Candidates should have at least 5 years of relevant experience...SuggestedRemote jobHourly payWork at office
- Obsidian is seeking expert Evaluators in Biology/environmental science to review and assess AI-generated work products for accuracy and quality. In this remote, hourly role, you will leverage your expertise to provide feedback on documents and presentations, ensuring they...SuggestedRemote jobHourly pay
$80 - $120 per hour
Mercor, based in San Francisco, is looking for an Incident management / reliability / SRE Evaluator. The role involves evaluating AI-generated artifacts and providing structured feedback. Applicants should have 5+ years of experience in the areas of incident management,...Remote jobHourly payContract workWork at office$20 - $26 per hour
Prolific is seeking fluent Thai speakers to join their project as evaluators. You will assess AI-generated audio for naturalness and authenticity, requiring a strong command of Thai and English skills. The position offers competitive pay ranging from $20 to $26 per hour...Remote jobHourly payFlexible hours- Mercor is seeking a Compliance / Regulatory Response Evaluator specializing in financial-services AI. The role involves evaluating AI-generated outputs and providing structured feedback. Candidates should have over 5 years of experience in this field, fluency in English...Remote jobContract workWork at office
- Mercor is seeking a Training / onboarding / L&D Evaluator to enhance AI evaluation processes. Based in San Francisco, you'll evaluate AI... ...generated artifacts, provide structured feedback, and work with experts to ensure quality. The role requires 5+ years of relevant...Remote jobWork at officeFlexible hours
$80 - $120 per hour
...Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain‑specific quality rubrics. Identify factual, aesthetic, and presentation errors in documents...Contract workWork at officeRemote workMercor Inc
San Francisco, CA2 days ago- Obsidian is seeking a Spanish Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project. You will handle transcription, annotation, and evaluation tasks to help train and benchmark advanced language models. The ideal candidate should have...Part time10 hours per week
- A leading AI research lab is looking for a Bilingual Korean STEM Expert to design and evaluate complex STEM reasoning tasks used for AI training. This fully remote independent contractor role requires a bachelor's degree in a STEM field, along with native-level Korean fluency...For contractorsRemote workFlexible hours
24-MAG
San Francisco, CA14 hours ago $80 - $140 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...Summers , and Jack Dorsey . Position: Research Physics Expert Type: Contract Compensation: $80–$140/hour...Contract workSummer workRemote workMercor
San Francisco, CA12 days ago$55 - $80 per hour
Mercor, headquartered in San Francisco, is seeking STEM PhDs and Technical Domain Experts for a contract role. This remote position requires candidates to contribute to cutting-edge AI projects by providing expert knowledge and creating high-quality data. Successful applicants...Remote jobHourly payContract work- TryApplyNow is hiring a mid-level Remote Chemistry Expert (PhD) to work on cutting-edge projects focusing on AI applications in Chemistry. This fully remote contractor role requires strong analytical skills and the ability to simplify complex concepts effectively. Candidates...Remote jobFor contractors
- Obsidian is collaborating with a leading AI research group to engage experts with advanced training in physics. The role involves solving complex physics problems and reviewing AI-generated proofs. Ideal candidates should hold a PhD in Physics from a top program and possess...
$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ..., and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ..., and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote work$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote work- ...IT and Tech Leaders with director-level experience to join our Expert Network. With a focus on IT Service Management and Operations,... ...earning up to $200 per hour. Responsibilities include answering research questions, scenario assessments, and providing feedback on ITSM...Remote jobHourly payFlexible hours
$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ..., and Jack Dorsey . Position: Cybersecurity / IT GRC Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote work$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote work- ...Leaders with hands-on experience in ITSM or ESM platforms to join as subject-matter experts. Successful candidates will share their expertise and get paid up to $200 per hour for various research tasks. This includes answering research questions and providing feedback on...Hourly pay
$85k - $100k
A heritage outdoor equipment company based in San Francisco is seeking an IT Support Technician. The role includes providing Tier 1-2 technical support, diagnosing hardware and software issues, and enhancing tech operations across various teams. The ideal candidate should...Work at office- Structure Therapeutics in South San Francisco is looking for a Manager, End User Services to lead the global IT Service Desk and End User Computing function. The role involves managing service desk operations, endpoint management, and supporting team performance. The ideal...
- ...experiences that deliver more value. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess... ...and input, with the potential for reimbursement on purchases A user-friendly platform for managing missions and feedback How to...Contract workWorldwideFlexible hours
$80 - $120 per hour
Mercor is seeking a User/customer research and feedback synthesis Evaluator based in San Francisco, California, to evaluate AI-generated artifacts and provide structured feedback. The ideal candidate will have over 5 years of relevant experience and a high proficiency in...Remote jobHourly payContract workWork at office- ...experienced Title Examiner to join their team in Texas. The role requires a minimum of 5 years in title examination and entails researching real estate documents and making insurability decisions. Ideal candidates should have excellent communication skills and attention...
- ...work on issues submitted by end users of Maps or test the location... ...The Mapping City/Country Expert will be responsible for high-... ...areas. Conduct in-city field research to determine the ground truth... ...errors at scale. Evaluate import data from the Import Engineering...Local area
TSMG
San Francisco, CA1 day ago - ...its customers, employees, and communities. The Role As a Product Expert, you will be the ultimate bridge between our software... ...subject matter expert and voice of the product at industry events, user groups, and webinars. Create compelling educational content, release...Work at officeWork from home
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to User Research Expert - Evaluator. Be the first to apply!
Related searches
- fulfillment expert San Francisco, CA
- subject matter expert San Francisco, CA
- technology expert San Francisco, CA
- guest service support expert San Francisco, CA
- evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- quality evaluator San Francisco, CA
- student research intern San Francisco, CA
- research writer San Francisco, CA
- history research San Francisco, CA