User Research Expert - Evaluator - AI Trainer
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Work independently and asynchronously to meet deadlines and enhance AI model performance .
- Collaborate with subject matter experts to ensure consistency and quality across datasets.
Qualifications
Must-Have
- 5+ years of relevant professional experience in User/customer research and feedback synthesis .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercor$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... .... Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote work$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: Investment Banking Expert Type: Contract Compensation:... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...SuggestedContract workSummer workRemote work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Program management / implementation planning Evaluator Type: Contract Compensation:... .... Collaborate with subject matter experts to ensure consistency and quality. Work...SuggestedContract workSummer workWork at officeRemote work$150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Summers , and Jack Dorsey . Position: Equity Research Expert — Single-Name Analyst Publications Type: Contract Compensation...SuggestedContract workSummer workRemote work- ...hiring experienced Project Management Specialists to help evaluate and improve cutting‑edge AI systems. In this role, you'll evaluate AI-generated... ...budget, staffing, and procurement decisions and provide expert feedback. Required Qualifications 4+ years of experience...SuggestedHourly payImmediate start
- \ Mercor is recruiting on behalf of a leading AI research lab seeking experienced professionals to help evaluate how enterprise software vendors structure pricing, licensing... ...enterprise software categories.\ \ Contribute expert judgment on how large organisations evaluate,...Contract work
- Obsidian is building a high‑impact in‑house corporate development function in Dallas. You will own end‑to‑end M&A work, delivering analyses, models, and recommendations from mock or real scenarios to inform leadership decisions. You will build valuation and merger models...
- Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code) Mercor is partnering with leading AI labs on a new... ...scientific computing. You will author original, executable research problems that today's frontier models cannot solve. Domains...Part timeImmediate start
- ...building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces... ...and executing, QA and reconciliation, triage and escalation, research and evaluation, reporting, and orchestrating multi-step...
- ...negotiation, and pipeline-generation skills. Thrives in a fast-moving, high-autonomy startup environment. Nice to Have Experience selling AI/ML, data, or professional-services solutions. History as an early or founding AE building a territory from scratch. #J-18808-Ljbffr...
- ...Overview Mercor is seeking senior HR professionals to build evaluation tasks for AI systems operating in talent management, employee relations,... ...track (UK Employment Rights Act, EU labor directives). Experts qualified in either or both tracks are encouraged to apply....
$80 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...: Operations / Program Management Experts Type: Contract Compensation:... ...feedback to improve document standards and evaluation processes. Collaborate with teams to...Contract workSummer workRemote work- About the work We're building a high-quality library of in-house corporate development work products. You'll complete self-contained M&A exercises from mock files (CIMs, diligence reports, term sheets, board decks) and produce the deliverable for each, graded against a ...
- ...compassion. As a world-renowned medical and research center, we strive to provide the best... ...with clinicians and researchers to develop AI models using large-scale musculoskeletal datasets... ...expertise. Advises and assists users and other personnel in analyzing, defining...Full time
$18 per hour
...AI Trainer – Freelance Annotator (Portuguese) At Toloka, we connect smart, curious people... ...projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses... ...of English, both written and spoken User-friendly experience in data annotation (...Part timeFreelanceRemote work- ...Description Job Description Claude Code User Job Type: Contractor Location:... ...to support a project focused on advancing AI coding agents. You will share real-world experience... ...and ambiguous technical problems. Evaluate the strengths and limitations of AI coding...Remote jobFor contractors
- ...Job Description Job Description Codex User Job Type: Contractor Location: Remote... ...Job Overview We are seeking experienced AI Coding Agent Users to support a project... ...coding capabilities. You will document and evaluate how AI coding tools are used for complex software...Remote jobFor contractors
$217k - $303.9k
...conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics... ...and monitor safety experiences, and evaluate the impact of interventions designed to protect... ...summarized by artificial intelligence (AI). You will have the opportunity to opt out...For contractorsWork experience placementWork at officeRemote workFlexible hours$700 per unit
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workRemote work$70 - $110 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...hours/week Role Responsibilities Evaluate AI-generated project plans , status reports... ..., and procurement decisions. Provide expert feedback. Collaborate with AI...Hourly payContract workSummer workImmediate startRemote work$63 per hour
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workRemote work$60 - $100 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Jack Dorsey . Position: Marketing Expert — Social Media (AI Agent Environments)... ...wrong ones. Review AI agent attempts and evaluate them against established standards....Contract workSummer workRemote work$80 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... .... Position: Product / Platform Experts Type: Contract Compensation:... ...analytical skills to contribute to high-impact evaluation projects. Collaborate asynchronously...Contract workSummer workRemote work- ...looking for IT and Tech Leaders with director-level experience in IT, Technology, or IT Operations to join our Expert Network. Participants will complete research tasks and get paid up to $200 per hour for their expertise. Ideal candidates have hands-on experience with...Hourly pay
- UT Southwestern Medical Center in Dallas seeks a seasoned professional to support researchers by identifying funding opportunities, assisting with proposals, and managing contracts and awards. The role sits within the Department of Neurology, a leader in neurological care...
- YO AI Labs seeks established Physics Professors or Principal Investigators for a remote... ...role to provide high-level scientific evaluation for AI-focused projects. You will apply... ...authoritative assessments for senior researchers. The ideal candidate has a strong research...Remote jobFor contractors
$55 - $65 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...: Remote Role Responsibilities Evaluate AI-generated content in manufacturing... ...defensibility of AI-generated scores and provide expert judgment. Collaborate with AI...Contract workSummer workRemote workShift work$20.3 per hour
...What if your knowledge English language?could help improve the AI.? ?? WHAT YOU’LL DO ? Evaluate the aesthetic quality, readability, and overall polish of digital map designs. Assess user-focused elements like viewport framing, geospatial accuracy, and content...Hourly payContract workFreelanceImmediate startRemote work- ...Toxicology Forensic Expert You are a highly driven toxicologist with 5+ years of experience working with alcohol, prescription/illicit... ..., physiology, pathology, etc.). Postdoctoral training & research in toxicology is preferred. Certification: Board certification...Work experience placement
- Third Bridge is a global research firm seeking a commercially minded professional to support senior analysts and recruit industry experts for in-depth interviews. You will engage with executives to secure relevant experts for research projects and help translate insights...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to User Research Expert - Evaluator - AI Trainer. Be the first to apply!


