User Research Expert - Evaluator - AI Trainer
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Work independently and asynchronously to meet deadlines and enhance AI model performance .
- Collaborate with subject matter experts to ensure consistency and quality across datasets.
Qualifications
Must-Have
- 5+ years of relevant professional experience in User/customer research and feedback synthesis .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercor$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... .... Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote work$150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Summers , and Jack Dorsey . Position: Equity Research Expert — Single-Name Analyst Publications Type: Contract Compensation...SuggestedContract workSummer workRemote work$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: Investment Banking Expert Type: Contract Compensation:... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...SuggestedContract workSummer workRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... .... Position: Investor materials / fundraising / pitchbook Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote work- ...Job Description Job Description Codex User Job Type: Contractor Location: Remote... ...Job Overview We are seeking experienced AI Coding Agent Users to support a project... ...coding capabilities. You will document and evaluate how AI coding tools are used for complex software...SuggestedRemote jobFor contractors
- ...Description Job Description Claude Code User Job Type: Contractor Location:... ...to support a project focused on advancing AI coding agents. You will share real-world experience... ...and ambiguous technical problems. Evaluate the strengths and limitations of AI coding...Remote jobFor contractors
$80 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...: Operations / Program Management Experts Type: Contract Compensation:... ...feedback to improve document standards and evaluation processes. Collaborate with teams to...Contract workSummer workRemote work$63 per hour
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workRemote work$70 - $110 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...hours/week Role Responsibilities Evaluate AI-generated project plans , status reports... ..., and procurement decisions. Provide expert feedback. Collaborate with AI...Hourly payContract workSummer workImmediate startRemote work$55 - $65 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...: Remote Role Responsibilities Evaluate AI-generated content in manufacturing... ...defensibility of AI-generated scores and provide expert judgment. Collaborate with AI...Contract workSummer workRemote workShift work$80 - $160 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...strong analytical skills to contribute to high-impact evaluation projects. Work independently and follow structured guidelines...Contract workSummer workRemote work$50 - $70 per hour
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workImmediate startRemote work$18 per hour
...AI Trainer – Freelance Annotator (Portuguese) At Toloka, we connect smart, curious people... ...projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses... ...of English, both written and spoken User-friendly experience in data annotation (...Part timeFreelanceRemote work$217k - $303.9k
...conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics... ...and monitor safety experiences, and evaluate the impact of interventions designed to protect... ...summarized by artificial intelligence (AI). You will have the opportunity to opt out...For contractorsWork experience placementWork at officeRemote workFlexible hours$700 per unit
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workRemote work$60 - $100 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Jack Dorsey . Position: Marketing Expert — Social Media (AI Agent Environments)... ...wrong ones. Review AI agent attempts and evaluate them against established standards....Contract workSummer workRemote work- ...Toxicology Forensic Expert You are a highly driven toxicologist with 5+ years of experience working with alcohol, prescription/illicit... ..., physiology, pathology, etc.). Postdoctoral training & research in toxicology is preferred. Certification: Board certification...Work experience placement
$20.3 per hour
...What if your knowledge English language?could help improve the AI.? ?? WHAT YOU’LL DO ? Evaluate the aesthetic quality, readability, and overall polish of digital map designs. Assess user-focused elements like viewport framing, geospatial accuracy, and content...Hourly payContract workFreelanceImmediate startRemote work$70 - $80 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ..., Larry Summers , and Jack Dorsey . Position: HR Expert Type: Contract Compensation: $70–$80/hour Location...Contract workSummer workRemote work$60 - $65 per hour
...Type: Contractor Pay: $60–$65/hour Job Overview We are looking for an experienced Biostatistician to support clinical research projects by analyzing clinical trial data, validating statistical outputs, and ensuring compliance with regulatory standards. Key...Remote jobFor contractors$100 per hour
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workRemote work- ...Job Description You are already an expert. Robson Forensic will train you to be a... ...years or more in manufacturing and/or end-user product design. This role asks you to bring... ...into the stream of commerce and/or in the research/development of novel mechanical systems;...
$23 per hour
...We Do The Toloka Annotators connects individuals with Generative AI projects from leading tech innovators. Our mission is to unlock... ...take part in online projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses — when projects are...Part timeFreelanceRemote work- ...Job Description Design Expert Job Type: Contractor... ...senior Product Design and AI-Assisted Development Experts to create evaluation tasks for AI systems... ...systems, component libraries, research, and usability. No... ...Human-Centered Design User Research & Usability...Remote jobWeekly payContract workFor contractorsFlexible hours
- ...have an immediate need to add specialized experts to our physician panel to support Texas... ...Major Duties and Responsibilities Case Evaluation: On a contract basis as your individual... ...delivery. Streamlined Tech: Work through a user-friendly, secure case management portal....Extra incomeContract workImmediate start
$10k
Job Description Job Description We are looking for Stellantis Phase 3 Certified Technician , and we're ready to invest in your expertise from Day 1. ~$10,000 Sign-On Bonus: Fully certified Phase 3 Techs receive a $10k payout structured over your first 6 months...Price workFull timeRelocation packageShift work$55 per hour
Freelance AI Trainer – Civil Engineering & Python 4 days ago – Be among the first 25 applicants... ...with Python skills to train and evaluate AI models on realistic civil engineering... ...unlocking community knowledge in a new way. Experts add insights directly into each article,...Part timeFreelanceRemote workFlexible hours- ...seeking a skilled and Biomechanical Engineer Expert in DFW area to join our team for... ...country for objective, high-quality medical evaluations. Key Responsibilities: Thorough review... ...transcription services at no cost, and a user-friendly work portal If you are a...Extra incomeContract workFlexible hours
$15 per hour
...Description Job description: What if your knowledge Chinese (Traditional) language?could help improve the AI.? ?? WHAT YOU’LL DO ? Review, evaluate, and validate AI-generated content and data according to project guidelines. Compare AI-generated outputs...Hourly payFreelanceWork at officeRemote work$100k
...inquisitive experience in programming language Java and understanding of the software development life cycle knowledge of statistics, gen AI, LLM, Python, computer vision, data visualization tools excellent written and verbal communication skills. Preferred skills: NLP,...Full timeH1b
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to User Research Expert - Evaluator - AI Trainer. Be the first to apply!


