Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

User Research Expert - Evaluator - AI Trainer

$80 - $120 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
  • Provide clear, structured written feedback to improve AI model outputs .
  • Work independently and asynchronously to meet deadlines and enhance AI model performance .
  • Collaborate with subject matter experts to ensure consistency and quality across datasets.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in User/customer research and feedback synthesis .
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace , especially Slides .

Preferred

  • Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#hiringmercor
Vacancy posted 13 days ago
Similar jobs that could be interesting for youBased on the User Research Expert - Evaluator - AI Trainer in Dallas, TX vacancy
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  .... Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Dallas, TX
    11 days ago
  • $150 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...Summers , and Jack Dorsey . Position: Equity Research Expert — Single-Name Analyst Publications Type: Contract Compensation... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    Dallas, TX
    16 days ago
  • $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Dorsey . Position: Investment Banking Expert Type: Contract Compensation:...  ...~ Prior experience with AI training , evaluation, or human-data projects. Application... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    Dallas, TX
    22 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  .... Position: Investor materials / fundraising / pitchbook Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Dallas, TX
    13 days ago
  •  ...Job Description Job Description Codex User Job Type: Contractor Location: Remote...  ...Job Overview We are seeking experienced AI Coding Agent Users to support a project...  ...coding capabilities. You will document and evaluate how AI coding tools are used for complex software... 
    Suggested
    Remote job
    For contractors

    YO AI Labs

    Dallas, TX
    11 days ago
  •  ...Description Job Description Claude Code User Job Type: Contractor Location:...  ...to support a project focused on advancing AI coding agents. You will share real-world experience...  ...and ambiguous technical problems. Evaluate the strengths and limitations of AI coding... 
    Remote job
    For contractors

    YO AI Labs

    Dallas, TX
    11 days ago
  • $80 - $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...: Operations / Program Management Experts Type: Contract Compensation:...  ...feedback to improve document standards and evaluation processes. Collaborate with teams to... 
    Contract work
    Summer work
    Remote work

    Mercor

    Dallas, TX
    3 days ago
  • $63 per hour

     ...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers... 
    Contract work
    Summer work
    Remote work

    Mercor

    Dallas, TX
    15 days ago
  • $70 - $110 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...hours/week Role Responsibilities Evaluate AI-generated project plans , status reports...  ..., and procurement decisions. Provide expert feedback. Collaborate with AI... 
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    Dallas, TX
    4 days ago
  • $55 - $65 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...: Remote Role Responsibilities Evaluate AI-generated content in manufacturing...  ...defensibility of AI-generated scores and provide expert judgment. Collaborate with AI... 
    Contract work
    Summer work
    Remote work
    Shift work

    Mercor

    Dallas, TX
    16 days ago
  • $80 - $160 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...strong analytical skills to contribute to high-impact evaluation projects. Work independently and follow structured guidelines... 
    Contract work
    Summer work
    Remote work

    Mercor

    Dallas, TX
    3 days ago
  • $50 - $70 per hour

     ...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    Dallas, TX
    21 days ago
  • $18 per hour

     ...AI Trainer – Freelance Annotator (Portuguese) At Toloka, we connect smart, curious people...  ...projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses...  ...of English, both written and spoken User-friendly experience in data annotation (... 
    Part time
    Freelance
    Remote work

    Toloka Annotators

    Dallas, TX
    4 days ago
  • $217k - $303.9k

     ...conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics...  ...and monitor safety experiences, and evaluate the impact of interventions designed to protect...  ...summarized by artificial intelligence (AI). You will have the opportunity to opt out... 
    For contractors
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    GrabJobs

    Mesquite, TX
    3 days ago
  • $700 per unit

     ...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers... 
    Contract work
    Summer work
    Remote work

    Mercor

    Dallas, TX
    26 days ago
  • $60 - $100 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Jack Dorsey . Position: Marketing Expert — Social Media (AI Agent Environments)...  ...wrong ones. Review AI agent attempts and evaluate them against established standards.... 
    Contract work
    Summer work
    Remote work

    Mercor

    Dallas, TX
    6 days ago
  •  ...Toxicology Forensic Expert You are a highly driven toxicologist with 5+ years of experience working with alcohol, prescription/illicit...  ..., physiology, pathology, etc.). Postdoctoral training & research in toxicology is preferred. Certification: Board certification... 
    Work experience placement

    Robson Forensic

    Irving, TX
    1 day ago
  • $20.3 per hour

     ...What if your knowledge English language?could help improve the AI.?  ??  WHAT YOU’LL DO ?  Evaluate the aesthetic quality, readability, and overall polish of digital map designs. Assess user-focused elements like viewport framing, geospatial accuracy, and content... 
    Hourly pay
    Contract work
    Freelance
    Immediate start
    Remote work

    Welo Data

    Dallas, TX
    22 days ago
  • $70 - $80 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ..., Larry Summers , and Jack Dorsey . Position: HR Expert Type: Contract Compensation: $70–$80/hour Location... 
    Contract work
    Summer work
    Remote work

    Mercor

    Dallas, TX
    19 days ago
  • $60 - $65 per hour

     ...Type: Contractor Pay: $60–$65/hour Job Overview We are looking for an experienced Biostatistician to support clinical research projects by analyzing clinical trial data, validating statistical outputs, and ensuring compliance with regulatory standards. Key... 
    Remote job
    For contractors

    YO AI Labs

    Dallas, TX
    21 days ago
  • $100 per hour

     ...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers... 
    Contract work
    Summer work
    Remote work

    Mercor

    Dallas, TX
    19 days ago
  •  ...Job Description You are already an expert. Robson Forensic will train you to be a...  ...years or more in   manufacturing and/or end-user product design. This role asks you to bring...  ...into the stream of commerce and/or in the research/development of novel mechanical systems;... 

    Robson Forensic

    Irving, TX
    13 days ago
  • $23 per hour

     ...We Do The Toloka Annotators connects individuals with Generative AI projects from leading tech innovators. Our mission is to unlock...  ...take part in online projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses — when projects are... 
    Part time
    Freelance
    Remote work

    Toloka Annotators

    Dallas, TX
    4 days ago
  •  ...Job Description Design Expert Job Type: Contractor...  ...senior Product Design and AI-Assisted Development Experts to create evaluation tasks for AI systems...  ...systems, component libraries, research, and usability. No...  ...Human-Centered Design User Research & Usability... 
    Remote job
    Weekly pay
    Contract work
    For contractors
    Flexible hours

    YO AI Labs

    Dallas, TX
    3 days ago
  •  ...have an immediate need to add specialized experts to our physician panel to support Texas...  ...Major Duties and Responsibilities Case Evaluation: On a contract basis as your individual...  ...delivery. Streamlined Tech: Work through a user-friendly, secure case management portal.... 
    Extra income
    Contract work
    Immediate start

    Dane Street

    Dallas, TX
    3 days ago
  • $10k

    Job Description Job Description   We are looking for Stellantis Phase 3 Certified Technician , and we're ready to invest in your expertise from Day 1. ~$10,000 Sign-On Bonus: Fully certified Phase 3 Techs receive a $10k payout structured over your first 6 months...
    Price work
    Full time
    Relocation package
    Shift work

    Carvana

    Farmers Branch, TX
    15 days ago
  • $55 per hour

    Freelance AI Trainer – Civil Engineering & Python 4 days ago – Be among the first 25 applicants...  ...with Python skills to train and evaluate AI models on realistic civil engineering...  ...unlocking community knowledge in a new way. Experts add insights directly into each article,... 
    Part time
    Freelance
    Remote work
    Flexible hours

    Mind Rift

    Dallas, TX
    4 days ago
  •  ...seeking a skilled and Biomechanical Engineer Expert in DFW area to join our team for...  ...country for objective, high-quality medical evaluations. Key Responsibilities: Thorough review...  ...transcription services at no cost, and a user-friendly work portal If you are a... 
    Extra income
    Contract work
    Flexible hours

    Dane Street, LLC

    Dallas, TX
    12 days ago
  • $15 per hour

     ...Description Job description: What if your knowledge Chinese (Traditional) language?could help improve the AI.?  ??  WHAT YOU’LL DO ?  Review, evaluate, and validate AI-generated content and data according to project guidelines. Compare AI-generated outputs... 
    Hourly pay
    Freelance
    Work at office
    Remote work

    Welo Data

    Dallas, TX
    22 days ago
  • $100k

     ...inquisitive experience in programming language Java and understanding of the software development life cycle knowledge of statistics, gen AI, LLM, Python, computer vision, data visualization tools excellent written and verbal communication skills. Preferred skills: NLP,... 
    Full time
    H1b

    SynergisticIT

    Mesquite, TX
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to User Research Expert - Evaluator - AI Trainer. Be the first to apply!