Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

User Research Expert - Evaluator - AI Trainer

$80 - $120 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
  • Provide clear, structured written feedback to improve AI model outputs .
  • Work independently and asynchronously to meet deadlines and enhance AI model performance .
  • Collaborate with subject matter experts to ensure consistency and quality across datasets.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in User/customer research and feedback synthesis .
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace , especially Slides .

Preferred

  • Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#hiringmercor
Vacancy posted 14 days ago
Similar jobs that could be interesting for youBased on the User Research Expert - Evaluator - AI Trainer in Dallas, TX vacancy
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  .... Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Dallas, TX
    12 days ago
  • $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Dorsey . Position: Investment Banking Expert Type: Contract Compensation:...  ...~ Prior experience with AI training , evaluation, or human-data projects. Application... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    Dallas, TX
    23 days ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Program management / implementation planning Evaluator Type: Contract Compensation:...  .... Collaborate with subject matter experts to ensure consistency and quality. Work... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Dallas, TX
    17 days ago
  • $150 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...Summers , and Jack Dorsey . Position: Equity Research Expert — Single-Name Analyst Publications Type: Contract Compensation... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    Dallas, TX
    17 days ago
  •  ...hiring experienced Project Management Specialists to help evaluate and improve cutting‑edge AI systems. In this role, you'll evaluate AI-generated...  ...budget, staffing, and procurement decisions and provide expert feedback. Required Qualifications 4+ years of experience... 
    Suggested
    Hourly pay
    Immediate start

    Mercor

    Dallas, TX
    3 days ago
  • \ Mercor is recruiting on behalf of a leading AI research lab seeking experienced professionals to help evaluate how enterprise software vendors structure pricing, licensing...  ...enterprise software categories.\ \ Contribute expert judgment on how large organisations evaluate,... 
    Contract work

    Obsidian

    Dallas, TX
    6 days ago
  • Obsidian is building a high‑impact in‑house corporate development function in Dallas. You will own end‑to‑end M&A work, delivering analyses, models, and recommendations from mock or real scenarios to inform leadership decisions. You will build valuation and merger models...

    Obsidian

    Dallas, TX
    2 days ago
  • Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code) Mercor is partnering with leading AI labs on a new...  ...scientific computing. You will author original, executable research problems that today's frontier models cannot solve. Domains... 
    Part time
    Immediate start

    Mercor

    Dallas, TX
    6 days ago
  •  ...building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces...  ...and executing, QA and reconciliation, triage and escalation, research and evaluation, reporting, and orchestrating multi-step... 

    Mercor Inc

    Dallas, TX
    4 days ago
  •  ...negotiation, and pipeline-generation skills. Thrives in a fast-moving, high-autonomy startup environment. Nice to Have Experience selling AI/ML, data, or professional-services solutions. History as an early or founding AE building a territory from scratch. #J-18808-Ljbffr... 

    Mercor

    Dallas, TX
    2 days ago
  •  ...Overview Mercor is seeking senior HR professionals to build evaluation tasks for AI systems operating in talent management, employee relations,...  ...track (UK Employment Rights Act, EU labor directives). Experts qualified in either or both tracks are encouraged to apply.... 

    Obsidian

    Dallas, TX
    3 days ago
  • $80 - $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...: Operations / Program Management Experts Type: Contract Compensation:...  ...feedback to improve document standards and evaluation processes. Collaborate with teams to... 
    Contract work
    Summer work
    Remote work

    Mercor

    Dallas, TX
    4 days ago
  • About the work We're building a high-quality library of in-house corporate development work products. You'll complete self-contained M&A exercises from mock files (CIMs, diligence reports, term sheets, board decks) and produce the deliverable for each, graded against a ...

    Obsidian

    Dallas, TX
    3 days ago
  •  ...compassion. As a world-renowned medical and research center, we strive to provide the best...  ...with clinicians and researchers to develop AI models using large-scale musculoskeletal datasets...  ...expertise. Advises and assists users and other personnel in analyzing, defining... 
    Full time

    University of Texas Southwestern Medical Center

    Dallas, TX
    6 days ago
  • $18 per hour

     ...AI Trainer – Freelance Annotator (Portuguese) At Toloka, we connect smart, curious people...  ...projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses...  ...of English, both written and spoken User-friendly experience in data annotation (... 
    Part time
    Freelance
    Remote work

    Toloka Annotators

    Dallas, TX
    5 days ago
  •  ...Description Job Description Claude Code User Job Type: Contractor Location:...  ...to support a project focused on advancing AI coding agents. You will share real-world experience...  ...and ambiguous technical problems. Evaluate the strengths and limitations of AI coding... 
    Remote job
    For contractors

    YO AI Labs

    Dallas, TX
    13 days ago
  •  ...Job Description Job Description Codex User Job Type: Contractor Location: Remote...  ...Job Overview We are seeking experienced AI Coding Agent Users to support a project...  ...coding capabilities. You will document and evaluate how AI coding tools are used for complex software... 
    Remote job
    For contractors

    YO AI Labs

    Dallas, TX
    13 days ago
  • $217k - $303.9k

     ...conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics...  ...and monitor safety experiences, and evaluate the impact of interventions designed to protect...  ...summarized by artificial intelligence (AI). You will have the opportunity to opt out... 
    For contractors
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    GrabJobs

    Irving, TX
    4 days ago
  • $700 per unit

     ...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers... 
    Contract work
    Summer work
    Remote work

    Mercor

    Dallas, TX
    27 days ago
  • $70 - $110 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...hours/week Role Responsibilities Evaluate AI-generated project plans , status reports...  ..., and procurement decisions. Provide expert feedback. Collaborate with AI... 
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    Dallas, TX
    5 days ago
  • $63 per hour

     ...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers... 
    Contract work
    Summer work
    Remote work

    Mercor

    Dallas, TX
    16 days ago
  • $60 - $100 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Jack Dorsey . Position: Marketing Expert — Social Media (AI Agent Environments)...  ...wrong ones. Review AI agent attempts and evaluate them against established standards.... 
    Contract work
    Summer work
    Remote work

    Mercor

    Dallas, TX
    7 days ago
  • $80 - $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  .... Position: Product / Platform Experts Type: Contract Compensation:...  ...analytical skills to contribute to high-impact evaluation projects. Collaborate asynchronously... 
    Contract work
    Summer work
    Remote work

    Mercor

    Dallas, TX
    4 days ago
  •  ...looking for IT and Tech Leaders with director-level experience in IT, Technology, or IT Operations to join our Expert Network. Participants will complete research tasks and get paid up to $200 per hour for their expertise. Ideal candidates have hands-on experience with... 
    Hourly pay

    Prolific

    Dallas, TX
    2 days ago
  • UT Southwestern Medical Center in Dallas seeks a seasoned professional to support researchers by identifying funding opportunities, assisting with proposals, and managing contracts and awards. The role sits within the Department of Neurology, a leader in neurological care... 

    UT Southwestern Medical Center

    Dallas, TX
    2 days ago
  • YO AI Labs seeks established Physics Professors or Principal Investigators for a remote...  ...role to provide high-level scientific evaluation for AI-focused projects. You will apply...  ...authoritative assessments for senior researchers. The ideal candidate has a strong research... 
    Remote job
    For contractors

    YO AI Labs

    Dallas, TX
    5 days ago
  • $55 - $65 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...: Remote Role Responsibilities Evaluate AI-generated content in manufacturing...  ...defensibility of AI-generated scores and provide expert judgment. Collaborate with AI... 
    Contract work
    Summer work
    Remote work
    Shift work

    Mercor

    Dallas, TX
    17 days ago
  • $20.3 per hour

     ...What if your knowledge English language?could help improve the AI.?  ??  WHAT YOU’LL DO ?  Evaluate the aesthetic quality, readability, and overall polish of digital map designs. Assess user-focused elements like viewport framing, geospatial accuracy, and content... 
    Hourly pay
    Contract work
    Freelance
    Immediate start
    Remote work

    Welo Data

    Dallas, TX
    23 days ago
  •  ...Toxicology Forensic Expert You are a highly driven toxicologist with 5+ years of experience working with alcohol, prescription/illicit...  ..., physiology, pathology, etc.). Postdoctoral training & research in toxicology is preferred. Certification: Board certification... 
    Work experience placement

    Robson Forensic

    Irving, TX
    2 days ago
  • Third Bridge is a global research firm seeking a commercially minded professional to support senior analysts and recruit industry experts for in-depth interviews. You will engage with executives to secure relevant experts for research projects and help translate insights... 

    Third Bridge

    Dallas, TX
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to User Research Expert - Evaluator - AI Trainer. Be the first to apply!