Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

User Research Expert - Evaluator

$80 - $120 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
  • Provide clear, structured written feedback to improve AI model outputs .
  • Work independently and asynchronously to meet deadlines and enhance AI model performance .
  • Collaborate with subject matter experts to ensure consistency and quality across datasets.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in User/customer research and feedback synthesis .
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace , especially Slides .

Preferred

  • Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the User Research Expert - Evaluator in New York, NY vacancy
  • $80 per hour

     ...technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . \n Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation...  ...Collaborate with subject matter experts to ensure consistency and quality... 
    Suggested
    Full time
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    3 days ago
  • $117.3k - $195.5k

     ...be visualized in easy to read and understand dashboards Lead “user research” with MCCDH Planning and Impact team to design dashboards...  ...compliance, issue management and business development opportunity evaluations. Technical: Anticipates Customer and Market Needs - Knows the... 
    Suggested
    Remote work
    Relocation package
    Flexible hours

    Pfizer Inc.

    New York, NY
    3 days ago
  • $207k - $300k

     ...taxonomy, and partnering with research to prioritize capabilities,...  ...false assumptions.Build Science evaluations by assessing industry...  ...vendor quality, and converting expert contributions into usable training...  ...innovation for billions of users. We use our technologies for... 
    Suggested

    Google

    New York, NY
    1 day ago
  • $80 - $120 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark...  ...and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    20 days ago
  • $80 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Dorsey . Position: UI / UX Design Expert Type: Contract Compensation:...  ...Work independently and asynchronously to evaluate and improve AI model performance .... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    9 days ago
  • $80 - $120 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark...  .... Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    7 days ago
  •  ...the Opportunity Our client, a leading AI research organization, is looking for experienced...  ...finance professionals to help evaluate and improve how AI systems analyze financial...  ...outputs. Provide structured feedback and expert insights to improve AI systems' quantitative... 
    Freelance
    Remote work

    Braintrust

    New York, NY
    1 day ago
  • $40 - $50 per hour

     ...A remote training organization is seeking a Sociology Expert to analyze humanities texts and synthesize themes across cultures. Offering a pay range of $40 to $50 per hour for a commitment of 10–40 hours per week. Candidates should possess a Bachelor's degree in a relevant... 
    Hourly pay
    Remote work
    10 hours per week

    Crossing Hurdles

    New York, NY
    3 days ago
  • NYU Langone Health invites applications for a Nurse Practitioner to join the Cardiac Stress Testing program at Levit Medical in Brooklyn. The NP will provide comprehensive nursing care, diagnosis, and prescriptive authority under a physician collaboration agreement, in ...

    NYU Langone

    New York, NY
    2 days ago
  •  ...Description Job Description: Godot Game Engine Expert Job Type: Contract Location: Remote...  ...gameplay mechanics, animations, and user interface elements. # Work with...  ...such as data annotation, RLHF, or AI model evaluation. # Experience with multiplayer games, game... 
    Remote job
    Contract work

    YO AI Labs

    New York, NY
    9 days ago
  •  ...Director, Expert Research SEDA Experts |United States| Full-time About SEDA Experts SEDA Experts provides expert witness consulting services for complex financial matters. Our experts are former senior executives from leading global banks, regulators and investment... 
    Full time
    Worldwide

    SEDA Experts

    New York, NY
    22 days ago
  • $100 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...Larry Summers , and Jack Dorsey . Position: ChatGPT Power User Type: Contract Compensation: $100 total Location:... 
    Hourly pay
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    12 days ago
  • $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...: Survey Research & Consumer Insights Expert Type: Contract Compensation:...  ...Role Responsibilities Review and evaluate surveys for methodological quality, clarity... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    8 days ago
  •  ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark...  ...: Flexible part-time hours Role Responsibilities Evaluate AI answers to orthopedic surgery questions for clinical... 
    Contract work
    Part time
    Summer work
    Immediate start
    Remote work
    Flexible hours

    Mercor

    New York, NY
    28 days ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation:...  ...~ Prior experience with AI training , evaluation, or human-data projects. Application... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    13 days ago
  • $100 - $120 per unit

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...: Baseball Fan – Live MLB Game AI Evaluator (US) Type: Contract Compensation...  ...schedules, broadcasts, highlights, and expert-style analysis. Run the same question... 
    Contract work
    Work experience placement
    Summer work
    Remote work

    Mercor

    New York, NY
    16 days ago
  • $15 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract...  ...hours/week Role Responsibilities Evaluate AI-generated music across various genres... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    a month ago
  • $30 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  .... Position: Hindi Linguistic Experts Type: Contract Compensation:...  ...: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    25 days ago
  • $39 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Dorsey . Position: Music Audio Expert - English (US) Type: Contract Compensation...  ...hours/week Role Responsibilities Evaluate AI model output for lyrics, voice... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    13 days ago
  • $14 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation...  ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    13 days ago
  • $50 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ..., and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation:... 
    Contract work
    Summer work
    10 hours per week

    Mercor

    New York, NY
    14 days ago
  • $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  .... Position: Investment Banking Expert Type: Contract Compensation:...  ...~ Prior experience with AI training , evaluation, or human-data projects. Application... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    11 days ago
  • CGS is seeking a FOIA Paralegal to join our Legal team in the United States. The role focuses on legal review and FOIA request processing, with opportunities to assist in litigation support tasks and other government- focused duties. Ideal candidates will have paralegal...

    CGS Federal

    New York, NY
    2 days ago
  •  ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark...  ...350/hour Location: Remote Role Responsibilities Evaluate AI answers to anesthesiology questions for clinical accuracy... 
    Contract work
    Summer work
    Immediate start
    Remote work
    Flexible hours

    Mercor

    New York, NY
    21 days ago
  •  ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark...  ...: Flexible part-time hours Role Responsibilities Evaluate AI answers to obstetrics and gynecology questions for... 
    Contract work
    Part time
    Summer work
    Immediate start
    Remote work
    Flexible hours

    Mercor

    New York, NY
    28 days ago
  • $80 - $120 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark...  ...Jack Dorsey . Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    4 days ago
  • $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation:...  ...hours/week Role Responsibilities Evaluate and compare AI-generated responses on... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    24 days ago
  • $70 - $110 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...hours/week Role Responsibilities Evaluate AI-generated sales strategies , quota...  ...complaint resolution. Provide expert feedback on sales-performance analysis to... 
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    27 days ago
  • $50 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  .... Position: English Linguistic Experts Type: Contract Compensation:...  ...: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    25 days ago
  • $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation:...  ...hours/week Role Responsibilities Evaluate and compare AI-generated responses to... 
    Contract work
    Summer work
    Immediate start
    Remote work
    Flexible hours

    Mercor

    New York, NY
    7 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to User Research Expert - Evaluator. Be the first to apply!