User Research Expert - Evaluator
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Work independently and asynchronously to meet deadlines and enhance AI model performance .
- Collaborate with subject matter experts to ensure consistency and quality across datasets.
Qualifications
Must-Have
- 5+ years of relevant professional experience in User/customer research and feedback synthesis .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 24 days ago
Similar jobs that could be interesting for youBased on the User Research Expert - Evaluator in New York, NY vacancy
$80 - $120 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/...SuggestedContract workSummer workWork at officeRemote work$160 per unit
...in chemistry to review prompts, explain mechanisms, and provide expert feedback. Strong domain knowledge and clear communication... ...join AI-moderated sessions, review materials, and contribute to evaluating and improving scientific models. Compensation is $160 per task...SuggestedRemote job- ...help build high-fidelity scientific models. The role emphasizes expert interpretation of complex data and clear communication of... ...should hold a Master’s degree or PhD in chemistry and have a track record of research or applied industry work. #J-18808-Ljbffr WwshemiSuggestedRemote job
- ...cutting‑edge technology and expert insights. Backed by EQT, a top... ...Website: Linkedin Job Title: Evaluator - Political Science Location:... ...the question posed in the user prompt. The goal is to assess... ...Stay updated with the latest research, guidelines, and advancements...SuggestedContract workRemote workWorldwide
$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...Jack Dorsey . Position: Procurement / vendor management Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedContract workSummer workWork at officeRemote workMercor
New York, NYa month ago$50 per hour
Prolific is seeking Product Designers and UX Specialists to join its Expert Network, helping train and evaluate AI models with real design expertise. A quick skills test follows, and successful candidates may join as paid participants to work on AI tasks from home. Pay...Remote jobHourly payWork from homeFlexible hours- We are seeking skilled and experienced Audio Speech Evaluators Experts to assess speech quality and conversational performance through natural, unscripted interactions with an AI bot, in accordance with established evaluation guidelines. The ideal candidates will demonstrate...
- ...Job Description Job Description Claude Code User Job Type: Contractor Location: Remote Job Overview We are seeking experienced... ...to-end feature development and ambiguous technical problems. Evaluate the strengths and limitations of AI coding agents using...Remote jobFor contractors
YO AI Labs
New York, NY17 days ago $100 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Larry Summers , and Jack Dorsey . Position: ChatGPT Power User Type: Contract Compensation: $100 total Location:...Hourly payContract workSummer workRemote workMercor
New York, NY22 days ago- ...Job Description Job Description Codex User Job Type: Contractor Location: Remote Job Overview We are seeking experienced... ...real-world AI coding capabilities. You will document and evaluate how AI coding tools are used for complex software development, debugging...Remote jobFor contractors
YO AI Labs
New York, NY17 days ago $150 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...: Flexible part-time hours Role Responsibilities Evaluate AI answers to geriatric medicine questions for clinical accuracy...Contract workPart timeSummer workImmediate startRemote workFlexible hoursMercor
New York, NY5 days ago$60 - $70 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy...Contract workSummer workRemote workMercor
New York, NY14 days ago$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote workMercor
New York, NY17 days ago$50 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... .... Position: English Linguistic Experts Type: Contract Compensation:... ...: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated...Contract workSummer workRemote workMercor
New York, NY5 days ago$50 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...: English Language and Literature Expert Type: Contract Compensation:... ...: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated...Contract workSummer workRemote workMercor
New York, NY24 days ago$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation:... ...hours/week Role Responsibilities Evaluate and compare AI-generated responses to...Contract workSummer workImmediate startRemote workFlexible hoursMercor
New York, NY17 days ago$14 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice...Contract workSummer workImmediate startRemote workMercor
New York, NY23 days ago$100 - $120 per unit
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...: Baseball Fan – Live MLB Game AI Evaluator (US) Type: Contract Compensation... ...schedules, broadcasts, highlights, and expert-style analysis. Run the same question...Contract workWork experience placementSummer workRemote workMercor
New York, NY26 days ago$39 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: Music Audio Expert - English (US) Type: Contract Compensation... ...hours/week Role Responsibilities Evaluate AI model output for lyrics, voice...Contract workSummer workImmediate startRemote workMercor
New York, NY23 days ago$70 - $110 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...hours/week Role Responsibilities Evaluate AI-generated sales strategies , quota... ...complaint resolution. Provide expert feedback on sales-performance analysis to...Hourly payContract workSummer workImmediate startRemote workMercor
New York, NY7 days ago$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation:... ...hours/week Role Responsibilities Evaluate and compare AI-generated responses on...Contract workSummer workImmediate startRemote workMercor
New York, NY4 days ago$15 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract... ...hours/week Role Responsibilities Evaluate AI-generated music across various genres...Contract workSummer workImmediate startRemote workMercor
New York, NY10 days ago$70 - $110 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...hours/week Role Responsibilities Evaluate AI-generated sales conversations ,... ...handling, and post-sale support. Provide expert feedback. Work independently and asynchronously...Hourly payContract workSummer workImmediate startRemote workMercor
New York, NY4 days ago$50 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ..., and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation:...Contract workSummer work10 hours per weekMercor
New York, NY24 days ago$90 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use...Contract workSummer workLocal areaRemote workMercor
New York, NY17 days ago$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: UI / UX Design Expert Type: Contract Compensation:... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Contract workSummer workRemote workMercor
New York, NY12 days ago$40 - $50 per hour
...A remote training organization is seeking a Sociology Expert to analyze humanities texts and synthesize themes across cultures. Offering a pay range of $40 to $50 per hour for a commitment of 10–40 hours per week. Candidates should possess a Bachelor's degree in a relevant...Hourly payRemote work10 hours per weekCrossing Hurdles
New York, NY2 days ago$30 per hour
...human data in the world. Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid... ...Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation...Remote jobWork from homeFlexible hours$70 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...short audio samples containing spoken medication names. Evaluate whether medication names are pronounced accurately and clearly....Contract workSummer workRemote workMercor
New York, NY1 day ago$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote workMercor
New York, NY12 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to User Research Expert - Evaluator. Be the first to apply!
Related searches
- subject matter expert New York, NY
- fulfillment expert New York, NY
- guest service support expert New York, NY
- sql expert New York, NY
- technology expert New York, NY
- social media evaluator New York, NY
- web search evaluator New York, NY
- work from home social media evaluator New York, NY
- clinical evaluator New York, NY
- program evaluator New York, NY