User Research Expert - Evaluator
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors.
- Provide clear, structured written feedback.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
- Utilize Microsoft Office and Google Workspace , especially Slides .
Qualifications
Must-Have
- 5+ years of relevant professional experience in User/customer research and feedback synthesis .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 18 days ago
Similar jobs that could be interesting for youBased on the User Research Expert - Evaluator in New York, NY vacancy
$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation... ...with subject matter experts to ensure consistency and quality...SuggestedContract workSummer workWork at officeRemote work$40 - $50 per hour
...A remote training organization is seeking a Sociology Expert to analyze humanities texts and synthesize themes across cultures. Offering a pay range of $40 to $50 per hour for a commitment of 10–40 hours per week. Candidates should possess a Bachelor's degree in a relevant...SuggestedHourly payRemote work10 hours per weekCrossing Hurdles
New York, NY3 days ago$170 per hour
...Subject Matter Expert: Legal & Regulatory Research (Remote Advisory)About ProlificProlific is not just another player in the AI space – we are building the biggest pool of quality human data in the world.Over 35,000 AI developers, researchers, and organizations use Prolific...SuggestedHourly paySelf employmentRemote workWork from homeFlexible hoursProlific
New York, NY6 hours ago- ...Job Description Job Description Equity Research Expert Role Type: Contractor Location: Remote We are seeking experienced Equity... ..., and sector insights. You'll apply your expertise to evaluate real-world equity research content and help train next-generation...SuggestedFor contractorsRemote work
YO AI Labs
New York, NY13 days ago - ...Job Description Job Description Research & Insights Expert – PowerPoint Review & Reconstruction Role Type: Contractor Location: Remote... ..., or business analytics. Experience with AI training, evaluation, or rubric development. Strong ability to translate complex...SuggestedFor contractorsRemote work
YO AI Labs
New York, NY10 days ago $80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: UI / UX Design Expert Type: Contract Compensation:... ...Work independently and asynchronously to evaluate and improve AI model performance ....Contract workSummer workRemote work$14 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice...Contract workSummer workImmediate startRemote work$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...Position: Engineering / manufacturing / technical operations Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote work$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ..., and Jack Dorsey . Position: Education / school Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... .... Position: Investment Banking Expert Type: Contract Compensation:... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Contract workSummer workRemote work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation:... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Contract workSummer workRemote work$50 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ..., and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation:...Contract workSummer work10 hours per week$15 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract... ...hours/week Role Responsibilities Evaluate AI-generated music across various genres...Contract workSummer workImmediate startRemote work$70 - $110 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...hours/week Role Responsibilities Evaluate AI-generated sales conversations ,... ...handling, and post-sale support. Provide expert feedback. Work independently and asynchronously...Hourly payContract workSummer workImmediate startRemote work$90 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use...Contract workSummer workLocal areaRemote work$39 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: Music Audio Expert - English (US) Type: Contract Compensation... ...hours/week Role Responsibilities Evaluate AI model output for lyrics, voice...Contract workSummer workImmediate startRemote work$50 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...: English Language and Literature Expert Type: Contract Compensation:... ...: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated...Contract workSummer workRemote work$50 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar...Contract workSummer workRemote workFlexible hours$100 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Larry Summers , and Jack Dorsey . Position: ChatGPT Power User Type: Contract Compensation: $100 total Location:...Hourly payContract workSummer workRemote work- ...Job Description Job Description Codex User Job Type: Contractor Location: Remote Job Overview We are seeking experienced... ...real-world AI coding capabilities. You will document and evaluate how AI coding tools are used for complex software development, debugging...Remote jobFor contractors
- ...Job Description Job Description Claude Code User Job Type: Contractor Location: Remote Job Overview We are seeking experienced... ...to-end feature development and ambiguous technical problems. Evaluate the strengths and limitations of AI coding agents using...Remote jobFor contractors
$14.5 per hour
...apply for the AI Web Search Evaluator role at Welo Data Welo Data... ...0,000 AI training and domain experts. As a Web Search Evaluator... ...engine results, ensuring users find the most relevant and useful... ...and digital trends. Enjoy researching topics online and provides...Hourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hoursWelo Data
New York, NY1 day ago$60 - $70 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy...Contract workSummer workRemote work- ...Description Job Description Cogent Scientific, an insourced contract research organization, is looking for the right people to accomplish our... ...to build on your skills and knowledge while working among experts in their fields and with cutting-edge instrumentation....Contract workLocal areaRelocation packageDay shift
Cogent Scientific
New York, NYa month ago $100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... .... Position: Sales Engineering Expert Type: Contract Compensation:... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Contract workSummer workRemote work$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote work- ...Earnix Implementation Expert New York, New York, United States About the Job Job Summary: We are seeking a highly experienced... ...a key liaison between stakeholders at all levels—from business users and modelers to the Chief Underwriting Officer and Steering...
Inizio Partners
New York, NY23 hours ago $55 - $65 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Role Responsibilities Review and evaluate AI-generated clinical outputs based on... ...for AI training datasets . Provide expert feedback on nursing assessments and documentation...Contract workSummer workRemote work- ...accuracy, integrity, and consistency across all reporting outputs Optimize report performance and troubleshoot reporting issues Support Workday releases by assessing impact and updating reports as needed Provide documentation, training, and ongoing support to end users
Mindlance
New York, NY2 days ago $160k - $210k
BVAL (Bloomberg's Evaluated Pricing Service) Evaluator - US Agency Structured Products... ...BVAL Evaluator, you will serve as a sector expert responsible for delivering accurate, high... ...background in trading, portfolio management, research, structuring, or valuations. - Agency...Price workTemporary workFor contractorsWork experience placementBloomberg
New York, NY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to User Research Expert - Evaluator. Be the first to apply!
Related searches
- guest service support expert New York, NY
- fulfillment expert New York, NY
- subject matter expert New York, NY
- technology expert New York, NY
- clinical evaluator New York, NY
- ai evaluator New York, NY
- quality evaluator New York, NY
- social media evaluator New York, NY
- education evaluator New York, NY
- program evaluator New York, NY