User Research Expert - Evaluator
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors.
- Provide clear, structured written feedback.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
- Utilize Microsoft Office and Google Workspace , especially Slides .
Qualifications
Must-Have
- 5+ years of relevant professional experience in User/customer research and feedback synthesis .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the User Research Expert - Evaluator in New York, NY vacancy
$80 - $120 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/...SuggestedContract workSummer workWork at officeRemote work- A tech company focusing on AI research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least...SuggestedRemote jobContract workFlexible hours
- ...cutting‑edge technology and expert insights. Backed by EQT, a top... ...Website: Linkedin Job Title: Evaluator - Political Science Location:... ...the question posed in the user prompt. The goal is to assess... ...Stay updated with the latest research, guidelines, and advancements...SuggestedContract workRemote workWorldwide
- ...Job Description Job Description Claude Code User Job Type: Contractor Location: Remote Job Overview We are seeking experienced... ...to-end feature development and ambiguous technical problems. Evaluate the strengths and limitations of AI coding agents using...SuggestedFor contractorsRemote work
YO AI Labs
New York, NY2 days ago - ...Job Description Job Description Codex User Job Type: Contractor Location: Remote Job Overview We are seeking experienced... ...real-world AI coding capabilities. You will document and evaluate how AI coding tools are used for complex software development, debugging...SuggestedFor contractorsRemote work
YO AI Labs
New York, NY2 days ago $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... .... Position: Investment Banking Expert Type: Contract Compensation:... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Contract workSummer workRemote workMercor
New York, NY5 days ago$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation:... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Contract workSummer workRemote workMercor
New York, NY7 days ago$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...Jack Dorsey . Position: Procurement / vendor management Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote workMercor
New York, NY6 days ago$90 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use...Contract workSummer workLocal areaRemote workMercor
New York, NY1 day ago$50 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ..., and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation:...Contract workSummer work10 hours per weekMercor
New York, NY8 days ago$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: UI / UX Design Expert Type: Contract Compensation:... ...Work independently and asynchronously to evaluate and improve AI model performance ....Contract workSummer workRemote workMercor
New York, NY2 days ago- Obsidian is seeking a Spanish (Mexico) Audio Generalist Evaluator Expert for a high-impact audio AI research project. The role focuses on transcription, annotation, and evaluation tasks to help train advanced language models. Candidates need to be fluent in Spanish (Mexico...Temporary work10 hours per week
- ...of hands-on experience using SolidWorks and related CAD software, and professional proficiency in Mandarin Chinese, to support AI research through flexible, hourly contract work. This ongoing, project-based opportunity is fully remote and asynchronous, with no minimum...Remote jobHourly payContract workFlexible hours
- ...comprehensive IT training for attorneys and staff. You will create courseware, provide classroom and on-demand training, and support end users across Microsoft 365, iManage Work 10, and related tools. Required are a Bachelor’s degree and 3-5 years of technology training...
$30 per hour
...human data in the world. Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid... ...Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation...Remote jobWork from homeFlexible hours$55 - $65 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Role Responsibilities Review and evaluate AI-generated clinical outputs based on... ...for AI training datasets . Provide expert feedback on nursing assessments and documentation...Contract workSummer workRemote workMercor
New York, NY7 days ago$177k - $260k
...private content includes equity research, company filings, event transcripts, expert calls, news, trade journals, and... ...content capabilities that enable users to unearth even more comprehensive... ...with data analysis and SQL, can evaluate quality in AI-generated outputs,...Local areaShift work$119 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... .... Rate each question's difficulty as Medium, Hard, or Expert to challenge expert-level solvers. Provide one correct answer...Contract workSummer workRemote workMercor
New York, NY1 day ago$80 - $110 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...Up to 20 hours/week Role Responsibilities Review and evaluate research papers in chemistry for correctness, novelty, and...Contract workPart timeSummer workRemote workMercor
New York, NY7 days ago$120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: Equity Research Expert Type: Contract Compensation:... ...filings to support AI model training . Evaluate the accuracy of AI-generated equity...Hourly payContract workFor contractorsSummer workRemote workMercor
New York, NY7 days ago$170 per hour
...Subject Matter Expert: Legal & Regulatory Research (Remote Advisory) About Prolific Prolific is not just another player in the AI space – we are building the biggest pool of quality human data in the world. Over 35,000 AI developers, researchers, and organizations...Hourly paySelf employmentRemote workWork from homeFlexible hoursProlific
New York, NY1 day ago$40 - $50 per hour
...A remote training organization is seeking a Sociology Expert to analyze humanities texts and synthesize themes across cultures. Offering a pay range of $40 to $50 per hour for a commitment of 10–40 hours per week. Candidates should possess a Bachelor's degree in a relevant...Hourly payRemote work10 hours per weekCrossing Hurdles
New York, NY2 days ago- TECEZE seeks an experienced IT Dispatch and Backup professional to support end users and desk-side operations. The role focuses on IT service management, OS imaging, patches, and hardware troubleshooting across a corporate environment. You will manage laptop lifecycles,...
- ...software, and connectivity issues while partnering with an escalation team for more complex networking and infrastructure incidents. The role emphasizes self-sufficiency, strong customer service, and clear communication with end users in a #J-18808-Ljbffr ViziRecruiter,LLC.Remote jobWork at office
- ...hiring experienced Adult Inpatient Nurses (RNs) to help train and evaluate AI systems used in clinical and healthcare settings. This role... ...nursing assessment data for AI training datasets Provide expert feedback on nursing assessments and documentation practices Identify...
$70k - $160k
Compliance Associate - Experts & ResearchAbout MillenniumMillennium is a global, diversified alternative investment firm, founded in 1... ...and sell-side experts• Support the administration of the firm’s research compliance program, including initial due diligence and ongoing...$60 - $90 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...sound scientific reasoning versus superficial reasoning. Evaluate models by reviewing attempts and identifying immediate mistakes...Contract workSummer workImmediate startRemote workMercor
New York, NY8 days ago- We are recruiting a select cohort of accomplished chemistry researchers to contribute to the next generation of AI systems for scientific... ...part of their extended workforce. What you’ll do Review and evaluate research papers in chemistry for correctness, novelty, and...Contract workPart timeImmediate start
- A leading research services provider is seeking a Chemistry Expert (PhD) to evaluate complex chemistry problems and review AI-generated outputs for accuracy. This remote, hourly contract role requires deep subject-matter expertise and excellent communication skills. Candidates...Remote jobHourly payContract workFlexible hours
$100 - $130 per hour
Mercor is seeking Investment Banking Experts for a research project across U.S./UK/Canada/Europe/Australia. Ideal candidates have at least 2 years of top-tier investment banking experience and are proficient in financial modeling, pitch decks, and memos. The engagement...Hourly pay10 hours per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to User Research Expert - Evaluator. Be the first to apply!
Related searches
- subject matter expert New York, NY
- guest service support expert New York, NY
- technology expert New York, NY
- fulfillment expert New York, NY
- sql expert New York, NY
- program evaluator New York, NY
- work from home web search evaluator New York, NY
- clinical evaluator New York, NY
- evaluator New York, NY
- ai evaluator New York, NY