User Research Expert - Evaluator
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Work independently and asynchronously to meet deadlines and enhance AI model performance .
- Collaborate with subject matter experts to ensure consistency and quality across datasets.
Qualifications
Must-Have
- 5+ years of relevant professional experience in User/customer research and feedback synthesis .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the User Research Expert - Evaluator in New York, NY vacancy
- A tech company focusing on AI research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least...SuggestedContract workRemote workFlexible hours
Handshake
New York, NY2 days ago - ...Mercor is partnering with a leading AI research organization to engage experienced UI/UX... ...product designers for a project focused on evaluating how well AI systems perform real-world... ...meet the bar for a real product and its users Detail-oriented, consistent, and comfortable...Suggested
- ...cutting‑edge technology and expert insights. Backed by EQT, a top... ...Website: Linkedin Job Title: Evaluator - Political Science Location:... ...the question posed in the user prompt. The goal is to assess... ...Stay updated with the latest research, guidelines, and advancements...SuggestedContract workRemote workWorldwide
$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedContract workSummer workWork at officeRemote workMercor
New York, NY10 days ago$70 - $110 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...hours/week Role Responsibilities Evaluate AI-generated sales strategies , quota... ...complaint resolution. Provide expert feedback on sales-performance analysis to...SuggestedHourly payContract workSummer workImmediate startRemote workMercor
New York, NY4 days ago$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: UI / UX Design Expert Type: Contract Compensation:... ...Work independently and asynchronously to evaluate and improve AI model performance ....Contract workSummer workRemote workMercor
New York, NY6 days ago$50 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ..., and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation:...Contract workSummer work10 hours per weekMercor
New York, NY10 days ago$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... .... Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote workMercor
New York, NY10 days ago$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... .... Position: Investment Banking Expert Type: Contract Compensation:... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Contract workSummer workRemote workMercor
New York, NY6 days ago$90 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use...Contract workSummer workLocal areaRemote workMercor
New York, NY10 days ago$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ..., and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote workMercor
New York, NY10 days ago$50 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar...Contract workSummer workRemote workFlexible hoursMercor
New York, NY6 days ago$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation:... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Contract workSummer workRemote workMercor
New York, NY11 days ago- Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models, in partnership with a leading AI... ...Duration: up to 6 months Commitment: flexible. Most experts work around 20 hours per week; there is no cap We consider all...Immediate startFlexible hours
- Weekday AI is seeking an experienced Agency Brand Design Expert to evaluate AI and human-created brand design work. You will define grading criteria and provide rigorous, justified feedback based on professional standards. Remote, independent contractor engagement with...Remote jobFor contractorsFlexible hoursWeekday work
- Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI... ...Duration: up to 6 months Commitment: flexible. Most experts work around 20 hours per week; there is no cap Compensation: this...Hourly payImmediate startFlexible hours
- Join a growing network of industry experts supporting AI research and development. Overview We\'re building a select group of experienced healthcare professionals to help evaluate and improve how AI systems understand and reason about healthcare topics. You\'ll bring your...Contract workPart timeRemote work10 hours per weekFlexible hours
- Mercor is seeking experienced musicians to evaluate generative music AI models, collaborating with a leading AI lab. You will assess AI-generated music and lyrics in Telugu and English, applying detailed quality standards across genres. Responsibilities include comparing...Part timeImmediate start
- Obsidian is seeking a Spanish (Mexico) Audio Generalist Evaluator Expert for a high-impact audio AI research project. The role focuses on transcription, annotation, and evaluation tasks to help train advanced language models. Candidates need to be fluent in Spanish (Mexico...Temporary work10 hours per week
- Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards. Start date: immediate. Duration: up to...Hourly payImmediate start
- ...comprehensive IT training for attorneys and staff. You will create courseware, provide classroom and on-demand training, and support end users across Microsoft 365, iManage Work 10, and related tools. Required are a Bachelor’s degree and 3-5 years of technology training...
$60 - $70 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy...Contract workSummer workRemote workMercor
New York, NY12 days ago- Mercor is seeking expert Evaluators in user and customer research to review AI-generated work products for accuracy, rigor, and domain quality. This remote, hourly role requires applying deep subject-matter expertise to grade outputs and provide clear, structured feedback...Remote jobHourly pay
$30 per hour
...human data in the world. Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from... ...Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image...Remote workWork from homeFlexible hoursProlific
New York, NY2 days ago- Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Vietnamese and English...Immediate startFlexible hours
- 1. Role Overview Mercor is partnering with a leading AI research organization to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work. Rather than producing deliverables yourself, you will define...
$177k - $260k
...private content includes equity research, company filings, event transcripts, expert calls, news, trade journals, and... ...content capabilities that enable users to unearth even more comprehensive... ...with data analysis and SQL, can evaluate quality in AI-generated outputs,...Local areaShift work$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...Dorsey . Position: Product launch / experiment readiness Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote workMercor
New York, NY6 days ago- ...software, and connectivity issues while partnering with an escalation team for more complex networking and infrastructure incidents. The role emphasizes self-sufficiency, strong customer service, and clear communication with end users in a #J-18808-Ljbffr ViziRecruiter,LLC.Remote jobWork at office
- TECEZE seeks an experienced IT Dispatch and Backup professional to support end users and desk-side operations. The role focuses on IT service management, OS imaging, patches, and hardware troubleshooting across a corporate environment. You will manage laptop lifecycles,...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to User Research Expert - Evaluator. Be the first to apply!
Related searches
- subject matter expert New York, NY
- fulfillment expert New York, NY
- guest service support expert New York, NY
- sql expert New York, NY
- technology expert New York, NY
- quality evaluator New York, NY
- clinical evaluator New York, NY
- work from home web search evaluator New York, NY
- evaluator New York, NY
- program evaluator New York, NY