User Research Expert - Evaluator - AI Trainer
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Work independently and asynchronously to meet deadlines and enhance AI model performance .
- Collaborate with subject matter experts to ensure consistency and quality across datasets.
Qualifications
Must-Have
- 5+ years of relevant professional experience in User/customer research and feedback synthesis .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercor$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote work$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: Investment Banking Expert Type: Contract Compensation:... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...SuggestedContract workSummer workRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Jack Dorsey . Position: Procurement / vendor management Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Program management / implementation planning Evaluator Type: Contract Compensation:... .... Collaborate with subject matter experts to ensure consistency and quality. Work...SuggestedContract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... .... Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote work- Mercor is seeking expert Evaluators in Finance operations / audit support to review AI-generated documents, spreadsheets, and slide decks for accuracy, rigor, and domain quality. This is a remote, hourly engagement, requiring strong subject-matter expertise to grade outputs...Remote jobHourly pay
$76 per hour
...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is... ...mathematics problems that simulate real mathematical research workflows; Create problems requiring Python...Hourly payPermanent employmentTemporary workPart timeFreelance10 hours per week$55 per hour
A leading AI consulting firm is seeking a Freelance Accounting Expert - AI Trainer to create complex tasks for AI models. This part-time, flexible role is suited for those with a Bachelor's or Master's Degree in Accounting and at least 3 years of relevant experience. Responsibilities...Remote jobPart timeFreelanceFlexible hours- \ Mercor is recruiting on behalf of a leading AI research lab seeking experienced professionals to help evaluate how enterprise software vendors structure pricing, licensing... ...enterprise software categories.\ \ Contribute expert judgment on how large organisations evaluate,...Contract work
- Mercor is seeking senior supply chain professionals to build evaluation tasks for AI systems operating in Fortune 500 enterprise supply chain contexts. Contributors design enterprise supply chain scenarios, draft reference outputs, and write rubrics that capture how senior...
- Role Overview Mercor is collaborating with a leading AI lab to engage experienced audit and controls professionals — external audit... ...performs audit and controls tasks Collaborate asynchronously with the research team Ideal Qualifications Public accounting audit background (...
$55 per hour
Freelance Accounting Expert - AI Trainer This opportunity is only for candidates currently residing... ...how modern AI systems are tested and evaluated? This is a flexible, project‑based opportunity well‑suited for: Analysts, researchers, experienced professionals and...Permanent employmentPart timeFreelanceRemote workFlexible hours- ...building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces... ...and executing, QA and reconciliation, triage and escalation, research and evaluation, reporting, and orchestrating multi-step...
$60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Summers , and Jack Dorsey . Position: Supply Chain Expert Type: Contract Compensation: $60–$70/hour Location...Contract workSummer workRemote work- Role Overview Mercor is seeking senior supply chain professionals to build evaluation tasks for AI systems operating in Fortune 500 enterprise supply chain contexts. The workflows are calibrated to the network complexity, volume scale, and operational stakes of Fortune...Contract work
- ...Overview Mercor is seeking senior HR professionals to build evaluation tasks for AI systems operating in talent management, employee relations,... ...track (UK Employment Rights Act, EU labor directives). Experts qualified in either or both tracks are encouraged to apply....
- UT Southwestern Medical Center is seeking an administrative professional to support researchers by identifying funding opportunities, assisting with proposal preparation and processing, and supporting research administration. The role involves negotiating contracts, receiving...
- ...Description Job Description Claude Code User Job Type: Contractor Location:... ...to support a project focused on advancing AI coding agents. You will share real-world experience... ...and ambiguous technical problems. Evaluate the strengths and limitations of AI coding...Remote jobFor contractors
$175k - $200k
...HaveProven experience in digital marketing, performance marketing, or the leadgen industryBuilding adtech algorithms and supporting user acquisition or paid media modeling (highly desired)Strong modeling fundamentals: the ability to build effective models that drive business...Remote work- ...Job Description Job Description Codex User Job Type: Contractor Location: Remote... ...Job Overview We are seeking experienced AI Coding Agent Users to support a project... ...coding capabilities. You will document and evaluate how AI coding tools are used for complex software...Remote jobFor contractors
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...with the research team to enhance AI model training and evaluation. Develop SOX controls documentation, walkthroughs, testing...Contract workSummer workRemote work$60 - $100 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Jack Dorsey . Position: Marketing Expert — Social Media (AI Agent Environments)... ...wrong ones. Review AI agent attempts and evaluate them against established standards....Contract workSummer workRemote work$80 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...: Operations / Program Management Experts Type: Contract Compensation:... ...feedback to improve document standards and evaluation processes. Collaborate with teams to...Contract workSummer workRemote work$63 per hour
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workRemote work- ...looking for IT and Tech Leaders with director-level experience in IT, Technology, or IT Operations to join our Expert Network. Participants will complete research tasks and get paid up to $200 per hour for their expertise. Ideal candidates have hands-on experience with...Hourly pay
$293.5k
...Information Job Title Expert Senior Manager, AI Engineering Job ID 10... ...Areas Analytics, Data & Research, Management Consulting,... ...model experimentation, and evaluation design to production system... ...evaluation suites integrating user signals, continual learning...Permanent employmentFull timeApprenticeshipWork at officeLocal areaWork from homeHome office3 days per week- Third Bridge is a global research firm seeking a commercially minded professional to support senior analysts and recruit industry experts for in-depth interviews. You will engage with executives to secure relevant experts for research projects and help translate insights...
$76.7k - $115.1k
...additional information on remote work at Penn State, see Notice to Out of State Applicants. Position Specifics We are looking for Research Data Scientist, to join our Geospatial Data Science team in the Applied Research. You will aid our research efforts in this unique...Full timeFor contractorsWork experience placementRemote workFlexible hours- ...IT AI Innovation Engineer We are a Firm where people truly believe in what they do... ...build prototype solutions, engage legal users in feedback cycles, and refine tools to deliver... ...collaboration between teams. Evaluation and Innovation: Evaluate third-party AI tools...Contract workTemporary work
$14.5 per hour
...scalable to supercharge their AI models. As a Welocalize... ...AI training and domain experts. Key Responsibilities... ...relevance and quality. Evaluate and rate the... ...results to ensure they meet user expectations. Offer feedback... ...digital trends. Enjoys researching topics online and...Hourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to User Research Expert - Evaluator - AI Trainer. Be the first to apply!
- subject matter expert Dallas, TX
- fulfillment expert Dallas, TX
- guest service support expert Dallas, TX
- technology expert Dallas, TX
- ai evaluator Dallas, TX
- work from home web search evaluator Dallas, TX
- social media evaluator Dallas, TX
- evaluator Dallas, TX
- education evaluator Dallas, TX
- quality evaluator Dallas, TX


