Generalist Expert - Content Evaluator
$50 - $70 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert (US/Canada)
Type: Contract
Compensation: $50–$70/hour
Location: Remote
Role Responsibilities
- Review and evaluate documents, slides, spreadsheets, and similar materials for quality and correctness.
- Provide clear, well-reasoned written feedback and ratings.
- Compare and rank AI-generated outputs against defined criteria.
- Flag errors, inconsistencies, and gaps in reasoning or formatting.
- Work independently across common productivity tools with flexible hours .
Qualifications
Must-Have
- Bachelor's degree (minimum requirement)
- Based in the United States or Canada
- Excellent reading comprehension and written communication in English
- Strong attention to detail and sound judgment across varied subject matter
- Comfort working independently across common productivity tools (docs, slides, sheets)
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$50 per hour
...Summers , and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation... ...Transcribe and optimize audio and video content in Hindi, ensuring clarity and accuracy. Produce high-...ContentContract workSummer work10 hours per week$30 per hour
...Dorsey . Position: Hindi Linguistic Experts Type: Contract Compensation:... ...: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated... ...summarization. Edit, refine, or rewrite Hindi content to meet linguistic and cultural...ContentContract workSummer workRemote work$50 per hour
...Dorsey . Position: German Linguistic Experts Type: Contract Compensation:... ...: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated... .... Edit, refine, or rewrite German content to meet linguistic and cultural standards...ContentContract workSummer workRemote work- ...Job Description Job Description Generalist Job Type: Contractor Location: Remote... ...projects. The role involves reviewing, evaluating, and annotating information across different... ...Evaluate and improve AI-generated content and responses. Provide clear, accurate...ContentRemote jobFor contractors
$50 per hour
...Position: English Language and Literature Expert Type: Contract Compensation: $... ...: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-... ...reasoning. Edit, refine, or rewrite English content to meet high linguistic, stylistic, and cultural...ContentContract workSummer workRemote work$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour... ...Google Workspace , especially Slides , to assess and review content. Qualifications Must-Have ~5+ years of relevant professional...ContentContract workSummer workWork at officeRemote work$60 - $70 per hour
...Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality. Review content involving misinformation, political persuasion, self-harm, violence, cyber...ContentContract workSummer workRemote work$80 - $120 per hour
...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location... ...Provide clear, structured written feedback to improve AI-generated content. Review documents, spreadsheets, and slide decks for...ContentContract workSummer workWork at officeRemote work$70 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Generalist Search Expert Type: Contract Compensation: $40–$70/hour... ...strategies to enhance the accuracy and depth of AI-generated content . Provide structured feedback to improve training data...ContentContract workSummer workRemote work$85 per hour
...Position: Fab Safety and Emergency Response Expert Type: Contract Compensation: $... ...Review and create expert content on semiconductor fab hazards, emergency procedures, and safety documentation. Evaluate the accuracy and depth of safety protocols...ContentContract workSummer workRemote work$20 - $160 per hour
...Jack Dorsey . Position: Generalist Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation... ...language for non-experts. Detect sycophancy in AI interactions... ...human-feedback, evaluation, or content review. Background in explaining...ContentContract workSummer workRemote work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...Contract workSummer workWork at officeRemote work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...Contract workSummer workWork at officeRemote work$37 per unit
...Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content in AI safety to strengthen reasoning and rigor in... ...and solutions. Collaborate with subject matter experts to ensure consistency, relevance, and coverage across...ContentContract workSummer workRemote work$80 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour... ...quickly on work. Work independently and asynchronously to evaluate and improve AI model performance . Qualifications Must-...Contract workSummer workRemote work- ...Pharmacovigilance Safety Evaluator is a remote evaluation track for reviewing pharmacovigilance safety evaluation prompts and responses... ...Label hallucinations, instruction-following failures, and unsafe content with structured tags. Capture ambiguous prompts and route them...ContentHourly payFor contractorsRemote work10 hours per week
- A leading research accelerator is seeking a contractor to evaluate North American teen humor. The role involves reviewing short-form content, rating based on cultural relevance, and explaining humor dynamics clearly. Ideal candidates are 18 to 19 years old, familiar with...ContentRemote jobContract workFor contractorsFreelanceFlexible hours
- ...Indian media, broadcasting, publishing, and digital content environments. As a Subject Matter Expert, you will create and review realistic, high-quality... ...compliance, audiovisual troubleshooting) Adapt structured evaluation rubrics for editorial decision-making, content...ContentExtra incomeFull timeFor contractorsLocal areaRemote work10 hours per week
- ...In this hourly, remote contractor role, you will review AI-generated French-language responses and/or generate expert language content, evaluating reasoning quality and step-by-step edits while providing precise, actionable feedback. You will assess solutions for accuracy...ContentHourly payFor contractorsImmediate startRemote work
$15 - $40 per hour
...Video Editing Expert Remote $15 - $40/hr Required Skills Adobe Premiere Pro... ...export settings Understanding of different content formats Job Description Job Title... .... Key Responsibilities: Review, evaluate, and refine interview content related to...ContentFor contractorsRemote work- ...-generated Arabic and English responses and/or generate high-quality bilingual training content, evaluating reasoning quality and step-by-step problem-solving while providing expert feedback that helps models produce answers that are accurate, logical, and clearly explained...ContentHourly payFor contractorsImmediate startRemote workFlexible hours
$50 - $80 per hour
...related skills for this job. Available in All Countries About the Role We are looking for physicists to help train and evaluate AI models on physics content. You will analyse physics documents, create and review problems, validate analytical solutions and correct model...ContentHourly payFor contractorsRemote work$115k - $125k
...Hex is growing fast; we are hiring a Product Expert to nurture and support customers to make them successful with Hex. Our focus is... ...questions. Beyond point-to-point work, you will develop technical content to help users get and stay successful with Hex, including demo...ContentWork at officeFlexible hours- ...Job Description: Hebrew Transcription Expert Job Type: Contractor Location: Remote Job Summary: In this role, you... ...Responsibilities: Accurately transcribe and review Hebrew audio content, ensuring high fidelity to the source material. Correct...ContentFor contractorsRemote work
- ...Labor & Human Relations - Subject Matter Expert - Remote Worldwide Join to apply for the Labor & Human Relations - Subject Matter Expert... ...Subject Matter Experts to develop and review educational content. Roles are 1099 contract positions. Responsibilities include: Developing...ContentFull timeContract workRemote workWork from homeWorldwideFlexible hours
- ...Physics Expert (AI Training) About the Role We're looking for Physics Experts to help evaluate and improve AI systems trained on scientific reasoning and physics content. Your deep knowledge will directly shape how AI understands and solves problems across mechanics, electromagnetism...ContentHourly payOngoing contractContract workFreelanceRemote work
$20.3 per hour
...looking for qualified raters to support a project focused on evaluating personalized search and location recommendations. This role involves... ...elements like viewport framing, geospatial accuracy, and content relevance. Review personalized location recommendations to ensure...ContentHourly payContract workFreelanceImmediate start- ...incidents and rights complaints, developing plans of correction, evaluating person-centered planning, and ensuring corrective actions... ...educational provider, training course titles and summary of course content. Narrative information supplied in response to the questions...ContentCasual workSeasonal workWeekend workAfternoon shift
- ...Job Description Job Description Japanese Bilingual Expert Role Type: Contractor Location: Remote Job Description... ...this role, you will use your Japanese language expertise to evaluate audio content and help enhance AI language understanding and generation. No...ContentFor contractorsRemote work
- Experience Design Expert 100% REMOTE. Must be able to work 9a-5p CST 2-3 months w/ option to extend Additional Comments - 3 submission... ...experience - Data-oriented design (components as data / content) - Experience working closely with engineering -Must be able to...ContentWork at officeImmediate startRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Generalist Expert - Content Evaluator. Be the first to apply!
- sql expert New York, NY
- technology expert New York, NY
- fulfillment expert New York, NY
- guest service support expert New York, NY
- subject matter expert New York, NY
- education evaluator New York, NY
- work from home web search evaluator New York, NY
- clinical evaluator New York, NY
- evaluator New York, NY
- ai evaluator New York, NY



