Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Generalist Expert - Content Evaluator

$50 - $70 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Generalist Expert (US/Canada)
Type: Contract
Compensation: $50–$70/hour
Location: Remote

Role Responsibilities

  • Review and evaluate documents, slides, spreadsheets, and similar materials for quality and correctness.
  • Provide clear, well-reasoned written feedback and ratings.
  • Compare and rank AI-generated outputs against defined criteria.
  • Flag errors, inconsistencies, and gaps in reasoning or formatting.
  • Work independently across common productivity tools with flexible hours .

Qualifications

Must-Have

  • Bachelor's degree (minimum requirement)
  • Based in the United States or Canada
  • Excellent reading comprehension and written communication in English
  • Strong attention to detail and sound judgment across varied subject matter
  • Comfort working independently across common productivity tools (docs, slides, sheets)

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the Generalist Expert - Content Evaluator in New York, NY vacancy
  • $50 per hour

     ...Summers , and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation...  ...Transcribe and optimize audio and video content in Hindi, ensuring clarity and accuracy. Produce high-... 
    Content
    Contract work
    Summer work
    10 hours per week

    Mercor

    New York, NY
    16 days ago
  • $30 per hour

     ...Dorsey . Position: Hindi Linguistic Experts Type: Contract Compensation:...  ...: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated...  ...summarization. Edit, refine, or rewrite Hindi content to meet linguistic and cultural... 
    Content
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    6 days ago
  • $50 per hour

     ...Dorsey . Position: German Linguistic Experts Type: Contract Compensation:...  ...: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated...  .... Edit, refine, or rewrite German content to meet linguistic and cultural standards... 
    Content
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    27 days ago
  •  ...Job Description Job Description Generalist Job Type: Contractor Location: Remote...  ...projects. The role involves reviewing, evaluating, and annotating information across different...  ...Evaluate and improve AI-generated content and responses. Provide clear, accurate... 
    Content
    Remote job
    For contractors

    YO AI Labs

    New York, NY
    11 days ago
  • $50 per hour

     ...Position: English Language and Literature Expert Type: Contract Compensation: $...  ...: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-...  ...reasoning. Edit, refine, or rewrite English content to meet high linguistic, stylistic, and cultural... 
    Content
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    14 days ago
  • $80 - $120 per hour

     ...Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour...  ...Google Workspace , especially Slides , to assess and review content. Qualifications Must-Have ~5+ years of relevant professional... 
    Content
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    13 days ago
  • $60 - $70 per hour

     ...Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality. Review content involving misinformation, political persuasion, self-harm, violence, cyber... 
    Content
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    15 days ago
  • $80 - $120 per hour

     ...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location...  ...Provide clear, structured written feedback to improve AI-generated content. Review documents, spreadsheets, and slide decks for... 
    Content
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    4 days ago
  • $70 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: Generalist Search Expert Type: Contract Compensation: $40–$70/hour...  ...strategies to enhance the accuracy and depth of AI-generated content . Provide structured feedback to improve training data... 
    Content
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    5 days ago
  • $85 per hour

     ...Position: Fab Safety and Emergency Response Expert Type: Contract Compensation: $...  ...Review and create expert content on semiconductor fab hazards, emergency procedures, and safety documentation. Evaluate the accuracy and depth of safety protocols... 
    Content
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    8 days ago
  • $20 - $160 per hour

     ...Jack Dorsey . Position: Generalist Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation...  ...language for non-experts. Detect sycophancy in AI interactions...  ...human-feedback, evaluation, or content review. Background in explaining... 
    Content
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    4 days ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    22 days ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    16 days ago
  • $37 per unit

     ...Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content in AI safety to strengthen reasoning and rigor in...  ...and solutions. Collaborate with subject matter experts to ensure consistency, relevance, and coverage across... 
    Content
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    28 days ago
  • $80 - $150 per hour

     ...Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour...  ...quickly on work. Work independently and asynchronously to evaluate and improve AI model performance . Qualifications Must-... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    9 days ago
  •  ...Pharmacovigilance Safety Evaluator is a remote evaluation track for reviewing pharmacovigilance safety evaluation prompts and responses...  ...Label hallucinations, instruction-following failures, and unsafe content with structured tags. Capture ambiguous prompts and route them... 
    Content
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne, Inc.

    New York, NY
    3 days ago
  • A leading research accelerator is seeking a contractor to evaluate North American teen humor. The role involves reviewing short-form content, rating based on cultural relevance, and explaining humor dynamics clearly. Ideal candidates are 18 to 19 years old, familiar with... 
    Content
    Remote job
    Contract work
    For contractors
    Freelance
    Flexible hours

    Turing

    New York, NY
    1 day ago
  •  ...Indian media, broadcasting, publishing, and digital content environments. As a Subject Matter Expert, you will create and review realistic, high-quality...  ...compliance, audiovisual troubleshooting) Adapt structured evaluation rubrics for editorial decision-making, content... 
    Content
    Extra income
    Full time
    For contractors
    Local area
    Remote work
    10 hours per week

    Lilt

    New York, NY
    5 days ago
  •  ...In this hourly, remote contractor role, you will review AI-generated French-language responses and/or generate expert language content, evaluating reasoning quality and step-by-step edits while providing precise, actionable feedback. You will assess solutions for accuracy... 
    Content
    Hourly pay
    For contractors
    Immediate start
    Remote work

    SME.careers

    New York, NY
    3 days ago
  • $15 - $40 per hour

     ...Video Editing Expert Remote $15 - $40/hr Required Skills Adobe Premiere Pro...  ...export settings Understanding of different content formats Job Description Job Title...  .... Key Responsibilities: Review, evaluate, and refine interview content related to... 
    Content
    For contractors
    Remote work

    ESR Healthcare

    New York, NY
    2 days ago
  •  ...-generated Arabic and English responses and/or generate high-quality bilingual training content, evaluating reasoning quality and step-by-step problem-solving while providing expert feedback that helps models produce answers that are accurate, logical, and clearly explained... 
    Content
    Hourly pay
    For contractors
    Immediate start
    Remote work
    Flexible hours

    SME.careers

    New York, NY
    3 days ago
  • $50 - $80 per hour

     ...related skills for this job. Available in All Countries About the Role We are looking for physicists to help train and evaluate AI models on physics content. You will analyse physics documents, create and review problems, validate analytical solutions and correct model... 
    Content
    Hourly pay
    For contractors
    Remote work

    RemoExperts

    New York, NY
    2 days ago
  • $115k - $125k

     ...Hex is growing fast; we are hiring a Product Expert to nurture and support customers to make them successful with Hex. Our focus is...  ...questions. Beyond point-to-point work, you will develop technical content to help users get and stay successful with Hex, including demo... 
    Content
    Work at office
    Flexible hours

    HEX

    New York, NY
    1 day ago
  •  ...Job Description: Hebrew Transcription Expert Job Type: Contractor Location: Remote Job Summary: In this role, you...  ...Responsibilities: Accurately transcribe and review Hebrew audio content, ensuring high fidelity to the source material. Correct... 
    Content
    For contractors
    Remote work

    ESR Healthcare

    New York, NY
    1 day ago
  •  ...Labor & Human Relations - Subject Matter Expert - Remote Worldwide Join to apply for the Labor & Human Relations - Subject Matter Expert...  ...Subject Matter Experts to develop and review educational content. Roles are 1099 contract positions. Responsibilities include: Developing... 
    Content
    Full time
    Contract work
    Remote work
    Work from home
    Worldwide
    Flexible hours

    VetJobs

    New York, NY
    5 days ago
  •  ...Physics Expert (AI Training) About the Role We're looking for Physics Experts to help evaluate and improve AI systems trained on scientific reasoning and physics content. Your deep knowledge will directly shape how AI understands and solves problems across mechanics, electromagnetism... 
    Content
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Remote work

    Alignerr

    New York, NY
    3 days ago
  • $20.3 per hour

     ...looking for qualified raters to support a project focused on evaluating personalized search and location recommendations. This role involves...  ...elements like viewport framing, geospatial accuracy, and content relevance. Review personalized location recommendations to ensure... 
    Content
    Hourly pay
    Contract work
    Freelance
    Immediate start

    Welocalize

    New York, NY
    3 days ago
  •  ...incidents and rights complaints, developing plans of correction, evaluating person-centered planning, and ensuring corrective actions...  ...educational provider, training course titles and summary of course content. Narrative information supplied in response to the questions... 
    Content
    Casual work
    Seasonal work
    Weekend work
    Afternoon shift

    State of Delaware

    New York, NY
    5 days ago
  •  ...Job Description Job Description Japanese Bilingual Expert Role Type: Contractor Location: Remote Job Description...  ...this role, you will use your Japanese language expertise to evaluate audio content and help enhance AI language understanding and generation. No... 
    Content
    For contractors
    Remote work

    YO AI Labs

    New York, NY
    6 days ago
  • Experience Design Expert 100% REMOTE. Must be able to work 9a-5p CST 2-3 months w/ option to extend Additional Comments - 3 submission...  ...experience - Data-oriented design (components as data / content) - Experience working closely with engineering -Must be able to... 
    Content
    Work at office
    Immediate start
    Remote work

    Anveta

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Generalist Expert - Content Evaluator. Be the first to apply!