Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Humanities Expert - Arts Evaluator

$80 - $120 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Humanities / arts / culture Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in AI outputs .
  • Provide clear, structured written feedback to improve AI model performance .
  • Collaborate with subject matter experts to ensure consistency and quality.
  • Work independently and asynchronously to meet deadlines while enhancing AI model outputs .

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Humanities / arts / culture .
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace , especially Slides .

Preferred

  • Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Humanities Expert - Arts Evaluator in San Francisco, CA vacancy
  • Obsidian is seeking expert Evaluators in Humanities / arts / culture to review AI-generated work products for accuracy and quality. You will apply deep subject-matter expertise to grade outputs and provide structured feedback. This is a remote, hourly engagement, requiring... 
    Suggested
    Remote job
    Hourly pay

    Obsidian

    San Francisco, CA
    1 day ago
  • $80 - $120 per hour

     ...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    20 days ago
  • $50 per hour

     ...Jack Dorsey . Position: Spanish (Spain) Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location...  ...students or recent graduates. Background in linguistics, humanities, social sciences, journalism, translation/localization, or... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    9 days ago
  • Obsidian is seeking expert Evaluators in FP&A / corporate finance to assess AI-generated work products for accuracy and quality. This role entails deep expertise to grade outputs and provide structured feedback. Candidates should have at least 5 years of relevant experience... 
    Suggested
    Remote job
    Hourly pay
    Work at office

    Obsidian

    San Francisco, CA
    1 day ago
  • About the roleWe're building a high-quality evaluation dataset for CNC manufacturing and are looking for experienced CNC machinists to help author and validate grading rubrics for CNC machining work. You'll bring real production-floor judgment to determine whether a machining... 
    Suggested

    Obsidian

    San Francisco, CA
    1 day ago
  • Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Hindi and English. Bring a background in songwriting... 

    Obsidian

    San Francisco, CA
    4 days ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80-$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor Inc

    San Francisco, CA
    4 days ago
  • Obsidian is seeking expert Evaluators in Biology/environmental science to review and assess AI-generated work products for accuracy and quality. In this remote, hourly role, you will leverage your expertise to provide feedback on documents and presentations, ensuring they... 
    Remote job
    Hourly pay

    Obsidian

    San Francisco, CA
    2 days ago
  • $60 - $70 per hour

     ...: AI Safety Practitioner Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality. Review content involving misinformation... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    10 days ago
  •  ...to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work. Rather...  ...‑fit and technical‑risk assessments) Score AI‑generated and human work samples against those criteria, with detailed written... 

    Mercor

    San Francisco, CA
    4 days ago
  • Mercor is seeking experienced musicians to evaluate generative musical AI models in collaboration with a leading AI lab. You will assess model outputs across different categories of music in your bilingual language and contribute to structured taxonomy annotations. Ideal... 
    Part time
    Immediate start
    10 hours per week

    Mercor

    San Francisco, CA
    4 days ago
  • Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models in partnership with a leading AI lab. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Korean and English.... 
    Part time
    Immediate start
    Flexible hours

    Obsidian

    San Francisco, CA
    3 days ago
  • Mercor is seeking experienced music producers and audio engineers to evaluate generative music AI models, working in Punjabi and English. You will compare AI-generated songs across musicality, creativity, prompt adherence, vocal quality and production/mix, labeling genre... 
    Hourly pay
    Immediate start

    Obsidian

    San Francisco, CA
    2 days ago
  • Mercor is hiring experienced music professionals to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards, working in Thai and English.... 
    Flexible hours

    Mercor

    San Francisco, CA
    2 days ago
  • $80 - $120 per hour

     ...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $15 per hour

     ...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation: $15/hour...  ...months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres and assess quality... 
    Contract work
    Summer work
    Immediate start
    Remote work
    Flexible hours

    Mercor

    San Francisco, CA
    18 days ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $100 - $150 per hour

     ...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $...  ...outreach emails. Score AI-generated and human work samples with detailed written...  ...asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    12 days ago
  • Mercor is hiring experienced musicians to evaluate generative musical AI models in partnership with a leading AI lab. You will assess model outputs across lyrics, voice generation, and other standards, using your bilingual language skills. Ideal candidates have 3+ years... 
    Part time
    Immediate start
    10 hours per week

    Mercor

    San Francisco, CA
    4 days ago
  • Mercor seeks experienced music producers and audio engineers to evaluate generative music AI models in collaboration with a leading AI lab. You'll assess AI-generated music across diverse genres, label musical characteristics, review lyrics and vocals, and rate quality... 
    Immediate start
    Flexible hours

    Mercor

    San Francisco, CA
    13 hours ago
  • Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models in partnership with a leading AI lab. You will assess AI-generated tracks across genres and rate quality against detailed standards, working in Hindi and English. The... 
    Hourly pay
    Immediate start
    Shift work

    Mercor

    San Francisco, CA
    1 day ago
  • $70 - $110 per hour

     ...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product recommendations,...  ..., order handling, and post-sale support. Provide expert feedback. Work independently and asynchronously to meet deadlines... 
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $120 - $175 per hour

     ...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: CNC Machining Expert Type: Contract Compensation: $120–$175/hour Location: Remote Role Responsibilities Contribute to text-only,... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    18 days ago
  • $150 per hour

     ...Dorsey . Position: Investment Banking Expert Type: Contract Compensation: $...  ...analyses. Score AI-generated and human work samples against criteria with detailed...  ...~ Prior experience with AI training , evaluation, or human-data projects. Application... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    8 days ago
  • Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models, in partnership with a leading AI lab. The work requires evaluating AI-generated music in Hebrew and English to assess quality across genres and styles. You will rate... 
    Immediate start

    Obsidian

    San Francisco, CA
    4 days ago
  • $14 - $42 per hour

     ...Summers , and Jack Dorsey . Position: Music Production Expert - Hindi Type: Contract Compensation: $14–$42/hour...  ...months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music on musicality , creativity , prompt adherence... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    4 days ago
  • $50 per hour

    About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Voice Actor: CX...
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    13 hours ago
  • Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models, in partnership with a leading AI...  ...Duration: up to 6 months Commitment: flexible. Most experts work around 20 hours per week; there is no cap Compensation: this... 
    Hourly pay
    Immediate start
    Flexible hours

    Obsidian

    San Francisco, CA
    2 days ago
  • Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models, in partnership with a leading AI...  ...Duration: up to 6 months Commitment: flexible. Most experts work around 20 hours per week; there is no cap We consider all... 
    Immediate start
    Flexible hours

    Mercor

    San Francisco, CA
    13 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Humanities Expert - Arts Evaluator. Be the first to apply!