Humanities Expert - Arts Evaluator
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Humanities / arts / culture Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in AI outputs .
- Provide clear, structured written feedback to improve AI model performance .
- Collaborate with subject matter experts to ensure consistency and quality.
- Work independently and asynchronously to meet deadlines while enhancing AI model outputs .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Humanities / arts / culture .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
- Obsidian is seeking expert Evaluators in Humanities / arts / culture to review AI-generated work products for accuracy and quality. You will apply deep subject-matter expertise to grade outputs and provide structured feedback. This is a remote, hourly engagement, requiring...SuggestedRemote jobHourly pay
$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedContract workSummer workWork at officeRemote work$50 per hour
...Jack Dorsey . Position: Spanish (Spain) Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location... ...students or recent graduates. Background in linguistics, humanities, social sciences, journalism, translation/localization, or...SuggestedContract workSummer workRemote work- Obsidian is seeking expert Evaluators in FP&A / corporate finance to assess AI-generated work products for accuracy and quality. This role entails deep expertise to grade outputs and provide structured feedback. Candidates should have at least 5 years of relevant experience...SuggestedRemote jobHourly payWork at office
- About the roleWe're building a high-quality evaluation dataset for CNC manufacturing and are looking for experienced CNC machinists to help author and validate grading rubrics for CNC machining work. You'll bring real production-floor judgment to determine whether a machining...Suggested
- Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Hindi and English. Bring a background in songwriting...
$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80-$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Contract workSummer workWork at officeRemote work- Obsidian is seeking expert Evaluators in Biology/environmental science to review and assess AI-generated work products for accuracy and quality. In this remote, hourly role, you will leverage your expertise to provide feedback on documents and presentations, ensuring they...Remote jobHourly pay
$60 - $70 per hour
...: AI Safety Practitioner Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality. Review content involving misinformation...Contract workSummer workRemote work- ...to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work. Rather... ...‑fit and technical‑risk assessments) Score AI‑generated and human work samples against those criteria, with detailed written...
- Mercor is seeking experienced musicians to evaluate generative musical AI models in collaboration with a leading AI lab. You will assess model outputs across different categories of music in your bilingual language and contribute to structured taxonomy annotations. Ideal...Part timeImmediate start10 hours per week
- Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models in partnership with a leading AI lab. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Korean and English....Part timeImmediate startFlexible hours
- Mercor is seeking experienced music producers and audio engineers to evaluate generative music AI models, working in Punjabi and English. You will compare AI-generated songs across musicality, creativity, prompt adherence, vocal quality and production/mix, labeling genre...Hourly payImmediate start
- Mercor is hiring experienced music professionals to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards, working in Thai and English....Flexible hours
$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...Contract workSummer workWork at officeRemote work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$15 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation: $15/hour... ...months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres and assess quality...Contract workSummer workImmediate startRemote workFlexible hours$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$100 - $150 per hour
...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $... ...outreach emails. Score AI-generated and human work samples with detailed written... ...asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have...Contract workSummer workRemote work- Mercor is hiring experienced musicians to evaluate generative musical AI models in partnership with a leading AI lab. You will assess model outputs across lyrics, voice generation, and other standards, using your bilingual language skills. Ideal candidates have 3+ years...Part timeImmediate start10 hours per week
- Mercor seeks experienced music producers and audio engineers to evaluate generative music AI models in collaboration with a leading AI lab. You'll assess AI-generated music across diverse genres, label musical characteristics, review lyrics and vocals, and rate quality...Immediate startFlexible hours
- Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models in partnership with a leading AI lab. You will assess AI-generated tracks across genres and rate quality against detailed standards, working in Hindi and English. The...Hourly payImmediate startShift work
$70 - $110 per hour
...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product recommendations,... ..., order handling, and post-sale support. Provide expert feedback. Work independently and asynchronously to meet deadlines...Hourly payContract workSummer workImmediate startRemote work$120 - $175 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: CNC Machining Expert Type: Contract Compensation: $120–$175/hour Location: Remote Role Responsibilities Contribute to text-only,...Contract workSummer workRemote work$150 per hour
...Dorsey . Position: Investment Banking Expert Type: Contract Compensation: $... ...analyses. Score AI-generated and human work samples against criteria with detailed... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Contract workSummer workRemote work- Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models, in partnership with a leading AI lab. The work requires evaluating AI-generated music in Hebrew and English to assess quality across genres and styles. You will rate...Immediate start
$14 - $42 per hour
...Summers , and Jack Dorsey . Position: Music Production Expert - Hindi Type: Contract Compensation: $14–$42/hour... ...months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music on musicality , creativity , prompt adherence...Contract workSummer workImmediate startRemote work$50 per hour
About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Voice Actor: CX...Contract workSummer workRemote work- Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models, in partnership with a leading AI... ...Duration: up to 6 months Commitment: flexible. Most experts work around 20 hours per week; there is no cap Compensation: this...Hourly payImmediate startFlexible hours
- Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models, in partnership with a leading AI... ...Duration: up to 6 months Commitment: flexible. Most experts work around 20 hours per week; there is no cap We consider all...Immediate startFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Humanities Expert - Arts Evaluator. Be the first to apply!
- subject matter expert San Francisco, CA
- fulfillment expert San Francisco, CA
- guest service support expert San Francisco, CA
- technology expert San Francisco, CA
- ai evaluator San Francisco, CA
- work from home web search evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- evaluator San Francisco, CA
- education evaluator San Francisco, CA
- quality evaluator San Francisco, CA

