Analytical Evaluator - AI Feedback
$70 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses to ensure accuracy and depth in reasoning.
- Provide structured written feedback to improve AI model outputs .
- Identify nuances, implicit meanings, and gaps in reasoning in AI-generated content .
- Write clear, precise, and well-evidenced rationales beyond surface-level observations.
- Work independently and asynchronously to meet deadlines and improve AI model performance .
Qualifications
Must-Have
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills.
- Native English fluency required.
Preferred
- None specified.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 27 days ago
Similar jobs that could be interesting for youBased on the Analytical Evaluator - AI Feedback in San Francisco, CA vacancy
$80 - $120 per hour
Mercor, based in San Francisco, is seeking a Healthcare operations Evaluator to evaluate AI-generated artifacts against quality standards and provide feedback. Candidates must have more than 5 years of experience in Healthcare operations and fluency in English. This contract...SuggestedRemote jobContract workWork at office$80 - $120 per hour
Mercor is seeking a Software / AI / IT / data Evaluator to join their team remotely. In this role, you will evaluate AI-generated artifacts based on quality standards, providing structured feedback and ensuring accuracy. The ideal candidate will have over 5 years of experience...SuggestedRemote jobHourly payContract workWork at office- ...Welo Data is seeking Data Labeling Associates in California to evaluate AI outputs and ensure cultural context and safety in Arabic datasets. This role requires professional-level proficiency in Portuguese (Brazil), a bachelor's degree, and at least 2 years of experience...Suggested
Welo Data
San Francisco, CA3 days ago $80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $... ...errors. Provide clear, structured written feedback. Collaborate asynchronously to enhance...SuggestedContract workSummer workWork at officeRemote workFlexible hoursMercor
San Francisco, CA27 days ago$80 - $120 per hour
Mercor is seeking an IP / trademark / copyright law Evaluator with a strong background in relevant legal experience. This remote role involves evaluating AI-generated artifacts and collaborating with AI research teams to enhance quality. The ideal candidate has over 5...SuggestedRemote jobHourly payWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Program management / implementation planning Evaluator Type: Contract Compensation: $... ...decks. Provide clear, structured written feedback to enhance AI model outputs....Contract workSummer workWork at officeRemote workMercor
San Francisco, CA27 days ago- Welo Data is seeking Data Labeling Associates in San Francisco to evaluate AI systems focused on Arabic language nuances. The role includes model evaluation, identifying biases in datasets, and ensuring quality across global AI workflows. Candidates should have native French...
- ...deadline-driven environment. Potential to participate in San Francisco office growth. Qualifications: Strong analytical and critical thinking skills. Strong organizational and multi-tasking skills. Must have experience and be skilled in writing...Work at officeRemote workHome office
Integra Realty Resources
San Francisco, CA2 days ago $85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...Contract workSummer workRemote work$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex engineering tasks. Review model-generated mobile...Contract workSummer workRemote work$120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $... .... Provide clear, structured written feedback. Work independently and asynchronously...Remote jobContract workSummer workWork at office$120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $... .... Provide clear, structured written feedback to improve AI model outputs . Apply...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $... ...decks. Provide clear, structured written feedback to improve AI model outputs....Contract workSummer workWork at officeRemote work$15 - $20 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...tools . Generate high-quality human evaluation data by identifying response strengths,... ...experience in domains requiring structured analytical thinking . Preferred Prior...Contract workSummer workRemote work$50 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Spanish (Spain) Audio Generalist Evaluator Expert Type: Contract Compensation... ...and fluency. Provide structured feedback to improve AI model performance in Spanish...Contract workSummer workRemote work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Finance operations / audit support Evaluator Type: Contract Compensation: $... .... Provide clear, structured written feedback to enhance the quality of AI outputs....Contract workSummer workWork at officeRemote work- Merchant Mariner Course Evaluator (Deck) This vacancy is for a GS - 2101 - 12, Merchant Mariner Course Evaluator (Deck) located in the Department of Homeland Security, U.S. Coast Guard, NMC MARINER COURSE APPROVALS BRANCH.
US Government Jobs
Oakland, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Analytical Evaluator - AI Feedback. Be the first to apply!
Related searches
- work from home web search evaluator San Francisco, CA
- education evaluator San Francisco, CA
- evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- quality evaluator San Francisco, CA
- ai evaluator San Francisco, CA
- scientific evaluator
- child custody evaluator
- transcript evaluator
- travel evaluator