Analytical Evaluator - AI Feedback
$70 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses to ensure accuracy and depth in reasoning.
- Provide structured written feedback to improve AI model outputs .
- Identify nuances, implicit meanings, and gaps in reasoning in AI-generated content .
- Write clear, precise, and well-evidenced rationales beyond surface-level observations.
- Work independently and asynchronously to meet deadlines and improve AI model performance .
Qualifications
Must-Have
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills.
- Native English fluency required.
Preferred
- None specified.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Analytical Evaluator - AI Feedback in San Francisco, CA vacancy
$80 - $120 per hour
Mercor is seeking a User/Customer Research and Feedback Synthesis Evaluator to evaluate AI-generated artifacts using specific quality rubrics. The role demands deep subject-matter expertise in user research and involves providing feedback to improve AI performance. The...SuggestedRemote jobContract workWork at officeFlexible hours- ...is seeking a Data analysis / quantitative readouts Evaluator to connect elite talent with leading AI research labs. This remote position requires 5+ years... ...assess AI-generated documents for quality and provide feedback to enhance AI performance. Ideal candidates possess...SuggestedRemote jobWork at office
$80 - $120 per hour
Mercor is seeking a User/customer research and feedback synthesis Evaluator based in San Francisco, California, to evaluate AI-generated artifacts and provide structured feedback. The ideal candidate will have over 5 years of relevant experience and a high proficiency in...SuggestedRemote jobHourly payContract workWork at office$80 - $120 per hour
Mercor is seeking a Legal / compliance Evaluator to connect elite talent with AI research. This remote position involves evaluating AI-generated artifacts and providing structured feedback. The ideal candidate will have 5+ years of relevant professional experience in Legal...SuggestedRemote jobHourly payWork at office- ...seeking a Hindi Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading... ...candidates with strong academic or analytical backgrounds who are fluent in... ...clarity. - Provide structured feedback to improve model performance in...SuggestedTemporary workPart time10 hours per week
Mercor
San Francisco, CA13 days ago - ...seeking a Cybersecurity Expert to remotely evaluate AI-generated outputs related to cybersecurity and provide structured feedback on accuracy. The role requires 3+ years of... ...professional experience in cybersecurity, strong analytical skills, and proficiency in incident...Remote jobHourly payWeekly pay
$80 - $100 per hour
A leading AI research collaborator is seeking a part-time Legal Evaluator in Australia. The role involves evaluating the quality... ..., and providing structured feedback. Candidates should have experience... ...law or legal research, strong analytical skills, and excellent written communication...Hourly payPart timeFlexible hours- ...looking for a Market research / competitive intelligence Evaluator to join their team remotely. The ideal candidate will... ...Google Workspace. Responsibilities include evaluating AI-generated content and providing feedback to improve AI outputs. This role allows for flexible...Remote jobWork at officeFlexible hours
- ...headquartered in San Francisco, is seeking a Nonprofit / Philanthropy / Community Programs Evaluator. This remote position involves evaluating AI-generated artifacts, providing constructive feedback, and ensuring quality in various documents. Candidates should have over 5 years...Remote jobWork at office
$80 - $120 per hour
Mercor is seeking a Procurement / vendor management Evaluator to evaluate AI-generated content against specific quality standards. Responsibilities include identifying errors and providing feedback to enhance AI outputs. The ideal candidate should have over 5 years of experience...Remote jobHourly payWork at office$80 - $120 per hour
...Francisco is hiring a Program management / implementation planning Evaluator to evaluate AI-generated outputs against quality rubrics. The role involves identifying errors and providing structured feedback while collaborating with AI teams. The ideal candidate has 5+...Remote jobContract workWork at office$80 - $120 per hour
Mercor, based in San Francisco, is seeking an FP&A / corporate finance Evaluator to assess AI-generated artifacts and provide structured feedback. The role requires over 5 years of professional experience in corporate finance and fluency in English. This is a remote contract...Remote jobHourly payContract workWork at office- Obsidian is seeking expert Evaluators to assess AI-generated products for accuracy and quality. This remote position requires 5+ years of experience... ...quality rubrics, identify errors, and provide structured feedback. Fluency in English is essential. #J-18808-Ljbffr ObsidianRemote jobWork at office
$80 - $120 per hour
Mercor is seeking a Document/deck production QA Evaluator to evaluate AI-generated content and provide structured feedback. The ideal candidate has over 5 years of experience in QA, fluency in English, and proficiency in Microsoft Office and Google Workspace. This remote...Remote jobHourly payWork at office- Mercor is seeking a Real estate / hospitality / events Evaluator to work remotely. This role requires evaluating AI-generated artifacts and providing structured feedback. Ideal candidates will have over 5 years of relevant experience and must be fluent in English. Proficiency...Remote jobWork at office
$80 - $120 per hour
...based in San Francisco, is seeking a People ops / Recruiting Evaluator to analyze AI-generated artifacts and enhance output quality. This remote... ...an advanced degree. The role involves providing structured feedback and working independently. Competitive compensation of $80-...Remote jobContract workWork at office- Mercor is seeking an experienced Education / school Evaluator to evaluate AI-generated artifacts and provide structured feedback. The ideal candidate should have over 5 years of experience in education and fluency in English. Proficiency in Microsoft Office and Google...Remote jobContract workWork at office
$80 - $120 per hour
Mercor, based in San Francisco, is seeking a Cybersecurity / IT GRC Evaluator to evaluate AI-generated artifacts and provide structured feedback. Candidates should have over 5 years of relevant experience and fluency in English. This remote position offers a competitive...Remote jobHourly payWork at office$80 - $120 per hour
...Compliance / regulatory response with financial-services AI. The ideal candidate should have over 5 years of... ...$120 per hour. Candidates will be responsible for evaluating AI-generated outputs and providing structured feedback to enhance AI model performance. #J-18808-Ljbffr...Remote jobHourly pay- Obsidian is looking for expert Evaluators in Finance operations/audit support to review AI-generated work products for accuracy and quality. This remote hourly... ...involve evaluating outputs and providing structured feedback. Preferred candidates will hold advanced degrees...Remote jobHourly payWork at office
$80 - $120 per hour
Mercor is seeking a Software / AI / IT / data Evaluator to join their team remotely. In this role, you will evaluate AI-generated artifacts based on quality standards, providing structured feedback and ensuring accuracy. The ideal candidate will have over 5 years of experience...Remote jobHourly payContract workWork at office$80 - $120 per hour
Mercor is looking for a Cybersecurity / IT GRC Evaluator to evaluate AI-generated artifacts using specific quality rubrics. This position requires... .../ IT GRC and the ability to provide structured feedback to enhance AI model outputs. The ideal candidate has over 5...Remote jobHourly payContract work$80 - $120 per hour
Mercor is looking for a Market research / competitive intelligence Evaluator to assess AI-generated outputs. Responsibilities include evaluating artifacts, identifying errors, and providing structured feedback. This remote role offers flexible hours. The ideal candidate...Remote jobHourly payWork at officeFlexible hours- Obsidian is hiring expert Evaluators in Investment analysis / valuation / credit to review AI-generated work products for accuracy and quality. This remote, hourly... ...professional fluency in English to provide structured feedback. The ideal candidate will have over 5 years of...Hourly payWork at officeRemote work
$80 - $120 per hour
Mercor, based in San Francisco, is seeking a Healthcare operations Evaluator to evaluate AI-generated artifacts against quality standards and provide feedback. Candidates must have more than 5 years of experience in Healthcare operations and fluency in English. This contract...Remote jobContract workWork at office- ...remotely. You will be responsible for fact-checking, generating evaluation data, and assessing model responses for clarity and... ...excellent English writing skills. Attention to detail and structured analytical thinking background are crucial for this role. #J-18808-Ljbffr...Remote job
$80 - $120 per hour
Mercor is seeking a Healthcare Operations Evaluator to assess AI-generated outputs based on quality standards. You'll leverage your deep expertise in healthcare operations and provide structured feedback to enhance AI performance. Successful candidates will have at least...Remote jobContract workWork at office$80 - $120 per hour
Mercor is seeking an IP / trademark / copyright law Evaluator for a remote role. The successful candidate will evaluate AI-generated artifacts, provide structured feedback, and collaborate with research teams. Candidates should have over 5 years of relevant experience,...Remote jobContract workWork at office$80 - $120 per hour
Mercor is hiring a Legal / compliance Evaluator to evaluate AI-generated artifacts and provide structured feedback. The role demands 5+ years of experience in Legal / compliance and fluency in English. The position involves independent work improving AI performance. Compensation...Remote jobContract work$80 - $120 per hour
Mercor is seeking a Customer Success / Support Operations Evaluator to work on evaluating AI-generated artifacts against quality rubrics. The role... ...identifying errors in various formats and providing structured feedback. The position is remote at a compensation rate of $80-$1...Remote jobContract workWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Analytical Evaluator - AI Feedback. Be the first to apply!
Related searches
- work from home web search evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- evaluator San Francisco, CA
- quality evaluator San Francisco, CA
- psychological stress evaluator
- credential evaluator
- work from home web search evaluator
- child custody evaluator
- social media evaluator
- court evaluator