Analytical Evaluator - AI Feedback
Obsidian
Overview In this role, you will evaluate AI-generated responses and provide structured written feedback. This is a great opportunity for sharp, analytical thinkers to contribute to high-impact AI research projects. Basic Qualifications Bachelor's degree from a top-500 globally ranked university preferred Strong analytical and written communication skills Ability to work independently and follow detailed task guidelines Required Skills Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning Ability to write clear, precise, and well-evidenced written rationales that go beyond surface-level observations Consistent and honest judgment, including the ability to give critical assessments when warranted Strict attention to detail and accurate application of structured evaluation guidelines #J-18808-Ljbffr
- ...seeking candidates in San Francisco, California, to evaluate AI-generated responses and provide structured feedback. Ideal candidates will possess a Bachelor's degree from a top-ranked university and strong analytical and communication skills. As part of a high-impact AI...Suggested
- ...is seeking a Data analysis / quantitative readouts Evaluator to connect elite talent with leading AI research labs. This remote position requires 5+ years... ...assess AI-generated documents for quality and provide feedback to enhance AI performance. Ideal candidates possess...SuggestedRemote jobWork at office
$80 - $120 per hour
Mercor is seeking a User/customer research and feedback synthesis Evaluator based in San Francisco, California, to evaluate AI-generated artifacts and provide structured feedback. The ideal candidate will have over 5 years of relevant experience and a high proficiency in...SuggestedRemote jobHourly payContract workWork at office$80 - $120 per hour
Mercor is seeking a Legal / compliance Evaluator to connect elite talent with AI research. This remote position involves evaluating AI-generated artifacts and providing structured feedback. The ideal candidate will have 5+ years of relevant professional experience in Legal...SuggestedRemote jobHourly payWork at office- ...seeking a Cybersecurity Expert to remotely evaluate AI-generated outputs related to cybersecurity and provide structured feedback on accuracy. The role requires 3+ years of... ...professional experience in cybersecurity, strong analytical skills, and proficiency in incident...SuggestedRemote jobHourly payWeekly pay
- Obsidian is seeking expert Evaluators in Nonprofit / philanthropy / community programs. This... ...remote role entails reviewing and assessing AI-generated outputs for accuracy and... ...artifacts, identifying errors, and providing structured feedback. #J-18808-Ljbffr ObsidianRemote jobWork at office
$80 - $120 per hour
...Compliance / regulatory response with financial-services AI. The ideal candidate should have over 5 years of... ...$120 per hour. Candidates will be responsible for evaluating AI-generated outputs and providing structured feedback to enhance AI model performance. #J-18808-Ljbffr...Remote jobHourly pay$80 - $120 per hour
Mercor, located in San Francisco, is seeking a General finance / accounting Evaluator to evaluate AI-generated artifacts. This role involves providing structured feedback, ensuring quality, and collaborating with research teams. Candidates should have 5+ years of experience...Remote jobHourly payWork at office- Obsidian is hiring expert Evaluators in Healthcare operations for a remote, hourly engagement. You will review AI-generated work products for accuracy, rigor, and domain quality... ...AI outputs and providing structured feedback to ensure high-quality results. #J-18808-Ljbffr...Remote jobHourly payWork at office
- Mercor is seeking an experienced Education / school Evaluator to evaluate AI-generated artifacts and provide structured feedback. The ideal candidate should have over 5 years of experience in education and fluency in English. Proficiency in Microsoft Office and Google...Remote jobContract workWork at office
$80 - $120 per hour
...based in San Francisco, is seeking a People ops / Recruiting Evaluator to analyze AI-generated artifacts and enhance output quality. This remote... ...an advanced degree. The role involves providing structured feedback and working independently. Competitive compensation of $80-...Remote jobContract workWork at office$80 - $120 per hour
Mercor is seeking a Healthcare / Clinical Evaluator to connect elite creative and technical talent with leading AI research labs. This fully remote role includes evaluating... ...standards, identifying errors, and providing feedback to enhance AI model performance. The ideal...Remote jobHourly payWork at office$80 - $120 per hour
Mercor is seeking a Software / AI / IT / data Evaluator to join their team remotely. In this role, you will evaluate AI-generated artifacts based on quality standards, providing structured feedback and ensuring accuracy. The ideal candidate will have over 5 years of experience...Remote jobHourly payContract workWork at office- Mercor is seeking an Education / school Evaluator to assess AI-generated artifacts while ensuring high-quality standards. This role involves... ...identifying errors in various formats and providing structured feedback. The ideal candidate will have over 5 years of experience...Remote jobContract workWork at office
$80 - $120 per hour
Mercor is seeking a People ops / recruiting Evaluator to review and improve AI-generated content. This remote position requires 5+ years of relevant... ...assess quality against specified standards and provide feedback to enhance AI model accuracy. The ideal candidate is proficient...Remote jobHourly payWork at office$80 - $120 per hour
Mercor is seeking a Customer Success / Support Operations Evaluator to work on evaluating AI-generated artifacts against quality rubrics. The role... ...identifying errors in various formats and providing structured feedback. The position is remote at a compensation rate of $80-$1...Remote jobContract workWork at office- Obsidian is seeking expert Evaluators in Biology/environmental science to assess AI-generated work products for accuracy and quality. Candidates should have over... ..., identifying errors, and providing structured feedback. Proficiency in Microsoft Office and Google Workspace...Remote jobWork at office
$80 - $120 per hour
Mercor is looking for a Cybersecurity / IT GRC Evaluator to evaluate AI-generated artifacts using specific quality rubrics. This position requires... .../ IT GRC and the ability to provide structured feedback to enhance AI model outputs. The ideal candidate has over 5...Remote jobHourly payContract work$80 - $120 per hour
Mercor, based in San Francisco, seeks a General Sales / GTM Evaluator to assess AI-generated artifacts for quality. This role requires 5+... ...AI research teams, ensuring the accuracy and effectiveness of model outputs through structured feedback. #J-18808-Ljbffr MercorRemote jobContract workWork at office$80 - $120 per hour
Mercor, based in San Francisco, is seeking a Healthcare operations Evaluator to evaluate AI-generated artifacts against quality standards and provide feedback. Candidates must have more than 5 years of experience in Healthcare operations and fluency in English. This contract...Remote jobContract workWork at office$80 - $120 per hour
Mercor is seeking a Procurement / vendor management Evaluator to evaluate AI-generated content against specific quality standards. Responsibilities include identifying errors and providing feedback to enhance AI outputs. The ideal candidate should have over 5 years of experience...Remote jobHourly payWork at office- ...-paid contractor role aimed at improving AI systems' safety, reliability, and reasoning quality. Responsibilities include evaluating AI-generated content, conducting red-teaming... .... The position requires excellent analytical skills and attention to detail. #J-18808-...Remote jobHourly payFor contractors
- Obsidian is seeking expert Evaluators in Cybersecurity / IT GRC to review AI-generated work products for accuracy and quality. This remote position requires... ...quality standards and provide structured feedback. Proficiency in Microsoft Office and Google Workspace...Remote jobWork at office
- Obsidian is seeking expert Evaluators in Public Health Communications for a remote, hourly engagement to review AI-generated work products for quality and accuracy. Candidates... ...quality metrics while providing structured feedback to improve the quality of the documents,...Remote jobHourly payWork at office
- ...looking for a Market research / competitive intelligence Evaluator to join their team remotely. The ideal candidate will... ...Google Workspace. Responsibilities include evaluating AI-generated content and providing feedback to improve AI outputs. This role allows for flexible...Remote jobWork at officeFlexible hours
- ...headquartered in San Francisco, is seeking a Nonprofit / Philanthropy / Community Programs Evaluator. This remote position involves evaluating AI-generated artifacts, providing constructive feedback, and ensuring quality in various documents. Candidates should have over 5 years...Remote jobWork at office
$80 - $120 per hour
Mercor, based in San Francisco, is seeking an FP&A / corporate finance Evaluator to assess AI-generated artifacts and provide structured feedback. The role requires over 5 years of professional experience in corporate finance and fluency in English. This is a remote contract...Remote jobHourly payContract workWork at office- ...for a Nonprofit / philanthropy / community programs Evaluator. This remote role requires a professional with over... ...particularly Slides. The successful candidate will evaluate AI-generated outputs, provide structured feedback, and collaborate with teams to ensure quality and...Remote jobWork at office
$80 - $120 per hour
Mercor is seeking a Data quality / CRM operations Evaluator to work remotely. This position involves evaluating AI-generated artifacts, providing structured feedback, and ensuring high-quality outputs. Candidates should have 5+ years of experience in data quality or CRM...Remote jobHourly payWork at office- Obsidian is looking for expert Evaluators in Humanities / arts / culture to review AI-generated work products for accuracy and quality. Candidates should have... ...evaluating artifacts against quality standards and providing structured feedback. #J-18808-Ljbffr ObsidianRemote jobWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Analytical Evaluator - AI Feedback. Be the first to apply!
