Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Analytical Evaluator - AI Feedback

Obsidian

Overview In this role, you will evaluate AI-generated responses and provide structured written feedback. This is a great opportunity for sharp, analytical thinkers to contribute to high-impact AI research projects. Basic Qualifications Bachelor's degree from a top-500 globally ranked university preferred Strong analytical and written communication skills Ability to work independently and follow detailed task guidelines Required Skills Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning Ability to write clear, precise, and well-evidenced written rationales that go beyond surface-level observations Consistent and honest judgment, including the ability to give critical assessments when warranted Strict attention to detail and accurate application of structured evaluation guidelines #J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Analytical Evaluator - AI Feedback in San Francisco, CA vacancy
  •  ...seeking candidates in San Francisco, California, to evaluate AI-generated responses and provide structured feedback. Ideal candidates will possess a Bachelor's degree from a top-ranked university and strong analytical and communication skills. As part of a high-impact AI... 
    Suggested

    Obsidian

    San Francisco, CA
    2 days ago
  •  ...is seeking a Data analysis / quantitative readouts Evaluator to connect elite talent with leading AI research labs. This remote position requires 5+ years...  ...assess AI-generated documents for quality and provide feedback to enhance AI performance. Ideal candidates possess... 
    Suggested
    Remote job
    Work at office

    Mercor

    San Francisco, CA
    3 days ago
  • $80 - $120 per hour

    Mercor is seeking a User/customer research and feedback synthesis Evaluator based in San Francisco, California, to evaluate AI-generated artifacts and provide structured feedback. The ideal candidate will have over 5 years of relevant experience and a high proficiency in... 
    Suggested
    Remote job
    Hourly pay
    Contract work
    Work at office

    Mercor

    San Francisco, CA
    20 hours ago
  • $80 - $120 per hour

    Mercor is seeking a Legal / compliance Evaluator to connect elite talent with AI research. This remote position involves evaluating AI-generated artifacts and providing structured feedback. The ideal candidate will have 5+ years of relevant professional experience in Legal... 
    Suggested
    Remote job
    Hourly pay
    Work at office

    Mercor

    San Francisco, CA
    3 days ago
  •  ...seeking a Cybersecurity Expert to remotely evaluate AI-generated outputs related to cybersecurity and provide structured feedback on accuracy. The role requires 3+ years of...  ...professional experience in cybersecurity, strong analytical skills, and proficiency in incident... 
    Suggested
    Remote job
    Hourly pay
    Weekly pay

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    4 days ago
  • Obsidian is seeking expert Evaluators in Nonprofit / philanthropy / community programs. This...  ...remote role entails reviewing and assessing AI-generated outputs for accuracy and...  ...artifacts, identifying errors, and providing structured feedback. #J-18808-Ljbffr Obsidian
    Remote job
    Work at office

    Obsidian

    San Francisco, CA
    20 hours ago
  • $80 - $120 per hour

     ...Compliance / regulatory response with financial-services AI. The ideal candidate should have over 5 years of...  ...$120 per hour. Candidates will be responsible for evaluating AI-generated outputs and providing structured feedback to enhance AI model performance. #J-18808-Ljbffr... 
    Remote job
    Hourly pay

    Mercor

    San Francisco, CA
    20 hours ago
  • $80 - $120 per hour

    Mercor, located in San Francisco, is seeking a General finance / accounting Evaluator to evaluate AI-generated artifacts. This role involves providing structured feedback, ensuring quality, and collaborating with research teams. Candidates should have 5+ years of experience... 
    Remote job
    Hourly pay
    Work at office

    Mercor

    San Francisco, CA
    20 hours ago
  • Obsidian is hiring expert Evaluators in Healthcare operations for a remote, hourly engagement. You will review AI-generated work products for accuracy, rigor, and domain quality...  ...AI outputs and providing structured feedback to ensure high-quality results. #J-18808-Ljbffr... 
    Remote job
    Hourly pay
    Work at office

    Obsidian

    San Francisco, CA
    20 hours ago
  • Mercor is seeking an experienced Education / school Evaluator to evaluate AI-generated artifacts and provide structured feedback. The ideal candidate should have over 5 years of experience in education and fluency in English. Proficiency in Microsoft Office and Google... 
    Remote job
    Contract work
    Work at office

    Mercor

    San Francisco, CA
    3 days ago
  • $80 - $120 per hour

     ...based in San Francisco, is seeking a People ops / Recruiting Evaluator to analyze AI-generated artifacts and enhance output quality. This remote...  ...an advanced degree. The role involves providing structured feedback and working independently. Competitive compensation of $80-... 
    Remote job
    Contract work
    Work at office

    Mercor

    San Francisco, CA
    3 days ago
  • $80 - $120 per hour

    Mercor is seeking a Healthcare / Clinical Evaluator to connect elite creative and technical talent with leading AI research labs. This fully remote role includes evaluating...  ...standards, identifying errors, and providing feedback to enhance AI model performance. The ideal... 
    Remote job
    Hourly pay
    Work at office

    Mercor

    San Francisco, CA
    20 hours ago
  • $80 - $120 per hour

    Mercor is seeking a Software / AI / IT / data Evaluator to join their team remotely. In this role, you will evaluate AI-generated artifacts based on quality standards, providing structured feedback and ensuring accuracy. The ideal candidate will have over 5 years of experience... 
    Remote job
    Hourly pay
    Contract work
    Work at office

    Mercor

    San Francisco, CA
    3 days ago
  • Mercor is seeking an Education / school Evaluator to assess AI-generated artifacts while ensuring high-quality standards. This role involves...  ...identifying errors in various formats and providing structured feedback. The ideal candidate will have over 5 years of experience... 
    Remote job
    Contract work
    Work at office

    Mercor

    San Francisco, CA
    1 day ago
  • $80 - $120 per hour

    Mercor is seeking a People ops / recruiting Evaluator to review and improve AI-generated content. This remote position requires 5+ years of relevant...  ...assess quality against specified standards and provide feedback to enhance AI model accuracy. The ideal candidate is proficient... 
    Remote job
    Hourly pay
    Work at office

    Mercor

    San Francisco, CA
    20 hours ago
  • $80 - $120 per hour

    Mercor is seeking a Customer Success / Support Operations Evaluator to work on evaluating AI-generated artifacts against quality rubrics. The role...  ...identifying errors in various formats and providing structured feedback. The position is remote at a compensation rate of $80-$1... 
    Remote job
    Contract work
    Work at office

    Mercor

    San Francisco, CA
    3 days ago
  • Obsidian is seeking expert Evaluators in Biology/environmental science to assess AI-generated work products for accuracy and quality. Candidates should have over...  ..., identifying errors, and providing structured feedback. Proficiency in Microsoft Office and Google Workspace... 
    Remote job
    Work at office

    Obsidian

    San Francisco, CA
    20 hours ago
  • $80 - $120 per hour

    Mercor is looking for a Cybersecurity / IT GRC Evaluator to evaluate AI-generated artifacts using specific quality rubrics. This position requires...  .../ IT GRC and the ability to provide structured feedback to enhance AI model outputs. The ideal candidate has over 5... 
    Remote job
    Hourly pay
    Contract work

    Mercor

    San Francisco, CA
    20 hours ago
  • $80 - $120 per hour

    Mercor, based in San Francisco, seeks a General Sales / GTM Evaluator to assess AI-generated artifacts for quality. This role requires 5+...  ...AI research teams, ensuring the accuracy and effectiveness of model outputs through structured feedback. #J-18808-Ljbffr Mercor
    Remote job
    Contract work
    Work at office

    Mercor

    San Francisco, CA
    2 days ago
  • $80 - $120 per hour

    Mercor, based in San Francisco, is seeking a Healthcare operations Evaluator to evaluate AI-generated artifacts against quality standards and provide feedback. Candidates must have more than 5 years of experience in Healthcare operations and fluency in English. This contract... 
    Remote job
    Contract work
    Work at office

    Mercor

    San Francisco, CA
    20 hours ago
  • $80 - $120 per hour

    Mercor is seeking a Procurement / vendor management Evaluator to evaluate AI-generated content against specific quality standards. Responsibilities include identifying errors and providing feedback to enhance AI outputs. The ideal candidate should have over 5 years of experience... 
    Remote job
    Hourly pay
    Work at office

    Mercor

    San Francisco, CA
    20 hours ago
  •  ...-paid contractor role aimed at improving AI systems' safety, reliability, and reasoning quality. Responsibilities include evaluating AI-generated content, conducting red-teaming...  .... The position requires excellent analytical skills and attention to detail. #J-18808-... 
    Remote job
    Hourly pay
    For contractors

    YO IT Consulting

    San Francisco, CA
    4 days ago
  • Obsidian is seeking expert Evaluators in Cybersecurity / IT GRC to review AI-generated work products for accuracy and quality. This remote position requires...  ...quality standards and provide structured feedback. Proficiency in Microsoft Office and Google Workspace... 
    Remote job
    Work at office

    Obsidian

    San Francisco, CA
    20 hours ago
  • Obsidian is seeking expert Evaluators in Public Health Communications for a remote, hourly engagement to review AI-generated work products for quality and accuracy. Candidates...  ...quality metrics while providing structured feedback to improve the quality of the documents,... 
    Remote job
    Hourly pay
    Work at office

    Obsidian

    San Francisco, CA
    20 hours ago
  •  ...looking for a Market research / competitive intelligence Evaluator to join their team remotely. The ideal candidate will...  ...Google Workspace. Responsibilities include evaluating AI-generated content and providing feedback to improve AI outputs. This role allows for flexible... 
    Remote job
    Work at office
    Flexible hours

    Mercor

    San Francisco, CA
    20 hours ago
  •  ...headquartered in San Francisco, is seeking a Nonprofit / Philanthropy / Community Programs Evaluator. This remote position involves evaluating AI-generated artifacts, providing constructive feedback, and ensuring quality in various documents. Candidates should have over 5 years... 
    Remote job
    Work at office

    Mercor

    San Francisco, CA
    1 day ago
  • $80 - $120 per hour

    Mercor, based in San Francisco, is seeking an FP&A / corporate finance Evaluator to assess AI-generated artifacts and provide structured feedback. The role requires over 5 years of professional experience in corporate finance and fluency in English. This is a remote contract... 
    Remote job
    Hourly pay
    Contract work
    Work at office

    Mercor

    San Francisco, CA
    3 days ago
  •  ...for a Nonprofit / philanthropy / community programs Evaluator. This remote role requires a professional with over...  ...particularly Slides. The successful candidate will evaluate AI-generated outputs, provide structured feedback, and collaborate with teams to ensure quality and... 
    Remote job
    Work at office

    Mercor

    San Francisco, CA
    3 days ago
  • $80 - $120 per hour

    Mercor is seeking a Data quality / CRM operations Evaluator to work remotely. This position involves evaluating AI-generated artifacts, providing structured feedback, and ensuring high-quality outputs. Candidates should have 5+ years of experience in data quality or CRM... 
    Remote job
    Hourly pay
    Work at office

    Mercor

    San Francisco, CA
    2 days ago
  • Obsidian is looking for expert Evaluators in Humanities / arts / culture to review AI-generated work products for accuracy and quality. Candidates should have...  ...evaluating artifacts against quality standards and providing structured feedback. #J-18808-Ljbffr Obsidian
    Remote job
    Work at office

    Obsidian

    San Francisco, CA
    20 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Analytical Evaluator - AI Feedback. Be the first to apply!