Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Government Benefits AI Evaluator - Quality & Feedback

AuraOne

New York, NY
  • Remote job

AuraOne is seeking a Government Benefits AI Evaluator to remotely review prompts and model outputs against AuraOne's quality rubric. You will label edge cases and provide structured feedback to retrain the model. This contractor role emphasizes clear written reasoning, attention to detail, and consistency across long evaluation batches. You will work asynchronously for at least 10 hours per week from the US. #J-18808-Ljbffr AuraOne

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Remote Government Benefits AI Evaluator - Quality & Feedback in New York, NY vacancy
  •  ...Government Benefits AI Evaluator is a remote evaluation track for reviewing government benefits ai evaluation prompts...  ...and responses against AuraOne's quality rubric. Reviewers compare paired...  ...and write the kind of structured feedback the modeling team can use to retrain... 
    Remote job
    Quality
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    24 days ago
  • AuraOne is seeking a remote Classroom Scenario AI Evaluator to review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to retrain the model. This contractor role requires prior evaluation... 
    Remote job
    Quality
    Hourly pay
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    2 days ago
  • $80 - $120 per hour

    Mercor is seeking a User/Customer Research and Feedback Synthesis Evaluator to evaluate AI-generated artifacts using specific quality rubrics. The role demands deep subject-...  ...This is a contract position with a flexible remote working arrangement, offering a competitive... 
    Remote job
    Quality
    Contract work
    Work at office
    Flexible hours

    Mercor

    San Francisco, CA
    2 days ago
  • $70 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen...  ...Provide structured written feedback to improve training data quality and downstream performance.... 
    Remote work
    Quality
    Contract work
    Summer work

    Mercor

    Philadelphia, PA
    7 days ago
  • YO IT Consulting is seeking an AI Trainer & Evaluator for a remote contract role. You will train AI systems...  ...annotating data, and providing actionable feedback to improve model performance. You’ll...  ...areas while maintaining high-quality annotations. The ideal candidate has... 
    Remote job
    Quality
    Contract work

    YO IT Consulting

    Atlanta, GA
    4 days ago
  • Productive Playhouse is seeking a Kinyarwanda AI Product Evaluator. This freelancer role involves direct interaction with AI chatbots to test quality, safety, and helpfulness, with...  ...batches and flexible hours. You’ll work remotely from anywhere, choose tasks, and report... 
    Remote job
    Quality
    Freelance
    Flexible hours

    Productive Playhouse

    New York, NY
    2 days ago
  • $14.5 per hour

     ...datasets that are high-quality, ethically sourced...  ...supercharge their AI models. As a...  ...relevance and quality. Evaluate and rate the...  ...expectations. Offer feedback and recommendations...  ...Seeks a flexible, remote job that can...  ...possibility of extension. Benefits Medical Insurance... 
    Remote work
    Quality
    Hourly pay
    Part time
    Immediate start
    Work from home
    10 hours per week
    Flexible hours

    Kanz

    Dallas, TX
    18 hours ago
  •  ...looking for English AI Search Evaluators to help improve the online...  ...guidelines. Your feedback will directly help develop...  ...Details Location: Remote, based in the US...  .... Start Date: ASAP Benefits We offer a comprehensive...  ...is "Scout Search Quality Rater - English (United... 
    Remote work
    Quality
    Part time
    Currently hiring
    Immediate start
    Flexible hours

    Welo Data

    New York, NY
    2 days ago
  • $14.5 per hour

     ...datasets that are high-quality, ethically sourced...  ...supercharge their AI models. As a...  ...team as a Web Search Evaluator and help shape the...  .... Provide feedback to improve search...  ...work-life balance. Remote Work: Enjoy the freedom...  ...Additional Information Benefits of Joining Our... 
    Remote work
    Quality
    Bi-weekly pay
    Hourly pay
    Part time
    Immediate start
    Work from home
    Flexible hours

    Jobs for Humanity

    Jacksonville, FL
    2 days ago
  • $80 - $120 per hour

    Role Description ~Evaluate AI-generated artifacts against domain-specific quality rubrics. ~Identify factual...  ..., structured written feedback to improve AI outputs....  ...institution. Benefits ~Compensation: $80–$...  ...20/hour ~Location: Remote Application Process... 
    Remote work
    Quality
    Part time
    Work at office

    Mercor

    Remote
    4 days ago
  • $80 - $120 per hour

     ...Role Overview Assess AI-generated government and public...  ...and domain-specific quality. Use subject-matter expertise...  ...deliver clear, actionable feedback that improves factual...  ...and slide decks. Evaluate outputs using domain-...  .... Work Terms Remote engagement. Paid... 
    Remote work
    Quality
    Hourly pay
    Work at office

    SaidGig

    United States
    13 days ago
  • $80 - $120 per hour

    Role Description ~Evaluate AI-generated artifacts against domain-specific quality rubrics. ~Identify factual...  ..., structured written feedback to improve AI model...  ...reputable institution. Benefits ~Compensation: $80–$...  ...20/hour ~Location: Remote Application... 
    Remote work
    Quality
    Part time
    Work at office

    Mercor

    Remote
    a month ago
  •  ...Student Feedback AI Evaluator is a remote review track for evaluating AI outputs across student feedback ai specialist operations workflows. Reviewers...  ...playbooks or firm guidance. Maintain reviewer-quality scores in inter-rater calibration cycles. Qualifications... 
    Remote job
    Quality
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    24 days ago
  • Feitong Buke is hiring a Lead AI Trainer to oversee and enhance the quality of AI model dialogues with...  ...for accuracy, providing feedback to annotators, and...  ...conversational responses. This is a remote full-time position offering substantial benefits, including health... 
    Remote job
    Quality
    Full time

    Feitong Buke

    New York, NY
    4 days ago
  • Obsidian is seeking expert Evaluators in Privacy / regulatory compliance to review AI-generated work products for accuracy and quality. The role is remote and requires 5+ years of relevant experience...  ...errors, and provide structured feedback. This is an hourly engagement,... 
    Remote job
    Quality
    Hourly pay
    Work at office

    Obsidian

    New York, NY
    8 hours ago
  • $20 - $26 per hour

    Prolific is looking for an AI Trainer who is a fluent Lithuanian speaker to evaluate audio models used in AI development. The role involves reviewing audio snippets, providing feedback on voice quality, and ensuring cultural relevance in pronunciation. Candidates must... 
    Remote job
    Quality
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Chicago, IL
    2 days ago
  • $80 - $120 per hour

     ...contracts / diligence / redlines Evaluator to assess AI-generated artifacts. This role...  ...The ideal candidate will evaluate quality rubrics, provide structured feedback, and work independently to...  ...Compensation is $80-$120/hour with a fully remote work environment. #J-18808-... 
    Remote job
    Quality

    Mercor

    New York, NY
    4 days ago
  • $20 - $30 per hour

    A remote-focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing actionable feedback to enhance product quality. Ideal candidates will have strong... 
    Remote job
    Quality
    Hourly pay

    Crossing Hurdles

    New York, NY
    2 days ago
  • Turing is seeking detail-oriented AI Analysts based in the United States for a Google Wallet evaluation project. This role allows you to engage with...  ...evaluate model responses, review output quality, and provide structured feedback. The position is a full-time contract... 
    Remote job
    Quality
    Full time
    Contract work

    Turing

    Seattle, WA
    3 days ago
  •  ...assembling a pool of British English speakers to test and evaluate leading AI chatbots. Independent, project-based work lets...  ...tasks delivered in batches. You will provide feedback on safety, usefulness, and language quality, contributing directly to model improvements... 
    Remote job
    Quality
    Flexible hours

    Productive Playhouse

    New York, NY
    2 days ago
  • Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in...  ...evaluating documents and providing structured feedback. #J-18808-Ljbffr Obsidian
    Remote job
    Quality
    Work at office

    Obsidian

    New York, NY
    4 days ago
  • Obsidian is hiring expert Evaluators in Investment analysis / valuation / credit to review AI-generated work products for accuracy and quality. This remote, hourly position requires deep subject...  ...in English to provide structured feedback. The ideal candidate will have... 
    Remote work
    Quality
    Hourly pay
    Work at office

    Obsidian

    San Francisco, CA
    2 days ago
  • Obsidian is looking for expert Evaluators in Finance operations/audit support to review AI-generated work products for accuracy and quality. This remote hourly position requires a minimum of...  ...outputs and providing structured feedback. Preferred candidates will hold advanced... 
    Remote job
    Quality
    Hourly pay
    Work at office

    Obsidian

    San Francisco, CA
    2 days ago
  •  ...Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence,...  ..., attention to detail, and the ability to give structured feedback. This is a short-term engagement, starting ASAP. #J-18808-Ljbffr... 
    Remote job
    Quality
    Contract work
    Temporary work
    Immediate start

    MERIT Beauty

    New York, NY
    18 hours ago
  • Mercor partners with a leading AI research organization to engage senior UI/UX and product...  ...grading criteria for AI-driven design evaluation tasks. You will design task-specific...  ...judgments across real digital products, with feedback integrated from senior reviewers and... 
    Remote job
    Quality

    FirstCash, Inc.

    Surprise, AZ
    1 day ago
  • Mercor is seeking a General business strategy / management Evaluator for a remote position. You will evaluate AI-generated documents and provide structured feedback to enhance quality. The ideal candidate has 5+ years experience in a relevant field and professional fluency... 
    Remote job
    Quality
    Work at office

    Mercor

    New York, NY
    18 hours ago
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical... 
    Remote job
    Quality
    Hourly pay
    Part time
    Flexible hours

    Welo Data

    New York, NY
    4 days ago
  • $80 - $120 per hour

     ...seeking a Media / journalism / communications Evaluator to evaluate AI-generated artifacts and provide structured feedback. Ideal candidates will have over 5 years of experience and must be fluent in English. This remote role requires proficiency in Microsoft Office and... 
    Remote job
    Quality
    Hourly pay
    Work at office

    Mercor

    San Francisco, CA
    2 days ago
  • $30 per hour

     ...$20-$30/hour Location: Remote Commitment: 10-40 hours...  ...Role Responsibilities Evaluate outputs from large language...  ...defined rubrics and quality standards. Review multi...  ...structured, actionable feedback to support model refinement...  ...in LLM evaluation, AI output analysis, QA/testing... 
    Remote job
    Quality
    Hourly pay
    Contract work

    Crossing Hurdles

    New York, NY
    2 days ago
  • $11.5 per hour

     ...institution is offering a part-time remote position as an Online Task...  .... In this role, you will evaluate and provide feedback on content to enhance search engine results and quality. No prior experience is needed...  ...of contributors involved in AI advancements. #J-18808-Ljbffr... 
    Remote job
    Quality
    Hourly pay
    Part time

    University of Delaware

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Government Benefits AI Evaluator - Quality & Feedback. Be the first to apply!