Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Generalist for Data Annotation [Remote]

AuraOne Human Data

Remote
  • Remote job

Generalist for Data Annotation is a remote evaluation track for reviewing generalist for data annotation evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.

Why this role matters

AI data reviewers help turn generalist for data annotation evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.

Responsibilities

  • Evaluate generalist for data annotation evaluation model outputs against a versioned rubric and assign severity tags for Generalist for Data Annotation assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
  • Document recurring failure modes so the modeling team can target them in the next training run.

Qualifications

  • Prior evaluation, annotation, or human-rater experience on generalist for data annotation evaluation or adjacent content for Generalist for Data Annotation work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Compare two generalist for data annotation evaluation model responses to the same prompt and pick the stronger one with rationale.
  • Tag an unsafe response with the correct policy category and severity.
  • Audit a 50-row batch for rubric consistency and report drift to the program lead.
  • Propose a rubric clarification after spotting a recurring failure mode.

Nice to have

  • Background in linguistics, content moderation, or trust & safety review.
  • Experience with inter-rater agreement metrics and calibration cycles.
  • Domain expertise that lets you spot subject-matter errors automated checks miss.

Skills

  • Model output evaluation
  • Rubric-based annotation
  • Severity tagging
  • Inter-rater calibration
  • Generalist for Data Annotation evaluation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Generalist for Data Annotation [Remote] in Remote vacancy
  • micro1 is engaging Generalist - Mandarin Speakers to contribute to a dynamic customer project...  ...language, technology, and meticulous data work to influence the future of artificial...  ...two extended responses side by side. Annotate data accurately, leveraging your Mandarin... 
    Suggested
    Remote work

    Micro1

    New York, NY
    5 days ago
  • micro1 is seeking a Generalist - Korean Speaker contractor to contribute to a dynamic AI training project. You will annotate Korean data, review content, and evaluate AI outputs in Korean and English, delivering detailed feedback to improve model performance. No prior... 
    Suggested
    Remote job
    For contractors

    micro1 Inc.

    New York, NY
    2 days ago
  • $21 - $35 per hour

    Pay: $21 - $35/hour Required Skills image data annotation attention to detail written and verbal communication remote collaboration annotation...  ...system ensures both quality and velocity. Role Title: Generalist for Data Annotation Role Type: Contractor Location: Remote micro... 
    Suggested
    For contractors
    Remote work

    Micro1

    New York, NY
    5 days ago
  • About the role Generalist - Video Recorder is a remote evaluation track for reviewing generalist...  ...modeling team can use to retrain. AI data reviewers help turn generalist video...  ...examples each week. Track Evaluation & annotation Work model Remote · Independent specialist... 
    Suggested
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    Auraone

    New York, NY
    5 days ago
  • Role Title: Generalist - Greek Speaker Role Type: Contractor Location: Remote micro1 is engaging Generalist - Greek Speakers to contribute to a dynamic customer project involving language data annotation and critical assessment. In this role, you'll apply your expertise... 
    Suggested
    For contractors
    Remote work

    micro1 Inc.

    New York, NY
    2 days ago
  •  ...financial services. What to Expect as the Talent Acquisition Generalist The Talent Acquisition Generalist supports the full...  ...timely resolution of exceptions, protect customer and employee data, and help ensure accounts are available for the employee’s first... 
    Full time
    Temporary work
    Part time
    Bank staff
    Remote work
    Shift work

    Climate First Bank

    Remote
    4 days ago
  • $78k - $80k

     ...Salary: $78,000 - $80,000 / year Job Summary Working as the HR Generalist, your primary focus will be to support the Human Resources...  ...increase monitoring, hiring non‑exempt associates and managing data associated with bonus administration. Key Responsibilities Ensures... 
    Hourly pay
    Contract work
    Local area
    Remote work
    Flexible hours

    FLIK Hospitality Group

    Jersey City, NJ
    6 days ago
  • Role Title: Generalist - Korean Speaker Role Type: Contractor Location: Remote micro1 is engaging Generalist - Korean Speakers to contribute...  ...strong command of both Korean and English, you will work on data annotation, language evaluation, and content review, providing... 
    For contractors
    Remote work

    micro1 Inc.

    New York, NY
    2 days ago
  • $50k - $60k

     ...Eastern Nebraska. Position Description: We are looking for an HR Generalist to recruit, prepare, and support new employees entering the...  ...periods of time. Frequent use of hands and fingers for typing, data entry, and operating office equipment. Occasional standing, walking... 
    Hourly pay
    Seasonal work
    Work at office
    Remote work
    Monday to Friday

    McAninch Corporation

    Des Moines, IA
    5 days ago
  • $60k - $65k

    HR Generalist (Staff Assistant), Human Resources Development North Shore Community College is a diverse, caring, inclusive community that...  ...professional environment. Knowledge of or ability to learn reporting and data analysis tools (such as Access, Tableau, or similar... 
    Full time
    Work at office
    Local area
    Remote work
    Monday to Friday
    1 day per week

    North Shore Community College

    Danvers, MA
    4 days ago
  • $90 per hour

    Position: Generalist Type: Contract Compensation: $50 - $90/hour Location: Remote Commitment: 10-40 hrs/week Role Responsibilities Analyze, evaluate, and annotate a variety of data sets to support AI system training and validation. Deliver clear, high-quality written input... 
    Remote job
    Contract work

    Crossing Hurdles

    New York, NY
    5 days ago
  • $59k - $74k

     ...paced Human Resources Department as an Associate Human Resources Generalist . This role is part of The Hub, Fish’s remote-first group of...  ...ability to quickly learn HRIS and similar applications required for data entry, research, and reporting, along with the willingness to... 
    Work at office
    Remote work
    Work from home

    Fish & Richardson P.C.

    Dallas, TX
    4 days ago
  • Crossing Hurdles is seeking a Generalist for Data Annotation to work remotely on image datasets. You will annotate, categorize, and ensure accuracy according to detailed project guidelines. This contract role requires strong communication, meticulous attention to detail... 
    Remote job
    Contract work

    Crossing Hurdles

    New York, NY
    2 days ago
  • $38 - $94 per hour

     ...intern to build humanoid robot foundation models and systems in the Generalist Embodied Agent Research (GEAR) group. Everything that moves...  ...: Scaling Dexterous Manipulation with Diverse Egocentric Human Data DreamZero: World Action Models are Zero-shot Policies... 
    Remote job
    Hourly pay
    Internship

    NVIDIA

    Santa Clara, CA
    1 day ago
  • Micro1 is seeking a Generalist - Mandarin Speakers to contribute to a dynamic AI training project. You will annotate long transcripts, analyze conversations, and provide structured...  ...Mandarin domain knowledge and meticulous data work will influence how AI systems learn and... 
    Remote work

    Micro1

    New York, NY
    5 days ago
  • AuraOne is seeking a remote Generalist for Data Annotation to evaluate prompts and responses against a quality rubric. You’ll help turn outputs into auditable labels, rationales, and regression cases for Human Data, reviewing frontier model outputs and calibrating evaluators... 
    Remote job

    Auraone

    New York, NY
    5 days ago
  • $86.4k - $108k

    HR Generalist Posted Date: Oct 15, 2026 Requisition Number: 130775 Why Hershey: At The Hershey Company, our culture is rooted in purpose...  ...requirements. Manage key HR processes, including HRIS/SAP data entry and reporting, attendance and leave tracking, and coordination... 
    Hourly pay
    Local area
    Flexible hours

    The Hershey Company

    Topeka, KS
    4 days ago
  • $64.79k - $76.22k

     ...maintenance, preparation of legal compliance logs, and HRIS systems data entry and maintenance Supports Field Operations with...  ...guidelines as well as Company policy Reporting Relationship The HR Generalist reports to the HR Business Partner Minimum Qualifications, Knowledge... 
    Work at office
    Local area
    Remote work
    Flexible hours

    Avolta AG

    Boston, MA
    3 days ago
  • $21 - $35 per hour

    Label and review image data against detailed project guidelines, on your own schedule, and give feedback that improves the annotation process. AI systems that work with images depend on labeled examples, and those labels have to be accurate and consistent. This project... 
    Remote job
    Hourly pay
    Part time
    For contractors
    Flexible hours

    OpenTrain AI

    New York, NY
    5 days ago
  • $61k - $76k

     ...among the workforce. This position will also be responsible for data entry into the Learning Management System, delivering courses...  ...with high school diploma . Must possess 3-5 years of strong HR Generalist experience• 1-3 years training experience in a GMP regulated field... 
    Permanent employment
    Work at office
    Local area
    Remote work

    Fresenius Kabi

    Pleasant Prairie, WI
    3 days ago
  • $20 - $80 per unit

     ...Angelo , Larry Summers , and Jack Dorsey . Position: Generalist Type: Contract Compensation: $20–$80 per task Location...  ...by 9 out of 10 people. Outline each counted object in an annotation tool for accuracy verification. Aim for image and prompt... 
    Contract work
    Summer work
    Remote work
    Flexible hours

    Mercor

    New York, NY
    1 day ago
  • $21.9 per hour

     ...IMMEDIATE VACANCIES AVAILABLE! The Preschool Services Department (PSD) is recruiting for Home Visiting Program (HVP) Program Generalists - Contract who determine eligibility for the HV Program and identify and provide appropriate resources and/or referrals for the... 
    Hourly pay
    Full time
    Contract work
    Work experience placement
    Work at office
    Immediate start
    Visa sponsorship

    County of San Bernardino, CA

    San Bernardino, CA
    5 days ago
  • $20 - $40 per hour

    Job Description: AI Image Evaluation Specialist Role Type: Contractor Part-Time Project-Based Location: Remote United States Only About the Role We are seeking detail-oriented individuals to support an AI image evaluation this role you will upload your...
    Full time
    Part time
    For contractors
    Remote work

    YO AI Labs

    New York, NY
    2 days ago
  • $50 - $70 per hour

     ...Job Description: Generalist Mandarin Speaker Role Type: Contractor Location: Remote...  .... This role involves reviewing and annotating complex conversations evaluating AI-generated...  ...extended responses. # Annotate data accurately using Mandarin language proficiency... 
    Full time
    For contractors
    Remote work

    YO AI Labs

    New York, NY
    1 day ago
  •  ...impact? Valley Cabinet is looking for a motivated and driven HR Generalist to join our team! As a family-owned company, we value our...  ...day HRIS administration, ensuring accurate employee records and data integrity. Maintain HRIS updates, troubleshoot system issues,... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Monday to Friday

    Valley Cabinet Inc.

    De Pere, WI
    2 days ago
  • $63.38k - $100.55k

     ...Mexico team. This position will have a primary assignment to NMLA's Disaster Legal Services (DLS) Program, while also maintaining a generalist civil legal services practice serving low-income residents of Northern New Mexico. The Staff Attorney may be based in NMLA's... 
    Full time
    For contractors
    Work at office
    Remote work
    2 days per week

    New Mexico Legal Aid Inc

    Santa Fe, NM
    2 days ago
  • $40k - $60k

     ...and workflow gaps in AI-generated work products. Collaborate with project teams to support AI training, quality assurance, and data annotation initiatives. Strong knowledge of healthcare operations, medical coding, billing, claims management, or revenue cycle workflows... 
    Permanent employment
    Full time
    Remote work
    10 hours per week
    Flexible hours

    Talentify.io

    New York, NY
    2 days ago
  •  ...Detail-oriented and tech-savvy, the full-time Data Annotation Specialist will work remotely to accurately label and annotate objects within visual datasets, ensuring high-quality data for AI model training in a temporary contract role. Key Responsibilities Perform Object... 
    Full time
    Temporary work
    Remote work

    Virtual Vocations Inc

    United States
    5 days ago
  •  ...frontier AI labs to generate high‑quality data, evaluations, and reinforcement learning...  ...Wallet evaluation project. This is a Generalist role and does not require candidates from...  ...Prior experience in AI evaluation, data annotation, content review, quality assurance, or fintech... 
    Remote job
    Full time
    Contract work

    Turing

    Seattle, WA
    4 days ago
  •  ...accelerating frontier research with high-quality data, advanced training pipelines, plus top...  ...Overview: We are seeking US-based generalist raters to participate in Gemini...  ...Experience in AI evaluation, data annotation, content review, quality assurance, or a... 
    Contract work
    For contractors
    Remote work

    Turing

    Remote
    6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Generalist for Data Annotation [Remote]. Be the first to apply!