Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Rubric Ontology Data Evaluator

AuraOne Human Data

New York, NY
  • Remote job

AuraOne, Inc. is seeking a remote Rubric Ontology Data Specialist to evaluate prompts and responses against our quality rubric. Reviewers label edge cases, assign severity, and generate structured feedback to retrain our models. Your work ensures auditable labels, robust rationale, and regression cases for AuraOne Human Data across multiple review cycles. The role is contractor-based with flexible hours, focusing on accuracy and clear documentation. #J-18808-Ljbffr AuraOne Human Data

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote Rubric Ontology Data Evaluator in New York, NY vacancy
  • AuraOne's Benchmark Dataset Ontology QA Reviewer role is a remote contractor position...  ...responses to a versioned rubric, assign severity tags, and...  ...candidates bring experience in evaluation/annotation, clear written...  ...weekly calibration tasks. #J-18808-Ljbffr AuraOne Human Data
    Remote job
    Data
    For contractors
    Flexible hours

    AuraOne Human Data

    New York, NY
    1 day ago
  • AuraOne, Inc. is seeking a diligent remote contractor to evaluate at-work video recorder outputs against a versioned rubric. You will assign severity tags, write rationales, and...  ...failure modes to guide future training iterations. #J-18808-Ljbffr AuraOne Human Data
    Remote job
    Data
    For contractors

    AuraOne Human Data

    New York, NY
    4 days ago
  •  ...contractor to act as an Anonymization Writer evaluator for long projects. Remote US-eligible, you will review model outputs, apply a versioned rubric, and provide structured feedback to help...  ...to detail and clear, traceable reasoning. #J-18808-Ljbffr AuraOne Human Data
    Remote job
    Data
    For contractors

    AuraOne Human Data

    New York, NY
    2 days ago
  • AuraOne, Inc. is seeking a remote contractor to review Australian voice actor evaluation outputs and apply a versioned rubric. You will label edge cases, provide structured feedback...  ...must be authorized to work from the United States. #J-18808-Ljbffr AuraOne Human Data
    Remote job
    Data
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    2 days ago
  •  ...Inc. is seeking a Hmong Language Expert for a remote evaluation track to review prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label...  ...remote, US-eligible, with hourly compensation after interview. #J-18808-Ljbffr AuraOne Human Data
    Remote job
    Data
    Hourly pay
    For contractors

    AuraOne Human Data

    New York, NY
    2 days ago
  • AI Trainer Jobs is seeking a Cantonese Language Evaluator for a remote contractor role. You will review cantonese generalist evaluation prompts and responses, apply AuraOne's quality rubric, and label edge cases with structured feedback to retrain the model. You will compare... 
    Remote job
    Data
    For contractors
    10 hours per week

    Auraone

    New York, NY
    3 days ago
  • AuraOne, Inc. seeks an Entity Resolution Data Specialist for a remote evaluation track to review prompts and responses against AuraOne's quality rubric. You will label edge cases, write structured feedback, and help retrain models. You will compare paired outputs, assign... 
    Remote job
    Data
    For contractors

    AuraOne Human Data

    New York, NY
    2 days ago
  • AuraOne, Inc. is seeking an AI Product Evaluator for a remote contractor role. You will review prompts and model outputs, apply a versioned rubric, and provide structured feedback to retrain...  ...availability of at least 10 hours per week. #J-18808-Ljbffr AuraOne Human Data
    Remote job
    Data
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    3 days ago
  • AuraOne, Inc. is seeking a remote Computer Vision Data Annotation Specialist contractor to evaluate model outputs against a versioned rubric, tag edge cases, and provide structured feedback for retraining. You will compare paired responses, label hallucinations and safety... 
    Remote job
    Data
    For contractors

    AuraOne, Inc.

    New York, NY
    2 days ago
  •  ...Pharmacovigilance Safety Evaluator is a remote evaluation track for reviewing pharmacovigilance safety...  ...responses against AuraOne's quality rubric. Reviewers compare paired outputs, label...  ...use to retrain. Why this role matters AI data reviewers help turn pharmacovigilance... 
    Remote work
    Data
    Hourly pay
    For contractors
    10 hours per week

    AuraOne, Inc.

    New York, NY
    15 hours ago
  • $70 - $120 per hour

    3D Generalist (Remote | $70–$120/hr)] Position: 3D Generalist:...  ...Modeling, Rigging & Animation (AI Evaluation)] Type: Full-Time...  ...Develop evaluation guidelines, rubrics, and quality checks, including...  ...and accuracy in AI training data. Required Qualifications... 
    Remote work
    Data
    Hourly pay
    Full time
    Weekday work

    Synthires

    United States
    2 days ago
  • AuraOne, Inc. seeks a Finance Research Expert — AI Evaluation (Remote) to review AI outputs in finance and risk...  ...ACA credentials or equivalent experience, strong written reasoning, and the ability to apply rubrics across long batches. #J-18808-Ljbffr AuraOne Human Data
    Remote job
    Data

    AuraOne Human Data

    New York, NY
    1 day ago
  • AuraOne, Inc. is seeking aRemote evaluation contractor for Mandarin Generalist tasks to review model outputs against a versioned rubric, label issues, and provide structured feedback...  ...reliable weekly availability (at least 10 hours). #J-18808-Ljbffr AuraOne Human Data
    Remote job
    Data
    For contractors

    AuraOne Human Data

    New York, NY
    4 days ago
  •  ...Inc. is seeking a Pharmacovigilance Safety Evaluator for a remote, contractor role. You will review model outputs against a rubric, label edge cases, and provide structured feedback...  ...remote, US-eligible work and no full-time commitments. #J-18808-Ljbffr AuraOne Human Data
    Remote job
    Data
    Full time
    For contractors

    AuraOne Human Data

    New York, NY
    1 day ago
  •  ...Formality Cultural Context Reviewer for a remote contractor role based in the United...  ...Korean generalist outputs against a fixed rubric, tag edge cases, and provide structured feedback...  ...scores against gold-standard examples weekly. #J-18808-Ljbffr AuraOne Human Data
    Remote job
    Data
    For contractors

    AuraOne Human Data

    New York, NY
    2 days ago
  • AuraOne, Inc. is seeking an AI Data Reviewer for the Misinformation Context AI Evaluator track. This remote contractor role involves reviewing model outputs against AuraOne's rubric, labeling edge cases, and providing structured feedback to retrain prompts. You will compare... 
    Remote job
    Data
    For contractors

    AuraOne Human Data

    New York, NY
    1 day ago
  •  ...seeking a Management Consultant — AI Workflow Evaluator as a remote contractor to assess AI workflow evaluation outputs against a quality rubric. You will compare paired responses, label...  ...an emphasis on consistency across large batches. #J-18808-Ljbffr AuraOne Human Data
    Remote job
    Data
    For contractors

    AuraOne Human Data

    New York, NY
    1 day ago
  • AuraOne, Inc. seeks a remote Robot Trajectory Task Evaluator to review model outputs against our quality rubric. You will compare paired responses, label edge cases, and provide...  ...failures to drive rubric updates and improve evaluation #J-18808-Ljbffr AuraOne Human Data
    Remote job
    Data
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    1 day ago
  •  .... seeks a Revenue Recognition AI Reviewer to remotely assess evaluation prompts and responses against a published quality rubric. You will compare paired outputs, label edge...  ...clear rationale, and consistency across multi-page rubrics. #J-18808-Ljbffr AuraOne Human Data
    Remote job
    Data
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    2 days ago
  • AuraOne, Inc. is seeking a remote evaluator to review food delivery AI response evaluations. You...  ...retrain the model according to AuraOne's rubric. Ideal candidates have prior annotation...  ...emphasizes accuracy and consistency across long batches. #J-18808-Ljbffr AuraOne Human Data
    Remote job
    Data
    For contractors

    AuraOne Human Data

    New York, NY
    4 days ago
  • Lifted is seeking experienced evaluators to assess model-generated...  ...more. You will apply defined rubrics for factuality and consistency...  ...should have 3+ years in LLM/GenAI data evaluation, a Bachelor's...  ...evaluating multimodal content. Remote work with flexible workload and... 
    Remote job
    Data
    Flexible hours

    Lifted (Upwork)

    New York, NY
    1 day ago
  •  ...is seeking a French Bilingual Expert to remotely review and evaluate French generalist prompts and responses using AuraOne’s quality rubric. You will compare paired outputs, label edge...  ...compensation discussed after the interview process. #J-18808-Ljbffr AuraOne Human Data
    Remote job
    Data
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    2 days ago
  •  ...a dedicated Application User to evaluate AI-generated Econometrics content using EViews on Windows. This remote contract role focuses on ensuring...  ...teams, develop evaluation rubrics, and provide clear feedback to improve training data quality. Independent work and meeting... 
    Remote job
    Data
    Contract work

    Mercor

    San Francisco, CA
    2 days ago
  • $60 per hour

    AuraOne is seeking a remote Human Resources Expert, Mandarin Chinese (mainland China) reviewer on a CONTRACTOR basis. You will evaluate model outputs against a rubric, tag severity, and provide structured feedback to help retrain the model. The role requires strong Mandarin... 
    Remote job
    Data
    For contractors
    10 hours per week

    Auraone

    New York, NY
    5 hours ago
  • $80 - $120 per hour

    People ops / recruiting Evaluator is a remote evaluation track for reviewing people ops / recruiting...  ...and responses against AuraOne's quality rubric. Reviewers compare paired outputs,...  ...the modeling team can use to retrain. AI data reviewers help turn people ops / recruiting... 
    Remote work
    Data
    For contractors
    10 hours per week

    Auraone

    New York, NY
    4 days ago
  • AuraOne is seeking a remote, contract-based bilingual Benefits Counselor (Spanish) to review...  ...and label model outputs against a quality rubric, providing structured feedback to improve AI data quality. This is a remote evaluation track with US eligibility and an hourly... 
    Remote job
    Data
    Hourly pay
    Contract work

    Auraone

    New York, NY
    5 hours ago
  • Identity Abuse Security Evaluator is a remote evaluation track for reviewing identity abuse security...  ...and responses against AuraOne's quality rubric. Reviewers compare paired outputs,...  ...use to retrain. Why this role matters AI data reviewers help turn identity abuse security... 
    Remote work
    Data
    Hourly pay
    For contractors
    10 hours per week

    AuraOne, Inc.

    New York, NY
    1 day ago
  • Social Content Quality Evaluator is a remote evaluation track for reviewing social content quality evaluation...  ...responses against AuraOne's quality rubric. Reviewers compare paired outputs,...  ...to retrain. Why this role matters AI data reviewers help turn social content quality... 
    Remote work
    Data
    Hourly pay
    For contractors
    10 hours per week

    AuraOne, Inc.

    New York, NY
    1 day ago
  • Food Delivery AI Response Evaluator is a remote evaluation track for reviewing food delivery ai response...  ...responses against AuraOne's quality rubric. Reviewers compare paired outputs,...  ...use to retrain. Why this role matters AI data reviewers help turn food delivery ai response... 
    Remote work
    Data
    Hourly pay
    For contractors
    10 hours per week

    AuraOne, Inc.

    New York, NY
    4 days ago
  •  ...is seeking a Luganda Language Expert for a remote evaluation track to review Luganda prompts and model outputs against a quality rubric. Reviewers compare paired outputs, label edge...  ..., and regression cases for AuraOne Human Data. Review frontier model outputs and calibrate... 
    Remote job
    Data
    For contractors

    Auraone

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Rubric Ontology Data Evaluator. Be the first to apply!