Remote Rubric Ontology Data Evaluator
AuraOne Human Data
New York, NY
- Remote job
AuraOne, Inc. is seeking a remote Rubric Ontology Data Specialist to evaluate prompts and responses against our quality rubric. Reviewers label edge cases, assign severity, and generate structured feedback to retrain our models. Your work ensures auditable labels, robust rationale, and regression cases for AuraOne Human Data across multiple review cycles. The role is contractor-based with flexible hours, focusing on accuracy and clear documentation. #J-18808-Ljbffr AuraOne Human Data
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote Rubric Ontology Data Evaluator in New York, NY vacancy
- AuraOne's Benchmark Dataset Ontology QA Reviewer role is a remote contractor position... ...responses to a versioned rubric, assign severity tags, and... ...candidates bring experience in evaluation/annotation, clear written... ...weekly calibration tasks. #J-18808-Ljbffr AuraOne Human DataRemote jobDataFor contractorsFlexible hours
- AuraOne, Inc. is seeking a diligent remote contractor to evaluate at-work video recorder outputs against a versioned rubric. You will assign severity tags, write rationales, and... ...failure modes to guide future training iterations. #J-18808-Ljbffr AuraOne Human DataRemote jobDataFor contractors
- ...contractor to act as an Anonymization Writer evaluator for long projects. Remote US-eligible, you will review model outputs, apply a versioned rubric, and provide structured feedback to help... ...to detail and clear, traceable reasoning. #J-18808-Ljbffr AuraOne Human DataRemote jobDataFor contractors
- AuraOne, Inc. is seeking a remote contractor to review Australian voice actor evaluation outputs and apply a versioned rubric. You will label edge cases, provide structured feedback... ...must be authorized to work from the United States. #J-18808-Ljbffr AuraOne Human DataRemote jobDataFor contractors10 hours per week
- ...Inc. is seeking a Hmong Language Expert for a remote evaluation track to review prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label... ...remote, US-eligible, with hourly compensation after interview. #J-18808-Ljbffr AuraOne Human DataRemote jobDataHourly payFor contractors
- AI Trainer Jobs is seeking a Cantonese Language Evaluator for a remote contractor role. You will review cantonese generalist evaluation prompts and responses, apply AuraOne's quality rubric, and label edge cases with structured feedback to retrain the model. You will compare...Remote jobDataFor contractors10 hours per week
- AuraOne, Inc. seeks an Entity Resolution Data Specialist for a remote evaluation track to review prompts and responses against AuraOne's quality rubric. You will label edge cases, write structured feedback, and help retrain models. You will compare paired outputs, assign...Remote jobDataFor contractors
- AuraOne, Inc. is seeking an AI Product Evaluator for a remote contractor role. You will review prompts and model outputs, apply a versioned rubric, and provide structured feedback to retrain... ...availability of at least 10 hours per week. #J-18808-Ljbffr AuraOne Human DataRemote jobDataFor contractors10 hours per week
- AuraOne, Inc. is seeking a remote Computer Vision Data Annotation Specialist contractor to evaluate model outputs against a versioned rubric, tag edge cases, and provide structured feedback for retraining. You will compare paired responses, label hallucinations and safety...Remote jobDataFor contractors
- ...Pharmacovigilance Safety Evaluator is a remote evaluation track for reviewing pharmacovigilance safety... ...responses against AuraOne's quality rubric. Reviewers compare paired outputs, label... ...use to retrain. Why this role matters AI data reviewers help turn pharmacovigilance...Remote workDataHourly payFor contractors10 hours per week
$70 - $120 per hour
3D Generalist (Remote | $70–$120/hr)] Position: 3D Generalist:... ...Modeling, Rigging & Animation (AI Evaluation)] Type: Full-Time... ...Develop evaluation guidelines, rubrics, and quality checks, including... ...and accuracy in AI training data. Required Qualifications...Remote workDataHourly payFull timeWeekday work- AuraOne, Inc. seeks a Finance Research Expert — AI Evaluation (Remote) to review AI outputs in finance and risk... ...ACA credentials or equivalent experience, strong written reasoning, and the ability to apply rubrics across long batches. #J-18808-Ljbffr AuraOne Human DataRemote jobData
- AuraOne, Inc. is seeking aRemote evaluation contractor for Mandarin Generalist tasks to review model outputs against a versioned rubric, label issues, and provide structured feedback... ...reliable weekly availability (at least 10 hours). #J-18808-Ljbffr AuraOne Human DataRemote jobDataFor contractors
- ...Inc. is seeking a Pharmacovigilance Safety Evaluator for a remote, contractor role. You will review model outputs against a rubric, label edge cases, and provide structured feedback... ...remote, US-eligible work and no full-time commitments. #J-18808-Ljbffr AuraOne Human DataRemote jobDataFull timeFor contractors
- ...Formality Cultural Context Reviewer for a remote contractor role based in the United... ...Korean generalist outputs against a fixed rubric, tag edge cases, and provide structured feedback... ...scores against gold-standard examples weekly. #J-18808-Ljbffr AuraOne Human DataRemote jobDataFor contractors
- AuraOne, Inc. is seeking an AI Data Reviewer for the Misinformation Context AI Evaluator track. This remote contractor role involves reviewing model outputs against AuraOne's rubric, labeling edge cases, and providing structured feedback to retrain prompts. You will compare...Remote jobDataFor contractors
- ...seeking a Management Consultant — AI Workflow Evaluator as a remote contractor to assess AI workflow evaluation outputs against a quality rubric. You will compare paired responses, label... ...an emphasis on consistency across large batches. #J-18808-Ljbffr AuraOne Human DataRemote jobDataFor contractors
- AuraOne, Inc. seeks a remote Robot Trajectory Task Evaluator to review model outputs against our quality rubric. You will compare paired responses, label edge cases, and provide... ...failures to drive rubric updates and improve evaluation #J-18808-Ljbffr AuraOne Human DataRemote jobDataFor contractors10 hours per week
- .... seeks a Revenue Recognition AI Reviewer to remotely assess evaluation prompts and responses against a published quality rubric. You will compare paired outputs, label edge... ...clear rationale, and consistency across multi-page rubrics. #J-18808-Ljbffr AuraOne Human DataRemote jobDataFor contractors10 hours per week
- AuraOne, Inc. is seeking a remote evaluator to review food delivery AI response evaluations. You... ...retrain the model according to AuraOne's rubric. Ideal candidates have prior annotation... ...emphasizes accuracy and consistency across long batches. #J-18808-Ljbffr AuraOne Human DataRemote jobDataFor contractors
- Lifted is seeking experienced evaluators to assess model-generated... ...more. You will apply defined rubrics for factuality and consistency... ...should have 3+ years in LLM/GenAI data evaluation, a Bachelor's... ...evaluating multimodal content. Remote work with flexible workload and...Remote jobDataFlexible hours
- ...is seeking a French Bilingual Expert to remotely review and evaluate French generalist prompts and responses using AuraOne’s quality rubric. You will compare paired outputs, label edge... ...compensation discussed after the interview process. #J-18808-Ljbffr AuraOne Human DataRemote jobDataFor contractors10 hours per week
- ...a dedicated Application User to evaluate AI-generated Econometrics content using EViews on Windows. This remote contract role focuses on ensuring... ...teams, develop evaluation rubrics, and provide clear feedback to improve training data quality. Independent work and meeting...Remote jobDataContract work
$60 per hour
AuraOne is seeking a remote Human Resources Expert, Mandarin Chinese (mainland China) reviewer on a CONTRACTOR basis. You will evaluate model outputs against a rubric, tag severity, and provide structured feedback to help retrain the model. The role requires strong Mandarin...Remote jobDataFor contractors10 hours per week$80 - $120 per hour
People ops / recruiting Evaluator is a remote evaluation track for reviewing people ops / recruiting... ...and responses against AuraOne's quality rubric. Reviewers compare paired outputs,... ...the modeling team can use to retrain. AI data reviewers help turn people ops / recruiting...Remote workDataFor contractors10 hours per week- AuraOne is seeking a remote, contract-based bilingual Benefits Counselor (Spanish) to review... ...and label model outputs against a quality rubric, providing structured feedback to improve AI data quality. This is a remote evaluation track with US eligibility and an hourly...Remote jobDataHourly payContract work
- Identity Abuse Security Evaluator is a remote evaluation track for reviewing identity abuse security... ...and responses against AuraOne's quality rubric. Reviewers compare paired outputs,... ...use to retrain. Why this role matters AI data reviewers help turn identity abuse security...Remote workDataHourly payFor contractors10 hours per week
- Social Content Quality Evaluator is a remote evaluation track for reviewing social content quality evaluation... ...responses against AuraOne's quality rubric. Reviewers compare paired outputs,... ...to retrain. Why this role matters AI data reviewers help turn social content quality...Remote workDataHourly payFor contractors10 hours per week
- Food Delivery AI Response Evaluator is a remote evaluation track for reviewing food delivery ai response... ...responses against AuraOne's quality rubric. Reviewers compare paired outputs,... ...use to retrain. Why this role matters AI data reviewers help turn food delivery ai response...Remote workDataHourly payFor contractors10 hours per week
- ...is seeking a Luganda Language Expert for a remote evaluation track to review Luganda prompts and model outputs against a quality rubric. Reviewers compare paired outputs, label edge... ..., and regression cases for AuraOne Human Data. Review frontier model outputs and calibrate...Remote jobDataFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Rubric Ontology Data Evaluator. Be the first to apply!
Related searches
- evaluator New York, NY
- work from home web search evaluator New York, NY
- web search evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- work from home social media evaluator New York, NY
- ai evaluator New York, NY
- education evaluator New York, NY
- quality evaluator New York, NY
- social media evaluator New York, NY


