AI Interaction Quality Reviewer & Rubric Specialist
AuraOne Human Data
AuraOne, Inc. is seeking an AI Agent Interaction Specialist to remotely review ai agent interaction evaluation prompts and responses against AuraOne's quality rubric. You will compare paired outputs, label edge cases, and write structured feedback for the modeling team to retrain. The role requires careful attention to detail, clear written reasoning citing rubric clauses, and reliable availability for at least 10 hours per week. #J-18808-Ljbffr AuraOne Human Data
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Interaction Quality Reviewer & Rubric Specialist in New York, NY vacancy
- AuraOne is seeking an AI Agent Evaluator to remotely review and label ai agent evaluation prompts and responses against AuraOne's quality rubric. You will compare outputs, identify edge cases, and provide structured feedback to support retraining. The role focuses on auditing...QualityRemote job
- You will grade tone, escalation logic, and policy adherence on a structured rubric, flag risks, and help ensure quality and reliability in automated tasks. This is a contractor role with flexible hours, requiring at least 10 hours per week and US work authorization. #J...QualityRemote jobFor contractors10 hours per weekFlexible hours
- AI Trainer Jobs is seeking a detail-oriented QA reviewer to assess AI-generated or edited video content for quality, pacing, transitions, and audio sync. Workflows are browser-based with 3... ...timestamps and rate outputs using a rubric. You will need at least 12 months of...Quality
- AuraOne, Inc. is seeking a Knowledge Retrieval Research QA Specialist as a remote contractor to review prompts and model outputs against AuraOne's quality rubric. You will label edge cases, write structured feedback, and help retrain the evaluation system. Responsibilities...QualityFor contractorsRemote work
- The role emphasizes precise rubric application, clear written reasoning, and attention to detail. Applicants should have experience in earth systems evaluation and be available asynchronously for at least 10 hours per week. #J-18808-Ljbffr AuraOne, Inc.QualityRemote job10 hours per week
$20 - $50 per hour
AI Trainer Jobs is seeking a Quality Analyst for a remote review track evaluating AI outputs across quality analyst workflows. Reviewers grade workflow correctness... ...requires direct QA experience, the ability to apply rubrics across long batches, and clear written reasoning....QualityRemote jobHourly payFor contractors- AuraOne, Inc. is seeking a remote Differential Diagnosis AI Reviewer to evaluate evaluation prompts and responses against the company's quality rubric. You will compare paired outputs, label edge cases, and write structured feedback for model retraining. The role is an...QualityRemote jobFor contractors10 hours per week
- ...contractor for Biology PhD Coding Experts to evaluate AI outputs in biology reasoning, calculations, and research workflows. Reviewers grade derivations, reproduce key results, and... ...availability and a willingness to work across long batches and rubrics. #J-18808-Ljbffr AuraOneQualityRemote jobContract workFor contractors
- AI Trainer Jobs is seeking a remote reviewer for Agentic AI Expert tasks. You will assess AI outputs against defined workflows, policies, and playbooks,... ...direct experience with agentic AI operations, strong rubric adherence, and exceptional attention to detail. Flexible...QualityRemote job10 hours per weekFlexible hours
- AuraOne is seeking a Spanish-Language Consumer Reviewer to work remotely as a contractor evaluating model outputs against AuraOne's rubric. You will compare paired responses, label edge cases, and provide structured feedback to help retrain the model. This remote role requires...QualityRemote jobFor contractors10 hours per week
- ...seeking a Bilingual (Spanish) Benefits Counselor on a remote evaluation track. You will review Spanish generalist evaluation prompts and responses against AuraOne's quality rubric, comparing paired outputs, labeling edge cases, and writing structured feedback for retraining...QualityRemote jobFor contractorsFlexible hours
- AuraOne Human Data is seeking a remote reviewer to evaluate AI-generated outputs across recruiting workflows. Reviewers will grade workflow correctness... ...experience on real teams, strong ability to apply rubrics consistently, and clear written reasoning to name the policies...QualityRemote jobFor contractors
- ...an experienced remote evaluation generalist to review application users premiere on Windows outputs and annotate with rubric-based labels. You will compare responses,... ...flexible weekly hours. Role focuses on ensuring quality and consistency across long batches, with emphasis...QualityRemote jobFor contractorsFlexible hours
- Epidemiology AI Reviewer is a remote clinical-review track for evaluating... ...handling on a structured rubric. Flag patient-safety issues with... .... Maintain reviewer-quality scores in weekly inter-rater... ...eligible. Remote - Independent specialist contractor. Employment type:...QualityHourly payFor contractorsRemote work10 hours per week
$30 per hour
AuraOne, Inc. is seeking an AI Chat Generalist reviewer to evaluate model outputs against a versioned rubric and tag edge cases. This independent contractor role requires strong written reasoning and attention to detail, with at least 10 hours per week available. You will...QualityRemote jobHourly payFor contractors10 hours per weekFlexible hours- ERP Workflow Workflow AI Reviewer is a remote evaluation track for reviewing erp workflow... ...and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label... ...Remote — US-eligible. Remote · Independent specialist contractor. Employment type:...QualityHourly payFor contractorsRemote work10 hours per week
- Computational Biology AI Reviewer is a remote review track for evaluating... .... AuraOne uses scientific specialists to grade outputs the way a... .... Maintain reviewer-quality scores in inter-rater calibration... ...Comfort applying multi-page rubrics consistently across long batches...QualityHourly payFor contractorsRemote work10 hours per week
- ...is seeking a Swedish Language Expert (US/Canada Based) for remote evaluation of prompts and responses under AuraOne's quality rubric. You will review paired outputs, label edge cases, and write structured feedback for retraining the model. The role requires prior evaluation...QualityRemote jobHourly pay10 hours per week
- AuraOne, Inc. is seeking remote Contractors to evaluate computer use agent outputs against our quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain models. Clear written reasoning and reliable weekly availability...QualityRemote jobFor contractors
- AI Trainer Jobs is seeking a Cantonese Language Evaluator for a remote contractor role. You will review cantonese generalist evaluation prompts and responses, apply AuraOne's quality rubric, and label edge cases with structured feedback to retrain the model. You will compare...QualityRemote jobFor contractors10 hours per week
- AuraOne, Inc. is seeking a Fighter Pilot reviewer to work remotely from the United States as a contractor. You will evaluate AI outputs against fighter pilot workflows, policy... ...experience, can apply multi-page rubrics consistently, and provide clear written reasoning...QualityRemote jobFor contractors
- ...independent Audio Evaluation Specialists for an AI benchmark evaluation project.... ...reasoning Generate diverse, high-quality audio datasets reflecting real customer interactions Provide structured, detailed... ...prompts and evaluation rubrics Access to a high-quality microphone...QualityHourly payFor contractorsFreelanceWork at officeRemote workWorldwide
- ...independent Audio Evaluation Specialists for an AI benchmark evaluation project assessing... ...to autonomously produce high-quality evaluation tasks through simulated interactions, audit conversational AI... ...structured prompts, complex evaluation rubrics, and technical guidelines....QualityHourly payFor contractorsFreelanceRemote work
- AuraOne, Inc. is seeking a Physician AI Trainer - Hospital Medicine for a remote... ...in the United States. You will review AI outputs for clinical reasoning, dosing... ...logic, and guideline adherence, rate quality on structured rubrics, and document corrected reasoning to guide...QualityRemote jobFor contractors10 hours per week
- Federal Contract Specialist — AI Output Reviewer is a remote review track for evaluating AI outputs across... ...and stakeholder fit on a structured rubric. Flag operational risk, missed escalations... ...or firm guidance. Maintain reviewer-quality scores in inter-rater calibration...QualityHourly payContract workFor contractorsWork experience placementRemote work10 hours per week
$30 - $60 per hour
...role QA / Software Engineering Reviewer - Browser Test Validation is... ...responses against AuraOne's quality rubric. Reviewers compare paired outputs... ...team can use to retrain. AI data reviewers help turn qa /... ...Work model Remote · Independent specialist contractor Compensation $30-$...QualityFor contractorsRemote work10 hours per week- ...Vietnamese Voice Actor - Freelance AI Trainer Project World Wide -... ...rapidly, moving beyond simple interactions into expressive, human-like communication. With high-quality training data, tomorrow’s AI... ...: Vietnamese Voice Acting Specialist – AI Trainer Employment type:...QualityHourly payContract workFor contractorsFreelanceRemote work
Meridial
New York, NY2 days ago - ...Physician Expert for a remote clinical-review track evaluating AI outputs touching physician practice. You... ...you will grade results on a structured rubric, adjudicate cases against published evidence, and maintain reviewer-quality scores. #J-18808-Ljbffr AuraOne Human DataQualityRemote jobFor contractors
- ...for a fully remote contract role. You will evaluate Korean audio to determine nativeness and fluency, and provide high-quality feedback to help train AI systems. Document assessments with clear justifications in English, following established guidelines for pronunciation...QualityRemote jobContract work
- AuraOne, Inc. seeks a Consular Officer / Passport Specialist reviewer to evaluate AI outputs in consular operations. This remote contract role focuses... ...contribute to inter-rater calibration to ensure high-quality results. Applicants must be authorized to work in the US...QualityRemote jobContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Interaction Quality Reviewer & Rubric Specialist. Be the first to apply!
Related searches
- quality review specialist New York, NY
- quality assurance auditor New York, NY
- quality control associate New York, NY
- quality specialist New York, NY
- quality compliance specialist New York, NY
- warehouse quality control associate New York, NY
- quality management specialist New York, NY
- supplier quality specialist New York, NY
- quality system auditor New York, NY
- quality systems specialist New York, NY