Remote AI Output Auditor | Rubric-Driven Reviews
OpenTrain AI
New York, NY
- Remote job
OpenTrain AI is seeking individuals to review AI-generated outputs against source materials and guidelines. You will assess each model output for consistency, record evidence-based judgments, and clearly explain decisions. This is a remote, flexible, contract-based role with hourly pay. Ideal candidates have professional fluency in English and strong analytical skills, with experience using ChatGPT or similar AI tools. The project runs one to three months with a part-time schedule. #J-18808-Ljbffr OpenTrain AI
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote AI Output Auditor | Rubric-Driven Reviews in New York, NY vacancy
- ...seeking qualified Legal Headhunters to review AI outputs in legal review workflows, grade citations... ...corrected analysis for model training. Remote work with US eligibility and contractor... ...maintaining inter-rater scores to improve rubric consistency. #J-18808-Ljbffr AuraoneRemote jobFor contractors
- AI Trainer Jobs seeks a remote Clinical Health Strategy Evaluation Specialist to review AI outputs touching clinical review. You will assess reasoning, dosing logic, and guideline adherence while flagging patient-safety issues, documenting corrections for model improvement...Remote jobFor contractorsFlexible hours
- ...coding and auditing experience to review claims for billing and coding... ...teams. The role leverages AI tools to flag anomalous patterns... ...coding expertise. This is a remote-first opportunity with competitive... ...from a fast-growing, mission-driven company. #J-18808-Ljbffr...Remote job
- AuraOne, Inc. seeks a Legal Headhunter - Referral Partner to review AI outputs in legal review workflows. You will evaluate citations, statutory... ...corrected analysis so the modeling team can train on it. Remote — US-eligible. Independent contractor with hourly compensation...Remote jobHourly payFor contractors
- AuraOne, Inc. is seeking a remote Legal Headhunter contractor to evaluate AI outputs in legal review workflows. You will grade citations, statutory reasoning, and policy adherence, flag risk, and document corrected analysis for model training. You will verify citations,...Remote jobFor contractors10 hours per week
$45 - $60 per hour
AI Trainer Jobs is seeking a Code Plan Reviewer (Plans Examiner) to remotely review AI outputs across code plan vulcan specialist operations workflows. You will assess workflow correctness, policy adherence, and stakeholder fit, flag operational risk, and document the...Remote workHourly payFor contractors- AuraOne, Inc. is seeking a remote AI Agent Power User reviewer who can assess outputs against workflows, playbooks, and policy. You will evaluate tone, escalation logic, and stakeholder fit to support safe, scalable AI operations. As an independent contractor, you’ll work...Remote jobFor contractors10 hours per week
- AuraOne, Inc. seeks Physician & Clinical Headhunter reviewers to evaluate AI-generated clinical outputs remotely across the United States. You will assess differential diagnosis, dosing logic, and guideline adherence, flag safety concerns, and document corrected reasoning...Remote jobContract work
- AuraOne, Inc. is seeking an AI Product Evaluator for a remote contractor role. You will review prompts and model outputs, apply a versioned rubric, and provide structured feedback to retrain the model. The work involves tagging issues, labeling edge cases, and maintaining...Remote jobFor contractors10 hours per week
- AI Trainer Jobs seeks a Visual Designer (Motion & 3D) for a remote reviewer track evaluating AI outputs across 3D design workflows. You will assess craft, constraints, and tooling adherence... ...include grading outputs against a rubric, flagging tooling failures, and...Remote job
- ...is seeking an experienced Visual Designer reviewer to evaluate AI outputs for visual design craft and tooling adherence. This remote contractor role focuses on grading, documenting... ...in visual design review, comfort with rubrics, and reliable async availability for at...Remote jobFor contractors10 hours per week
- AuraOne Human Data is seeking a Remote Video Editor Specialist for AI Video Output Review. You will assess AI outputs for craft, constraints, and tooling adherence, grading against a structured rubric and documenting the corrected approach for model training. This contractor...Remote jobFor contractors
- ...seeking a Registered Nurse for a fully remote, Medicare-focused medical record review role. You will evaluate Part A and... .... The position supports AI-driven review processes and requires independent... ...include validating AI outputs, translating policy documents into...Remote jobLocal area
- AI Trainer Jobs is seeking a remote independent contractor to review AI outputs for Google Suite operations, grading against policies and playbooks. You will assess tone,... ...logic, and stakeholder fit using a structured rubric and document actionable next steps for model...Remote jobPart timeFor contractors
- AuraOne, Inc. is seeking a Federal Contract Specialist — AI Output Reviewer for a remote, contractor role in the United States. You will assess AI... ...direct federal contract operations experience, exceptional rubric consistency, and clear reasoning naming the applicable...Remote jobContract workFor contractors
- AuraOne, Inc. seeks a remote Gmail & Calendar AI Assistant Evaluator to review prompts and responses against our quality rubric. You will compare outputs, tag edge cases, and write structured feedback for retraining the modeling team. As an independent contractor, you will...Remote jobFor contractors10 hours per week
$70 per hour
AuraOne is seeking specialists for a remote review track focused on evaluating AI outputs across material science phd coding experts operations workflows. Reviewers... ...modeling team. Role requires applying multi-page rubrics, clear written reasoning, and strong attention to...Remote jobHourly pay10 hours per week- AuraOne, Inc. is seeking a Hmong Language Expert for a remote evaluation track to review prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and provide structured feedback for retraining. You will evaluate model...Remote jobHourly payFor contractors
- ...seeks a Lifestyle & Travel Concierge Expert contractor to remotely review AI outputs for lifestyle travel concierge operations. You will evaluate... ...experience in lifestyle travel concierge operations, strong rubric application skills, and reliable async availability for at...Remote jobFor contractors10 hours per week
- AI Trainer Jobs is seeking an Estonian Language Expert for a remote evaluation track. You will review prompts and responses against AuraOne's rubric, compare outputs, label edge cases, and provide structured feedback to retrain models. This is a contractor role, remote,...Remote jobHourly payFor contractors10 hours per weekFlexible hours
- Remote Video Editor Specialist — AI Video Output Review is a remote review track for evaluating AI outputs across video review workflows. Reviewers grade craft... ..., and production-readiness on a structured rubric. Flag tooling-specific failures (file format, scale...Remote jobHourly payFor contractors10 hours per week
- Federal Contract Specialist — AI Output Reviewer is a remote review track for evaluating AI outputs across federal contract specialist operations workflows... ..., escalation logic, and stakeholder fit on a structured rubric. Flag operational risk, missed escalations, and policy-...Remote workHourly payContract workFor contractorsWork experience placement10 hours per week
- AI Trainer Jobs is seeking a STEM Expert to remotely review AI outputs in stem research reasoning, calculations, and workflows. Reviewers grade derivations and reproduce... ...justification. This role emphasizes applying rubrics consistently across long batches and providing...Remote job
- AuraOne, Inc. is seeking a STEM Expert, German (Germany) for remote review of AI outputs. You will evaluate derivations, reproduce key steps, and... .... The position emphasizes reproducibility, adherence to rubrics, and consistent results across long batches, with a commitment...Remote jobFor contractors10 hours per week
- Verita AI seeks experienced UI/UX Experts to support AI training and evaluation projects... ..., interface quality, and usability. Review digital products, identify usability issues... ...overall user experience. Verita engagements are remote and asynchronous, and Verita says they are...Remote jobWeekly pay
- AuraOne, Inc. is seeking an Inpatient Coder reviewer on a remote contractor track to evaluate AI outputs across inpatient coder operations workflows. You will grade... ...adherence, and stakeholder fit using a structured rubric, flag operational risk, and document clear next...Remote jobFor contractors10 hours per week
- AuraOne, Inc. is seeking an AI Agent Interaction Specialist to remotely review ai agent interaction evaluation prompts and responses against AuraOne's quality rubric. You will compare paired outputs, label edge cases, and write structured feedback for the modeling team...Remote work10 hours per week
- AuraOne, Inc. is seeking a Tax Preparer reviewer for Form 1040 TY2025. This remote, independent contractor role evaluates AI outputs, grades calculations, cites standards, and documents corrected workpapers to train models. You will flag issues and adjudicate treatments...Remote workFor contractorsFlexible hours
- AuraOne seeks a remote Photographer reviewer contractor in the US to evaluate AI outputs across photography review workflows. You will assess craft, constraints, and tooling adherence, grade production-readiness, and document corrected approaches for model training. You...Remote jobFor contractors10 hours per week
$30 - $85 per hour
AI Trainer Jobs is seeking an Education & Training Expert for a remote review role. You will evaluate AI outputs across education review workflows, grade tone and policy adherence... ...of $30-$85 per hour and task-driven workload. Strong rubric-based judgment and attention to...Remote jobHourly payFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Output Auditor | Rubric-Driven Reviews. Be the first to apply!
Related searches