Remote Trace Workflow Evaluator & Feedback Auditor
AuraOne Human Data
New York, NY
- Remote job
AuraOne, Inc. is seeking a remote Debugging Trace Workflow Reviewer to evaluate model outputs against our quality rubric, tag edge cases, and provide structured feedback for retraining. You will compare paired responses, label issues, and document recurring failure modes. This is a contractor role with flexible weekly hours, requiring strong written reasoning and attention to detail. Ideal candidates have prior experience in evaluation or annotation and can work asynchronously for at least 10 #J-18808-Ljbffr AuraOne Human Data
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote Trace Workflow Evaluator & Feedback Auditor in New York, NY vacancy
$60 per hour
...for AI-Assisted Developer Workflows (Trace) AI Task Auditor - Freelance AI Trainer Project... ...Project World Wide - Remote roject Overview We... ...audit tasks used to train and evaluate AI systems. The objective... .... Technical Auditing & Feedback: Provide clear,...Remote workHourly payContract workPart timeFor contractorsFreelanceInvisible Technologies
San Francisco, CAa month ago- AuraOne, Inc. is seeking a Management Consultant — AI Workflow Evaluator as a remote contractor to assess AI workflow evaluation outputs against... ...paired responses, label edge cases, and provide structured feedback to retrain models. The role emphasizes clear reasoning,...Remote jobFor contractors
- Management Consultant — AI Workflow Evaluator is a remote evaluation track for reviewing management consultant ai workflow evaluation prompts and... ...outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain. Why this role...Remote workHourly payFor contractors10 hours per week
- AuraOne, Inc. is seeking a Hmong Language Expert for a remote evaluation track to review prompts and responses against AuraOne's quality rubric... ...paired outputs, label edge cases, and provide structured feedback for retraining. You will evaluate model outputs, label...Remote jobHourly payFor contractors
- AI Trainer Jobs is seeking an Estonian Language Expert for a remote evaluation track. You will review prompts and responses against AuraOne... ..., compare outputs, label edge cases, and provide structured feedback to retrain models. This is a contractor role, remote, with...Remote jobHourly payFor contractors10 hours per weekFlexible hours
- AI Trainer Jobs is seeking a Tagalog Language Expert for a remote evaluation track. You will review prompts and responses, label issues, compare outputs, and contribute structured feedback for retraining. The role emphasizes high attention to detail and clear justifications...Remote jobFor contractors10 hours per week
- Appsierra Group is seeking an AI Session Annotator for a fully remote, independent contractor role. You will review recorded AI sessions, compare responses to visuals, and provide precise written feedback using a detailed rubric. Strong English, attention to detail, and...Remote jobWeekly payFor contractorsFlexible hours
- AI Trainer Jobs seeks a Hindi Language Expert for a remote evaluation track. Review Hindi prompts and responses, compare paired outputs, label edge cases, and provide structured feedback to retrain models. You will turn evaluation outputs into auditable labels, rationales...Remote jobFor contractorsFlexible hours
- AuraOne, Inc. is seeking a remote Browser Automation Task Evaluator to review prompts and responses against our quality rubric. This contractor role focuses on labeling edge cases, writing structured feedback, and helping retrain our models. You will compare paired outputs...Remote jobFor contractors10 hours per week
- CXG is seeking luxury brand evaluators to discreetly assess customer experiences across boutiques and online channels. You may visit stores or evaluate online, and provide honest feedback via questionnaires to help brands refine their services. This role offers flexible...Remote jobFlexible hours
- AuraOne, Inc. seeks a remote Historical Reasoning AI Evaluator to review prompts and responses, applying AuraOne's quality rubric. You will label edge cases, provide structured feedback, and inform retraining efforts through precise rationale. The role supports a contractor...Remote jobFor contractors
- ...Trainer Jobs is seeking an English Language Specialist (Transcription) for remote evaluation work. You will review prompts and responses, apply a strict rubric, and generate structured feedback to aid model retraining. Ideal candidates have prior evaluation or annotation...Remote jobHourly payPart timeFor contractors
$80 - $120 per hour
...About the role User/customer research and feedback synthesis Evaluator is a remote review track for evaluating AI outputs across user/customer research... ...research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions,...Remote workContract workFor contractors10 hours per weekAuraOne
San Jose, CAa month ago$80 - $120 per hour
...User/customer research and feedback synthesis Evaluator is a remote review track for evaluating AI outputs across user/customer research and feedback... ...research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce...Remote jobFor contractors10 hours per week- ...Student Feedback AI Evaluator is a remote review track for evaluating AI outputs across student feedback ai specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next...Remote jobHourly payFor contractorsWork experience placement10 hours per week
- ...Population Health Informaticist to join a remote, flexible hourly contract focused on... ...training AI with public health data. You will evaluate AI-generated analyses for accuracy and... ...gaps, and provide clear, actionable feedback to improve model performance. The role emphasizes...Remote workHourly payContract workFlexible hours
- AuraOne is seeking an Everyday AI Agent Tester specialist operations contractor for remote US-eligible work. You will review AI outputs against workflows, policy, and playbooks, grade tone and escalation, and document next steps for model training. Ideal candidates have...Remote jobFor contractors
- AuraOne is seeking a Luganda Language Expert for a remote evaluation track to review Luganda prompts and model outputs against a quality rubric... ...paired outputs, label edge cases, and draft structured feedback for retraining. As a remote independent contractor, you will...Remote jobFor contractors
- OpenTrain AI, Inc. is seeking an Employment and Labor Law AI Evaluation Expert to review AI-generated answers to U.S.... ...scenarios, assess legal accuracy and reasoning, and write feedback to improve models. This 100% remote, part-time freelance role requires a U.S. law degree...Remote jobPart timeFreelance
- A leading AI evaluation company is looking for candidates to assess AI-generated responses and provide structured feedback. This role involves evaluating reasoning quality, tone, and factual... ...part-time contract. This position is remote and available throughout the United...Remote workFull timeContract workPart timeFlexible hours
- AuraOne is seeking an AI Agent Evaluator to remotely review and label ai agent evaluation prompts and responses against AuraOne's quality rubric... ...outputs, identify edge cases, and provide structured feedback to support retraining. The role focuses on auditing model outputs...Remote job
- NCR Eduservices is seeking an enthusiastic English Evaluator to join our remote team. You will review recorded reading and pronunciation sessions from US and UK teachers and provide constructive feedback to uphold high academic standards. A Bachelor’s degree in Education...Remote job
- AI Trainer is a remote evaluation track for reviewing AI trainer evaluation prompts and responses against AuraOne’s quality rubric. Reviewers... ...paired outputs, label edge cases, and write structured feedback for retraining the model. Responsibilities include evaluating...Remote jobHourly payFor contractorsFlexible hours
$70 per hour
...Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and rigor... ...in model outputs . Provide structured written feedback to improve training data quality and downstream performance...Remote workContract workSummer workMercor
Philadelphia, PAa month ago$45 - $60 per hour
AI Trainer Jobs is seeking a Code Plan Reviewer (Plans Examiner) to remotely review AI outputs across code plan vulcan specialist operations workflows. You will assess workflow correctness, policy adherence, and stakeholder fit, flag operational risk, and document the...Remote workHourly payFor contractors- AuraOne, Inc. is seeking a remote AI Agent Power User reviewer who can assess outputs against workflows, playbooks, and policy. You will evaluate tone, escalation logic, and stakeholder fit to support safe, scalable AI operations. As an independent contractor, you’ll work...Remote jobFor contractors10 hours per week
- AuraOne, Inc. is seeking an Inpatient Coder reviewer on a remote contractor track to evaluate AI outputs across inpatient coder operations workflows. You will grade workflow accuracy, policy adherence, and stakeholder fit using a structured rubric, flag operational risk...Remote jobFor contractors10 hours per week
$35 per hour
...Compensation: $21 - $35/hour Location: Remote Commitment: 10-40 hrs/week Role Responsibilities... ...discrepancies. Provide constructive feedback on annotation processes, contributing to... ...quickly integrate feedback into your workflow. Requirements Demonstrated expertise...Remote jobContract work- ...review AI-generated healthcare content for accuracy against real-world workflows. You will assess outputs for Epic, Cerner, and similar platforms, identify gaps, and provide detailed feedback. Remote, hourly contract with flexible scheduling allows independent work...Remote jobHourly payContract workFlexible hours
$75 per hour
...And Planning Professionals AI Evaluator Evaluate AI-generated responses... ..., and expediting work. This remote US project offers flexible asynchronous... ...real logistics and planning workflows and reviewing large language model responses. Your feedback will show whether an answer is...Remote workHourly payContract workPart timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Trace Workflow Evaluator & Feedback Auditor. Be the first to apply!
Related searches
- evaluator New York, NY
- work from home web search evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- nurse evaluator New York, NY
- work from home social media evaluator New York, NY
- ai evaluator New York, NY
- education evaluator New York, NY
- quality evaluator New York, NY
- social media evaluator New York, NY