Remote AI Evaluation Rubric Reviewer & Feedback Specialist
AuraOne Human Data
New York, NY
- Remote job
AuraOne, Inc. is seeking a remote AI Evaluation Rubric Writer reviewer to assess model outputs against a versioned rubric and assign severity tags. You will compare paired responses, label issues, and document recurring failures to help retrain the model. Ideal candidates bring experience in evaluation, annotation, and cross-page rubric application, with strong attention to detail and the ability to articulate clear rationales. This is a remote contractor role requiring US work authorization. #J-18808-Ljbffr AuraOne Human Data
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote AI Evaluation Rubric Reviewer & Feedback Specialist in New York, NY vacancy
- ...Mandarin Transcription Expert to remotely evaluate mandarin generalist prompts and responses... ...cases, and create structured feedback for retraining the model. As an independent contractor, you will review tasks with guidance from the rubric and provide clear written...Remote jobFor contractors
- ...Hampshire University is seeking a part-time Reviewer for English to evaluate student project submissions using a pre-existing rubric and provide specific, applicable feedback to help students demonstrate mastery. This remote role requires strong rubric knowledge and proactive...Remote jobPart time
- ...seeking a Swedish Language Expert (US/Canada Based) for remote evaluation of prompts and responses under AuraOne's quality rubric. You will review paired outputs, label edge cases, and write structured feedback for retraining the model. The role requires prior evaluation...Remote jobHourly pay10 hours per week
- AI Trainer Jobs is seeking a Haitian Creole Language Expert for a remote evaluation track. You will review language prompts and responses, compare outputs,... ...and provide structured feedback to retrain models. This... ...emphasizes precise reasoning and rubric alignment....Remote jobHourly payFor contractors
- ...Meridial seeks independent Audio Evaluation Specialists for an AI benchmark evaluation... ...structured, detailed feedback and data for model optimization... ...prompts and evaluation rubrics Access to a high-quality... ...apply Work environment is remote; no office required #J-18...Remote workHourly payFor contractorsFreelanceWork at officeWorldwide
- Workada is hiring a remote contractor to help evaluate AI assistants on realistic marketing, content and design tasks. You will work with an AI on tasks... ...projects and rate performance, providing structured feedback to improve accuracy and usefulness. This hourly, remote...Remote jobHourly payFor contractors
$70 - $100 per hour
...talent with leading AI research labs. Headquartered... ...hour Location: Remote Commitment: 10–2... ...Responsibilities Evaluate and compare AI-... ...outputs against structured rubrics and provide feedback to improve model... ...; applications reviewed on a rolling basis....Remote workContract workSummer workWork at officeImmediate start$70 - $100 per hour
...talent with leading AI research labs. Headquartered... ...Location: Remote Commitment: 10–... ...stronger one. Evaluate both the content and... ...against structured rubrics. Provide written feedback to the research team... ...experience producing and reviewing office documents....Remote workContract workSummer workWork at officeImmediate start$25 per hour
...Account Generalist Raters for a remote contractor assignment. The... ...The successful candidate will review AI-generated prompts and responses... ...explanations, and constructive feedback to improve system quality. Responsibilities include evaluating relevance, accuracy, helpfulness...Remote jobFor contractors- LILT is seeking detail-oriented human reviewers to support AI training and evaluation projects. You will review prompts, assess AI outputs, and annotate content... ...of tasks, with expectations for careful judgment, high-quality feedback, and timely delivery. #J-18808-Ljbffr LILTRemote jobFor contractorsLocal area
- AuraOne, Inc. is seeking a Domain Contributor Evaluation Specialist for a remote contractor role in the United States. You will review AI outputs against workflows, policy, and stakeholder-fit using a structured rubric, and document the next steps for model training. Responsibilities...Remote jobFor contractors10 hours per week
- ...Writing Feedback Learning Content Reviewer is a remote review track for evaluating AI outputs across writing feedback learning content specialist operations workflows. Reviewers grade workflow correctness... ...fit on a structured rubric. Flag operational risk, missed...Remote jobHourly payFor contractorsWork experience placement10 hours per week
$70 - $120 per hour
Gridnaut Recruiting is hiring a remote Architectural & Interior Visualization Specialist (AI Evaluation) contractor (pay $70-$120/hr).... ...and give clear, written feedback, catching problems with spatial... ...lighting.; Develop guidelines, rubrics and quality checks for architectural...Remote workContract workFor contractors$41.6k
...sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation project. As... ..., and clear, well-structured rubrics that generate clean, reliable data... ...: Freelance / Independent Contractor Workplace Type: Remote...Remote workHourly payContract workFor contractorsFreelance- AuraOne, Inc. is seeking an AI Product Evaluator for a remote contractor role. You will review prompts and model outputs, apply a versioned rubric, and provide structured feedback to retrain the model. The work involves tagging issues, labeling edge cases, and maintaining...Remote jobFor contractors10 hours per week
- ...Careers is seeking an experienced Healthcare SME for an hourly remote contractor role. You will create expert healthcare questions, design scoring rubrics, evaluate AI-generated content, and provide precise feedback to improve clinical accuracy and reliability. The role...Remote jobHourly payFor contractors
$90 per hour
...talent with leading AI research labs. Headquartered... ...: Civil Engineer Reviewer Type: Contract... ...hour Location: Remote Role... ...errors and omissions. Evaluate grading rubrics for clarity and specificity... ...Provide clear written feedback and verify that revisions...Remote workContract workSummer workMercor
New York, NY7 days ago- AuraOne, Inc. is seeking a remote Differential Diagnosis AI Reviewer to evaluate evaluation prompts and responses against the company's quality rubric. You will compare paired outputs, label edge cases, and write structured feedback for model retraining. The role is an...Remote jobFor contractors10 hours per week
- AuraOne, Inc. seeks a detail-oriented reviewer to assess photo and visual editors' outputs against a quality rubric. This remote position involves evaluating model responses, labeling edge cases, and providing structured feedback the team can use to retrain. You will work...Remote job
- AuraOne is seeking a Spanish-Language Consumer Reviewer to work remotely as a contractor evaluating model outputs against AuraOne's rubric. You will compare paired responses, label edge cases, and provide structured feedback to help retrain the model. This remote role...Remote jobFor contractors10 hours per week
- AuraOne, Inc. is seeking a remote contractor to review English (UK) with a Mac evaluation outputs, label issues, and provide structured feedback for retraining. You will compare paired responses... ...ensure consistency with a versioned rubric. Responsibilities include tagging...Remote jobFor contractors10 hours per week
$50 per hour
...company Mindrift connects specialists with project-based AI opportunities for leading... ...companies, focused on testing, evaluating, and improving AI systems.... ...tasks to take and when Remote: open to US-licensed... ...malpractice exposure: you review written clinical cases All...Remote workPart timeFor contractorsFlexible hours- AuraOne seeks an experienced Senior Journalist / Writer for a remote evaluation track. You will review prompts and responses, compare paired outputs, label edge cases, and provide structured feedback for retraining. You’ll help turn outputs into auditable labels, rationales...Remote jobHourly payFor contractors
- ...AI Fact-Checking & Response Evaluation Reviewer (French) Mission of the Role Apply independent... .... This is a remote freelance opportunity with... ...Provide clear quality feedback and rationale for review... ..., Fact-Checking, and QC Specialist roles ~ Help shape how...Remote workContract workFreelanceFlexible hours
e2f
San Jose, CA6 days ago $70 - $120 per hour
...Gridnaut Recruiting is hiring a remote Music Producer & Audio Post Specialist (AI Evaluation) contractor (pay $70–$120/hr). Contribute... ...mixes and give clear, written feedback, catching problems with... ...loudness.; Develop guidelines, rubrics and quality checks for music and...Remote workContract workFor contractors$40 - $45 per hour
...talent with leading AI research labs.... ...English AI Safety Specialist Type: Contract... ...hour Location: Remote Role Responsibilities Review short English-language... ...conversations to evaluate AI responses .... ...Submit structured feedback to improve AI model...Remote workContract workSummer workMercor
Abbeville, GA22 days ago- AI Evaluation Rubric Writer is a remote evaluation track for reviewing ai evaluation rubric writer evaluation prompts and responses... ...write the kind of structured feedback the modeling team can use to... .... Remote · Independent specialist contractor. Employment type:...Remote workHourly payFor contractors10 hours per week
$80 - $120 per hour
...talent with leading AI research labs.... .../ arts / culture Evaluator Type: Contract... ...hour Location: Remote Role... ...-specific quality rubrics. Identify factual... ...structured written feedback to improve AI model... ...com PS: Our team reviews applications daily...Remote workContract workSummer workWork at office$90 per hour
...Electrical Engineer Reviewer (AI Evaluation) is a remote engineering review track for evaluating production... ...with a written rationale tied to the rubric. Tag failure modes (compile... ...US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR...Remote jobFor contractors10 hours per week$70 per hour
...technical talent with leading AI research labs.... ...$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses... ...Provide structured written feedback to improve training data... ...mercor.com PS: Our team reviews applications daily. Please...Remote workContract workSummer workMercor
Abbeville, GA22 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Evaluation Rubric Reviewer & Feedback Specialist. Be the first to apply!
Related searches
- live chat specialist New York, NY
- patient safety specialist New York, NY
- credit card specialist New York, NY
- senior specialist New York, NY
- zoning specialist New York, NY
- charge entry specialist New York, NY
- health program specialist New York, NY
- youth specialist New York, NY
- microsoft specialist New York, NY
- transportation specialist New York, NY