Remote Educational Safety AI Evaluator — Rubric Reviewer
AuraOne
New York, NY
- Remote job
AuraOne is seeking an Educational Safety AI Evaluator for a remote, contractor-based role. You will review educational safety AI outputs, apply the quality rubric, and produce auditable labels, rationales, and regression cases for AuraOne Human Data. Responsibilities include comparing responses, labeling issues with rubric tags, and documenting failure modes to guide future training iterations. Remote work is available for US-eligible contractors. #J-18808-Ljbffr AuraOne
Vacancy posted 8 hours ago
Similar jobs that could be interesting for youBased on the Remote Educational Safety AI Evaluator — Rubric Reviewer in New York, NY vacancy
- AuraOne is seeking a remote Capability Elicitation Risk Evaluator to review prompts and model outputs. You will apply a versioned rubric to label edge cases, assign severity, and provide structured feedback for retraining. You will compare paired responses, select the stronger...Remote job
- AuraOne is seeking a remote Video Understanding AI Evaluator contractor to review model outputs, apply a structured rubric, and provide rationale. You will compare responses, tag issues, and help refine prompts to improve reliability across batches. The role emphasizes...Remote jobFor contractors
- ...Educational Safety AI Evaluator is a remote evaluation track for reviewing educational safety ai evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling...Remote jobHourly payFor contractors10 hours per week
- ...Educational Safety Learning Content Reviewer is a remote review track for evaluating AI outputs across education review workflows. Reviewers grade workflow correctness, policy... ...logic, and stakeholder fit on a structured rubric. Flag operational risk, missed...Remote jobHourly payFor contractorsWork experience placement10 hours per week
- AuraOne is seeking a remote People Ops / Recruiting Evaluator to review evaluation prompts and responses against a quality rubric. You will compare paired outputs, write rationale, and tag edge cases to support retraining of the modeling system. The role emphasizes structured...Remote jobFor contractors
- AuraOne is seeking a Crisis Response Safety Risk Evaluator for a remote, contractor role. You will review crisis response outputs, apply versioned rubrics, and assign severity labels to model results. You’ll compare paired responses, provide written rationales, and tag...Remote jobFor contractors
- AuraOne is seeking an AI data reviewer to assess Welsh language evaluation outputs against a versioned rubric, tagging severity and providing rationales. You will compare paired... ...ambiguous prompts for rubric updates. This remote contractor role requires thorough attention...Remote jobFor contractors10 hours per week
- AuraOne seeks a remote Bambara Language Expert contractor to review prompts and model outputs, apply a versioned rubric, and provide structured feedback for retraining. You will compare paired responses, label edge cases, and document recurring failure modes for continuous...Remote jobFor contractors10 hours per week
- AuraOne is seeking an Indigenous Language AI Evaluator to remotely review indigenous language AI evaluation prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain the model. This...Remote jobFor contractors10 hours per week
- AuraOne is seeking a Remote Receipt and Invoice Understanding Model Evaluator to review outputs against rubrics and provide structured feedback. You will compare paired responses, label edge cases, and contribute to retraining with rationale. Ideal candidates have prior...Remote jobFor contractors10 hours per week
- AuraOne is seeking an Oncology AI Reviewer for a remote clinical-review track evaluating AI outputs related to oncology. Reviewers... ...adherence, flag patient-safety issues, and document corrected clinical... ...oncology guidelines, grading rubric-based reasoning, flagging safety...Remote job
- ...Mental Health Clinical AI Evaluator is a remote clinical-review track for evaluating AI outputs... ...adherence; flag patient-safety issues; and document the... ...handling on a structured rubric. Flag patient-safety... ...peer reviewer, or clinical educator. Familiarity with AI-...Remote jobHourly payFor contractors10 hours per week
- AuraOne is seeking an AI Data Annotation Expert for a remote contractor role focused on evaluating AI data annotation outputs against a versioned rubric. You will compare paired responses, label... ...ambiguous prompts, calibrating reviewer scores weekly, and reporting recurring...Remote jobFor contractors
- Obsidian is hiring expert Evaluators for a remote, hourly role focused on Compliance and regulatory response with financial-services AI. You'll assess AI-generated work products for accuracy and domain quality, leveraging your expertise. The ideal candidate has over 5 years...Remote jobHourly payWork at office
$80 - $120 per hour
...talent with leading AI research labs. Headquartered... .... Position: Education / school Evaluator Type: Contract... ...hour Location: Remote Role Responsibilities... ...-specific quality rubrics. Identify factual,... ...written feedback. Review and assess AI-generated...Remote workContract workSummer workWork at office$55 per hour
A leading staffing agency is seeking a Dental Hygienist Subject Matter Expert to review and evaluate AI-generated educational content for dental hygiene learners. This part-time remote position requires an active RDH license and a minimum of two years of clinical experience...Remote jobHourly payPart time- A remote educational organization is seeking Sociology Teachers, Postsecondary to develop and deliver content through AI training initiatives. Responsibilities include creating lectures, evaluating academic materials, and facilitating online discussions to enhance educational...Remote jobFlexible hours
- AuraOne is seeking an AI Policy Compliance AI Evaluator to perform remote adversarial evaluation, crafting 5-turn prompts and documenting failures with precise... ...a growing library of attack patterns to strengthen safety measures. The contractor role requires strong...Remote jobFor contractors
- ...AI Safety and Red-Team Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team...Remote jobHourly payFor contractors10 hours per week
- AuraOne is seeking a Thai and English AI Safety Reviewer for remote model evaluation. You will design adversarial prompts that probe known weakness classes, document every attack with steps, and pair each successful jailbreak with the violated policy clause so the safety...Remote jobFor contractors
- A leading AI company is seeking detail-oriented linguists with native... ...speaker fluency in Vietnamese. This remote freelance position involves... ...-related projects such as prompt evaluation, video content understanding, and text review. Ideal candidates will have strong...Remote jobFreelance
- Productive Playhouse seeks AI Evaluators to support evaluating AI chatbots by interacting with models, assessing capabilities, safety, and usefulness. This is a project-based, task-based... ...the United States, candidates work remotely, provide deliverables like write-ups,...Remote jobFreelanceFlexible hours
- mpathic.ai in Seattle is seeking AI Safety Experts for a temporary project to evaluate and improve the safety, reliability, and real-world... ...in human behavior, policy, education, healthcare, or trust &... ...rate outputs with structured rubrics, annotate data for training...Temporary work
- Productive Playhouse is seeking Marathi-speaking AI Evaluators to test and assess next‑gen AI chatbots.... ...structured feedback on performance, safety, and usefulness, and deliver write-ups, ratings, and media per task. Remote, flexible hours, and batch-based work arrangements...Remote jobFreelanceFlexible hours
- AuraOne is seeking a remote Secrets Detection Security Evaluator to review model outputs, apply structured rubrics, and label edge cases. You will compare paired responses, justify the stronger answer, and calibrate your scoring against gold-standard examples. The role...Remote jobFor contractors
- AuraOne is seeking a remote contractor to review home robot failure case evaluations. You will assess model outputs against a versioned rubric, label edge cases, and provide structured feedback... ...comparing responses, tagging safety and policy failures, and reporting...Remote jobFor contractors
$60 - $70 per hour
...talent with leading AI research labs. Headquartered... .... Position: AI Safety Practitioner Type... ...Location: Remote Role Responsibilities Evaluate AI-generated responses... ...overall quality. Review content involving... ...and refine evaluation rubrics for RLHF , SFT ,...Remote workContract workSummer work$34 per hour
...Discover why Cooper University Health Care is the employer of choice in South Jersey.Short DescriptionThe HIM Coding Quality Reviewer & Educator is responsible for:Ensuring the accuracy, integrity, and quality of coding practices within the HIM department.This role involves...Remote workFull timePart time$40 per hour
A leading AI development company is seeking experienced quantitative professionals to evaluate AI-generated work and help shape future AI systems. This fully remote role offers a flexible schedule, competitive... ...skills, and a strong education in a relevant field. Join...Remote workHourly payFlexible hoursDataAnnotation
Nashville, TN2 days ago- ...Obsidian is hiring expert Evaluators in Special education/IEP to review AI-generated work products for accuracy and rigor. This is a remote, hourly engagement where you will apply your deep subject-matter expertise to grade outputs. Candidates must possess at least...Remote workHourly payWork at office
Obsidian
New York, NY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Educational Safety AI Evaluator — Rubric Reviewer. Be the first to apply!
Related searches
- program evaluator New York, NY
- work from home web search evaluator New York, NY
- clinical evaluator New York, NY
- evaluator New York, NY
- ai evaluator New York, NY
- work from home social media evaluator New York, NY
- quality evaluator New York, NY
- education evaluator New York, NY
- social media evaluator New York, NY
- operations coordinator remote New York, NY