Remote Humanoid Task Evaluator & Rubric Specialist
AuraOne
New York, NY
- Remote job
AuraOne is seeking a remote Humanoid Task Task Evaluator to review and label humanoid task evaluation prompts and responses. You will compare paired outputs, apply a versioned rubric, and produce structured feedback for retraining the model. This contractor role requires reliable async availability for at least 10 hours weekly and strict adherence to rubric criteria. Responsibilities include labeling, severity tagging, and documenting failure modes to improve the evaluation pipeline. #J-18808-Ljbffr AuraOne
Vacancy posted 8 hours ago
Similar jobs that could be interesting for youBased on the Remote Humanoid Task Evaluator & Rubric Specialist in New York, NY vacancy
- AuraOne is seeking a remote Retrieval Relevance Task Evaluator to review prompts and responses against our quality rubric. You will compare outputs, assign severity tags, and provide structured feedback for model retraining. This contractor role requires careful reasoning...Remote jobFor contractors10 hours per week
- AuraOne is seeking a Prompt Robustness Model Evaluation Specialist to remotely review prompts and model outputs, applying AuraOne's quality rubric. You will compare paired responses, label edge cases, and provide structured feedback for retraining. This contractor role...Remote jobFor contractors10 hours per week
- AuraOne is seeking a remote Pairwise Preference Reward Model Evaluator to review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain the modeling team. This independent contractor...Remote jobHourly payFor contractors10 hours per week
- Home Robot Failure Task Evaluator is a remote evaluation track for reviewing home robot failure task... ...responses against AuraOne's quality rubric. Reviewers compare paired outputs, label... ...— US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR...Remote workHourly payFor contractors10 hours per week
- AuraOne seeks a remote contractor to evaluate multi-turn ranking reward model evaluation prompts and responses. You will compare outputs, assign severity... ...structured feedback to retrain the model using AuraOne's rubric. You will identify hallucinations, instruction-following...Remote jobFor contractors
- AuraOne is seeking a remote News Monitoring Task Evaluator to assess evaluation prompts and responses against our quality rubric. You will compare paired outputs, write rationales, and label edge cases to aid model retraining and quality control. Join as a contractor working...Remote jobFor contractors
- AuraOne is seeking a Capability Generalization Model Evaluation Specialist for a remote contractor role. You will evaluate model outputs against AuraOne's quality rubric, compare paired responses, and label edge cases with structured tags to guide retraining. Responsibilities...Remote workFor contractors
- AuraOne is seeking a Remote Receipt and Invoice Understanding Model Evaluator to review outputs against rubrics and provide structured feedback. You will compare paired responses, label edge cases, and contribute to retraining with rationale. Ideal candidates have prior...Remote jobFor contractors10 hours per week
- ...Warehouse Robotics Task Evaluator is a remote review track for evaluating robotics review outputs against... ..., and decision logic on a structured rubric. Flag near-miss and unsafe... ...— US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR...Remote jobHourly payFor contractors10 hours per week
- ...Assessment Rubric AI Evaluator is a remote review track for evaluating AI outputs across assessment rubric ai specialist operations workflows. Reviewers grade workflow correctness, policy... ...unwritten rules that decide whether a task actually gets done....Remote jobHourly payFor contractorsWork experience placement10 hours per week
- ...Travel Research Task Evaluator is a remote review track for evaluating AI outputs across travel research... ...scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer... .... Comfort applying multi-page rubrics consistently across long batches....Remote jobHourly payFor contractors10 hours per week
- ...Robot Policy Compliance Task Evaluator is a remote red-team track for stress-testing AI systems against... ...each successful jailbreak with the rubric clause it violated so the safety team... ...— US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR...Remote jobHourly payFor contractors10 hours per week
- AuraOne is seeking a Remote Social Engineering Security Evaluator to review prompts and responses against our quality rubric, producing auditable labels, rationales, and regression cases. This role operates as an independent contractor to support the security evaluation...Remote jobFor contractors
- AuraOne is seeking an AI Data Annotation Expert for a remote contractor role focused on evaluating AI data annotation outputs against a versioned rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain the model. Responsibilities...Remote jobFor contractors
- AuraOne seeks a remote Helpfulness Ranking Reward Model Evaluator to review evaluation prompts and responses under a versioned rubric. You will compare paired outputs, assign severity, and provide structured feedback the modeling team can use for retraining. The role is...Remote jobHourly payFor contractors
- AuraOne is seeking a remote Capability Elicitation Risk Evaluator to review prompts and model outputs. You will apply a versioned rubric to label edge cases, assign severity, and provide structured feedback for retraining. You will compare paired responses, select the stronger...Remote job
- AuraOne is seeking a remote Video Understanding AI Evaluator contractor to review model outputs, apply a structured rubric, and provide rationale. You will compare responses, tag issues, and help refine prompts to improve reliability across batches. The role emphasizes...Remote jobFor contractors
- AuraOne is seeking a Brand Design Quality Evaluator to remotely assess design quality prompts and model outputs. You will compare paired responses, apply a versioned rubric, and provide structured feedback for retraining the modeling team. Responsibilities include labeling...Remote jobFor contractors
- AuraOne seeks a remote Bambara Language Expert contractor to review prompts and model outputs, apply a versioned rubric, and provide structured feedback for retraining. You will compare paired responses, label edge cases, and document recurring failure modes for continuous...Remote jobFor contractors10 hours per week
- AuraOne is seeking an Educational Safety AI Evaluator for a remote, contractor-based role. You will review educational safety AI outputs, apply the quality rubric, and produce auditable labels, rationales, and regression cases for AuraOne Human Data. Responsibilities include...Remote jobFor contractors
- ...seeking an AI data reviewer to assess Welsh language evaluation outputs against a versioned rubric, tagging severity and providing rationales. You will compare... ...capture ambiguous prompts for rubric updates. This remote contractor role requires thorough attention to detail,...Remote jobFor contractors10 hours per week
- AuraOne is seeking a Czech Bilingual Expert for a remote contractor role to evaluate and label Czech bilingual outputs using AuraOne's rubric. The reviewer will compare responses, assign severity tags, and provide structured feedback to support model retraining. Responsibilities...Remote jobFor contractors
- AuraOne is seeking a remote Spreadsheet QA / workbook maintenance Evaluator to help ensure high-quality AI outputs. You will review model responses, apply a versioned rubric, and provide structured feedback to retrain the system. As a contractor based in the US, you will...Remote jobFor contractors
- Pearson is seeking a Scoring Assistant for School Administrator and Superintendent credential evaluation. The role is remote and part-time, with sessions typically lasting 2-3 days monthly and scheduled between 8:00 a.m. and 4:00 p.m. PST. Training and review are provided...Remote jobPart timeFlexible hours
- AuraOne is seeking a remote Business Document Expert (Portuguese Speaker) to review prompts and responses against our quality rubric. You will evaluate Portuguese generalist outputs, label edge cases, and provide structured feedback to retrain models. This is a contractor...Remote jobFor contractorsFlexible hours
- AuraOne is seeking a remote Business Document Expert (Korean Speaker) to review and rate Korean generalist evaluation prompts and responses. You will compare paired outputs, label... ...clear written reasoning, and experience with multi-page rubrics. #J-18808-Ljbffr AuraOneRemote jobHourly payFor contractors
$80 - $120 per hour
...Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... ...artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...Remote workContract workSummer workWork at office$80 - $120 per hour
...Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-... ...artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...Remote workContract workSummer workWork at office- AuraOne is seeking a Tagalog Language Expert to review generalist evaluation prompts and responses against the company’s quality rubric. This is a remote contractor role focusing on structuring feedback, labeling edge cases, and generating regression data for retraining...Remote jobFor contractors
- AuraOne is seeking a remote Rubric Calibration Model Evaluation Specialist contractor in the United States. The role focuses on evaluating rubric calibration model outputs, labeling issues, and providing structured feedback to retrain the model. You will compare paired...Remote jobFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Humanoid Task Evaluator & Rubric Specialist. Be the first to apply!
Related searches
- program evaluator New York, NY
- work from home web search evaluator New York, NY
- clinical evaluator New York, NY
- evaluator New York, NY
- ai evaluator New York, NY
- work from home social media evaluator New York, NY
- quality evaluator New York, NY
- education evaluator New York, NY
- social media evaluator New York, NY
- skin specialist New York, NY