Remote Robot Trajectory Evaluator (Contractor)
AuraOne Human Data
New York, NY
- Remote job
AuraOne, Inc. seeks a remote Robot Trajectory Task Evaluator to review model outputs against our quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain the model. Strong written reasoning naming the rubric clause is essential. As a contractor, you will work asynchronously from the US, dedicating around 10 hours per week, calibrate against gold-standard samples, and surface recurring failures to drive rubric updates and improve evaluation #J-18808-Ljbffr AuraOne Human Data
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote Robot Trajectory Evaluator (Contractor) in New York, NY vacancy
- Robot Trajectory Task Evaluator is a remote evaluation track for reviewing robot trajectory task evaluation prompts and responses against AuraOne's quality... ...— US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized...For contractorsRemote workHourly pay10 hours per week
- ...Surgical Robotics Task Evaluator is a remote review track for evaluating robotics review outputs against... ...physical-AI constraints. Reviewers grade trajectory choices, perception assumptions,... .... Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants...For contractorsRemote jobHourly pay10 hours per week
- ...Robot Policy Compliance Task Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios... ...— US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized...For contractorsRemote jobHourly pay10 hours per week
$30 - $45 per hour
...Description: Web Browsing Evaluator remote $30 - $45/hour pay Required Skills... ...Web Browsing Evaluator Role Type: Contractor Location: Remote micro1 is... ...Annotate and document each browsing trajectory, including data points, actions, and contextual...For contractorsRemote work- ...A leading AI research accelerator is seeking a contractor to evaluate North American teen humor. The ideal candidate will review and rate humorous content popular among teens and explain its appeal. This role offers flexible, project-based work with competitive pay and...For contractorsRemote workFreelanceFlexible hours
- ...A leading research accelerator is seeking a contractor to evaluate North American early to mid-teen humor. The role involves reviewing short-form... ...culture. This project allows for flexible hours and remote work within North America with a commitment of around 30 hours...For contractorsRemote workFreelanceFlexible hours
- ...A leading research accelerator is seeking a contractor to evaluate North American teen humor. The role involves reviewing short-form content,... ...culture, and can evaluate humor objectively. This flexible, remote-friendly project is expected to require about 30 hours a week...For contractorsRemote workContract workFreelanceFlexible hours
- ...A leading AI research accelerator is seeking a contractor for a role focused on evaluating North American teen humor through structured ratings and clear... ...and providing insights on their appeal. This flexible remote position promises competitive pay and engagement in...For contractorsRemote workContract workFreelanceFlexible hours
- ...leading tech organization is seeking candidates aged 18 to 19 to evaluate North American teen humor through structured rating and... ...content resonates. The position offers competitive pay and flexible remote work options, requiring a commitment of 30 hours per week with...For contractorsRemote workPart timeFreelanceFlexible hours
- ...responsibly. This may include occasional remote work, starting the day with morning... ...life: end-to-end autonomous driving and robotic generalist. We have a group composed of... ...equal opportunity employer and federal contractor or subcontractor. Consequently, the parties...For contractorsRemote workFor subcontractorCasual workInternshipWork at officeImmediate startDay shift
- ...with hiring companies. This freelance trainer project focuses on evaluating conversational AI through realistic audio interactions conducted remotely, offering flexible hours and independent contractor status. You will contribute to high-quality datasets for models, design...For contractorsRemote jobFreelanceFlexible hours
- ...Trainer Jobs is seeking a Mongolian Bilingual Expert for a remote evaluation track. You will review prompts and model outputs against a versioned... ...calibration with gold-standard examples. As an independent contractor, you will review frontier model outputs, compare pairs, and...For contractorsRemote job
- ...Francisco, is seeking US-based generalist evaluators to participate in Gemini... ...personalization across connected Google apps. This contractor role requires strong analytical thinking... ...clear written feedback. You will work remotely, with 4+ hours daily and up to 40 hours...For contractorsRemote job
- Remotebridge is seeking a Sales and Business Development Expert for a remote contractor role focused on an internal AI training project. You will... ...feedback through written and verbal communication. You will evaluate AI interview scenarios, simulate conversations across...For contractorsRemote job
- AuraOne is seeking a Norwegian Transcription Expert for a remote evaluation track. You will review transcription outputs against AuraOne's... ...provide structured feedback to retrain the model. This is a contractor role requiring strong writing, attention to detail, and ability...For contractorsRemote jobHourly pay
- OpenTrain AI, Inc. is seeking a remote contractor to review and refine AI-generated guidance on federal student loans. The role focuses on evaluating accuracy, completeness, and current practices, with emphasis on careful written and practical judgment. You will use direct...For contractorsRemote jobPart timeFlexible hours
- AuraOne's Benchmark Dataset Ontology QA Reviewer role is a remote contractor position focused on auditing and labeling model outputs. You... ...the strongest answer. Ideal candidates bring experience in evaluation/annotation, clear written reasoning, and strong attention to...For contractorsRemote jobFlexible hours
- ...Jobs is seeking a French Transcription Expert (France) for a remote evaluation track. You will review french generalist prompts and... ...outputs, and provide structured feedback to retrain models. As a contractor, you will assess outputs against a versioned rubric, label edge...For contractorsRemote jobHourly pay
- AI Trainer Jobs is seeking an Acting and Animation Evaluation Specialist to remotely review AI outputs across animation workflows. You will assess... ...ensure outputs match senior-level standards. This is a contractor role with outputs tracked via a structured rubric and remote...For contractorsRemote job
- AuraOne, Inc. seeks a remote Historical Reasoning AI Evaluator to review prompts and responses, applying AuraOne's quality rubric. You will label edge... ...through precise rationale. The role supports a contractor arrangement with remote, US-eligible work and requires...For contractorsRemote job
- AuraOne, Inc. is seeking aRemote evaluation contractor for Mandarin Generalist tasks to review model outputs against a versioned rubric, label issues, and provide structured feedback for retraining. You will compare responses, justify the stronger answer with rationale,...For contractorsRemote job
- Remotebridge is seeking a Food Delivery AI Response Evaluator for a remote, contract-based role. You will review AI-generated interactions in food delivery, assess quality, relevance, and accuracy, and provide actionable feedback to improve model performance. Ideal candidates...For contractorsRemote jobContract work
$40 per hour
Talantir is seeking a remote contractor to work on evaluating AI chatbots. You will be given coding challenges for AI chatbots and assess their outputs for correctness and performance. Projects are paid hourly starting at $40+ USD per hour, with bonuses for high-quality...For contractorsRemote jobHourly payContract work- Meridial is seeking independent contractor experts to evaluate AI-generated outputs focusing on JSON structure, formatting accuracy, and response quality... ...English and the chosen language of the cohort. This is a remote contractor role in the United States. #J-18808-Ljbffr...For contractorsRemote workContract work
- ...Capital Markets SME to support AI model development, evaluation, and improvement in finance. This project-based contractor role requires evaluating AI-generated financial... ...experience and can work independently in a remote environment on a global basis, collaborating with...For contractorsRemote work
- AI Trainer Jobs is seeking a Dutch Transcription Expert to evaluate model outputs against AuraOne's rubric, label edge cases, and... ...select the stronger answer, and write clear rationales. This remote contractor role requires prior evaluation experience, meticulous rubric...For contractorsRemote job
- AuraOne, Inc. is seeking a remote Helpfulness Ranking Reward Model Evaluator to assess paired model outputs against a versioned rubric. You will label edge... ...structured feedback to help retrain the model. This contractor role requires careful written reasoning, attention...For contractorsRemote job10 hours per week
- LILT seeks detail-oriented human reviewers to support AI training and evaluation. You will work as an independent contractor across tasks like evaluating prompts, reviewing text, and analyzing multimedia content. Your work depends on applying local cultural context, brand...For contractorsRemote jobLocal area
- AuraOne, Inc. is seeking a remote Browser Automation Task Evaluator to review prompts and responses against our quality rubric. This contractor role focuses on labeling edge cases, writing structured feedback, and helping retrain our models. You will compare paired outputs...For contractorsRemote job10 hours per week
- AuraOne, Inc. is seeking a remote Deception Behavior Risk Evaluator to stress-test AI systems with adversarial prompts. You will design jailbreak-like... ...to enable rapid patching by the safety team. This contractor role requires strong written communication, experience...For contractorsRemote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Robot Trajectory Evaluator (Contractor). Be the first to apply!
Related searches
- evaluator New York, NY
- work from home web search evaluator New York, NY
- web search evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- work from home social media evaluator New York, NY
- ai evaluator New York, NY
- education evaluator New York, NY
- quality evaluator New York, NY
- social media evaluator New York, NY


