Robotics Evaluation Specialist
AI Trainer Jobs
Robotics Evaluation Specialist is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers grade trajectory choices, perception assumptions, and safety envelopes; flag failure modes; and document the corrected behavior so the modeling team can train on it. Category: Robotics & Embodied AI · Pay: Hourly rate confirmed after the interview process · Location: Remote — US-eligible · Contractor Robotics Evaluation Specialist is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. About the role Robotics Evaluation Specialist is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers grade trajectory choices, perception assumptions, and safety envelopes; flag failure modes; and document the corrected behavior so the modeling team can train on it. Robotics review systems run in the physical world, where a confident-looking failure can hurt someone. AuraOne uses experienced robotics and operations reviewers to grade outputs against perception, motion, and safety constraints. Review teleoperation, navigation, and manipulation work. Physical-world safety is part of it. Responsibilities Review robotics review outputs against current safety standards and operating envelopes for Robotics Evaluation Specialist assignments. Grade perception, motion, and decision logic on a structured rubric. Flag near-miss and unsafe trajectories with severity tags that match incident taxonomies. Capture the corrected behavior or reference trajectory so the modeling team can train on it.Track Robotics & physical AI review Work model Remote · Independent specialist contractor Compensation Hourly rate confirmed after the interview process. Eligible from US What you should bring Hands-on experience with robotic, autonomous, or teleoperated systems. Operating, supervising, or evaluating them for Robotics Evaluation Specialist work. Comfort reasoning about perception, motion planning, and physical safety envelopes. Familiarity with structured incident taxonomies and severity scoring. Clear written reasoning that names the failure mode and the standard being applied. Reliable async availability for at least 10 hours per week. Example tasks Grade a robotics review model's chosen trajectory and flag any near-miss or unsafe motion. Score a perception output against ground-truth labels and rate the failure category. Adjudicate a disputed safety call between two reviewers using firm operating procedures. Audit a 25-trajectory batch for rubric consistency and report drift to the program lead. Useful experience Background in robotics engineering, autonomy operations, or industrial safety. Prior experience reviewing AI-assisted robotics tooling and its failure modes. Familiarity with simulation environments and trajectory-replay tooling. Compensation and schedule Hourly rate confirmed after the interview process. Expected arrangement: contractor , with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation. Skills used in matching Robotics evaluation Perception review Motion safety #J-18808-Ljbffr
$90.58k - $114.59k
Position InformationNY HELP: YesAgency: Mental Health, Office ofTitle: Mental Hygiene Program Evaluation Specialist 3 (NY HELPS), Kingsboro Psychiatric Center, P27987Occupational Category: Health Care, Human/Social ServicesSalary Grade: 23Bargaining Unit: PS&T - Professional...SuggestedPermanent employmentFull timeWork at officeRemote work- ...About the role Calibration Technology Evaluation Specialist is a remote review track for evaluating AI outputs across calibration technology evaluation specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational...SuggestedHourly payFor contractorsWork experience placementRemote work10 hours per week
$45 - $70 per hour
...Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Behavioral Health Expert AI Safety and Model Evaluation Type: Contract Compensation: $45$70/hour Location: Remote Commitment: 2040 hours/week...SuggestedFull timeContract workSummer workRemote workWeekday work- AuraOne is seeking a Mandarin Transcription Expert to remotely evaluate mandarin generalist prompts and responses. You will compare outputs, label edge cases, and create structured feedback for retraining the model. As an independent contractor, you will review tasks with...SuggestedRemote jobFor contractors
- ...contractor, you’ll work asynchronously, roughly 10 hours per week, with hourly compensation discussed after interview. Remote work available for US-eligible candidates; prior evaluation, annotation, or Uyghur bilingual experience is highly #J-18808-Ljbffr AI Trainer JobsSuggestedRemote jobHourly payFor contractors10 hours per week
- Mercor is seeking detail-oriented writing experts to contribute to a high-impact video AI research project. You will evaluate paired video outputs, score them against a rubric, and document brief rationales. This is a short-term, flexible engagement for researchers with...Temporary workFlexible hours
- Weekday 1 is seeking analytical professionals to evaluate AI-generated responses across a variety of topics in a fully remote contractor role. You will assess AI outputs, identify strengths and weaknesses in reasoning, and provide structured, evidence-based feedback to...For contractorsRemote workWeekday work
- AuraOne is seeking a Voice Actor: CX Agent Voice Cloning (Indonesian Bahasa - Female) for a remote evaluation track reviewing prompts and responses against our quality rubric. Reviewers label edge cases and provide structured feedback for retraining. You will compare paired...Remote jobFor contractors10 hours per week
- NCR Eduservices Pvt. Ltd. is seeking an English Evaluator to remotely assess phonics-based reading and pronunciation sessions delivered by native English teachers from the US and UK. The ideal candidate has a strong English background, knowledge of phonics, and the ability...Remote work
- AI Trainer Jobs seeks a Generalist - English & Telugu evaluator to review prompts and responses from AuraOne's data-labeling rubric. You will compare outputs, label edge cases, and provide structured feedback for model retraining. Applicants should have prior evaluation...Remote jobFor contractors10 hours per weekFlexible hours
- YO AI Labs seeks a Humanities Evaluation Specialist to support an AI training project entirely remotely. You will create challenging humanities questions and high-quality answers, and research using authoritative sources with proper citations. Design prompts that require...Remote job
- AI Trainer Jobs is seeking a Cantonese Bilingual Expert for a remote evaluation track. Reviewers compare cantonese prompts and responses against AuraOne's rubric, label edge cases, and provide structured feedback to retrain the model. This contractor role offers hourly...Remote jobHourly payFor contractors10 hours per weekFlexible hours
- AuraOne is seeking a French Audio Recording Expert (Canada) for remote evaluation. You will review prompts and responses, compare outputs, and label issues using a versioned rubric to aid retraining. This role focuses on assessing pronunciation, voice quality, and conversation...Remote job
- AuraOne seeks a Hebrew Transcription Expert to remotely evaluate Hebrew outputs using a versioned rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain the model. This is a contractor role with US-eligibility for remote...For contractorsRemote work
- Humanities Evaluation Specialist role for a remote contractor project. The specialist will create rigorous humanities questions, verify sources, and craft prompts that require deep interpretation and analytical reasoning. You will evaluate AI-generated responses for accuracy...Remote jobContract workFor contractors
- ...compare paired outputs, label edge cases, and provide structured feedback to help retrain the model. Ideal candidates have prior evaluation or annotation experience in music production English, strong attention to detail, and the ability to work asynchronously for at least...Remote jobFor contractors10 hours per week
- ...oriented UX/UI Designers and creative/technical professionals to support a video annotation project involving robotic arm tasks. You will review, label, and evaluate video sessions according to established guidelines to support AI training. As a contractor working remotely...Remote jobFor contractors
- micro1 is seeking Humanities Evaluation Specialists to support an AI training project. Remote contractors will craft challenging humanities questions, verify sources, and design prompts that demand deep interpretation and analytical reasoning. The role involves evaluating...Remote jobFor contractors
$90.58k - $114.59k
The State of New York - Mental Health, Office of, at Kingsboro Psychiatric Center, seeks a Mental Hygiene Program Evaluation Specialist 3 for NY HELPS. This full-time role evaluates mental health programs, analyzes data, and supports evidence-based improvements within a...Permanent employmentFull timeWork at office- AI Trainer Jobs is seeking a Korean bilingual expert for a remote evaluation track. The role involves reviewing Korean generalist prompts and responses against AuraOne's rubric, comparing paired outputs, and writing structured feedback for retraining. As a remote independent...Hourly payFor contractorsRemote work
- ...professional to join a GenAI red-team within a leading AI lab network. The role involves probing frontier models, designing robust evaluation tasks, and documenting findings for reproducibility. This full-time W-2 position is remote within the United States, requiring...Full timeRemote work
- AI Trainer Jobs is seeking an Albanian Bilingual Expert to remotely evaluate prompts and responses against AuraOne's quality rubric. Reviewers label edge cases, compare outputs, and write structured feedback to aid model retraining. You will work as a contractor, reviewing...Remote jobFor contractors
- AuraOne seeks a contractor to join a remote evaluation track for reviewing writer evaluation prompts and responses against its quality rubric. You will compare outputs, label edge cases, and write structured feedback for model retraining. Responsibilities include evaluating...Remote jobFor contractors10 hours per weekFlexible hours
$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80-$120/hour Location: Remote Responsibilities Evaluate AI-generated artifacts against domain-...Contract workSummer workWork at officeRemote work$60 per hour
...of Medicine at Mount Sinai, perform complex procedures using robotics, laparoscopy, and endoscopy, all as a part of our minimally invasive... ...generation of leaders in the field. The Per Diem Diagnostic Specialist (Ultrasound/Micro-Ultrasound) performs radiologic procedures,...Hourly payDaily paidTraineeshipLocal area- Senior Merchant Mariner Evaluation Specialist (Engine) This vacancy is for a GS-2101-13, Senior Merchant Mariner Evaluation Specialist (Engine) located in the Department of Homeland Security, U.S. Coast Guard, NMC MARINER EXAMINATIONS BRANCH in location to be determined...
$145k
...Make: We are looking for an experienced PolyPath Market Risk Specialist with strong technical and business knowledge to support... ...your supervisors or managers to perform other duties. You may be evaluated in part based upon your performance of the tasks listed in this...Hourly payFull timeContract workWork experience placementShift work$89.59k - $197.46k
...own future.KPMG is currently seeking a Senior Associate, Credit Specialist to join our Audit practice.Responsibilities:Execute the day-to... ...models to credit loss accounting concepts, including evaluation of model validation design and application Ability to meet challenging...H1bLocal area- AuraOne is seeking a Polish Bilingual Expert to remotely review prompts and responses against the company’s quality rubric. You will compare paired outputs, label edge cases, and write structured feedback to retrain models. You will label hallucinations, instruction-following...Remote jobFor contractors
- YO AI Labs is seeking a meticulous Video Annotation Specialist to review and label videos of robotic arms for AI and machine-learning projects. This remote contractor role emphasizes accuracy, consistency, and structured data annotation following project guidelines. You...Remote jobFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Robotics Evaluation Specialist. Be the first to apply!
- addiction specialist New York, NY
- youth engagement specialist New York, NY
- denials specialist New York, NY
- mathematics specialist New York, NY
- configuration specialist New York, NY
- enterprise solutions specialist New York, NY
- member outreach specialist New York, NY
- vetting specialist New York, NY
- occupancy specialist New York, NY
- creative specialist New York, NY




