Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Surgical Robotics Task Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Surgical Robotics Task Evaluator is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers grade trajectory choices, perception assumptions, and safety envelopes; flag failure modes; and document the corrected behavior so the modeling team can train on it.

Why this role matters

Robotics review systems run in the physical world, where a confident-looking failure can hurt someone. AuraOne uses experienced robotics and operations reviewers to grade outputs against perception, motion, and safety constraints.

Responsibilities

  • Review robotics review outputs against current safety standards and operating envelopes for Surgical Robotics Task Evaluator assignments.
  • Grade perception, motion, and decision logic on a structured rubric.
  • Flag near-miss and unsafe trajectories with severity tags that match incident taxonomies.
  • Capture the corrected behavior or reference trajectory so the modeling team can train on it.
  • Adjudicate disputed cases against published standards or firm operating procedures.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Hands-on experience operating, supervising, or evaluating robotic, autonomous, or teleoperated systems for Surgical Robotics Task Evaluator work.
  • Comfort reasoning about perception, motion planning, and physical safety envelopes.
  • Familiarity with structured incident taxonomies and severity scoring.
  • Clear written reasoning that names the failure mode and the standard being applied.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a robotics review model's chosen trajectory and flag any near-miss or unsafe motion.
  • Score a perception output against ground-truth labels and rate the failure category.
  • Adjudicate a disputed safety call between two reviewers using firm operating procedures.
  • Audit a 25-trajectory batch for rubric consistency and report drift to the program lead.

Nice to have

  • Background in robotics engineering, autonomy operations, or industrial safety.
  • Prior experience reviewing AI-assisted robotics tooling and its failure modes.
  • Familiarity with simulation environments and trajectory-replay tooling.

Skills

  • Robotics evaluation
  • Perception review
  • Motion safety
  • Incident taxonomy
  • Robotics review
  • Embodied AI
  • Safety review
  • Surgical
  • Robotics

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Surgical Robotics Task Evaluator [Remote] in Remote vacancy
  • $41.65 - $52.36 per hour

     ...Mental Health Evaluator Company: MidHudson Regional Hospital City/State: Poughkeepsie, NY Category: Allied Health Prof/Technical...  ..., is home to the Redl Center for Cancer Care and Center for Robotic Surgery, and is a destination hospital for patients with serious... 
    Suggested
    Full time
    Flexible hours
    Shift work

    WMCHealth

    Poughkeepsie, NY
    5 days ago
  •  ...Surgical Planning Safety Evaluator is a remote evaluation track for reviewing surgical planning safety evaluation prompts and responses against AuraOne...  ...availability for at least 10 hours per week. Example tasks Compare two surgical planning safety evaluation model... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    2 days ago
  •  ...Robot Policy Compliance Task Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    2 days ago
  •  ...Physical Affordance Task Evaluator is a remote review track for evaluating AI outputs across physics reasoning, calculations, and research...  ...Citation review Quantitative analysis Physics Robotics evaluation Embodied AI Safety review Physical Affordance... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    2 days ago
  • $20 per hour

     ...is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’...  .... The position offers flexible hours and pays $20+ USD/hr for general projects and $40+ for design-focused tasks. #J-18808-Ljbffr
    Suggested
    Remote work
    Flexible hours

    DataAnnotation

    Columbia, SC
    2 days ago
  • $20 per hour

     ...company specializing in AI is looking for a Digital Web Designer to evaluate AI-generated designs and help train models for better aesthetic...  ...pay rates start at $20/hr for general projects and $40/hr for design-focused tasks, with possible bonuses. #J-18808-Ljbffr
    Remote work

    DataAnnotation

    Helena, MT
    3 days ago
  • $20 per hour

     ...company focused on AI and design is seeking a Digital Designer to evaluate AI-generated designs and enhance AI's understanding of user-...  ...from $20/hr for general projects and $40/hr for design-specific tasks. Candidates should possess strong design backgrounds and... 
    Remote work

    DataAnnotation

    Honolulu, HI
    3 days ago
  • $20 per hour

     ...Candidates should possess a strong design background and fluency in English. Compensation starts at $20+ USD/hr for general AI projects and $40+ USD/hr for design-focused tasks. This is a remote, independent contract position for applicants in the United States. #J-18808-Ljbffr
    Contract work
    Remote work

    DataAnnotation

    Denver, CO
    2 days ago
  • $11.5 per hour

     ...A leading educational institution is offering a part-time remote position as an Online Task Contributor. In this role, you will evaluate and provide feedback on content to enhance search engine results and quality. No prior experience is needed, but proficiency in English... 
    Hourly pay
    Part time
    Remote work

    University of Delaware

    New York, NY
    5 days ago
  • $60 per hour

     .... That's where you come in. As a member of DataAnnotation's team, you'll work closely with state-of-the-art AI models on tasks like evaluating AI-generated security content, solving technical security problems, and providing feedback that directly shapes how these systems... 
    Hourly pay
    Full time
    Remote work
    Flexible hours

    DataAnnotation

    Nevada, IA
    2 days ago
  • $20 per hour

     ...outputs and help refine design quality. Applicants should have a background in UI/UX and be fluent in English. This is a remote position with project flexibility and competitive pay starting at $20/hr for general projects and $40/hr for design-focused tasks. #J-18808-Ljbffr
    Remote work

    DataAnnotation

    Nevada, IA
    2 days ago
  •  ...Prolific is seeking fluent Thai speakers to act as evaluators for AI language models. You will assess how naturally Thai is spoken in AI...  ...ensuring cultural and contextual accuracy. This is a remote, paid task with flexible hours and competitive pay. Applicants should have... 
    Remote work
    Flexible hours

    Prolific

    Los Angeles, CA
    2 days ago
  • $60 per hour

     ...That's where you come in. As a member of DataAnnotation's team, you'll work closely with state-of-the-art AI models on tasks like evaluating AI-generated quantitative analysis, solving technical problems, and providing feedback that directly shapes how these systems... 
    Hourly pay
    Full time
    Remote work
    Flexible hours

    DataAnnotation

    Kansas City, MO
    2 days ago
  • $25 - $30 per hour

     ...analytical and detail-oriented independent contractors in New York to help train AI chatbots. You will manage various tasks, write high-quality responses, and evaluate AI models based on guidelines. This role offers flexibility as you can choose projects and work from home,... 
    Hourly pay
    Contract work
    For contractors
    Remote work
    Work from home

    DataAnnotation

    Florida, NY
    1 day ago
  • Search Quality Evaluator (AI Training) What if your everyday curiosity and sharp judgment could directly influence how millions of people...  ...written explanations to support your ratings Work through task-based assignments independently at your own pace and on your own... 
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Remote work
    Flexible hours

    Alignerr

    New York, NY
    1 day ago
  • $5,083 per month

     ...will begin on February 11, 2026. This position specializes in evaluation functions under the general supervision of the University Registrar...  ...and degree audit programs to assure timely completion of tasks. Accurately enter and update student information in administrative... 
    Work at office
    Remote work

    California State University - East Bay

    Hayward, CA
    14 hours ago
  • $20 per hour

    A leading data annotation firm is seeking a Web Designer to evaluate AI-generated designs and enhance their understanding of design principles...  ...at $20/hr for general projects and $40/hr for design-specific tasks, with bonus opportunities for exceptional work. #J-18808-Ljbffr... 
    Remote job

    DataAnnotation

    Wyoming, OH
    1 day ago
  • $20 per hour

     ...looking for an Experience Designer to improve AI model outputs by evaluating design work, including interfaces and visuals. This role offers...  ..., with compensation starting at $20+ USD/hr for general AI tasks and $40+ USD/hr for design-focused work. Applicants must be fluent... 
    Remote job
    Contract work
    Flexible hours

    DataAnnotation

    Lincoln, NE
    3 days ago
  • $70 per hour

     ...Location: Remote Commitment: 10-40 hrs/week Role Responsibilities Evaluate and critique the performance and accuracy of AI-generated...  ...Contribute user-level expertise by simulating real-life scenarios or tasks to gauge model utility and effectiveness. Requirements Have... 
    Contract work
    Remote work

    Crossing Hurdles

    New York, NY
    2 days ago
  • $20 per hour

     ...firm in the United States is seeking a Digital Web Designer to evaluate AI-generated designs and enhance the model's understanding of aesthetics...  ...and involves both general AI training and design-focused tasks, with compensation starting at $20/hr. Candidates should have a... 
    Remote job

    DataAnnotation

    Montgomery, AL
    14 hours ago
  • $60 per hour

     ...development firm seeks experienced quantitative professionals to evaluate AI-generated quantitative analysis and contribute to cutting-...  ...systems. This fully remote role offers a flexible schedule, with tasks including solving technical problems and providing impactful... 
    Remote work
    Flexible hours

    DataAnnotation

    Washington DC
    2 days ago
  • $20 per hour

     ...Candidates should have a background in design and fluency in English. The position offers flexibility to choose projects and a pay rate starting at $20+ USD/hr for general tasks, with higher rates for design-focused projects. Independent contractors only. #J-18808-Ljbffr
    For contractors
    Remote work

    DataAnnotation

    Indiana, PA
    2 days ago
  • $40 per hour

     ...training company is seeking a Postdoctoral Physics Associate to evaluate AI chatbot outputs and enhance model quality. This remote...  ...assess the performance of AI models through complex problem-solving tasks. Flexible project choices and hourly pay starting at $40+ are offered... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Lansing, MI
    2 days ago
  • $60 per hour

    A leading AI research company is seeking quantitative professionals to evaluate AI-generated work and provide valuable feedback on analytical tasks. This fully remote position offers a flexible schedule and competitive pay up to $60 USD/hour. Ideal candidates will have... 
    Remote job
    Flexible hours

    DataAnnotation

    New York, NY
    14 hours ago
  • $30 per hour

     ...Speakers in Chicago, IL to train AI models. You will complete AI tasks and assess AI performance in Dutch, with pay at $30/hr. Ideal...  ...home with competitive rates and direct payment through PayPal. Pass the evaluation, and you can start within 15 minutes. #J-18808-Ljbffr... 
    Remote work
    Work from home

    Prolific

    Chicago, IL
    1 day ago
  • $60 per hour

     ...company is seeking proficient programmers to advance AI development in a fully remote setting. As part of this team, you'll engage in tasks like solving coding problems and building applications, with a competitive pay rate of up to $60/hour based on performance.... 
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    3 days ago
  • $75k - $110k

     ...Opportunity to specialize in unique rural and forestland appraisals Stable, respected firm with over 70 years of industry experience A Task and Duty Guide for this position is available upon request. Pay and benefits are commensurate with skills and experience.... 
    Temporary work
    Remote work

    Forecon

    New York, NY
    2 days ago
  • $30 per hour

     ...A prominent AI data company is seeking Advanced Mandarin Speakers for evaluating AI models and completing training tasks. This remote role offers competitive pay of $30/hr for tasks requiring one hour of focused work. Candidates should be fluent in Mandarin with the ability... 
    Remote work
    Work from home
    Flexible hours

    Prolific - UK Job Board?

    New York, NY
    5 days ago
  • $19 per hour

     ...is building realistic, high-fidelity simulated environments to evaluate and train AI models on real-world procurement workflows for a leading...  ..., distribution, packaging, receiving, and quality assurance tasks within the Mobile Services Team.This posi... Show more Full-... 
    Hourly pay
    Permanent employment
    Full time
    Temporary work
    Casual work
    Seasonal work
    Work at office
    Remote work
    Work from home
    Monday to Friday

    Impact Valuation Group LLC

    New York, NY
    3 days ago
  • $16 - $20 per hour

     ...DESCRIPTION AND POSITION REQUIREMENTS The research team at Penn State Ross and Carol Nese College of Nursing is hiring part‑time research evaluators for projects focused on dementia care in assisted living settings. The research evaluator will assist with in‑person recruitment,... 
    Hourly pay
    Part time
    Summer work

    The Pennsylvania State University

    Hershey, PA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Surgical Robotics Task Evaluator [Remote]. Be the first to apply!