Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Surgical Robotics Task Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Surgical Robotics Task Evaluator is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers grade trajectory choices, perception assumptions, and safety envelopes; flag failure modes; and document the corrected behavior so the modeling team can train on it.

Why this role matters

Robotics review systems run in the physical world, where a confident-looking failure can hurt someone. AuraOne uses experienced robotics and operations reviewers to grade outputs against perception, motion, and safety constraints.

Responsibilities

  • Review robotics review outputs against current safety standards and operating envelopes for Surgical Robotics Task Evaluator assignments.
  • Grade perception, motion, and decision logic on a structured rubric.
  • Flag near-miss and unsafe trajectories with severity tags that match incident taxonomies.
  • Capture the corrected behavior or reference trajectory so the modeling team can train on it.
  • Adjudicate disputed cases against published standards or firm operating procedures.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Hands-on experience with robotic, autonomous, or teleoperated systems. Operating, supervising, or evaluating them for Surgical Robotics Task Evaluator work.
  • Comfort reasoning about perception, motion planning, and physical safety envelopes.
  • Familiarity with structured incident taxonomies and severity scoring.
  • Clear written reasoning that names the failure mode and the standard being applied.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a robotics review model's chosen trajectory and flag any near-miss or unsafe motion.
  • Score a perception output against ground-truth labels and rate the failure category.
  • Adjudicate a disputed safety call between two reviewers using firm operating procedures.
  • Audit a 25-trajectory batch for rubric consistency and report drift to the program lead.

Nice to have

  • Background in robotics engineering, autonomy operations, or industrial safety.
  • Prior experience reviewing AI-assisted robotics tooling and its failure modes.
  • Familiarity with simulation environments and trajectory-replay tooling.

Skills

  • Robotics evaluation
  • Perception review
  • Motion safety
  • Incident taxonomy
  • Robotics review
  • Embodied AI
  • Safety review
  • Surgical
  • Robotics

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 17 days ago
Similar jobs that could be interesting for youBased on the Surgical Robotics Task Evaluator [Remote] in Remote vacancy
  • Productive Playhouse seeks a Portugal Portuguese AI Product Evaluator for an upcoming project testing and evaluating leading AI chatbots...  .... This is an independent contractor engagement with batches of tasks; you set your hours and may work with other clients. Transitions... 
    Suggested
    Remote job
    For contractors
    Freelance
    Flexible hours

    United States Digital Space LLC

    New York, NY
    3 days ago
  • Simulation-to-Real Task Evaluator is a remote evaluation track for reviewing simulation to real task evaluation prompts and responses against...  ...Inter-rater calibration Simulation to Real Task evaluation Robotics evaluation Embodied AI Safety review Simulation Real Work... 
    Suggested
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne

    New York, NY
    4 days ago
  •  ...Physical Affordance Task Evaluator is a remote review track for evaluating AI outputs across physics reasoning, calculations, and research...  ...Citation review Quantitative analysis Physics Robotics evaluation Embodied AI Safety review Physical Affordance... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    19 days ago
  •  ...Robot Policy Compliance Task Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    15 days ago
  • $20 per hour

     ...is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’...  .... The position offers flexible hours and pays $20+ USD/hr for general projects and $40+ for design-focused tasks. #J-18808-Ljbffr
    Suggested
    Remote work
    Flexible hours

    DataAnnotation

    Columbia, SC
    4 days ago
  • $52k - $57k

     ...POSITION TITLE: Program Evaluator REPORTS TO: Director of Quality BROAD FUNCTION: Collects, analyzes, and reports on data to evaluate effectiveness...  ...Independent judgement and self-direction to complete assigned tasks and identify tools and approaches for analysis. An... 
    Full time
    Summer work
    Local area

    Family-Connections,-Inc.-

    Cranford, NJ
    18 hours ago
  •  ...Alignerr is seeking a Search Quality Evaluator to assess search engine results, AI-generated answers, and content recommendations. This...  ...background required beyond reliable internet access. You will work on task-based assignments at your own pace, covering a wide range of... 
    Contract work
    Remote work
    Flexible hours

    Alignerr

    Peru, IL
    4 days ago
  •  ...core values in everything we do. NATURE AND SCOPE: The Lead Evaluator, Early Learning will provide high quality personalized and...  ...responsibilities that may, from time to time, include related or unrelated tasks. JOB REQUIREMENTS: Education & Experience: BS in Early... 
    Part time
    Work experience placement
    Work at office
    Local area
    Remote work

    Cognia, Inc.

    Portsmouth, NH
    9 days ago
  • Rex.zone is seeking a Senior AI data annotator to perform data labeling and evaluation for NLP tasks, RLHF assessments, and prompt QA to improve training data quality and model performance. This is a US-based remote, full-time role aligned with Miami talent demand. You... 
    Remote job
    Full time

    Rex.zone

    Miami, FL
    2 days ago
  •  ...Columbus, Ohio invites applicants for its Transfer and Articulation Evaluator. Position Summary The Transfer and Articulation Evaluator will...  ...to detail Demonstrated ability to successfully prioritize tasks Preferred Skills and Characteristics Strong interpersonal skills... 
    Full time
    Immediate start

    Franklin University

    Columbus, OH
    3 days ago
  • $20 - $26 per hour

    Prolific is seeking fluent Kannada speakers to act as evaluators. You will compare text and AI-generated Kannada audio, rating naturalness...  ...and providing precise feedback to improve language models. Tasks are paid at $20-$26 per hour, with many assignments taking about... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Columbus, OH
    23 hours ago
  • $8 per hour

    Dorado is seeking a Speech AI Evaluation Specialist to help improve AI-generated content in Thai or Chinese Simplified. This freelance, part...  ...are native in Thai or Chinese Simplified, fluent in English (B2-C2), and familiar with AI/data tasks such #J-18808-Ljbffr Dorado
    Remote job
    Part time
    Freelance
    Immediate start

    Dorado

    New York, NY
    1 day ago
  •  ...organization to engage senior UI/UX and product designers in a project focused on defining grading criteria for AI-driven design evaluation tasks. You will design task-specific scoring rubrics and provide rigorous written justifications for each score. You will score AI-... 
    Remote job

    FirstCash, Inc.

    Surprise, AZ
    1 day ago
  • $11 per hour

     ...Playhouse is building a pool of Traditional Chinese speakers for AI evaluation projects. This freelance role has flexible hours and project-...  ....; work from anywhere with a smartphone and reliable internet. Tasks arrive in batches and you can choose which to take, enabling a... 
    Remote job
    Hourly pay
    Freelance
    Flexible hours

    Productive Playhouse

    New York, NY
    2 days ago
  • $100 - $125 per hour

     ...24-hour fast-track onboarding required Key Responsibilities Translate real-world insurance workflows into structured tasks for AI systems Evaluate AI-generated outputs for accuracy, logical reasoning, and business relevance Work on use cases including underwriting,... 
    Remote job
    Hourly pay
    For contractors
    Freelance
    Work at office
    Immediate start
    Flexible hours

    Crossing Hurdles

    New York, NY
    2 days ago
  • $48.3k - $67.7k

     ...effective remote interactions. Strong analytical skills, applied in evaluating individual needs and resources. Qualifications Education...  ...in this document are not a comprehensive list and additional tasks may be assigned to the employee from time to time, or the scope... 
    Full time
    Remote work
    Flexible hours

    Centerstone

    Alton, IL
    2 days ago
  • Productive Playhouse is seeking a Kinyarwanda AI Product Evaluator. This freelancer role involves direct interaction with AI chatbots to test quality, safety, and helpfulness, with iterative task batches and flexible hours. You’ll work remotely from anywhere, choose tasks... 
    Remote job
    Freelance
    Flexible hours

    Productive Playhouse

    New York, NY
    2 days ago
  •  ...independent contractor role offers flexible hours and work from home. Candidates should have strong English proficiency and be based in the United States. You will be assigned tasks with earnings varying by volume and quality. #J-18808-Ljbffr TELUS Digital AI Data Solutions
    For contractors
    Work from home
    Flexible hours

    TELUS Digital AI Data Solutions

    Brooklyn, NY
    3 days ago
  •  ...people find information online? We're looking for Search Quality Evaluators to assess search engine results, AI-generated answers, and...  ...concise written explanations to support your ratings Work through task-based assignments independently at your own pace Cover a broad... 
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Remote work
    Flexible hours

    Alignerr

    Peru, IL
    23 hours ago
  •  ...and language services company, is assembling a pool of British English speakers to test and evaluate leading AI chatbots. Independent, project-based work lets you choose tasks, set hours, and work with multiple clients. This role focuses on hands-on evaluation of Generative... 
    Remote job
    Flexible hours

    Productive Playhouse

    New York, NY
    2 days ago
  • $15 per hour

    Productive Playhouse is building a pool of Spanish (Spain) speakers for evaluating leading AI chatbots. You will work as an independent contractor, choosing tasks, setting your own hours, and collaborating with clients globally. Pay is $15.00 USD per hour, with flexible... 
    Remote job
    Hourly pay
    For contractors
    Freelance
    Flexible hours

    Productive Playhouse

    New York, NY
    2 days ago
  • RWS - TrainAI in Albuquerque, New Mexico is seeking a Search Quality Rater for English language tasks. This part‑time, remote position involves testing and evaluating how our clients’ search engine responds to everyday queries from real users. You will need strong online... 
    Remote job
    Part time
    Work from home
    Home office
    10 hours per week

    aitrainer

    Albuquerque, NM
    3 days ago
  • Productive Playhouse is building a talent pool of Armenian speakers to test and evaluate leading AI chatbots. This freelance, project-based opportunity lets you choose tasks, set your own hours, and work with other clients as needed. Open to freelancers outside the U.S.... 
    Remote job
    Freelance
    Flexible hours

    Productive Playhouse

    New York, NY
    2 days ago
  • $9 per hour

    Productive Playhouse is forming a pool of Vietnamese-speaking evaluators for testing AI chatbots. This independent contractor role lets you choose tasks, set hours, and work with other clients globally. Pay is $9.00 USD per hour, with iterative batch-based work and flexible... 
    Remote job
    Hourly pay
    For contractors
    Freelance
    Flexible hours

    Productive Playhouse

    New York, NY
    2 days ago
  • $22 per hour

     ...their respective markets. About Job Overview As a Content Quality Evaluator, English, you will assess the quality of English-language...  ...field preferred, but not required Ability to perform repetitive tasks without degradation in quality. Detail-oriented problem-solving... 
    Hourly pay
    Work at office

    Centific Technologies, Inc

    Redmond, WA
    3 days ago
  • $5,083 per month

     ...will begin on February 11, 2026. This position specializes in evaluation functions under the general supervision of the University Registrar...  ...and degree audit programs to assure timely completion of tasks. Accurately enter and update student information in administrative... 
    Full time
    Work at office
    Remote work

    Opt For Healthy Living

    California, MO
    2 days ago
  • Productive Playhouse is assembling a pool of South African English evaluators to test leading AI chatbots. You will work as an independent contractor, choosing tasks, setting hours, and collaborating on project-based evaluations. Role involves hands-on testing of AI models... 
    Remote job
    For contractors
    Freelance

    Productive Playhouse

    New York, NY
    2 days ago
  •  ...Digita l are currently hiring for a Personalized Internet Ads Evaluator role! This is a freelance, independent contractor position that...  ...application to be installed on your smartphone to complete certain tasks. Assessment In order to be hired into the program, you’ll be... 
    Part time
    For contractors
    Freelance
    Currently hiring
    Immediate start
    Work from home
    Flexible hours

    University of Delaware

    New York, NY
    2 days ago
  • $24 per hour

    Prolific is seeking an AI Trainer with advanced Tamil fluency to evaluate AI models' understanding of the Tamil language's emotional and...  ...setup. Competitive compensation is offered at up to $24/hr for tasks, with flexible hours and remote work options. #J-18808-Ljbffr... 
    Remote job
    Flexible hours

    Prolific

    New York, NY
    4 days ago
  • $23.2 per hour

     ...set of guidelines to help us improve Roblox systems. As a Human Evaluator you will have the opportunity to provide us direct feedback on...  ...written communication skills Demonstrated patience for repetitive tasks and attention to detail Effective time management skills In-... 
    Hourly pay
    Full time
    Contract work
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday

    Roblox

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Surgical Robotics Task Evaluator [Remote]. Be the first to apply!