Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Surgical Robotics Task Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Surgical Robotics Task Evaluator is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers grade trajectory choices, perception assumptions, and safety envelopes; flag failure modes; and document the corrected behavior so the modeling team can train on it.

Why this role matters

Robotics review systems run in the physical world, where a confident-looking failure can hurt someone. AuraOne uses experienced robotics and operations reviewers to grade outputs against perception, motion, and safety constraints.

Responsibilities

  • Review robotics review outputs against current safety standards and operating envelopes for Surgical Robotics Task Evaluator assignments.
  • Grade perception, motion, and decision logic on a structured rubric.
  • Flag near-miss and unsafe trajectories with severity tags that match incident taxonomies.
  • Capture the corrected behavior or reference trajectory so the modeling team can train on it.
  • Adjudicate disputed cases against published standards or firm operating procedures.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Hands-on experience with robotic, autonomous, or teleoperated systems. Operating, supervising, or evaluating them for Surgical Robotics Task Evaluator work.
  • Comfort reasoning about perception, motion planning, and physical safety envelopes.
  • Familiarity with structured incident taxonomies and severity scoring.
  • Clear written reasoning that names the failure mode and the standard being applied.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a robotics review model's chosen trajectory and flag any near-miss or unsafe motion.
  • Score a perception output against ground-truth labels and rate the failure category.
  • Adjudicate a disputed safety call between two reviewers using firm operating procedures.
  • Audit a 25-trajectory batch for rubric consistency and report drift to the program lead.

Nice to have

  • Background in robotics engineering, autonomy operations, or industrial safety.
  • Prior experience reviewing AI-assisted robotics tooling and its failure modes.
  • Familiarity with simulation environments and trajectory-replay tooling.

Skills

  • Robotics evaluation
  • Perception review
  • Motion safety
  • Incident taxonomy
  • Robotics review
  • Embodied AI
  • Safety review
  • Surgical
  • Robotics

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Surgical Robotics Task Evaluator [Remote] in Remote vacancy
  •  ...Retrieval Relevance Task Evaluator is a remote evaluation track for reviewing retrieval relevance task evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  •  ...Physical Affordance Task Evaluator is a remote review track for evaluating AI outputs across physics reasoning, calculations, and research...  ...Citation review Quantitative analysis Physics Robotics evaluation Embodied AI Safety review Physical Affordance... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  •  ...Robot Policy Compliance Task Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  •  ...work.Work You’ll DoAs a Project - Program Analytics & Insights Evaluator IIon the project, you will be responsible for:Supporting the design...  ...relationships Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environmentStrong interpersonal skills... 
    Suggested
    Local area

    Deloitte

    Atlanta, GA
    3 days ago
  • $52k - $57k

     ...POSITION TITLE: Program Evaluator REPORTS TO: Director of Quality BROAD FUNCTION: Collects, analyzes, and reports on data to evaluate effectiveness...  ...Independent judgement and self-direction to complete assigned tasks and identify tools and approaches for analysis. An... 
    Suggested
    Full time
    Summer work
    Local area

    Family-Connections,-Inc.-

    Cranford, NJ
    4 days ago
  • $11.5 per hour

     ...A leading educational institution is offering a part-time remote position as an Online Task Contributor. In this role, you will evaluate and provide feedback on content to enhance search engine results and quality. No prior experience is needed, but proficiency in English... 
    Hourly pay
    Part time
    Remote work

    University of Delaware

    United States
    4 days ago
  • $50 - $60 per hour

     ...intelligence. Contributors review examples, test model behavior, evaluate responses, and identify errors so AI systems become more...  ...hours per week Work directly with cutting-edge AI evaluation tasks Use practical analytics expertise to improve AI systems The Role... 
    Hourly pay
    Part time
    For contractors
    Remote work
    Worldwide
    Flexible hours

    OpenTrain AI

    Brooklyn, NY
    5 days ago
  • $20 per hour

     ...is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’...  ...offers flexible hours and pays $20+ USD/hr for general projects and $40+ for design-focused tasks. #J-18808-Ljbffr DataAnnotation
    Remote job
    Flexible hours

    DataAnnotation

    Columbia, SC
    1 day ago
  • $22 per hour

     ...in their respective markets. Job Overview As a Content Quality Evaluator, English, you will assess the quality of English-language content...  ...preferred, but not required Ability to perform repetitive tasks without degradation in quality. Detail-oriented problem-solving... 
    Work at office

    Centific

    Redmond, WA
    4 days ago
  • $40 - $100 per hour

     ...countries English-language work About AI Training and Scientific Evaluation AI training is the human side of building modern artificial...  ...realistic scenarios, calculations, and research-style reasoning tasks. Focus on scientific evaluation of AI outputs Apply domain-specific... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    OpenTrain AI

    Brooklyn, NY
    4 days ago
  • $24 per hour

    Prolific is seeking an AI Trainer with advanced Tamil fluency to evaluate AI models' understanding of the Tamil language's emotional and...  ...setup. Competitive compensation is offered at up to $24/hr for tasks, with flexible hours and remote work options. #J-18808-Ljbffr... 
    Remote job
    Flexible hours

    Prolific

    New York, NY
    3 days ago
  • $390 per month

     ...Job Description Position: Florida Licensed Comprehensive Evaluator Position Description: Emerge Behavioral Health has several...  ...:5 · Light case management and other necessary administrative tasks. Pay Scale: $390.00 ($ 65.00/hr.) to $40.00 ($ 75.00/hr.) per... 
    Part time
    For contractors
    Internship
    Work at office
    Work from home

    Emergen Inc

    Lake Mary, FL
    12 days ago
  • CNTXT AI is seeking a remote contractor to evaluate AI-generated financial content and develop test cases that probe analytical reasoning...  ...-referencing data from balance sheets and reports; creating prompts and Excel-based evaluation tasks; and #J-18808-Ljbffr CNTXT AI
    Remote job
    For contractors

    CNTXT AI

    New York, NY
    5 days ago
  •  ...with a strong understanding of their local cultural context to support a range of AI training and evaluation projects . In this role, you will work across diverse task types, including evaluating prompts and AI-generated outputs, reviewing and correcting text,... 
    Extra income
    Full time
    For contractors
    Local area
    10 hours per week

    Lilt

    Remote
    a month ago
  •  ...| Contract  We are looking for detail-oriented Image Quality Evaluator for a multilingual AI data Annotation and Transcription Specialists...  ...Prior experience in transcription, annotation, or linguistic tasks is preferred  Access to a laptop/desktop and stable internet... 
    Contract work
    Remote work
    Work from home
    Monday to Friday
    Day shift

    iMerit Technologies

    San Jose, CA
    more than 2 months ago
  • $30 per hour

     ...Speakers in Chicago, IL to train AI models. You will complete AI tasks and assess AI performance in Dutch, with pay at $30/hr. Ideal...  ...with competitive rates and direct payment through PayPal. Pass the evaluation, and you can start within 15 minutes. #J-18808-Ljbffr Prolific
    Remote job
    Work from home

    Prolific

    Chicago, IL
    1 day ago
  • $60 per hour

     ...for Biology Experts and Life Science Professionals in Las Vegas, NV to evaluate AI-generated science. Successful candidates will work flexibly from home, earning up to $60 per hour for paid tasks. Responsibilities include reviewing scientific data accuracy, validating... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Las Vegas, NV
    1 day ago
  • $55k

     ...and depreciated costs Effective organization and time management skills with the ability to make progress on multiple duties and tasks simultaneously and work in high-pressure situations Proficient in the use of a PC in a Windows environment; in the use of the Internet... 
    Full time
    Temporary work
    Work experience placement
    Remote work
    Flexible hours

    Arizona Department of Administration

    United States
    3 days ago
  • Title: Forensic EvaluatorState Role Title: Psych III/Psychology Assoc IIIHiring Range: $123,326.00 - $161,762.00Pay Band: 6Agency: Dept Behavioral Health/DevelopLocation: Va Center for Behavioral RehabAgency Website: Type: General Public - GJob DutiesThis position has ...
    Work experience placement
    Work at office
    Local area
    Remote work

    Commonwealth of Virginia, USA

    Nottoway, VA
    3 hours ago
  •  ...Staffco, LLC · MENTAL HEALTH SERV.Poughkeepsie, NYAllied Health Prof/TechnicalPer DiemAll ShiftsvariedJob SummaryThe Mental Health Evaluator (MHE) is a critical role dedicated to delivering comprehensive, clinically appropriate, culturally competent, and trauma-informed... 

    HealthAlliance of the Hudson Valley

    Poughkeepsie, NY
    4 days ago
  • Overview At PAM Health, we care for chronically and critically ill patients who require extended hospital care. PAM Health has over 80 hospital locations and employs over 11,000 people across the country. Our teams work together to deliver the highest level of compassionate...
    Full time
    Local area

    PAM Health

    Humble, TX
    2 days ago
  • $16 - $20 per hour

     ...Research Evaluator Position The research team at Penn State Ross and Carol Nese College of Nursing is hiring part-time research evaluators for projects focused on dementia care in assisted living settings. The research evaluator will assist with in-person recruitment... 
    Hourly pay
    Part time
    Summer work

    Penn State University

    Harrisburg, PA
    2 days ago
  •  ...Overview Become a Luxury Brand Evaluator in NYC, NY - Apply Now. Join to apply for the Become a Luxury Brand Evaluator in NYC, NY - Apply Now role at CXG. About the Role As a luxury brand evaluator, you will discreetly assess customer experiences, providing... 
    Full time
    Contract work
    Flexible hours

    CXG

    Hoboken, NJ
    5 days ago
  • $14.5 per hour

     ...AI Web Search Evaluator Unlock the Power of the Internet! Are you curious, tech-savvy, and passionate about improving online search experiences? Join our team as a Web Search Evaluator and help shape the future of search engines from the comfort of your home! As... 
    Bi-weekly pay
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Welo Data

    United States
    2 days ago
  • $9 - $30 per hour

    ALTA Language Services, Inc. is looking for a remote Testing Evaluator in Atlanta, GA. This part-time position involves assisting with language proficiency examinations and evaluating tests according to set criteria. Candidates should have strong communication skills, professionalism... 
    Part time
    Remote work

    ALTA Language Services

    Atlanta, GA
    3 days ago
  •  ...BAM Ventures is seeking Swedish-speaking remote annotators to evaluate AI-generated content, ensuring that it's coherent and aligns with real-world expectations. Your role will involve reviewing outputs, identifying deviations, and providing structured feedback to enhance... 
    Remote work

    BAM VENTURES LLC

    New York, NY
    2 days ago
  •  ...Web Browsing Evaluator Contractor Remote Micro1 is engaging Web Browsing Evaluators to contribute high-quality web interaction data for a valued customer project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will... 
    For contractors
    Remote work

    ESR Healthcare

    New York, NY
    5 days ago
  • $75k - $110k

     ...to specialize in unique rural and forestland appraisals ~ Stable, respected firm with over 70 years of industry experience A “Task and Duty Guide” for this position is available upon request. Pay and benefits are commensurate with skills and experience.... 
    Temporary work
    Remote work

    FORECON, Inc.

    Falconer, NY
    more than 2 months ago
  •  ...platform, or infrastructure engineering backgrounds to test and evaluate AI-assisted workflows across modern developer and workplace...  ...Participate in asynchronous review and virtual discussions to clarify task requirements. Evaluate whether AI-generated solutions are... 
    Temporary work

    Gramian Consulting

    Remote
    21 days ago
  • $80 per hour

     ...must have strong analytical thinking, attention to detail, and experience with logical problem-solving. The role includes reviewing tasks, identifying inconsistencies, and defining expected behaviors for AI agents. This flexible remote opportunity allows you to work on... 
    Remote job
    Part time
    Flexible hours

    Mindrift

    Phoenix, AZ
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Surgical Robotics Task Evaluator [Remote]. Be the first to apply!