Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Robotics Evaluation Specialist [Remote]

AuraOne Human Data

Remote
  • Remote job

Robotics Evaluation Specialist is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers grade trajectory choices, perception assumptions, and safety envelopes; flag failure modes; and document the corrected behavior so the modeling team can train on it.

Why this role matters

Robotics review systems run in the physical world, where a confident-looking failure can hurt someone. AuraOne uses experienced robotics and operations reviewers to grade outputs against perception, motion, and safety constraints.

Responsibilities

  • Review robotics review outputs against current safety standards and operating envelopes for Robotics Evaluation Specialist assignments.
  • Grade perception, motion, and decision logic on a structured rubric.
  • Flag near-miss and unsafe trajectories with severity tags that match incident taxonomies.
  • Capture the corrected behavior or reference trajectory so the modeling team can train on it.
  • Adjudicate disputed cases against published standards or firm operating procedures.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Hands-on experience with robotic, autonomous, or teleoperated systems. Operating, supervising, or evaluating them for Robotics Evaluation Specialist work.
  • Comfort reasoning about perception, motion planning, and physical safety envelopes.
  • Familiarity with structured incident taxonomies and severity scoring.
  • Clear written reasoning that names the failure mode and the standard being applied.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a robotics review model's chosen trajectory and flag any near-miss or unsafe motion.
  • Score a perception output against ground-truth labels and rate the failure category.
  • Adjudicate a disputed safety call between two reviewers using firm operating procedures.
  • Audit a 25-trajectory batch for rubric consistency and report drift to the program lead.

Nice to have

  • Background in robotics engineering, autonomy operations, or industrial safety.
  • Prior experience reviewing AI-assisted robotics tooling and its failure modes.
  • Familiarity with simulation environments and trajectory-replay tooling.

Skills

  • Robotics evaluation
  • Perception review
  • Motion safety
  • Incident taxonomy
  • Robotics review

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Robotics Evaluation Specialist [Remote] in Remote vacancy
  • $112.2k - $129.6k

     ...help drive advancements in automation and robotics, mobility, healthcare, energy and data...  ...Analog Devices, Inc. Job Title: Senior Specialist, Talent DevelopmentJob Requisition: 101...  ...through delivery—including vendor evaluation, stakeholder collaboration, pilot launches... 
    Suggested
    Permanent employment
    Full time
    Work at office
    Remote work
    Work from home
    Day shift
    2 days per week

    Analog Devices

    Wilmington, MA
    3 days ago
  • $5,540 - $5,780 per month

     ...Reporting to the Director of Graduate Admissions and Program Evaluations (GAPE) in the College of Graduate Studies, this position is responsible...  ...are completed efficiently and on schedule. The Evaluation Specialist is responsible for interpreting and applying complex policies... 
    Suggested
    Permanent employment
    Full time
    Work experience placement
    Internship
    Work at office
    Immediate start
    Visa sponsorship

    San Jose State University

    San Jose, CA
    3 days ago
  • $5,540 - $5,780 per month

     ...Reporting to the Director of Graduate Admissions and Program Evaluations (GAPE) in the College of Graduate Studies, this position is responsible...  ...are completed efficiently and on schedule. The Evaluation Specialist interprets and applies complex policies, handles exceptions,... 
    Suggested
    Permanent employment
    Full time
    Work experience placement
    Internship
    Work at office
    Visa sponsorship

    The Chronicle of Higher Education

    San Jose, CA
    1 day ago
  •  ...given the means and mentorship needed to succeed, and your creativity will be rewarded.About the PositionThe Monitoring and Evaluation (M&E) Specialist will provide technical support to the Office of Monitoring and Evaluation (OME), Division of Global Health Protection (... 
    Suggested
    Work at office
    Remote work

    Dexis Consulting Group

    Washington DC
    5 days ago
  • $70k - $140k

     ...Program Evaluation SpecialistWe are seeking driven, thoughtful candidates with experience in program evaluation to support impactful initiatives...  ...the U.S. Department of State (DOS). As a Program Evaluation Specialist with Censeo, you will support quantitative and qualitative... 
    Suggested
    Full time
    Work at office
    Remote work
    Work from home
    Flexible hours
    Night shift

    Censeo Consulting Group

    Washington DC
    4 days ago
  •  ...Government Agencies. Learn More About ProSidian Consulting at .Job DescriptionProSidian Seeks a Infrastructure Project Evaluation and Coordination Specialist [DOE0080079] for Program Support on a Exempt W2: No Overtime Pay Basis Contract Contingent generally located across... 
    Full time
    Contract work
    Temporary work
    For contractors
    For subcontractor
    Work at office
    Remote work
    Flexible hours

    Prosidian Consultng

    Richland, WA
    3 days ago
  •  ...Program Evaluation Specialist The University of Michigan's Center for Global Health Equity was launched by a catalytic gift from Dr. Tachi and Leslie Yamada and was generously matched by the University. The Center brings together faculty and students from across the... 
    Work at office
    Remote work
    Worldwide
    Flexible hours
    Afternoon shift
    3 days per week
    Early shift

    University of Michigan Flint

    Ann Arbor, MI
    2 days ago
  • $81.69k - $95k

     ...Why is this a great job? (From the hiring manager) This role combines rigorous evaluation with real community impact. The Evaluation Specialist will split their time between a multi-year clinical transformation initiative across Louisiana and the Gulf Coast and LPHI's... 
    Full time
    Contract work
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    Socket

    Harahan, LA
    2 days ago
  •  ...Supporting the VA's Office of Suicide Prevention, the full-time Evaluation Specialist Jr. will design and implement evaluation systems to measure the effectiveness of elevated risk care management programs for Veterans, utilizing mixed-methods approaches such as surveys... 
    Full time
    Work at office
    Remote work

    Virtual Vocations Inc

    United States
    17 hours ago
  • $75.22k - $94.02k

     ...Impact Evaluation Specialist IIWhen you join Wounded Warrior Project® (WWP), you're committing to making a difference. We make a commitment to you, too – helping you to find that spark, ignite your passion to serve, and embark on a career with meaning and purpose.The Wounded... 
    Temporary work
    Work at office

    Wounded Warrior Project

    Chicago, IL
    2 days ago
  •  ...professional to join a GenAI red-team within a leading AI lab network. The role involves probing frontier models, designing robust evaluation tasks, and documenting findings for reproducibility. This full-time W-2 position is remote within the United States, requiring... 
    Full time
    Remote work

    Mercor

    New York, NY
    3 days ago
  • OpenTrain AI is seeking a GPU Kernel Evaluation Expert to assess the quality, correctness, and completeness of GPU and accelerator kernel development tasks used to train and evaluate frontier AI models. You will evaluate numerical correctness, benchmarking fairness, task... 
    Remote job
    Contract work

    OpenTrain AI

    Brooklyn, NY
    2 days ago
  •  ...the world stage, USIP is the place for you. Summary The full-time Personal Services Contractor will provide Monitoring and Evaluation (M&E) support to the El Salvador Team Lead including: coordination and collaboration with =project staff, key stakeholders, and... 
    Full time
    Contract work
    For contractors
    Work experience placement
    Work at office
    Local area
    Work from home
    Worldwide
    Home office
    Night shift

    The US Institute of Peace

    Washington DC
    4 days ago
  •  ...consulting firm in Colby, Kansas, is seeking a Nurse Practitioner or Physician Assistant to conduct examinations for veteran compensation evaluations. Responsibilities include conducting assessments, reviewing medical histories, and completing reports, all while collaborating... 
    Remote job
    Work from home
    Flexible hours

    Rodgers and Rodgers Consulting

    Colby, KS
    1 day ago
  • OpenTrain AI is seeking a Frontend Code Evaluation Specialist for remote, contract-based work evaluating AI-generated frontend implementations. You will run a crawled reference site and two model replications, inspect screenshots and code, and provide precise, evidence-... 
    Remote job
    Contract work

    OpenTrain AI

    Brooklyn, NY
    1 day ago
  • YO AI Labs is seeking experienced Producers across film, television, digital, or live events to support an AI evaluation project in a fully remote capacity. You will craft realistic industry scenarios, evaluate AI outputs, and develop benchmarks that reflect real-world... 
    Remote work

    YO AI Labs

    Austin, TX
    17 hours ago
  •  ...Program Evaluation Specialist Location: Nashville, Tennessee - 37243 Contract: 12+ months from the projected start Position Description: The Program Evaluation Lead is responsible for working with the management team to develop and implement evaluation and data collection... 
    Contract work
    Work experience placement
    Work at office

    Software Technology, Inc.

    Nashville, TN
    2 days ago
  • Rise Data Labs is seeking advanced Mathematics and Statistics experts to support the training and evaluation of state-of-the-art AI systems. We need subject-matter experts who can apply deep quantitative knowledge to AI evaluation problems, assess AI-generated reasoning... 
    Remote job
    Contract work
    Immediate start
    Flexible hours

    BAM Ventures

    New York, NY
    4 days ago
  •  ...Office Specialist Vi: Transcript Evaluator St. Edward's University of Austin, Texas invites applications for the position of Office Specialist VI: Transcript Evaluator. The Office Specialist VI: Transcript Evaluator provides accurate, timely evaluations of academic... 
    Temporary work
    Internship
    Work at office
    Immediate start
    Flexible hours

    St Edwards University

    Austin, TX
    17 hours ago
  •  ...AI-focused manufacturing project. You will apply your expertise in Fusion 360, CAM, CNC machining, and manufacturing workflows to evaluate processes and AI-generated recommendations. No prior AI experience is required, but you will provide critical feedback, develop evaluation... 
    Remote job
    For contractors

    YO AI Labs

    Dallas, TX
    4 days ago
  •  ...companies, and donor organizations. IBTCI specializes in monitoring, evaluation, research, and learning (MERL) and institutional support...  .... Assignment Title: Team Leader / Senior Evaluation Specialist Department/Location: Remote, with potential travel to Ethiopia... 
    Temporary work
    Part time
    Local area
    Remote work

    Integrated Business & Technical Consultants

    Vienna, VA
    8 days ago
  •  ...Job Description Job Description Title Office Specialist VI: Transcript EvaluatorDepartment Office of the Registrar St. Edward's...  ...applications for the position of Office Specialist VI: Transcript Evaluator. The Office Specialist VI: Transcript Evaluator provides... 
    Internship
    Work at office
    Immediate start
    Flexible hours

    St Edwards University

    Austin, TX
    26 days ago
  •  ...a fully remote School Psychologist to support a Colorado district for the 2026-2027 year. The role focuses on psychoeducational evaluations and eligibility processes across the district on a part-time, independent contractor basis. Responsibilities include conducting cognitive... 
    Remote job
    Part time
    For contractors

    MIYO Health

    Aurora, CO
    1 day ago
  •  ...Job Description Job Description Graham Technologies is seeking an experienced Project Manager / Senior Monitoring & Evaluation Specialist to support global public health monitoring and evaluation initiatives for a federal client. This role combines hands-on monitoring... 
    Remote work
    Flexible hours

    Graham Technologies

    Atlanta, GA
    11 days ago
  •  ...Merchant Mariner Evaluation Specialist (Deck) You will serve as a Merchant Mariner Evaluation Specialist (Deck) and be responsible for providing advice and administration on the regulatory provisions and controls for the examinations of the merchant mariner credentialing... 

    TSA

    New Orleans, LA
    4 days ago
  •  ...Senior Merchant Mariner Evaluation Specialist (Deck) You will serve as a Senior Merchant Mariner Evaluation Specialist (Deck) and be responsible for providing advisory services and administering the regulatory provisions and controls for examinations supporting the Merchant... 

    TSA

    Long Beach, CA
    17 hours ago
  •  ...Midwest, including a state-of-the-art, urology-specific ambulatory surgery center that is one of the first in the country to offer robotic surgery. U.S. Urology Partners was formed to support urology practices through an experienced team of healthcare executives and resources... 
    Hourly pay
    Work at office
    Local area
    Remote work
    Night shift

    Medavie

    United States
    2 days ago
  •  ...Job Description Job Description Robotic MIG Welding Specialist City/State: Marengo, IL Pay Rate: 23.88 Shift: 7:00 AM–3:30 PM, Monday–Friday (OT option: 5:00 AM–3:30 PM) Role snapshot MIG weld parts in all positions to meet mechanical strength and quality... 
    Temporary work
    Monday to Friday
    Shift work
    Weekday work

    Express Employment Professionals - Crystal Lake

    Marengo, IL
    4 days ago
  • $29.43 - $45.39 per hour

     ...Job Description: The Cardiac/Pulmonary Rehab Specialist plays a vital role in helping patients return to their baseline health or achieve...  ...event. This position focuses on designing, implementing, and evaluating individualized exercise and lifestyle management programs that... 
    Hourly pay
    Immediate start
    Remote work

    Intermountain Health

    Brighton, CO
    17 hours ago
  •  ...UX Designer Specialist — Product Flow and Usability Evaluation is a remote review track for evaluating AI outputs across ui / ux design workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach... 
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne Human Data

    Remote
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Robotics Evaluation Specialist [Remote]. Be the first to apply!