Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Robotics Evaluation Specialist

AI Trainer Jobs

Robotics Evaluation Specialist is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers grade trajectory choices, perception assumptions, and safety envelopes; flag failure modes; and document the corrected behavior so the modeling team can train on it. Category: Robotics & Embodied AI · Pay: Hourly rate confirmed after the interview process · Location: Remote — US-eligible · Contractor Robotics Evaluation Specialist is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. About the role Robotics Evaluation Specialist is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers grade trajectory choices, perception assumptions, and safety envelopes; flag failure modes; and document the corrected behavior so the modeling team can train on it. Robotics review systems run in the physical world, where a confident-looking failure can hurt someone. AuraOne uses experienced robotics and operations reviewers to grade outputs against perception, motion, and safety constraints. Review teleoperation, navigation, and manipulation work. Physical-world safety is part of it. Responsibilities Review robotics review outputs against current safety standards and operating envelopes for Robotics Evaluation Specialist assignments. Grade perception, motion, and decision logic on a structured rubric. Flag near-miss and unsafe trajectories with severity tags that match incident taxonomies. Capture the corrected behavior or reference trajectory so the modeling team can train on it.Track Robotics & physical AI review Work model Remote · Independent specialist contractor Compensation Hourly rate confirmed after the interview process. Eligible from US What you should bring Hands-on experience with robotic, autonomous, or teleoperated systems. Operating, supervising, or evaluating them for Robotics Evaluation Specialist work. Comfort reasoning about perception, motion planning, and physical safety envelopes. Familiarity with structured incident taxonomies and severity scoring. Clear written reasoning that names the failure mode and the standard being applied. Reliable async availability for at least 10 hours per week. Example tasks Grade a robotics review model's chosen trajectory and flag any near-miss or unsafe motion. Score a perception output against ground-truth labels and rate the failure category. Adjudicate a disputed safety call between two reviewers using firm operating procedures. Audit a 25-trajectory batch for rubric consistency and report drift to the program lead. Useful experience Background in robotics engineering, autonomy operations, or industrial safety. Prior experience reviewing AI-assisted robotics tooling and its failure modes. Familiarity with simulation environments and trajectory-replay tooling. Compensation and schedule Hourly rate confirmed after the interview process. Expected arrangement: contractor , with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation. Skills used in matching Robotics evaluation Perception review Motion safety #J-18808-Ljbffr

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Robotics Evaluation Specialist in New York, NY vacancy
  • $90.58k - $114.59k

    Position InformationNY HELP: YesAgency: Mental Health, Office ofTitle: Mental Hygiene Program Evaluation Specialist 3 (NY HELPS), Kingsboro Psychiatric Center, P27987Occupational Category: Health Care, Human/Social ServicesSalary Grade: 23Bargaining Unit: PS&T - Professional... 
    Suggested
    Permanent employment
    Full time
    Work at office
    Remote work

    State of New York, USA

    New York, NY
    5 days ago
  •  ...About the role Calibration Technology Evaluation Specialist is a remote review track for evaluating AI outputs across calibration technology evaluation specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational... 
    Suggested
    Hourly pay
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    AI Trainer Jobs

    New York, NY
    3 days ago
  • $45 - $70 per hour

     ...Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Behavioral Health Expert AI Safety and Model Evaluation Type: Contract Compensation: $45$70/hour Location: Remote Commitment: 2040 hours/week... 
    Suggested
    Full time
    Contract work
    Summer work
    Remote work
    Weekday work

    Mercor

    New York, NY
    6 days ago
  • AuraOne is seeking a Mandarin Transcription Expert to remotely evaluate mandarin generalist prompts and responses. You will compare outputs, label edge cases, and create structured feedback for retraining the model. As an independent contractor, you will review tasks with... 
    Suggested
    Remote job
    For contractors

    AI Trainer Jobs

    New York, NY
    4 days ago
  •  ...contractor, you’ll work asynchronously, roughly 10 hours per week, with hourly compensation discussed after interview. Remote work available for US-eligible candidates; prior evaluation, annotation, or Uyghur bilingual experience is highly #J-18808-Ljbffr AI Trainer Jobs
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AI Trainer Jobs

    New York, NY
    5 days ago
  • Mercor is seeking detail-oriented writing experts to contribute to a high-impact video AI research project. You will evaluate paired video outputs, score them against a rubric, and document brief rationales. This is a short-term, flexible engagement for researchers with... 
    Temporary work
    Flexible hours

    Mercor

    New York, NY
    3 days ago
  • Weekday 1 is seeking analytical professionals to evaluate AI-generated responses across a variety of topics in a fully remote contractor role. You will assess AI outputs, identify strengths and weaknesses in reasoning, and provide structured, evidence-based feedback to... 
    For contractors
    Remote work
    Weekday work

    Weekday 1

    New York, NY
    6 days ago
  • AuraOne is seeking a Voice Actor: CX Agent Voice Cloning (Indonesian Bahasa - Female) for a remote evaluation track reviewing prompts and responses against our quality rubric. Reviewers label edge cases and provide structured feedback for retraining. You will compare paired... 
    Remote job
    For contractors
    10 hours per week

    AI Trainer Jobs

    New York, NY
    5 days ago
  • NCR Eduservices Pvt. Ltd. is seeking an English Evaluator to remotely assess phonics-based reading and pronunciation sessions delivered by native English teachers from the US and UK. The ideal candidate has a strong English background, knowledge of phonics, and the ability... 
    Remote work

    NCR Eduservices

    New York, NY
    4 days ago
  • AI Trainer Jobs seeks a Generalist - English & Telugu evaluator to review prompts and responses from AuraOne's data-labeling rubric. You will compare outputs, label edge cases, and provide structured feedback for model retraining. Applicants should have prior evaluation... 
    Remote job
    For contractors
    10 hours per week
    Flexible hours

    AI Trainer Jobs

    New York, NY
    2 days ago
  • YO AI Labs seeks a Humanities Evaluation Specialist to support an AI training project entirely remotely. You will create challenging humanities questions and high-quality answers, and research using authoritative sources with proper citations. Design prompts that require... 
    Remote job

    YO AI Labs

    New York, NY
    2 days ago
  • AI Trainer Jobs is seeking a Cantonese Bilingual Expert for a remote evaluation track. Reviewers compare cantonese prompts and responses against AuraOne's rubric, label edge cases, and provide structured feedback to retrain the model. This contractor role offers hourly... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week
    Flexible hours

    AI Trainer Jobs

    New York, NY
    5 days ago
  • AuraOne is seeking a French Audio Recording Expert (Canada) for remote evaluation. You will review prompts and responses, compare outputs, and label issues using a versioned rubric to aid retraining. This role focuses on assessing pronunciation, voice quality, and conversation... 
    Remote job

    AI Trainer Jobs

    New York, NY
    2 days ago
  • AuraOne seeks a Hebrew Transcription Expert to remotely evaluate Hebrew outputs using a versioned rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain the model. This is a contractor role with US-eligibility for remote... 
    For contractors
    Remote work

    AI Trainer Jobs

    New York, NY
    4 days ago
  • Humanities Evaluation Specialist role for a remote contractor project. The specialist will create rigorous humanities questions, verify sources, and craft prompts that require deep interpretation and analytical reasoning. You will evaluate AI-generated responses for accuracy... 
    Remote job
    Contract work
    For contractors

    YO AI Labs

    New York, NY
    2 days ago
  •  ...compare paired outputs, label edge cases, and provide structured feedback to help retrain the model. Ideal candidates have prior evaluation or annotation experience in music production English, strong attention to detail, and the ability to work asynchronously for at least... 
    Remote job
    For contractors
    10 hours per week

    AI Trainer Jobs

    New York, NY
    5 days ago
  •  ...oriented UX/UI Designers and creative/technical professionals to support a video annotation project involving robotic arm tasks. You will review, label, and evaluate video sessions according to established guidelines to support AI training. As a contractor working remotely... 
    Remote job
    For contractors

    YO AI Labs

    New York, NY
    3 days ago
  • micro1 is seeking Humanities Evaluation Specialists to support an AI training project. Remote contractors will craft challenging humanities questions, verify sources, and design prompts that demand deep interpretation and analytical reasoning. The role involves evaluating... 
    Remote job
    For contractors

    YO AI Labs

    New York, NY
    2 days ago
  • $90.58k - $114.59k

    The State of New York - Mental Health, Office of, at Kingsboro Psychiatric Center, seeks a Mental Hygiene Program Evaluation Specialist 3 for NY HELPS. This full-time role evaluates mental health programs, analyzes data, and supports evidence-based improvements within a... 
    Permanent employment
    Full time
    Work at office

    State of New York - Mental Health, Office of

    New York, NY
    5 days ago
  • AI Trainer Jobs is seeking a Korean bilingual expert for a remote evaluation track. The role involves reviewing Korean generalist prompts and responses against AuraOne's rubric, comparing paired outputs, and writing structured feedback for retraining. As a remote independent... 
    Hourly pay
    For contractors
    Remote work

    AI Trainer Jobs

    New York, NY
    3 days ago
  •  ...professional to join a GenAI red-team within a leading AI lab network. The role involves probing frontier models, designing robust evaluation tasks, and documenting findings for reproducibility. This full-time W-2 position is remote within the United States, requiring... 
    Full time
    Remote work

    Mercor

    New York, NY
    5 days ago
  • AI Trainer Jobs is seeking an Albanian Bilingual Expert to remotely evaluate prompts and responses against AuraOne's quality rubric. Reviewers label edge cases, compare outputs, and write structured feedback to aid model retraining. You will work as a contractor, reviewing... 
    Remote job
    For contractors

    AI Trainer Jobs

    New York, NY
    5 days ago
  • AuraOne seeks a contractor to join a remote evaluation track for reviewing writer evaluation prompts and responses against its quality rubric. You will compare outputs, label edge cases, and write structured feedback for model retraining. Responsibilities include evaluating... 
    Remote job
    For contractors
    10 hours per week
    Flexible hours

    AI Trainer Jobs

    New York, NY
    4 days ago
  • $80 - $120 per hour

     ...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80-$120/hour Location: Remote Responsibilities Evaluate AI-generated artifacts against domain-... 
    Contract work
    Summer work
    Work at office
    Remote work

    mercor

    New York, NY
    2 days ago
  • $60 per hour

     ...of Medicine at Mount Sinai, perform complex procedures using robotics, laparoscopy, and endoscopy, all as a part of our minimally invasive...  ...generation of leaders in the field. The Per Diem Diagnostic Specialist (Ultrasound/Micro-Ultrasound) performs radiologic procedures,... 
    Hourly pay
    Daily paid
    Traineeship
    Local area

    Mount Sinai Health System

    New York, NY
    5 days ago
  • Senior Merchant Mariner Evaluation Specialist (Engine) This vacancy is for a GS-2101-13, Senior Merchant Mariner Evaluation Specialist (Engine) located in the Department of Homeland Security, U.S. Coast Guard, NMC MARINER EXAMINATIONS BRANCH in location to be determined... 

    US Government Jobs

    New York, NY
    3 days ago
  • $145k

     ...Make: We are looking for an experienced PolyPath Market Risk Specialist with strong technical and business knowledge to support...  ...your supervisors or managers to perform other duties. You may be evaluated in part based upon your performance of the tasks listed in this... 
    Hourly pay
    Full time
    Contract work
    Work experience placement
    Shift work

    Santander Holdings USA Inc

    New York, NY
    2 days ago
  • $89.59k - $197.46k

     ...own future.KPMG is currently seeking a Senior Associate, Credit Specialist to join our Audit practice.Responsibilities:Execute the day-to...  ...models to credit loss accounting concepts, including evaluation of model validation design and application Ability to meet challenging... 
    H1b
    Local area

    KPMG

    New York, NY
    5 days ago
  • AuraOne is seeking a Polish Bilingual Expert to remotely review prompts and responses against the company’s quality rubric. You will compare paired outputs, label edge cases, and write structured feedback to retrain models. You will label hallucinations, instruction-following...
    Remote job
    For contractors

    AI Trainer Jobs

    New York, NY
    5 days ago
  • YO AI Labs is seeking a meticulous Video Annotation Specialist to review and label videos of robotic arms for AI and machine-learning projects. This remote contractor role emphasizes accuracy, consistency, and structured data annotation following project guidelines. You... 
    Remote job
    For contractors

    YO AI Labs

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Robotics Evaluation Specialist. Be the first to apply!