Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Home Robot Failure Evaluator & Quality Reviewer

AuraOne

New York, NY
  • Remote job

AuraOne is seeking a remote contractor to review home robot failure case evaluations. You will assess model outputs against a versioned rubric, label edge cases, and provide structured feedback for retraining the system. The role emphasizes clear, written rationales and high attention to detail to identify issues and improve guidance across long batches. Responsibilities include comparing responses, tagging safety and policy failures, and reporting recurring failure modes to inform future #J-18808-Ljbffr AuraOne

Vacancy posted 13 hours ago
Similar jobs that could be interesting for youBased on the Remote Home Robot Failure Evaluator & Quality Reviewer in New York, NY vacancy
  • Home Robot Failure Task Evaluator is a remote evaluation track for reviewing home robot failure task evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling... 
    Remote work
    Quality
    Hourly pay
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    3 days ago
  •  ...Robotics Failure and Recovery Evaluator is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers...  ...or firm operating procedures. Maintain reviewer-quality scores in inter-rater calibration cycles. Qualifications... 
    Remote job
    Quality
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    19 days ago
  • Physical Affordance Failure Case Reviewer is a remote review track for evaluating AI outputs across physics reasoning, calculations...  ...standards. Maintain reviewer-quality scores in inter-rater...  ...Quantitative analysis Physics Robotics evaluation Embodied AI Safety... 
    Remote work
    Quality
    Hourly pay
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    3 days ago
  •  ...Physical Affordance Failure Case Reviewer is a remote review track for evaluating AI outputs across physics reasoning, calculations...  .... Maintain reviewer-quality scores in inter-rater calibration...  ...analysis Physics Robotics evaluation Embodied AI Safety... 
    Remote job
    Quality
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    16 days ago
  •  ...Robot Policy Compliance Failure Case Reviewer is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios...  ...the gap. Why this role matters Adversarial evaluation is how AuraOne hardens AI models before they ship... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    16 days ago
  • AuraOne is seeking an Indigenous Language AI Evaluator to remotely review indigenous language AI evaluation prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain the model. This... 
    Remote job
    Quality
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    2 days ago
  • Obsidian is hiring expert Evaluators for a remote, hourly role focused on Compliance and regulatory response with financial-services AI. You'll...  ...assess AI-generated work products for accuracy and domain quality, leveraging your expertise. The ideal candidate has over 5... 
    Remote job
    Quality
    Hourly pay
    Work at office

    Obsidian

    New York, NY
    4 days ago
  • AuraOne is seeking a remote Probability Model Evaluator to review prompts and model outputs against a quality rubric. You will compare paired responses, tag edge cases, and provide structured feedback to help retrain the system. The role emphasizes clear reasoning, attention... 
    Remote job
    Quality
    For contractors
    Flexible hours

    AuraOne

    New York, NY
    3 days ago
  • $25 - $30 per hour

     ...contractors to assist in training AI chatbots. This flexible role allows you to choose projects based on your schedule while working from home. Ideal candidates will manage business communications and possess excellent writing and research skills. A bachelor's degree is... 
    Remote work
    Work from home
    Quality
    Hourly pay
    For contractors
    Flexible hours

    DataAnnotation

    Indiana, PA
    13 hours ago
  • $25 - $30 per hour

     ...professionals to help train AI chatbots. This independent contractor role allows you to work from home and choose your own projects. Candidates will develop prompts, write responses, and evaluate AI models. Ideal for those experienced in business communication, this position... 
    Remote work
    Work from home
    Quality
    Hourly pay
    For contractors

    DataAnnotation

    Louisiana, MO
    4 days ago
  • $25 per hour

     ...our distributed team and help evaluate online platforms through interactive...  .... This is a flexible, remote opportunity with full training...  ...with higher pay for faster, high-quality work. Typical first-cycle...  ...Us Fully remote. Work from home on a flexible schedule, 5 to 2... 
    Remote work
    Work from home
    Quality
    Flexible hours

    Reeledge

    Wind Ridge, PA
    1 day ago
  •  ...our distributed team and help evaluate online platforms through interactive...  .... This is a flexible, remote opportunity with full training...  ...with higher pay for faster, high-quality work. Performance bonuses...  ...computer. Fully remote. Work from home on a flexible schedule, 5 to 2... 
    Remote work
    Work from home
    Quality
    Flexible hours

    Reeledge

    Noel, MO
    1 day ago
  • $14.5 per hour

     ...AI Web Search Evaluator Unlock the Power of the Internet...  ...the comfort of your home! As a Web Search Evaluator...  ..., you will: Review and assess internet...  ...work-life balance. Remote Work: Enjoy the freedom...  ...analytical, research, and quality assessment skills. ~... 
    Remote work
    Work from home
    Quality
    Bi-weekly pay
    Hourly pay
    Part time
    Immediate start
    Flexible hours

    Jobs for Humanity

    United States
    1 day ago
  • AuraOne is seeking a remote Secrets Detection Security Evaluator to review model outputs, apply structured rubrics, and label edge cases. You will compare paired...  ...emphasizes careful reasoning and documentation of failures for retraining. The work is contractor-based,... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    3 days ago
  • $37 per hour

     ...Acentra Health as a Clinical Evaluator (PASRR) in North...  ...Screening and Resident Review assessments, working directly...  ...as hospitals, nursing homes, and community-based...  ...continuity of quality care while ensuring compliance...  ...the flexibility to work remotely from your home office while... 
    Remote work
    Work from home
    Quality
    Hourly pay
    Relief
    Work at office
    Local area
    Home office

    Acentra Health

    Granite Falls, NC
    3 days ago
  • $14.5 per hour

     ...AI Web Search Evaluator Welo Data works with technology...  ...datasets that are high-quality, ethically sourced,...  .... Seeks a flexible, remote job that can easily fit...  ...Location: Remote/work from home, within the US– Note:...  ...there is more data to review, other weeks less. Start... 
    Remote work
    Work from home
    Quality
    Hourly pay
    Part time
    Currently hiring
    Immediate start
    10 hours per week
    Flexible hours

    Jobs for Humanity

    United States
    2 days ago
  •  ...seeking a part-time Search Quality Rater for English (Ohio...  ...to testing and evaluating how search results respond...  ...queries from users. This remote role suits self-...  ...comfortable working from home. You will commit to 10-...  ...United States (Ohio), review search results, and complete... 
    Remote job
    Work from home
    Quality
    Part time
    10 hours per week

    aitrainer

    Columbus, OH
    3 days ago
  •  ...- TrainAI is seeking a part-time Search Quality Rater to help assess how our clients’ search...  ...in the United States, you will work remotely up to 29 hours per week, maintaining quality...  ...NDA, and the ability to work independently from a home office. #J-18808-Ljbffr aitrainer
    Remote job
    Work from home
    Quality
    Part time
    Home office

    aitrainer

    New York, NY
    3 days ago
  • Itlearn360 is looking for a Search Engine Evaluator to work from home in Coral Terrace, Florida. This part-time role allows you to earn extra cash by evaluating the quality of search results based on web queries. Applicants must have a smartphone and a Gmail account, with... 
    Remote job
    Work from home
    Quality
    Extra income
    Part time

    Itlearn360

    Florida
    3 days ago
  • AuraOne seeks a remote Bambara Language Expert contractor to review prompts and model outputs, apply a versioned rubric, and provide structured feedback for...  ...responses, label edge cases, and document recurring failure modes for continuous improvement. The role requires... 
    Remote job
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    2 days ago
  • $20 - $26 per hour

     ...is a fluent Lithuanian speaker to evaluate audio models used in AI development. The role involves reviewing audio snippets, providing feedback on voice quality, and ensuring cultural relevance in...  ...hours, allowing for work from home. The pay range is between $20 and... 
    Remote job
    Work from home
    Quality
    Hourly pay
    Flexible hours

    Prolific

    Chicago, IL
    2 days ago
  •  ...Albuquerque, New Mexico is seeking a Search Quality Rater for English language tasks. This part‑time, remote position involves testing and evaluating how our clients’ search engine responds...  ...to meet SLAs while working from a home office. A minimum of 10 hours per week... 
    Remote job
    Work from home
    Quality
    Part time
    Home office
    10 hours per week

    aitrainer

    Albuquerque, NM
    3 days ago
  •  ...Acentra Health as a PASRR Evaluator in Kansas. In this role, you...  ...Admission Screening and Resident Review assessments in Kansas City...  ...ensure the delivery of quality care that meets industry...  ...offers the flexibility to work remotely from your home office while also traveling... 
    Remote job
    Work from home
    Quality
    Relief
    Home office

    Acentra Health

    Kansas City, MO
    1 day ago
  • $10 per hour

    Dorado is seeking a Speech AI Evaluation Specialist to help improve AI...  ...in Korean. This freelance, remote role offers a flexible schedule...  ...10+ per week) with work-from-home in Korea. You will...  ...accuracy, and clarity while meeting quality targets. #J-18808-Ljbffr Dorado
    Remote job
    Work from home
    Quality
    Hourly pay
    Part time
    Freelance
    Immediate start
    Flexible hours

    Dorado

    New York, NY
    1 day ago
  • $28 per hour

     ...Document Reviewer KLDiscovery, a leading global provider of electronic...  ...U.S. attorneys for ongoing remote Document Review projects. This...  ...is a fully remote work-from-home position. This is a temporary,...  ...responsiveness coding Conduct quality control checks as needed... 
    Remote work
    Work from home
    Quality
    Temporary work
    Home office

    KLDiscovery

    United States
    1 day ago
  •  ...join our Disability Peer Review team. This telework opportunity...  ...allows physicians to evaluate disability claims remotely, offering complete flexibility...  ...us to deliver superior quality in clinical decision-making...  ...the convenience of home-based work. #J-18808-Ljbffr... 
    Remote job
    Work from home
    Quality

    Dane Street, LLC

    New York, NY
    3 days ago
  • **Job Title: AI Trainer || Image Quality Evaluator || English** **Location**: Remote | Work from Home **Employment Type:** Project-based | Contract We are looking for detail-oriented Image Quality Evaluator for a multilingual AI data Annotation and Transcription Specialists... 
    Remote work
    Work from home
    Quality
    Contract work
    Monday to Friday
    Day shift

    iMerit Technology

    Louisiana
    a month ago
  •  ...HOW YOU'LL MAKE A DIFFERENCE: This Commercial Reviewer fills a remote role (work from home) in MountainSeed's Appraisal Review Department....  ...appraisers for any report corrections and/or revisions Evaluate appraiser quality of work and provide feedback for maintenance of... 
    Remote work
    Work from home
    Quality
    Work at office
    Flexible hours

    MountainSeed

    United States
    2 days ago
  • $28 per hour

     ...actively licensed U.S. attorneys for ongoing remote Document Review projects. This role is ideal for...  ...client approval. Fully remote work-from-home position. This is a temporary, project-...  ...and responsiveness coding, conducting quality control checks as needed, assisting with... 
    Remote work
    Work from home
    Quality
    Temporary work
    Home office

    KLDiscovery

    United States
    4 days ago
  •  ...to support delivery of the TMF to client quality and integrity specifications, as well as...  ...documentation, as required. Assists in the review and finalization of the TMF Plan and...  ...hours per day. Standard office and/or home working environment. Risk of eye strain... 
    Remote work
    Work from home
    Quality
    Work at office

    Avery Healthcare Group Ltd.

    United States
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Home Robot Failure Evaluator & Quality Reviewer. Be the first to apply!