Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Robot Policy Compliance Failure Case Reviewer [Remote]

AuraOne Human Data

Remote
  • Remote job

Robot Policy Compliance Failure Case Reviewer is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.

Why this role matters

Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.

Responsibilities

  • Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Robot Policy Compliance Failure Case Reviewer assignments.
  • Document every successful attack with reproduction steps and the policy clause it violated.
  • Score model defenses across single-turn and multi-turn conversations.
  • Triage emerging attack vectors and route them to the safety team with severity ratings.
  • Maintain a personal library of attack patterns and propose new red-team rubrics.
  • Calibrate against the broader red-team cohort to keep coverage and severity consistent.

Qualifications

  • Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Robot Policy Compliance Failure Case Reviewer work.
  • Strong written communication — your reports become the patch ticket.
  • Comfort working in policy-grey areas with clear documentation of what was attempted and why.
  • Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
  • Score a model's defenses against a known jailbreak pattern across 20 variants.
  • Propose a new red-team rubric category after spotting an emerging attack vector.
  • Reproduce a failure another reviewer reported and confirm the severity tag.

Nice to have

  • Background in offensive security, AppSec, or trust & safety operations.
  • Experience publishing or reproducing public adversarial-ML research.
  • Multilingual fluency for cross-language attack testing.

Skills

  • Adversarial prompting
  • Red-team analysis
  • Policy taxonomy
  • Failure documentation
  • Robot Policy Compliance Failure Case evaluation
  • Robotics evaluation
  • Embodied AI
  • Safety review
  • Robot
  • Policy
  • Compliance

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 22 days ago
Similar jobs that could be interesting for youBased on the Robot Policy Compliance Failure Case Reviewer [Remote] in Remote vacancy
  •  ...Robot Trajectory Failure Case Reviewer is a remote evaluation track for reviewing robot trajectory failure case evaluation prompts and responses against...  ...rationale. Tag an unsafe response with the correct policy category and severity. Audit a 50-row batch for rubric... 
    Policy
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    25 days ago
  •  ...Warehouse Robotics Failure Case Reviewer is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers grade trajectory choices, perception assumptions, and safety envelopes; flag failure modes; and document the... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    16 days ago
  • A staffing agency is seeking a SNAP Case Reviewer to ensure compliance with SNAP policy. The role is 100% remote and requires extensive knowledge of SNAP eligibility and quality assurance processes. Candidates should have over 5 years of experience in supervising SNAP staff... 
    Policy
    Remote job
    Work at office

    The Hollister Group

    Oklahoma City, OK
    3 days ago
  • Physical Affordance Failure Case Reviewer is a remote review track for evaluating AI outputs across physics reasoning, calculations, and research...  ...Citation review Quantitative analysis Physics Robotics evaluation Embodied AI Safety review Physical Affordance... 
    Suggested
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne

    New York, NY
    4 days ago
  •  ...Physical Affordance Failure Case Reviewer is a remote review track for evaluating AI outputs across physics reasoning, calculations, and research...  ...Citation review Quantitative analysis Physics Robotics evaluation Embodied AI Safety review Physical... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    22 days ago
  • $23 - $27 per hour

     ...Absolute Staffing & Consulting Solutions is looking for a Case Reviewer to join our team of professionals. This is a hybrid, work-from...  ...Medicaid. The utilization review process involves applying program policies, verifying medical, technical, and financial eligibility, and... 
    Policy
    Work at office
    Remote work
    Work from home
    Monday to Friday
    Shift work

    Absolute Staffing & Consulting Solutions

    Columbia, MD
    a month ago
  •  ...Quality Control Case Reviewer The Family Independence Administration (FIA) provides temporary...  ...for conducting quality control and compliance reviews of SNAP cases to ensure accurate...  ...with federal, state, and agency policies. The role involves performing detailed... 
    Policy
    Temporary work
    Work at office
    Monday to Friday
    Flexible hours
    Shift work

    New York City | Administration & Human Resources

    Brooklyn, NY
    3 days ago
  • $20 - $28 per hour

    Base Pay Range $20.00/hr - $28.00/hr SNAP Case Reviewer Location: Remote (Massachusetts) Start Date: ASAP Responsibilities: Manage a queue...  ...using a standardized case review tool and apply current SNAP policy. Navigate eligibility systems and electronic documents to... 
    Policy
    Hourly pay
    Work at office
    Immediate start
    Remote work

    The Hollister Group

    Oklahoma City, OK
    1 day ago
  •  ...consulting. We are seeking an experienced Case Reviewer to join our healthcare consulting...  ...requests to determine medical necessity and compliance with established guidelines and...  ...evidence-based practices and organizational policies Collaboration: Work closely with participant... 
    Policy
    Local area
    Remote work
    Work from home

    Jobless

    Columbia, MD
    4 days ago
  •  ...Document QA Specialist is a remote review track for evaluating AI...  ...accuracy, statutory reasoning, and policy adherence; flag risk; and...  ...current privacy law statutes, case law, or policy for Privacy Law...  ...AI-assisted legal-research or compliance tooling. Bilingual experience... 
    Policy
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne Human Data

    Remote
    26 days ago
  •  ...maintaining client-mandated turnaround times. Our reviewers are compensated on a per-case basis as a 1099 independent contractor....  ...provided by other healthcare professionals in compliance with client-specific policies, nationally recognized evidence-based guidelines... 
    Policy
    For contractors
    Remote work

    Dane Street

    Charlotte, NC
    4 days ago
  •  ...managing the documentation, design, and compliance of retirement plans (401(k), 403(b), 457(...  ...office and is subject to our hybrid working policy, which gives colleagues the benefits of...  ...Reasonable accommodations will be determined on a case-by-case basis, in accordance with... 
    Policy
    Work at office
    Local area
    Immediate start
    Remote work

    Corebridge Financial

    Houston, TX
    1 day ago
  •  ...ensuring the accuracy, completeness, and compliance of all logistics-related documentation...  ...formal program milestones and Sustainment Reviews. Coordinate and facilitate the staffing...  ...Equal Opportunity Employers. It is the policy of AM Pierce & Associates & Applied Technologies... 
    Policy
    Full time
    Part time
    Work at office
    Local area
    Flexible hours

    Applied Technologies Group, Inc.

    El Paso, TX
    2 days ago
  •  ...Healthcare Compliance Document QA Specialist is a remote clinical-review track for evaluating AI outputs that...  ...Adjudicate disputed cases against published evidence...  ...support and its failure modes. Bilingual clinical...  ...Legal reasoning Policy review Risk analysis... 
    Policy
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    20 days ago
  • $70k - $100k

     ...documentation. This role ensures accuracy, compliance, traceability, and timely distribution...  ...Control Operations Manage receipt, review, processing, distribution, and archiving...  ...repositories following retention and archival policies. Other Duties ~ Please note that... 
    Policy
    Contract work
    Temporary work
    For subcontractor
    Work at office
    Remote work

    Orbital Engineering, Inc.

    Baton Rouge, LA
    15 days ago
  • AuraOne is seeking a remote Multi-Turn Conversation Failure Analysis Reviewer. You will assess model outputs using a versioned rubric, label edge cases, and provide structured feedback to retrain the system. The role emphasizes written rationales, consistent rubric application... 
    Remote job
    Contract work
    For contractors

    AuraOne

    New York, NY
    5 days ago
  • Ellenco Estágios e Treinamentos is seeking a Finance Operations Workflow AI Reviewer to assess AI outputs in finance and risk workflows. The role requires applying standard policies and citing regulations with clear reasoning, remotely from the US as a contractor. Responsibilities... 
    Policy
    Remote job
    For contractors
    10 hours per week

    Ellenco Estágios e Treinamentos

    New York, NY
    4 days ago
  • $7,083 - $8,500 per month

     ...the Benefits of Working at HHS webpage. Functional Title: Compliance Reviewer (Contracts) Job Title: Contract Administration Mgr I Agency:...  ...accordance with applicable statutes, regulations, and HHSC policies and standards. Work involves making recommendations to advance... 
    Policy
    Full time
    Contract work
    Temporary work
    Part time
    Work at office
    Remote work
    Shift work

    Texas Health and Human Services

    Austin, TX
    3 days ago
  •  ...indexing, and retrieval of case management documents....  ...technical assistance. Review electronic scanned...  ...information per company policy and state/federal laws....  ...and isolate causes of failures. Respond to and resolve...  ...computers, and telephones. Compliance Statements ADA: Children... 
    Policy
    Work at office
    Local area
    Monday to Friday

    Childrens Network Of Southwest Florida

    Fort Myers, FL
    3 days ago
  • $46.77k - $47.83k

     ...supervision. Performance is reviewed by the Unit Supervisor,...  .... Reviews incoming Case Incident Reports filed...  ...’s Drug Free Workplace Policy**, and (3) a 90-day probationary...  ..., and system security compliance. Pursuant to the...  ...the job description; failure to do so may result in... 
    Policy
    Work at office
    Local area
    Flexible hours
    Shift work
    Rotating shift

    City of New Haven

    New Haven, CT
    4 days ago
  •  ...Audit Workpaper AI Reviewer is a remote review track for evaluating AI outputs across...  ..., narrative reasoning, and policy adherence; flag compliance and reconciliation issues; and document...  ...close, audit, or risk tooling and its failure modes. Bilingual experience for cross... 
    Policy
    Remote job
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    14 days ago
  • $17.01 per hour

     ...DEA Compliance Clerk Under general supervision, a DEA Compliance Clerk in warehouse operations is responsible for performing a variety...  ...: Performs other duties as assigned Complies with all policies and standards Required Qualifications: ~ High School diploma... 
    Policy
    Hourly pay
    Temporary work
    Work experience placement
    Work at office
    Local area
    Remote work
    Flexible hours
    Shift work
    Afternoon shift

    Inmar

    Grand Prairie, TX
    3 days ago
  •  ...Compliance Workflow Workflow AI Reviewer is a remote review track for evaluating AI outputs in compliance workflows...  ...accuracy, statutory reasoning, and policy adherence; flag risk; and document...  ...against current compliance statutes, case law, or policy for Compliance Workflow... 
    Policy
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    25 days ago
  •  ...looking for a detail-oriented QC Reviewer to ensure the quality and consistency of robot manipulation video annotations produced...  ...in the video, including failures, drops, or slipped grips — flagging...  ...with evolving guidelines or edge-case resolutions. Maintain a QC log... 
    Contract work

    Welo Global

    Remote
    22 hours ago
  • $76.84k - $90.28k

     ...of critical operational, regulatory, and compliance documents but also leads initiatives to...  ...compliance with internal document control policies and external regulations (e.g., ISO, FDA...  ...~ Demonstrated ability to interpret, review, and manage technical drawings and specifications... 
    Policy
    For contractors
    Work experience placement
    Work at office
    Work from home
    Weekend work

    PMA Consultants

    Van Nuys, CA
    3 days ago
  •  ...is seeking a Full-Time Utilization Management Physician Reviewer to determine inpatient and outpatient coverage using UM...  ...to ensure medically appropriate care and maintain compliance with CMS and payer policies. The role emphasizes collaboration with Transitional Care... 
    Policy
    Remote job
    Full time

    Oak Street Health

    Tampa, FL
    3 days ago
  •  ...seeking a Full-Time Utilization Management Physician Reviewer to determine inpatient and outpatient coverage...  ...care, aligning with CMS guidelines and internal policies. A current US medical license and NCQA standards compliance are required. The position emphasizes accuracy,... 
    Policy
    Remote job
    Full time

    Oak Street Health

    Spokane, WA
    3 days ago
  • Sr Plan Document Compliance Specialist (Remote, USA) Job Summary The Sr Plan Document Compliance...  ...New Business/Transition process through review and consultation with all plan types and...  ...initial document package which includes policies, forms, and notices as needed. Input... 
    Policy
    Remote job
    Work experience placement
    Work at office
    3 days per week

    American Trust

    Brooklyn, NY
    5 days ago
  • $60.52k - $129.62k

     ...Care Plan Reviewer (Clinical Case Manager BH) We're building a world of health around every individual — shaping a more connected, convenient...  ...of applicable criteria and clinical guidelines, policies, procedures, and regulatory standards while completing reviews... 
    Policy
    Hourly pay
    Full time
    Temporary work
    Remote work

    Avery Healthcare Group Ltd.

    United States
    9 hours ago
  •  ...Corporation and McDonald's USA, LLC (the "Company") are committed to a policy of Equal Employment Opportunity and will not discriminate...  ...comply with any social distancing guidelines or other compliance obligations. For corporate roles, please proceed to the online... 
    Policy
    Temporary work
    Local area
    Flexible hours
    Shift work

    McDonald's

    Phoenix, AZ
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Robot Policy Compliance Failure Case Reviewer [Remote]. Be the first to apply!