Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Policy Compliance Document QA Specialist [Remote]

AuraOne Human Data

Remote
  • Remote job

AI Policy Compliance Document QA Specialist is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.

Why this role matters

Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.

Responsibilities

  • Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for AI Policy Compliance Document QA Specialist assignments.
  • Document every successful attack with reproduction steps and the policy clause it violated.
  • Score model defenses across single-turn and multi-turn conversations.
  • Triage emerging attack vectors and route them to the safety team with severity ratings.
  • Maintain a personal library of attack patterns and propose new red-team rubrics.
  • Calibrate against the broader red-team cohort to keep coverage and severity consistent.

Qualifications

  • Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for AI Policy Compliance Document QA Specialist work.
  • Strong written communication — your reports become the patch ticket.
  • Comfort working in policy-grey areas with clear documentation of what was attempted and why.
  • Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
  • Score a model's defenses against a known jailbreak pattern across 20 variants.
  • Propose a new red-team rubric category after spotting an emerging attack vector.
  • Reproduce a failure another reviewer reported and confirm the severity tag.

Nice to have

  • Background in offensive security, AppSec, or trust & safety operations.
  • Experience publishing or reproducing public adversarial-ML research.
  • Multilingual fluency for cross-language attack testing.

Skills

  • Adversarial prompting
  • Red-team analysis
  • Policy taxonomy
  • Failure documentation
  • Document annotation
  • Legal reasoning
  • Policy review
  • Risk analysis
  • Policy
  • Compliance

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the AI Policy Compliance Document QA Specialist [Remote] in Remote vacancy
  •  ...Litigation Discovery Document QA Specialist is a remote review track for evaluating AI outputs in litigation workflows. Reviewers...  ..., statutory reasoning, and policy adherence; flag risk; and document...  ...AI-assisted legal-research or compliance tooling. Bilingual experience for... 
    Policy
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne, Inc.

    New York, NY
    2 days ago
  • Insurance Policy Document QA Specialist is a remote review track for evaluating AI outputs across insurance workflows. Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance and reconciliation issues; and document the correct treatment... 
    Policy
    Hourly pay
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    AuraOne, Inc.

    New York, NY
    3 days ago
  • AuraOne, Inc. seeks a Data Provenance Data Specialist contractor to review AI outputs and ensure compliance with data provenance workflows, policies, and escalation rules. You will...  ...structured rubrics. You’ll flag risks, document next steps for the modeling team, and... 
    Policy
    Remote job
    For contractors

    AuraOne, Inc.

    New York, NY
    3 days ago
  •  ...Privacy Law Document QA Specialist is a remote review track for evaluating AI outputs in privacy law workflows. Reviewers grade...  ...accuracy, statutory reasoning, and policy adherence; flag risk; and...  ...AI-assisted legal-research or compliance tooling. Bilingual experience... 
    Policy
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    5 days ago
  •  ...Healthcare Compliance Document QA Specialist is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade differential reasoning,...  ...writing Clinical review Legal reasoning Policy review Risk analysis Healthcare... 
    Policy
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    5 days ago
  •  ...Data Protection Document QA Specialist is a remote review track for evaluating AI outputs across data protection document qa specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document... 
    Policy
    Remote job
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  •  ...Regulatory Filing Document QA Specialist is a remote review track for evaluating AI outputs in legal review workflows. Reviewers...  ...accuracy, statutory reasoning, and policy adherence; flag risk; and...  ...AI-assisted legal-research or compliance tooling. Bilingual experience... 
    Policy
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  •  ...Insurance Policy Document QA Specialist is a remote review track for evaluating AI outputs across insurance workflows. Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance and reconciliation issues; and document the correct treatment... 
    Policy
    Remote job
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  • micro1 Inc. is seeking a Document Reviewer (Specialist) to join a remote project supporting sales, marketing and digital content initiatives. You...  ...clear, actionable feedback to improve accuracy, clarity, compliance and brand consistency. Ideal candidates have at least... 
    Remote job

    micro1 Inc.

    New York, NY
    1 day ago
  • $58.24k - $66.56k

     ...ensuring pro-fee coding compliance. This role is critical...  ...as appropriate when documentation in the medical record...  ...denial trends for client policy and procedure...  ...Coder, Coding Auditor, QA Analyst, or Coding SME...  ...experienced Healthcare Coding Specialist ready to contribute to... 
    Policy
    Temporary work
    Remote work
    Flexible hours

    Infinx

    Remote
    19 days ago
  • $87k - $100k

     ...you passionate about quality, compliance, and finding practical...  ...environment? We’re looking for a QA Specialist who can bring strong Quality...  ...help ensure our processes, documentation, and products meet applicable...  ...is also SEKISUI Diagnostics policy tocomply withall applicable... 
    Policy
    Local area

    Sekisui Diagnostics, LLC

    San Diego, CA
    4 days ago
  • $40 per hour

     ...a language-evaluation project. You will identify AI model failures, craft queries, test them, and document issues while writing clear instructions and rubrics...  ...of $40 per hour, with Start ASAP. Prior research/QA/compliance experience and strong attention to detail are... 
    Remote job
    Hourly pay
    Contract work
    Freelance
    Immediate start

    Welocalize, Inc.

    New York, NY
    4 days ago
  • $50k - $60k

     ...of services that prioritizes accuracy, compliance, and reduction of regulatory risk for...  ...partner, is looking for a Retirement Document Specialist to join their team and help ensure a seamless...  ...’s Equal Employment Opportunity policy,we do not discriminate on the basis of... 
    Policy
    For contractors
    Local area
    Remote work
    Flexible hours

    Strongpoint Partners

    New York, NY
    1 day ago
  • Dover Precision Components is hiring a Document Control Specialist at our Rosenberg , Texas...  ...equipment to help producers stay in compliance and meet stringent emission regulations...  ...handling of quality documents, including policies, procedures, templates, and administrative... 
    Policy
    Work experience placement
    Remote work
    2 days per week

    FW Murphy Production Controls

    Rosenberg, TX
    3 days ago
  • AuraOne, Inc. is seeking a QA Specialist - AI Product Testing & Support to remotely evaluate AI outputs across...  ...operations workflows. Reviewers assess tone, policy adherence, and stakeholder fit. You will flag risks, document next steps for the modeling team, and... 
    Policy
    Remote job
    For contractors

    AuraOne Human Data

    New York, NY
    3 days ago
  • AuraOne, Inc. seeks an AI Facial Data Collection Contributor referrals specialist operations contractor to join a remote workflow evaluation track. You will review outputs, grade policy adherence, and document the next steps so the modeling team can improve training data... 
    Policy
    Remote job
    For contractors

    AuraOne, Inc.

    New York, NY
    4 days ago
  • Zara's AI Recruiter program seeks an experienced Reviewer to assess outputs against recruiting workflows and policy, then document actionable next steps. The contractor will grade tone, escalation logic, and stakeholder fit, and flag risks with severity tags. Applicants... 
    Policy
    Remote job
    For contractors

    Auraone

    New York, NY
    4 days ago
  • AuraOne, Inc. is seeking a Derivatives Counsel (ISDA Specialist) reviewer for a remote contractor track in the United States. You will assess AI outputs against derivatives workflows, policy, and playbooks to ensure compliance and workplace readiness. You will grade tone,... 
    Policy
    Remote job
    For contractors

    AuraOne, Inc.

    New York, NY
    3 days ago
  • $20 - $36 per hour

    AI Trainer Jobs seeks a Music & Lyrics Expert - Slovak for a remote contractor role focused on evaluating AI outputs across...  ...lyrics operations workflows. You will review, grade and document workflow quality, policy adherence, and stakeholder fit to support model training.... 
    Policy
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    Auraone

    New York, NY
    4 days ago
  • AI Trainer Jobs is seeking an Architecture Expert to remotely review AI outputs across...  ...fit using a structured rubric and flag policy-adherence gaps with severity tags. The role...  ...direct experience in architecture specialist operations on real teams, clear written reasoning... 
    Policy
    Remote job
    10 hours per week

    Auraone

    New York, NY
    3 days ago
  • $85 per hour

    AI Trainer Jobs seeks an Office and Administrative Domains specialist for a remote review track evaluating AI outputs across office...  ...Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the... 
    Policy
    Remote job
    Hourly pay
    For contractors
    Work at office
    10 hours per week
    Flexible hours

    Auraone

    New York, NY
    4 days ago
  •  ...Annotators is a remote review track for evaluating AI outputs across rn annotators specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can... 
    Policy
    Remote job

    Auraone

    New York, NY
    2 days ago
  •  ...floor support as needed to maintain compliance with local policies and procedures. Review and approval...  ...Position Responsibilities: Tracking of Documents to ensure timely review to complete...  ...of 6 years relevant experience. Specialist: BA/BS with 2-4 years of experience... 
    Policy
    Local area

    Zoetis, Inc

    Charles City, IA
    2 days ago
  • AI Trainer Jobs is seeking a Data Privacy Analyst for a remote contractor role evaluating AI outputs in privacy law...  ...workflows. You will review citations, statutory reasoning, and policy adherence, flag risks, and document corrected analysis for training the modeling team. Ideal... 
    Policy
    Remote job
    For contractors

    Auraone

    New York, NY
    4 days ago
  • AI Trainer Jobs seeks a Finance Productivity Workflow Evaluation Specialist for a remote contractor role. You will review AI-generated valuations and financial...  ...narratives, ensuring adherence to standards and policies, and document corrections for model training.... 
    Policy
    Remote job
    For contractors

    Auraone

    New York, NY
    3 days ago
  • AI Trainer Jobs is seeking a remote reviewer for Agentic AI Expert tasks. You will assess AI outputs against defined workflows, policies, and playbooks, grade tone and escalation, and document actionable next steps for training. The role requires direct experience with... 
    Policy
    Remote job
    10 hours per week
    Flexible hours

    Auraone

    New York, NY
    4 days ago
  • AuraOne seeks a Privacy Analyst to review AI outputs in privacy law workflows. This remote, contractor role focuses on evaluating citations, statutory reasoning, and policy adherence, then documenting corrected analysis for model training. You will verify authorities,... 
    Policy
    Remote job
    For contractors
    10 hours per week
    Flexible hours

    Auraone

    New York, NY
    5 days ago
  •  ...Inc. is seeking a Systems & Infrastructure Specialist reviewer to assess AI outputs within infrastructure operations...  ...focuses on grading workflow correctness, policy adherence, and stakeholder fit, with careful documentation of next steps for model training. You will... 
    Policy
    Remote job
    For contractors

    AuraOne, Inc.

    New York, NY
    4 days ago
  • Seeking a Technical QA/Application Support Specialist to join our team! Hybrid position...  ...flows, and integrations AI-enabled workflows and automated...  ...system outcomesIdentify, document, and track defects, risks,...  ...laws and policies that prohibit discrimination... 
    Policy
    Work at office
    Remote work

    Advanced Recovery Systems, LLC

    Roswell, GA
    3 days ago
  • $68.64k - $70.72k

     ...Clinical Operations QA Specialist Remote About Reveleer...  ...to support traceable documentation across diagnoses,...  ...transparent, human-in-the-loop AI at its core, Reveleer...  ...QA protocols and QA policies in the bounds of...  ...information, in compliance with applicable federal... 
    Policy
    Full time
    Work at office
    Local area
    Remote work
    Flexible hours

    Reveleer

    Remote
    10 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Policy Compliance Document QA Specialist [Remote]. Be the first to apply!