Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Dual-Use Research Risk Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Dual-Use Research Risk Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.

Why this role matters

Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.

Responsibilities

  • Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Dual-Use Research Risk Evaluator assignments.
  • Document every successful attack with reproduction steps and the policy clause it violated.
  • Score model defenses across single-turn and multi-turn conversations.
  • Triage emerging attack vectors and route them to the safety team with severity ratings.
  • Maintain a personal library of attack patterns and propose new red-team rubrics.
  • Calibrate against the broader red-team cohort to keep coverage and severity consistent.

Qualifications

  • Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Dual-Use Research Risk Evaluator work.
  • Strong written communication — your reports become the patch ticket.
  • Comfort working in policy-grey areas with clear documentation of what was attempted and why.
  • Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
  • Score a model's defenses against a known jailbreak pattern across 20 variants.
  • Propose a new red-team rubric category after spotting an emerging attack vector.
  • Reproduce a failure another reviewer reported and confirm the severity tag.

Nice to have

  • Background in offensive security, AppSec, or trust & safety operations.
  • Experience publishing or reproducing public adversarial-ML research.
  • Multilingual fluency for cross-language attack testing.

Skills

  • Adversarial prompting
  • Red-team analysis
  • Policy taxonomy
  • Failure documentation
  • Dual Use Research Risk evaluation
  • AI safety
  • Red-team evaluation
  • Policy rubrics
  • Dual
  • Research

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 27 days ago
Similar jobs that could be interesting for youBased on the Dual-Use Research Risk Evaluator [Remote] in Remote vacancy
  •  ...-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content, craft relevant questions...  ...as stochastic modeling, derivatives pricing, econometrics, risk modeling, or computational finance Strong analytical and... 
    Risk
    Full time
    Contract work
    Remote work
    Flexible hours

    Virtual Vocations Inc

    United States
    3 days ago
  •  ...Litigation and Legal Research AI Evaluator is a remote review track for evaluating AI outputs in litigation...  ...reasoning, and policy adherence; flag risk; and document the corrected analysis so...  ...is judged on precision. AuraOne uses qualified legal and policy reviewers to... 
    Risk
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    24 days ago
  •  ...Equity Research AI Evaluator is a remote review track for evaluating AI outputs across finance and risk workflows. Reviewers grade calculations, narrative reasoning, and policy adherence...  ...no room for fuzzy reasoning. AuraOne uses experienced finance-and-risk professionals... 
    Risk
    Remote job
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    20 days ago
  •  ...applications• Experience with giving courtroom testimony required• Risk assessment experience required• Excellent written communication...  ...Health & Developmental Services is prohibited from employing or using as volunteers, persons who have been convicted of specific (“... 
    Risk
    Work experience placement
    Work at office
    Local area
    Remote work

    Commonwealth of Virginia, USA

    Nottoway, VA
    4 days ago
  • $81.7k - $135k

     ...Tax - Indirect Tax - Sales and Use Lookback Review COE - Senior...  ...complex issues requiring in-depth evaluation. Provide general guidance...  ...role or at a lower level. Research our clients’ business operations...  ...overpayment opportunities or risks and communicating these to our... 
    Risk
    Summer holiday
    Immediate start
    Flexible hours

    EY

    Columbus, OH
    5 days ago
  • $16 - $20 per hour

     ...DESCRIPTION AND POSITION REQUIREMENTS The research team at Penn State Ross and Carol Nese...  ...of Nursing is hiring part‑time research evaluators for projects focused on dementia care in...  ...protected veteran status. If you are unable to use our online application process due to an... 
    Hourly pay
    Part time
    Summer work

    The Pennsylvania State University

    Hershey, PA
    2 days ago
  • Dual General Manager - Hilton Garden Inn & Homewood Suites Montgomery Flynn Hospitality...  ...and industry organizations. Property & Risk Management * Ensure both properties...  ...Financially disciplined and comfortable using data to make operating decisions. * Highly... 
    Risk
    Full time
    Local area
    Relocation package

    Flynn Hospitality

    Irving, TX
    2 days ago
  • $9.1k - $11.86k

     ...Title:Psychologist III Forensic Evaluator Job Title:Psychologist III...  ...evaluations, as well as violence risk assessments under 46C....  ...considerable latitude for the use of initiative and independent...  ...practices and current peer-reviewed research. Provides effective expert testimony... 
    Risk
    Full time
    Temporary work
    Part time
    Traineeship
    Internship
    Work at office
    Remote work
    Shift work
    Rotating shift

    Health and Human Services Commission (HHSC)

    Vernon, TX
    1 day ago
  • $100 - $125 per hour

     ...workflows into structured tasks for AI systems Evaluate AI-generated outputs for accuracy, logical...  ..., and business relevance Work on use cases including underwriting, claims, actuarial...  ..., hands-on experience as an Underwriter, Risk Specialist, or Actuary. Strong... 
    Risk
    Remote job
    Hourly pay
    For contractors
    Freelance
    Work at office
    Immediate start
    Flexible hours

    Crossing Hurdles

    New York, NY
    11 hours ago
  •  ...with EQT. Website: Linkedin Job Title: Evaluator - Political Science Location: Remote (...  ...decisions must be guided towards evaluating the usefulness of the AI response. The primary metric...  ...Current: Stay updated with the latest research, guidelines, and advancements in your... 
    Contract work
    Remote work
    Worldwide

    Straive

    New York, NY
    11 hours ago
  • $5,000 - $6,999 per month

    Career Opportunities: Substance Use Program Evaluator (20388) Posting ID: 20388 - Posted: 08/21/2026 - Health & Human Services Comm - BHS Quality...  ...and external stakeholders to develop evaluation plans and research projects that reflect national standards and best practices... 
    Full time
    Temporary work
    Part time
    Work at office
    Remote work
    Relocation
    Shift work

    FALL CREEK FARM & NURSERY

    Austin, TX
    1 day ago
  •  ...ProSidian services focus on the broad spectrum of Risk Management, Compliance, Business Process,...  ...information, strategies, research needs, issue papers, testing protocols, or...  ...the past five (5) years, Must be able to use a computer to communicate via email; and proficient... 
    Risk
    Full time
    Contract work
    Temporary work
    For contractors
    Work experience placement
    Remote work
    Flexible hours

    Prosidian Consultng

    Charlotte, NC
    11 hours ago
  •  ...services focus on the broad spectrum of Risk Management, Compliance, Business...  ...DescriptionProSidian Seeks a Scientific Research and Evaluation Specialist (Glass Scientist) [DOE012212...  ...Off (PTO) Benefits: Eligible employees use PTO for vacation, a doctor’s appointment... 
    Risk
    Full time
    Contract work
    Temporary work
    For contractors
    For subcontractor
    Work at office
    Remote work
    Flexible hours

    Prosidian Consultng

    Richland, WA
    11 hours ago
  •  ...Appraiser Bring your expertise to JPMorgan Chase. As part of Risk Management and Compliance, you are at the center of keeping JPMorgan...  ...a responsible way by anticipating new and emerging risks, and using your expert judgement to solve real-world challenges that impact... 
    Risk
    Work at office
    Local area
    Remote work

    Chase

    United States
    1 day ago
  •  ...focus on the broad spectrum of Risk Management, Compliance,...  ...and its alternatives; andReview/evaluate/update studies produced by other...  ...Statistical analysis will be used to determine costs and impacts...  ...English verbal, written, editing, research, and verbal communication... 
    Risk
    Full time
    Contract work
    Temporary work
    For contractors
    Remote work
    Flexible hours

    Prosidian Consultng

    Charlotte, NC
    11 hours ago
  •  ...focus on the broad spectrum of Risk Management, Compliance,...  ...and its alternatives; andReview/evaluate/update economic studies produced...  ...Statistical analysis will be used to determine costs and impacts...  ...English verbal, written, editing, research, and verbal communication... 
    Risk
    Contract work
    For contractors
    Remote work

    ProSidian Consulting

    Charlotte, NC
    1 day ago
  •  ...provides enterprise services/solutions for Risk Management | Compliance | Business...  ...DescriptionProSidian Seeks a Scientific Research and Evaluation Specialist (Glass Scientist) [DOE014814...  ...(PTO) Benefits: Eligible employees can use PTO for vacations, doctor's appointments... 
    Risk
    Full time
    Contract work
    Temporary work
    For contractors
    For subcontractor
    Work at office
    Remote work
    Flexible hours

    Prosidian Consultng

    Richland, WA
    11 hours ago
  •  ...ProSidian services focus on the broad spectrum of Risk Management, Compliance, Business Process,...  ...a DOE - NNSA Subject Matter Expert - Research and Development (TEPSIII31) headquartered...  ...-Off (PTO) Benefits: Eligible employees use PTO for vacation, a doctor’s appointment,... 
    Risk
    Full time
    Temporary work
    For contractors
    Work at office
    Remote work
    Flexible hours

    Prosidian Consultng

    Washington DC
    11 hours ago
  •  ...Role: Legal Research Assistant Location: Shelbyville, KY Area Type: Contract / Onsite...  ...organization with a collaborative risk and compliance team supporting business operations...  .... • Perform background searches using research databases. • Review information... 
    Risk
    Contract work
    Work at office

    Turn2Partners

    Shelbyville, KY
    2 days ago
  •  ...Clinical Diagnostic Evaluator Easterseals Northern California (ES NorCal) and Easterseals...  ...children, youth, and adults who have or are at risk for intellectual and developmental...  ...health evaluations, and second opinions using standard diagnostic tools. This role involves... 
    Risk
    Hourly pay
    Part time
    Work at office
    Local area
    Remote work
    Work from home
    Flexible hours

    Catalight

    Honolulu, HI
    4 days ago
  • $155.5k

     ...Holdings, LLC seeks Senior Vice President, IM Research in Pittsburgh, PA, to coordinate a...  ...responsible experience must include: Utilizing risk management frameworks involving Value at...  ...issue, leveraging data analysis, and using productivity tools including Excel VBA macros... 
    Risk
    Temporary work
    Remote work
    Flexible hours

    The Bank of New York Mellon

    Pittsburgh, PA
    3 days ago
  • $153.3k - $284.7k

     ...analytical solutions to accelerate timelines, de-risk development, and increase the probability...  ...group, which enables the most impactful use of quantitative methodology across PDD...  ...05-113292Date posted : 2026-07-16Profession: Research & DevelopmentEmployment type: Full time
    Risk
    Full time
    Local area
    Relocation package

    Genentech

    South San Francisco, CA
    2 days ago
  • $97.5k - $127.5k

     ...every day.Smartsheet's horizontal use cases — spanning Enterprise...  ...Delivery, and Governance, Risk & Compliance — represent the company...  ...: Contribute to competitive research and differentiation for...  ...positioning that assists Sales during evaluations.Sales-Ready Content Suite:... 
    Risk
    Full time
    Temporary work
    Work at office
    Local area
    Remote work

    Smartsheet

    Bellevue, WA
    3 days ago
  • $225.6k - $338.4k

     ...driving trade-offs across quality, risk, cost, scalability, and time-...  ..., including application of evaluation, monitoring, model risk...  ...lead a domain-level Applied AI research and innovation agenda, balancing...  ...across a diverse portfolio of use cases.Strong judgment navigating... 
    Risk
    Full time
    Temporary work
    Work at office
    Remote work
    3 days per week

    The Hartford Financial Services Group

    Chicago, IL
    3 days ago
  •  ...University Emory University is a leading research university that fosters excellence and...  ...DESCRIPTION: The Senior IT GRC (Governance, Risk, and Compliance) Analyst oversees...  ...participation in university programs and in the use of facilities without such discrimination.... 
    Risk
    Work experience placement
    Remote work
    Work from home
    Flexible hours

    Emory University

    Atlanta, GA
    3 days ago
  •  ...internal clients and our team.The Research Operations Specialist, know...  ...research contracts, including evaluating renewal needs, periodically...  ...compliance, consistency, and effective risk management. Regularly review...  ...and external tools/platforms used to support both research and... 
    Risk
    Full time
    Contract work
    Work experience placement
    H1b
    Work at office
    Remote work
    Visa sponsorship
    Relocation package
    Monday to Friday

    AlixPartners

    Dallas, TX
    2 days ago
  • $130k - $150k

    ## Director, Value and Risk AdvisoryApplyremote type: On-sitelocations: San Francisco, CA: Los Angeles, CA: Salt Lake City, UTtime type...  ...experienced, licensed, qualified commercial real estate appraisers who use local insights and their years of expertise to deliver accurate,... 
    Risk
    Temporary work
    Local area

    Jones Lang LaSalle Incorporated

    Los Angeles, CA
    3 days ago
  • $118k - $197k

     ...functional partners (including Global Research and Development (R&D), Sales and Marketing...  ...regulatory viewpoint and providing risk/benefit evaluations to guide project strategy.Act as the...  ...other legally protected statusElanco may use automated tools, including AI, to... 
    Risk
    Full time
    Summer work
    Local area
    Remote work
    Relocation
    Flexible hours

    Elanco

    Indianapolis, IN
    11 hours ago
  • $19 - $21 per hour

     ...Description We are seeking a motivated and experienced MID Intake Evaluator to join our organization! The MID Intake Evaluator will work...  ...as the nicotine assessment, Tuberculosis screening, and health risk assessment. 3. Complete court evaluations letters during... 
    Risk
    Hourly pay
    Full time
    Local area
    Remote work
    Trial period

    Mental Health Association - Western MA

    Chicopee, MA
    3 days ago
  •  ...as a key business partner through our Castle High Value and EXL Risk Control service offerings. We offer a variety of field appraisal,...  ...-based and virtual High Value Home property surveys that will be used for homeowners' insurance purposes. This involves coordinating and... 
    Risk
    For contractors
    Work at office
    Work from home

    EXL Service

    Philadelphia, PA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Dual-Use Research Risk Evaluator [Remote]. Be the first to apply!