Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Dual-Use Research Risk Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Dual-Use Research Risk Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.

Why this role matters

Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.

Responsibilities

  • Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Dual-Use Research Risk Evaluator assignments.
  • Document every successful attack with reproduction steps and the policy clause it violated.
  • Score model defenses across single-turn and multi-turn conversations.
  • Triage emerging attack vectors and route them to the safety team with severity ratings.
  • Maintain a personal library of attack patterns and propose new red-team rubrics.
  • Calibrate against the broader red-team cohort to keep coverage and severity consistent.

Qualifications

  • Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Dual-Use Research Risk Evaluator work.
  • Strong written communication — your reports become the patch ticket.
  • Comfort working in policy-grey areas with clear documentation of what was attempted and why.
  • Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
  • Score a model's defenses against a known jailbreak pattern across 20 variants.
  • Propose a new red-team rubric category after spotting an emerging attack vector.
  • Reproduce a failure another reviewer reported and confirm the severity tag.

Nice to have

  • Background in offensive security, AppSec, or trust & safety operations.
  • Experience publishing or reproducing public adversarial-ML research.
  • Multilingual fluency for cross-language attack testing.

Skills

  • Adversarial prompting
  • Red-team analysis
  • Policy taxonomy
  • Failure documentation
  • Dual Use Research Risk evaluation
  • AI safety
  • Red-team evaluation
  • Policy rubrics
  • Dual
  • Research

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Dual-Use Research Risk Evaluator [Remote] in Remote vacancy
  • $69.57k - $114.1k

     ...Functional Title: Senior Substance Use Program Evaluator Job Title: Program Management Spec...  ...documentation; and communicating project status, risks, outcomes, and recommendations to...  ..., and analysis of complex data and research to inform evaluations and performance... 
    Risk
    Full time
    Temporary work
    Part time
    Work at office
    Remote work
    Relocation
    Shift work

    Texas Health & Human Services Commission

    Austin, TX
    19 days ago
  •  ...Government Policy and Legislative Research Evaluator is a remote review track for evaluating AI outputs...  ...reasoning, and policy adherence; flag risk; and document the corrected analysis so...  ...content is judged on precision. AuraOne uses qualified legal and policy reviewers to... 
    Risk
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    13 days ago
  •  ...Equity Research AI Evaluator is a remote review track for evaluating AI outputs across finance and risk workflows. Reviewers grade calculations, narrative reasoning, and policy adherence...  ...no room for fuzzy reasoning. AuraOne uses experienced finance-and-risk professionals... 
    Risk
    Remote job
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  •  ...applications• Experience with giving courtroom testimony required• Risk assessment experience required• Excellent written communication...  ...Health & Developmental Services is prohibited from employing or using as volunteers, persons who have been convicted of specific (“... 
    Risk
    Work experience placement
    Work at office
    Local area
    Remote work

    Commonwealth of Virginia, USA

    Nottoway, VA
    2 days ago
  • $16 - $20 per hour

     ...DESCRIPTION AND POSITION REQUIREMENTS The research team at Penn State Ross and Carol Nese...  ...of Nursing is hiring part-time research evaluators for projects focused on dementia care in...  ...as those concerning alcohol and drug use, crime prevention, the reporting of crimes... 
    Suggested
    Hourly pay
    Part time
    For contractors
    Summer work
    Remote work

    Penn State University

    University Park, PA
    5 days ago
  • $40 - $44 per hour

     ...to sensitive topics in Italian. You will use Italian language fluency and cultural judgment to evaluate model behavior, identify risks, and support safer responses. No previous...  ...judgment when working with sensitive and dual-use information. Preferred Background... 
    Risk
    Remote job
    Hourly pay
    Immediate start

    SaidGig

    Europe
    2 days ago
  • $61.18k - $99.66k

     ...Benefits of Working at HHS webpage. Functional Title: Substance Use Program Evaluator Job Title: Program Specialist VI Agency: Health &...  ...and external stakeholders to develop evaluation plans and research projects that reflect national standards and best practices... 
    Full time
    Temporary work
    Part time
    Work at office
    Remote work
    Relocation
    Shift work

    Texas Health & Human Services Commission

    Remote
    26 days ago
  • $98.21k - $142.37k

     ...Title: Psychologist III-Forensic Evaluator Job Title: Psychologist...  ..., as well as violence risk assessments under 46C. Responsibilities...  ...considerable latitude for the use of initiative and independent...  ...and current peer-reviewed research. Provides effective expert testimony... 
    Risk
    Full time
    Temporary work
    Part time
    Traineeship
    Internship
    Work at office
    Remote work
    Shift work
    Rotating shift

    Texas Health & Human Services Commission

    Austin, TX
    7 days ago
  • Health & Human Services Commission in Austin, TX, seeks a Senior Substance Use Program Evaluator to lead evaluations and performance improvement initiatives within the Behavioral Health Services department. This role partners with executives and external stakeholders to... 
    Remote work

    FALL CREEK FARM & NURSERY

    Austin, TX
    5 days ago
  •  ...with EQT. Website: Linkedin Job Title: Evaluator - Political Science Location: Remote (...  ...decisions must be guided towards evaluating the usefulness of the AI response. The primary metric...  ...Current: Stay updated with the latest research, guidelines, and advancements in your... 
    Contract work
    Remote work
    Worldwide

    Straive

    New York, NY
    3 days ago
  • Texas Health and Human Services invites applications for the Substance Use Program Evaluator role within the Behavioral Health Services division. This position focuses on evaluating substance use and recovery programs, developing evaluation questions, and translating data... 
    Remote work

    Texas Health and Human Services

    Austin, TX
    4 days ago
  • $40 - $100 per hour

     ...language work About AI Training and Scientific Evaluation AI training is the human side of building...  ...realistic scenarios, calculations, and research-style reasoning tasks. Focus on...  ..., space physics, and data interpretation Use orders of magnitude, unit consistency, limiting... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    OpenTrain AI

    Brooklyn, NY
    1 day ago
  • $390 per month

     ...Position: Florida Licensed Comprehensive Evaluator Position Description: Emerge...  ...Children [TSCC]. · Complete a Suicide Risk Scale/Questionnaire (e.g., Suicide Probability...  ...proficiently and on time. · Must be able to use Microsoft Office Word. Must have a... 
    Risk
    Part time
    For contractors
    Internship
    Work at office
    Work from home

    Emergen Inc

    Lake Mary, FL
    14 days ago
  •  ...services focus on the broad spectrum of Risk Management, Compliance, Business...  ...DescriptionProSidian Seeks a Scientific Research and Evaluation Specialist (Glass Scientist) [DOE012212...  ...Off (PTO) Benefits: Eligible employees use PTO for vacation, a doctor’s appointment... 
    Risk
    Full time
    Contract work
    Temporary work
    For contractors
    For subcontractor
    Work at office
    Remote work
    Flexible hours

    Prosidian Consultng

    Richland, WA
    3 days ago
  •  ...ProSidian services focus on the broad spectrum of Risk Management, Compliance, Business Process,...  ...information, strategies, research needs, issue papers, testing protocols, or...  ...the past five (5) years, Must be able to use a computer to communicate via email; and proficient... 
    Risk
    Full time
    Contract work
    Temporary work
    For contractors
    Work experience placement
    Remote work
    Flexible hours

    Prosidian Consultng

    Charlotte, NC
    3 days ago
  •  ...focus on the broad spectrum of Risk Management, Compliance,...  ...and its alternatives; andReview/evaluate/update studies produced by other...  ...Statistical analysis will be used to determine costs and impacts...  ...English verbal, written, editing, research, and verbal communication... 
    Risk
    Full time
    Contract work
    Temporary work
    For contractors
    Remote work
    Flexible hours

    Prosidian Consultng

    Charlotte, NC
    3 days ago
  •  ...focus on the broad spectrum of Risk Management, Compliance,...  ...and its alternatives; andReview/evaluate/update economic studies produced...  ...Statistical analysis will be used to determine costs and impacts...  ...English verbal, written, editing, research, and verbal communication... 
    Risk
    Contract work
    For contractors
    Remote work

    ProSidian Consulting

    Charlotte, NC
    4 days ago
  •  ...Clinical Diagnostic Evaluator Easterseals Northern California (ES NorCal) and Easterseals...  ...children, youth, and adults who have or are at risk for intellectual and developmental...  ...health evaluations, and second opinions using standard diagnostic tools. This role involves... 
    Risk
    Hourly pay
    Part time
    Work at office
    Local area
    Remote work
    Work from home
    Flexible hours

    Catalight

    Honolulu, HI
    2 days ago
  •  ...provides enterprise services/solutions for Risk Management | Compliance | Business...  ...DescriptionProSidian Seeks a Scientific Research and Evaluation Specialist (Glass Scientist) [DOE014814...  ...(PTO) Benefits: Eligible employees can use PTO for vacations, doctor's appointments... 
    Risk
    Full time
    Contract work
    Temporary work
    For contractors
    For subcontractor
    Work at office
    Remote work
    Flexible hours

    Prosidian Consultng

    Richland, WA
    3 days ago
  • $187.18k - $247.25k

     ...Job Family: Cyber and IT Risk Management Job Qualifications...  ...: The Expert-Level Network Evaluator / System Vulnerability Analyst provides advanced technical research, systems analysis, cyber-domain...  ...practices and lessons learned using the Joint Lessons Learned Program... 
    Risk
    Full time
    Temporary work
    Immediate start
    Remote work
    Worldwide
    Flexible hours

    General Dynamics Information Technology

    Maryland
    6 days ago
  •  ...ProSidian services focus on the broad spectrum of Risk Management, Compliance, Business Process,...  ...a DOE - NNSA Subject Matter Expert - Research and Development (TEPSIII31) headquartered...  ...-Off (PTO) Benefits: Eligible employees use PTO for vacation, a doctor’s appointment,... 
    Risk
    Full time
    Temporary work
    For contractors
    Work at office
    Remote work
    Flexible hours

    Prosidian Consultng

    Washington DC
    3 days ago
  • $56.56k - $79.16k

     ...or personal property for tax evaluation. Appraises personal, residential...  ...property at market value using established cost, market and...  ...field inspections and other research; Reviews valuations when petitioned...  ...regularly involves moderate risks or discomforts associated... 
    Risk
    Full time
    Work experience placement
    Work at office
    Remote work
    Visa sponsorship

    Pima County

    Tucson, AZ
    5 days ago
  •  ...and security. Make an impact by using your expertise to protect our...  ...The Expert-Level Network Evaluator / System Vulnerability Analyst provides advanced technical research, systems analysis, cyber-domain...  ...activity, and CI‑driven HUMINT risk considerations to ensure doctrine... 
    Risk

    General Dynamics Information Technology

    Maryland, MD
    6 days ago
  • $155.5k

     ...Holdings, LLC seeks Senior Vice President, IM Research in Pittsburgh, PA, to coordinate a...  ...responsible experience must include: Utilizing risk management frameworks involving Value at...  ...issue, leveraging data analysis, and using productivity tools including Excel VBA macros... 
    Risk
    Temporary work
    Remote work
    Flexible hours

    The Bank of New York Mellon

    Pittsburgh, PA
    1 day ago
  •  ...Enterprise Service Solutions for Risk Management | Compliance | Business...  ...communities. This will include evaluating policies, practices, and methodologies used by federal, state, and local agencies...  .... Environmental Justice Research: Conduct research on environmental... 
    Risk
    For contractors
    Work at office
    Local area
    Remote work
    Flexible hours

    ProSidian Consulting

    United States
    2 days ago
  • $56.56k - $79.16k

     ...or personal property for tax evaluation. Appraises personal, residential...  ...property at market value using established cost, market and...  ...field inspections and other research; Reviews valuations when petitioned...  ...regularly involves moderate risks or discomforts associated... 
    Risk
    Work experience placement
    Work at office
    Remote work
    Visa sponsorship

    Pima County

    Tucson, AZ
    2 days ago
  • $52k - $62.4k

     ...Hedgeye Risk Management is seeking undergraduate students to join our Summer 2027 Research Internship Program . This program offers the opportunity to gain meaningful, hands...  ..., merit and business need. We use E-Verify to confirm the identity and employment... 
    Risk
    Hourly pay
    Full time
    Temporary work
    Internship
    Summer internship
    Work at office
    Monday to Friday

    Hedgeye Risk Management

    Stamford, CT
    6 days ago
  • $61.9k - $141k

    Operations Research AnalystThe Opportunity:As an operations research...  ...delivery team, you’ll assist in the evaluation of data assessment strategies...  ..., Technical and Safety Risk Management to help deliver sound...  ...efficiency.In this role, you’ll use your passion for technology... 
    Risk
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work

    Booz Allen Hamilton

    Hampton, VA
    8 hours ago
  • $153.3k - $284.7k

     ...analytical solutions to accelerate timelines, de-risk development, and increase the probability...  ...group, which enables the most impactful use of quantitative methodology across PDD...  ...05-113292Date posted : 2026-07-16Profession: Research & DevelopmentEmployment type: Full time
    Risk
    Full time
    Local area
    Relocation package

    Genentech

    South San Francisco, CA
    8 hours ago
  •  ...University Emory University is a leading research university that fosters excellence and...  ...DESCRIPTION: The Senior IT GRC (Governance, Risk, and Compliance) Analyst oversees...  ...participation in university programs and in the use of facilities without such discrimination.... 
    Risk
    Work experience placement
    Remote work
    Work from home
    Flexible hours

    Emory University

    Atlanta, GA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Dual-Use Research Risk Evaluator [Remote]. Be the first to apply!