Dual-Use Research Risk Evaluator [Remote]
AuraOne Human Data
- Remote job
Dual-Use Research Risk Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.
Why this role matters
Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.
Responsibilities
- Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Dual-Use Research Risk Evaluator assignments.
- Document every successful attack with reproduction steps and the policy clause it violated.
- Score model defenses across single-turn and multi-turn conversations.
- Triage emerging attack vectors and route them to the safety team with severity ratings.
- Maintain a personal library of attack patterns and propose new red-team rubrics.
- Calibrate against the broader red-team cohort to keep coverage and severity consistent.
Qualifications
- Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Dual-Use Research Risk Evaluator work.
- Strong written communication — your reports become the patch ticket.
- Comfort working in policy-grey areas with clear documentation of what was attempted and why.
- Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
- Score a model's defenses against a known jailbreak pattern across 20 variants.
- Propose a new red-team rubric category after spotting an emerging attack vector.
- Reproduce a failure another reviewer reported and confirm the severity tag.
Nice to have
- Background in offensive security, AppSec, or trust & safety operations.
- Experience publishing or reproducing public adversarial-ML research.
- Multilingual fluency for cross-language attack testing.
Skills
- Adversarial prompting
- Red-team analysis
- Policy taxonomy
- Failure documentation
- Dual Use Research Risk evaluation
- AI safety
- Red-team evaluation
- Policy rubrics
- Dual
- Research
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
$69.57k - $114.1k
...Functional Title: Senior Substance Use Program Evaluator Job Title: Program Management Spec... ...documentation; and communicating project status, risks, outcomes, and recommendations to... ..., and analysis of complex data and research to inform evaluations and performance...RiskFull timeTemporary workPart timeWork at officeRemote workRelocationShift work- ...Government Policy and Legislative Research Evaluator is a remote review track for evaluating AI outputs... ...reasoning, and policy adherence; flag risk; and document the corrected analysis so... ...content is judged on precision. AuraOne uses qualified legal and policy reviewers to...RiskRemote jobHourly payFor contractors10 hours per week
- ...Equity Research AI Evaluator is a remote review track for evaluating AI outputs across finance and risk workflows. Reviewers grade calculations, narrative reasoning, and policy adherence... ...no room for fuzzy reasoning. AuraOne uses experienced finance-and-risk professionals...RiskRemote jobHourly payFor contractorsWork experience placement10 hours per week
- ...applications• Experience with giving courtroom testimony required• Risk assessment experience required• Excellent written communication... ...Health & Developmental Services is prohibited from employing or using as volunteers, persons who have been convicted of specific (“...RiskWork experience placementWork at officeLocal areaRemote work
$16 - $20 per hour
...DESCRIPTION AND POSITION REQUIREMENTS The research team at Penn State Ross and Carol Nese... ...of Nursing is hiring part-time research evaluators for projects focused on dementia care in... ...as those concerning alcohol and drug use, crime prevention, the reporting of crimes...SuggestedHourly payPart timeFor contractorsSummer workRemote work$40 - $44 per hour
...to sensitive topics in Italian. You will use Italian language fluency and cultural judgment to evaluate model behavior, identify risks, and support safer responses. No previous... ...judgment when working with sensitive and dual-use information. Preferred Background...RiskRemote jobHourly payImmediate start$61.18k - $99.66k
...Benefits of Working at HHS webpage. Functional Title: Substance Use Program Evaluator Job Title: Program Specialist VI Agency: Health &... ...and external stakeholders to develop evaluation plans and research projects that reflect national standards and best practices...Full timeTemporary workPart timeWork at officeRemote workRelocationShift work$98.21k - $142.37k
...Title: Psychologist III-Forensic Evaluator Job Title: Psychologist... ..., as well as violence risk assessments under 46C. Responsibilities... ...considerable latitude for the use of initiative and independent... ...and current peer-reviewed research. Provides effective expert testimony...RiskFull timeTemporary workPart timeTraineeshipInternshipWork at officeRemote workShift workRotating shift- Health & Human Services Commission in Austin, TX, seeks a Senior Substance Use Program Evaluator to lead evaluations and performance improvement initiatives within the Behavioral Health Services department. This role partners with executives and external stakeholders to...Remote work
- ...with EQT. Website: Linkedin Job Title: Evaluator - Political Science Location: Remote (... ...decisions must be guided towards evaluating the usefulness of the AI response. The primary metric... ...Current: Stay updated with the latest research, guidelines, and advancements in your...Contract workRemote workWorldwide
- Texas Health and Human Services invites applications for the Substance Use Program Evaluator role within the Behavioral Health Services division. This position focuses on evaluating substance use and recovery programs, developing evaluation questions, and translating data...Remote work
$40 - $100 per hour
...language work About AI Training and Scientific Evaluation AI training is the human side of building... ...realistic scenarios, calculations, and research-style reasoning tasks. Focus on... ..., space physics, and data interpretation Use orders of magnitude, unit consistency, limiting...Hourly payContract workPart timeFor contractorsRemote work$390 per month
...Position: Florida Licensed Comprehensive Evaluator Position Description: Emerge... ...Children [TSCC]. · Complete a Suicide Risk Scale/Questionnaire (e.g., Suicide Probability... ...proficiently and on time. · Must be able to use Microsoft Office Word. Must have a...RiskPart timeFor contractorsInternshipWork at officeWork from home- ...services focus on the broad spectrum of Risk Management, Compliance, Business... ...DescriptionProSidian Seeks a Scientific Research and Evaluation Specialist (Glass Scientist) [DOE012212... ...Off (PTO) Benefits: Eligible employees use PTO for vacation, a doctor’s appointment...RiskFull timeContract workTemporary workFor contractorsFor subcontractorWork at officeRemote workFlexible hours
- ...ProSidian services focus on the broad spectrum of Risk Management, Compliance, Business Process,... ...information, strategies, research needs, issue papers, testing protocols, or... ...the past five (5) years, Must be able to use a computer to communicate via email; and proficient...RiskFull timeContract workTemporary workFor contractorsWork experience placementRemote workFlexible hours
- ...focus on the broad spectrum of Risk Management, Compliance,... ...and its alternatives; andReview/evaluate/update studies produced by other... ...Statistical analysis will be used to determine costs and impacts... ...English verbal, written, editing, research, and verbal communication...RiskFull timeContract workTemporary workFor contractorsRemote workFlexible hours
- ...focus on the broad spectrum of Risk Management, Compliance,... ...and its alternatives; andReview/evaluate/update economic studies produced... ...Statistical analysis will be used to determine costs and impacts... ...English verbal, written, editing, research, and verbal communication...RiskContract workFor contractorsRemote work
- ...Clinical Diagnostic Evaluator Easterseals Northern California (ES NorCal) and Easterseals... ...children, youth, and adults who have or are at risk for intellectual and developmental... ...health evaluations, and second opinions using standard diagnostic tools. This role involves...RiskHourly payPart timeWork at officeLocal areaRemote workWork from homeFlexible hours
- ...provides enterprise services/solutions for Risk Management | Compliance | Business... ...DescriptionProSidian Seeks a Scientific Research and Evaluation Specialist (Glass Scientist) [DOE014814... ...(PTO) Benefits: Eligible employees can use PTO for vacations, doctor's appointments...RiskFull timeContract workTemporary workFor contractorsFor subcontractorWork at officeRemote workFlexible hours
$187.18k - $247.25k
...Job Family: Cyber and IT Risk Management Job Qualifications... ...: The Expert-Level Network Evaluator / System Vulnerability Analyst provides advanced technical research, systems analysis, cyber-domain... ...practices and lessons learned using the Joint Lessons Learned Program...RiskFull timeTemporary workImmediate startRemote workWorldwideFlexible hours- ...ProSidian services focus on the broad spectrum of Risk Management, Compliance, Business Process,... ...a DOE - NNSA Subject Matter Expert - Research and Development (TEPSIII31) headquartered... ...-Off (PTO) Benefits: Eligible employees use PTO for vacation, a doctor’s appointment,...RiskFull timeTemporary workFor contractorsWork at officeRemote workFlexible hours
$56.56k - $79.16k
...or personal property for tax evaluation. Appraises personal, residential... ...property at market value using established cost, market and... ...field inspections and other research; Reviews valuations when petitioned... ...regularly involves moderate risks or discomforts associated...RiskFull timeWork experience placementWork at officeRemote workVisa sponsorship- ...and security. Make an impact by using your expertise to protect our... ...The Expert-Level Network Evaluator / System Vulnerability Analyst provides advanced technical research, systems analysis, cyber-domain... ...activity, and CI‑driven HUMINT risk considerations to ensure doctrine...Risk
$155.5k
...Holdings, LLC seeks Senior Vice President, IM Research in Pittsburgh, PA, to coordinate a... ...responsible experience must include: Utilizing risk management frameworks involving Value at... ...issue, leveraging data analysis, and using productivity tools including Excel VBA macros...RiskTemporary workRemote workFlexible hours- ...Enterprise Service Solutions for Risk Management | Compliance | Business... ...communities. This will include evaluating policies, practices, and methodologies used by federal, state, and local agencies... .... Environmental Justice Research: Conduct research on environmental...RiskFor contractorsWork at officeLocal areaRemote workFlexible hours
$56.56k - $79.16k
...or personal property for tax evaluation. Appraises personal, residential... ...property at market value using established cost, market and... ...field inspections and other research; Reviews valuations when petitioned... ...regularly involves moderate risks or discomforts associated...RiskWork experience placementWork at officeRemote workVisa sponsorship$52k - $62.4k
...Hedgeye Risk Management is seeking undergraduate students to join our Summer 2027 Research Internship Program . This program offers the opportunity to gain meaningful, hands... ..., merit and business need. We use E-Verify to confirm the identity and employment...RiskHourly payFull timeTemporary workInternshipSummer internshipWork at officeMonday to Friday$61.9k - $141k
Operations Research AnalystThe Opportunity:As an operations research... ...delivery team, you’ll assist in the evaluation of data assessment strategies... ..., Technical and Safety Risk Management to help deliver sound... ...efficiency.In this role, you’ll use your passion for technology...RiskFull timeContract workPart timeWork at officeLocal areaRemote work$153.3k - $284.7k
...analytical solutions to accelerate timelines, de-risk development, and increase the probability... ...group, which enables the most impactful use of quantitative methodology across PDD... ...05-113292Date posted : 2026-07-16Profession: Research & DevelopmentEmployment type: Full timeRiskFull timeLocal areaRelocation package- ...University Emory University is a leading research university that fosters excellence and... ...DESCRIPTION: The Senior IT GRC (Governance, Risk, and Compliance) Analyst oversees... ...participation in university programs and in the use of facilities without such discrimination....RiskWork experience placementRemote workWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Dual-Use Research Risk Evaluator [Remote]. Be the first to apply!




