Dual-Use Research Risk Evaluator [Remote]
AuraOne Human Data
- Remote job
Dual-Use Research Risk Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.
Why this role matters
Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.
Responsibilities
- Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Dual-Use Research Risk Evaluator assignments.
- Document every successful attack with reproduction steps and the policy clause it violated.
- Score model defenses across single-turn and multi-turn conversations.
- Triage emerging attack vectors and route them to the safety team with severity ratings.
- Maintain a personal library of attack patterns and propose new red-team rubrics.
- Calibrate against the broader red-team cohort to keep coverage and severity consistent.
Qualifications
- Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Dual-Use Research Risk Evaluator work.
- Strong written communication — your reports become the patch ticket.
- Comfort working in policy-grey areas with clear documentation of what was attempted and why.
- Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
- Score a model's defenses against a known jailbreak pattern across 20 variants.
- Propose a new red-team rubric category after spotting an emerging attack vector.
- Reproduce a failure another reviewer reported and confirm the severity tag.
Nice to have
- Background in offensive security, AppSec, or trust & safety operations.
- Experience publishing or reproducing public adversarial-ML research.
- Multilingual fluency for cross-language attack testing.
Skills
- Adversarial prompting
- Red-team analysis
- Policy taxonomy
- Failure documentation
- Dual Use Research Risk evaluation
- AI safety
- Red-team evaluation
- Policy rubrics
- Dual
- Research
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
- ...-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content, craft relevant questions... ...as stochastic modeling, derivatives pricing, econometrics, risk modeling, or computational finance Strong analytical and...RiskFull timeContract workRemote workFlexible hours
- ...Litigation and Legal Research AI Evaluator is a remote review track for evaluating AI outputs in litigation... ...reasoning, and policy adherence; flag risk; and document the corrected analysis so... ...is judged on precision. AuraOne uses qualified legal and policy reviewers to...RiskRemote jobHourly payFor contractors10 hours per week
- ...Equity Research AI Evaluator is a remote review track for evaluating AI outputs across finance and risk workflows. Reviewers grade calculations, narrative reasoning, and policy adherence... ...no room for fuzzy reasoning. AuraOne uses experienced finance-and-risk professionals...RiskRemote jobHourly payFor contractorsWork experience placement10 hours per week
- ...applications• Experience with giving courtroom testimony required• Risk assessment experience required• Excellent written communication... ...Health & Developmental Services is prohibited from employing or using as volunteers, persons who have been convicted of specific (“...RiskWork experience placementWork at officeLocal areaRemote work
$81.7k - $135k
...Tax - Indirect Tax - Sales and Use Lookback Review COE - Senior... ...complex issues requiring in-depth evaluation. Provide general guidance... ...role or at a lower level. Research our clients’ business operations... ...overpayment opportunities or risks and communicating these to our...RiskSummer holidayImmediate startFlexible hours$16 - $20 per hour
...DESCRIPTION AND POSITION REQUIREMENTS The research team at Penn State Ross and Carol Nese... ...of Nursing is hiring part‑time research evaluators for projects focused on dementia care in... ...protected veteran status. If you are unable to use our online application process due to an...Hourly payPart timeSummer work- Dual General Manager - Hilton Garden Inn & Homewood Suites Montgomery Flynn Hospitality... ...and industry organizations. Property & Risk Management * Ensure both properties... ...Financially disciplined and comfortable using data to make operating decisions. * Highly...RiskFull timeLocal areaRelocation package
$9.1k - $11.86k
...Title:Psychologist III Forensic Evaluator Job Title:Psychologist III... ...evaluations, as well as violence risk assessments under 46C.... ...considerable latitude for the use of initiative and independent... ...practices and current peer-reviewed research. Provides effective expert testimony...RiskFull timeTemporary workPart timeTraineeshipInternshipWork at officeRemote workShift workRotating shift$100 - $125 per hour
...workflows into structured tasks for AI systems Evaluate AI-generated outputs for accuracy, logical... ..., and business relevance Work on use cases including underwriting, claims, actuarial... ..., hands-on experience as an Underwriter, Risk Specialist, or Actuary. Strong...RiskRemote jobHourly payFor contractorsFreelanceWork at officeImmediate startFlexible hours- ...with EQT. Website: Linkedin Job Title: Evaluator - Political Science Location: Remote (... ...decisions must be guided towards evaluating the usefulness of the AI response. The primary metric... ...Current: Stay updated with the latest research, guidelines, and advancements in your...Contract workRemote workWorldwide
$5,000 - $6,999 per month
Career Opportunities: Substance Use Program Evaluator (20388) Posting ID: 20388 - Posted: 08/21/2026 - Health & Human Services Comm - BHS Quality... ...and external stakeholders to develop evaluation plans and research projects that reflect national standards and best practices...Full timeTemporary workPart timeWork at officeRemote workRelocationShift work- ...ProSidian services focus on the broad spectrum of Risk Management, Compliance, Business Process,... ...information, strategies, research needs, issue papers, testing protocols, or... ...the past five (5) years, Must be able to use a computer to communicate via email; and proficient...RiskFull timeContract workTemporary workFor contractorsWork experience placementRemote workFlexible hours
- ...services focus on the broad spectrum of Risk Management, Compliance, Business... ...DescriptionProSidian Seeks a Scientific Research and Evaluation Specialist (Glass Scientist) [DOE012212... ...Off (PTO) Benefits: Eligible employees use PTO for vacation, a doctor’s appointment...RiskFull timeContract workTemporary workFor contractorsFor subcontractorWork at officeRemote workFlexible hours
- ...Appraiser Bring your expertise to JPMorgan Chase. As part of Risk Management and Compliance, you are at the center of keeping JPMorgan... ...a responsible way by anticipating new and emerging risks, and using your expert judgement to solve real-world challenges that impact...RiskWork at officeLocal areaRemote work
- ...focus on the broad spectrum of Risk Management, Compliance,... ...and its alternatives; andReview/evaluate/update studies produced by other... ...Statistical analysis will be used to determine costs and impacts... ...English verbal, written, editing, research, and verbal communication...RiskFull timeContract workTemporary workFor contractorsRemote workFlexible hours
- ...focus on the broad spectrum of Risk Management, Compliance,... ...and its alternatives; andReview/evaluate/update economic studies produced... ...Statistical analysis will be used to determine costs and impacts... ...English verbal, written, editing, research, and verbal communication...RiskContract workFor contractorsRemote work
- ...provides enterprise services/solutions for Risk Management | Compliance | Business... ...DescriptionProSidian Seeks a Scientific Research and Evaluation Specialist (Glass Scientist) [DOE014814... ...(PTO) Benefits: Eligible employees can use PTO for vacations, doctor's appointments...RiskFull timeContract workTemporary workFor contractorsFor subcontractorWork at officeRemote workFlexible hours
- ...ProSidian services focus on the broad spectrum of Risk Management, Compliance, Business Process,... ...a DOE - NNSA Subject Matter Expert - Research and Development (TEPSIII31) headquartered... ...-Off (PTO) Benefits: Eligible employees use PTO for vacation, a doctor’s appointment,...RiskFull timeTemporary workFor contractorsWork at officeRemote workFlexible hours
- ...Role: Legal Research Assistant Location: Shelbyville, KY Area Type: Contract / Onsite... ...organization with a collaborative risk and compliance team supporting business operations... .... • Perform background searches using research databases. • Review information...RiskContract workWork at office
- ...Clinical Diagnostic Evaluator Easterseals Northern California (ES NorCal) and Easterseals... ...children, youth, and adults who have or are at risk for intellectual and developmental... ...health evaluations, and second opinions using standard diagnostic tools. This role involves...RiskHourly payPart timeWork at officeLocal areaRemote workWork from homeFlexible hours
$155.5k
...Holdings, LLC seeks Senior Vice President, IM Research in Pittsburgh, PA, to coordinate a... ...responsible experience must include: Utilizing risk management frameworks involving Value at... ...issue, leveraging data analysis, and using productivity tools including Excel VBA macros...RiskTemporary workRemote workFlexible hours$153.3k - $284.7k
...analytical solutions to accelerate timelines, de-risk development, and increase the probability... ...group, which enables the most impactful use of quantitative methodology across PDD... ...05-113292Date posted : 2026-07-16Profession: Research & DevelopmentEmployment type: Full timeRiskFull timeLocal areaRelocation package$97.5k - $127.5k
...every day.Smartsheet's horizontal use cases — spanning Enterprise... ...Delivery, and Governance, Risk & Compliance — represent the company... ...: Contribute to competitive research and differentiation for... ...positioning that assists Sales during evaluations.Sales-Ready Content Suite:...RiskFull timeTemporary workWork at officeLocal areaRemote work$225.6k - $338.4k
...driving trade-offs across quality, risk, cost, scalability, and time-... ..., including application of evaluation, monitoring, model risk... ...lead a domain-level Applied AI research and innovation agenda, balancing... ...across a diverse portfolio of use cases.Strong judgment navigating...RiskFull timeTemporary workWork at officeRemote work3 days per week- ...University Emory University is a leading research university that fosters excellence and... ...DESCRIPTION: The Senior IT GRC (Governance, Risk, and Compliance) Analyst oversees... ...participation in university programs and in the use of facilities without such discrimination....RiskWork experience placementRemote workWork from homeFlexible hours
- ...internal clients and our team.The Research Operations Specialist, know... ...research contracts, including evaluating renewal needs, periodically... ...compliance, consistency, and effective risk management. Regularly review... ...and external tools/platforms used to support both research and...RiskFull timeContract workWork experience placementH1bWork at officeRemote workVisa sponsorshipRelocation packageMonday to Friday
$130k - $150k
## Director, Value and Risk AdvisoryApplyremote type: On-sitelocations: San Francisco, CA: Los Angeles, CA: Salt Lake City, UTtime type... ...experienced, licensed, qualified commercial real estate appraisers who use local insights and their years of expertise to deliver accurate,...RiskTemporary workLocal area$118k - $197k
...functional partners (including Global Research and Development (R&D), Sales and Marketing... ...regulatory viewpoint and providing risk/benefit evaluations to guide project strategy.Act as the... ...other legally protected statusElanco may use automated tools, including AI, to...RiskFull timeSummer workLocal areaRemote workRelocationFlexible hours$19 - $21 per hour
...Description We are seeking a motivated and experienced MID Intake Evaluator to join our organization! The MID Intake Evaluator will work... ...as the nicotine assessment, Tuberculosis screening, and health risk assessment. 3. Complete court evaluations letters during...RiskHourly payFull timeLocal areaRemote workTrial period- ...as a key business partner through our Castle High Value and EXL Risk Control service offerings. We offer a variety of field appraisal,... ...-based and virtual High Value Home property surveys that will be used for homeowners' insurance purposes. This involves coordinating and...RiskFor contractorsWork at officeWork from home
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Dual-Use Research Risk Evaluator [Remote]. Be the first to apply!



