Dual-Use Research Risk Evaluator [Remote]
AuraOne Human Data
- Remote job
Dual-Use Research Risk Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.
Why this role matters
Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.
Responsibilities
- Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Dual-Use Research Risk Evaluator assignments.
- Document every successful attack with reproduction steps and the policy clause it violated.
- Score model defenses across single-turn and multi-turn conversations.
- Triage emerging attack vectors and route them to the safety team with severity ratings.
- Maintain a personal library of attack patterns and propose new red-team rubrics.
- Calibrate against the broader red-team cohort to keep coverage and severity consistent.
Qualifications
- Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Dual-Use Research Risk Evaluator work.
- Strong written communication — your reports become the patch ticket.
- Comfort working in policy-grey areas with clear documentation of what was attempted and why.
- Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
- Score a model's defenses against a known jailbreak pattern across 20 variants.
- Propose a new red-team rubric category after spotting an emerging attack vector.
- Reproduce a failure another reviewer reported and confirm the severity tag.
Nice to have
- Background in offensive security, AppSec, or trust & safety operations.
- Experience publishing or reproducing public adversarial-ML research.
- Multilingual fluency for cross-language attack testing.
Skills
- Adversarial prompting
- Red-team analysis
- Policy taxonomy
- Failure documentation
- Dual Use Research Risk evaluation
- AI safety
- Red-team evaluation
- Policy rubrics
- Dual
- Research
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
- ...level expert in Quantitative Finance, the full-time Remote AI Research Evaluator will assess AI-generated financial content, craft relevant... ...such as stochastic modeling, derivatives pricing, econometrics, risk modeling, or computational finance Strong analytical and...RiskFull timeContract workRemote workFlexible hours
- ...Government Policy and Legislative Research Evaluator is a remote review track for evaluating AI outputs... ...reasoning, and policy adherence; flag risk; and document the corrected analysis so... ...content is judged on precision. AuraOne uses qualified legal and policy reviewers to...RiskRemote jobHourly payFor contractors10 hours per week
- ...Equity Research AI Evaluator is a remote review track for evaluating AI outputs across finance and risk workflows. Reviewers grade calculations, narrative reasoning, and policy adherence... ...no room for fuzzy reasoning. AuraOne uses experienced finance-and-risk professionals...RiskRemote jobHourly payFor contractorsWork experience placement10 hours per week
$81.7k - $135k
...Tax - Indirect Tax - Sales and Use Lookback Review COE - Senior... ...complex issues requiring in-depth evaluation. Provide general guidance... ...role or at a lower level. Research our clients’ business operations... ...overpayment opportunities or risks and communicating these to our...RiskSummer holidayImmediate startFlexible hours$16 - $20 per hour
...DESCRIPTION AND POSITION REQUIREMENTS The research team at Penn State Ross and Carol Nese... ...of Nursing is hiring part‑time research evaluators for projects focused on dementia care in... ...protected veteran status. If you are unable to use our online application process due to an...SuggestedHourly payPart timeSummer work$112k - $120k
Senior Community Manager (Dual Site) Job Locations US-CA-San Francisco | US-CA-Northern... ...manager; identifies actual or potential risk management issues. * Reads, follows, and... ...should have knowledge of operations software used at the property level; Outlook, Internet...RiskFull timeContract workFor contractorsMonday to Friday- ...transactions, financings, and corporate risk management. This role is ideal... ...Permitting and land use approvals Site remediation and... ...chemical regulations Excellent legal research, writing, and project... ...Connecticut Bar admission required Dual admission in New York and/or...RiskLocal areaRemote work2 days per week
- ...with EQT. Website: Linkedin Job Title: Evaluator - Political Science Location: Remote (... ...decisions must be guided towards evaluating the usefulness of the AI response. The primary metric... ...Current: Stay updated with the latest research, guidelines, and advancements in your...Contract workRemote workWorldwide
- ...focus on the broad spectrum of Risk Management, Compliance,... ...its alternatives; and Review/evaluate/update economic studies produced... ...Statistical analysis will be used to determine costs and impacts... ...English verbal, written, editing, research, and verbal communication...RiskContract workFor contractorsRemote work
- ...Appraiser Bring your expertise to JPMorgan Chase. As part of Risk Management and Compliance, you are at the center of keeping JPMorgan... ...a responsible way by anticipating new and emerging risks, and using your expert judgement to solve real-world challenges that impact...RiskWork at officeLocal areaRemote work
- ...establish the project deliverables using requirements gathering... ...communications plan. ~Manage project risks through facilitating pro-... ...issues lists and new product evaluations. ~Contribute to employee... ..., Multitasking, Organizing, Research Regulatory Environment,...RiskFull timeContract workPart time
- ...application information. The email address used in establishing your account will be used... ...accuracy, speed, problem resolution, risk mitigation, and personalized engagement.*... ..., and directing client traffic.* Perform research, special projects, and other duties as assigned...RiskFull timeWork at officeLocal areaNight shiftAfternoon shift
- ...Enterprise Service Solutions for Risk Management | Compliance | Business... ...communities. This will include evaluating policies, practices, and methodologies used by federal, state, and local agencies... .... Environmental Justice Research: Conduct research on environmental...RiskFor contractorsWork at officeLocal areaRemote workFlexible hours
- ...product decisions, process flows, and compensation plans YOU BRING Strong analytical, problem-solving, and research skills High proficiency in using technology, including software, apps, and databases Ability to work independently and rely on your own...Full timeTraineeshipRemote workLong distance
$80 - $120 per hour
...Education / school Evaluator is a remote review track for evaluating AI outputs across education... ..., and stakeholder fit; flag operational risk; and document the right next step so the... ...fit into an actual day at work. AuraOne uses experienced operators to grade outputs...RiskRemote jobFor contractorsWork experience placement10 hours per week- ...Patent Claim AI Evaluator is a remote review track for evaluating AI... ...reasoning, and policy adherence; flag risk; and document the corrected... ...judged on precision. AuraOne uses qualified legal and policy... ...experience reviewing AI-assisted legal-research or compliance tooling....RiskRemote jobHourly payFor contractors10 hours per week
$28.8 - $47.21 per hour
...liability litigation cases (e.g. case work, research, discovery responses, subpoenas, etc.). At... .... Zurich North America is a leader in risk management, with over 150 years of expertise... ...CVs from agencies. Preferred vendors should use our Recruiting Agency Portal. Location(s):...RiskHourly payFull timeTemporary workCurrently hiringWork at officeLocal areaRemote workVisa sponsorship$112.8k - $147.5k
...organizations understand and manage commercial data risks, shape their digital signatures, and... ...and maintain comprehensive project plans using tools such as Jira Roadmaps, Gantt charts,... ...management credential. Experience in dual-track product and delivery project management...RiskFull timeContract workWork at officeRemote workFlexible hours- ...Self-Harm Safety Risk Evaluator is a remote evaluation track for reviewing self harm safety risk evaluation prompts and responses against... ...and write the kind of structured feedback the modeling team can use to retrain. Why this role matters AI data reviewers help turn...RiskRemote jobHourly payFor contractors10 hours per week
- ...Healthcare Compliance AI Evaluator is a remote clinical-review track for evaluating AI outputs... ...matters Clinical review AI is only useful if a credentialed clinician would sign their... ...Legal reasoning Policy review Risk analysis Healthcare Compliance Work...RiskRemote jobHourly payFor contractors10 hours per week
$26.15 - $43.58 per hour
...Hart LLP as a Legal Conflicts Researcher. Challenging and engaging... ...supporting the department’s risk management function by ensuring... ...the firm and its attorneys, using a variety of electronic resources... ...conflicts software. Evaluates and makes decisions relating...RiskHourly payFull timePart timeWork at officeRemote workFlexible hoursAfternoon shift2 days per week3 days per week- ...remote, hourly contractor role, you will evaluate AI-generated medical content and develop... ...medical content against reliable sources using consistent reasoning Profile Requirements... ...skills: differential diagnosis, risk stratification, red-flag recognition ~...RiskHourly payTemporary workFor contractorsRemote work
- ...Sensitive Advice Boundary Risk Evaluator is a remote evaluation track for reviewing sensitive advice boundary risk evaluation prompts and... ...and write the kind of structured feedback the modeling team can use to retrain. Why this role matters AI data reviewers help turn...RiskRemote jobHourly payFor contractors10 hours per week
- ...a Senior Quantitative Analyst in Baltimore, MD to conduct research into energy products, including renewables, battery and other... ...green energy products; develop new models for pricing and risk evaluation using advanced knowledge and skills including mathematical modeling...RiskPermanent employmentRemote work
$105.1k - $192.6k
...Tax Manager - Indirect Tax - Sales and Use Location: Atlanta Other locations: Anywhere in Country Requisition... ...insights. Identify potential opportunities and risks and communicate these to our clients. Learn and research current market trends, to maintain your...RiskSummer holidayFlexible hours$113k - $197.7k
Role Description The LTSS and Dual Eligible Program Manager is responsible for managing large... ...and budget ~Identify, log, and manage risk, implement mitigation strategies,... ...program issues, hindrances, and blockers using company best practices ~Responsible for...RiskFull timeWork experience placementWork at office$105.1k - $192.6k
...Tax - Indirect Tax - Sales & Use Lookback Review COE - Manager Location: Anywhere in... ...to guide others toward quality solutions. Research our clients’ business operations and build... ...Identify potential overpayment opportunities or risks and communicate these to our clients....RiskSummer holidayFlexible hours- ...providing in depth analysis on the overall risk management and financial solvency for the... ...ideates process improvements, researches, and recommends changes to actuarial processes... ...constituents. Performs data exploration using a combination of statistical programming...RiskWork at officeRemote work
- ...leadership to develop reports that track risk, operational performance, compliance, and... ...reporting requirements into technical solutions using SQL and Power BI. Oversee and manage... ...ensuring timely and accurate completion. Research and analyze key business requirements...RiskFull timeLocal areaRemote work
- ...supports the credit union’s balance sheet risk management, financial analysis, forecasting... ...‑party vendors, and internal sources for use in balance sheet risk management, forecasting... ...monitoring, related accounting entries, research of alternatives, and recommendations as...Risk
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Dual-Use Research Risk Evaluator [Remote]. Be the first to apply!



