Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Dual-Use Research Risk Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Dual-Use Research Risk Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.

Why this role matters

Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.

Responsibilities

  • Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Dual-Use Research Risk Evaluator assignments.
  • Document every successful attack with reproduction steps and the policy clause it violated.
  • Score model defenses across single-turn and multi-turn conversations.
  • Triage emerging attack vectors and route them to the safety team with severity ratings.
  • Maintain a personal library of attack patterns and propose new red-team rubrics.
  • Calibrate against the broader red-team cohort to keep coverage and severity consistent.

Qualifications

  • Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Dual-Use Research Risk Evaluator work.
  • Strong written communication — your reports become the patch ticket.
  • Comfort working in policy-grey areas with clear documentation of what was attempted and why.
  • Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
  • Score a model's defenses against a known jailbreak pattern across 20 variants.
  • Propose a new red-team rubric category after spotting an emerging attack vector.
  • Reproduce a failure another reviewer reported and confirm the severity tag.

Nice to have

  • Background in offensive security, AppSec, or trust & safety operations.
  • Experience publishing or reproducing public adversarial-ML research.
  • Multilingual fluency for cross-language attack testing.

Skills

  • Adversarial prompting
  • Red-team analysis
  • Policy taxonomy
  • Failure documentation
  • Dual Use Research Risk evaluation
  • AI safety
  • Red-team evaluation
  • Policy rubrics
  • Dual
  • Research

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Dual-Use Research Risk Evaluator [Remote] in Remote vacancy
  •  ...level expert in Quantitative Finance, the full-time Remote AI Research Evaluator will assess AI-generated financial content, craft relevant...  ...such as stochastic modeling, derivatives pricing, econometrics, risk modeling, or computational finance Strong analytical and... 
    Risk
    Full time
    Contract work
    Remote work
    Flexible hours

    Virtual Vocations Inc

    United States
    11 hours ago
  •  ...Government Policy and Legislative Research Evaluator is a remote review track for evaluating AI outputs...  ...reasoning, and policy adherence; flag risk; and document the corrected analysis so...  ...content is judged on precision. AuraOne uses qualified legal and policy reviewers to... 
    Risk
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    1 day ago
  •  ...Equity Research AI Evaluator is a remote review track for evaluating AI outputs across finance and risk workflows. Reviewers grade calculations, narrative reasoning, and policy adherence...  ...no room for fuzzy reasoning. AuraOne uses experienced finance-and-risk professionals... 
    Risk
    Remote job
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  • $81.7k - $135k

     ...Tax - Indirect Tax - Sales and Use Lookback Review COE - Senior...  ...complex issues requiring in-depth evaluation. Provide general guidance...  ...role or at a lower level. Research our clients’ business operations...  ...overpayment opportunities or risks and communicating these to our... 
    Risk
    Summer holiday
    Immediate start
    Flexible hours

    EY

    Columbus, OH
    2 days ago
  • $16 - $20 per hour

     ...DESCRIPTION AND POSITION REQUIREMENTS The research team at Penn State Ross and Carol Nese...  ...of Nursing is hiring part‑time research evaluators for projects focused on dementia care in...  ...protected veteran status. If you are unable to use our online application process due to an... 
    Suggested
    Hourly pay
    Part time
    Summer work

    The Pennsylvania State University

    Hershey, PA
    4 days ago
  • $112k - $120k

    Senior Community Manager (Dual Site) Job Locations US-CA-San Francisco | US-CA-Northern...  ...manager; identifies actual or potential risk management issues. * Reads, follows, and...  ...should have knowledge of operations software used at the property level; Outlook, Internet... 
    Risk
    Full time
    Contract work
    For contractors
    Monday to Friday

    Sares- Regis Group

    Foster, CA
    1 day ago
  •  ...transactions, financings, and corporate risk management. This role is ideal...  ...Permitting and land use approvals Site remediation and...  ...chemical regulations Excellent legal research, writing, and project...  ...Connecticut Bar admission required Dual admission in New York and/or... 
    Risk
    Local area
    Remote work
    2 days per week

    Direct Counsel

    Boston, MA
    2 days ago
  •  ...with EQT. Website: Linkedin Job Title: Evaluator - Political Science Location: Remote (...  ...decisions must be guided towards evaluating the usefulness of the AI response. The primary metric...  ...Current: Stay updated with the latest research, guidelines, and advancements in your... 
    Contract work
    Remote work
    Worldwide

    Straive

    New York, NY
    2 days ago
  •  ...focus on the broad spectrum of Risk Management, Compliance,...  ...its alternatives; and Review/evaluate/update economic studies produced...  ...Statistical analysis will be used to determine costs and impacts...  ...English verbal, written, editing, research, and verbal communication... 
    Risk
    Contract work
    For contractors
    Remote work

    ProSidian Consulting

    United States
    1 day ago
  •  ...Appraiser Bring your expertise to JPMorgan Chase. As part of Risk Management and Compliance, you are at the center of keeping JPMorgan...  ...a responsible way by anticipating new and emerging risks, and using your expert judgement to solve real-world challenges that impact... 
    Risk
    Work at office
    Local area
    Remote work

    Chase

    United States
    3 days ago
  •  ...establish the project deliverables using requirements gathering...  ...communications plan. ~Manage project risks through facilitating pro-...  ...issues lists and new product evaluations. ~Contribute to employee...  ..., Multitasking, Organizing, Research Regulatory Environment,... 
    Risk
    Full time
    Contract work
    Part time

    Geisinger

    Remote
    1 day ago
  •  ...application information. The email address used in establishing your account will be used...  ...accuracy, speed, problem resolution, risk mitigation, and personalized engagement.*...  ..., and directing client traffic.* Perform research, special projects, and other duties as assigned... 
    Risk
    Full time
    Work at office
    Local area
    Night shift
    Afternoon shift

    Hancock Whitney

    Houma, LA
    11 hours ago
  •  ...Enterprise Service Solutions for Risk Management | Compliance | Business...  ...communities. This will include evaluating policies, practices, and methodologies used by federal, state, and local agencies...  .... Environmental Justice Research: Conduct research on environmental... 
    Risk
    For contractors
    Work at office
    Local area
    Remote work
    Flexible hours

    ProSidian Consulting

    United States
    1 day ago
  •  ...product decisions, process flows, and compensation plans YOU BRING Strong analytical, problem-solving, and research skills High proficiency in using technology, including software, apps, and databases Ability to work independently and rely on your own... 
    Full time
    Traineeship
    Remote work
    Long distance

    True Footage

    New York, NY
    2 days ago
  • $80 - $120 per hour

     ...Education / school Evaluator is a remote review track for evaluating AI outputs across education...  ..., and stakeholder fit; flag operational risk; and document the right next step so the...  ...fit into an actual day at work. AuraOne uses experienced operators to grade outputs... 
    Risk
    Remote job
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  •  ...Patent Claim AI Evaluator is a remote review track for evaluating AI...  ...reasoning, and policy adherence; flag risk; and document the corrected...  ...judged on precision. AuraOne uses qualified legal and policy...  ...experience reviewing AI-assisted legal-research or compliance tooling.... 
    Risk
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  • $28.8 - $47.21 per hour

     ...liability litigation cases (e.g. case work, research, discovery responses, subpoenas, etc.). At...  .... Zurich North America is a leader in risk management, with over 150 years of expertise...  ...CVs from agencies. Preferred vendors should use our Recruiting Agency Portal. Location(s):... 
    Risk
    Hourly pay
    Full time
    Temporary work
    Currently hiring
    Work at office
    Local area
    Remote work
    Visa sponsorship

    Zurich 56 Company Ltd

    Dallas, TX
    3 days ago
  • $112.8k - $147.5k

     ...organizations understand and manage commercial data risks, shape their digital signatures, and...  ...and maintain comprehensive project plans using tools such as Jira Roadmaps, Gantt charts,...  ...management credential. Experience in dual-track product and delivery project management... 
    Risk
    Full time
    Contract work
    Work at office
    Remote work
    Flexible hours

    Veilant

    United States
    3 days ago
  •  ...Self-Harm Safety Risk Evaluator is a remote evaluation track for reviewing self harm safety risk evaluation prompts and responses against...  ...and write the kind of structured feedback the modeling team can use to retrain. Why this role matters AI data reviewers help turn... 
    Risk
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  •  ...Healthcare Compliance AI Evaluator is a remote clinical-review track for evaluating AI outputs...  ...matters Clinical review AI is only useful if a credentialed clinician would sign their...  ...Legal reasoning Policy review Risk analysis Healthcare Compliance Work... 
    Risk
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    1 day ago
  • $26.15 - $43.58 per hour

     ...Hart LLP as a Legal Conflicts Researcher. Challenging and engaging...  ...supporting the department’s risk management function by ensuring...  ...the firm and its attorneys, using a variety of electronic resources...  ...conflicts software. Evaluates and makes decisions relating... 
    Risk
    Hourly pay
    Full time
    Part time
    Work at office
    Remote work
    Flexible hours
    Afternoon shift
    2 days per week
    3 days per week

    Holland & Hart LLP

    Anchorage, AK
    3 days ago
  •  ...remote, hourly contractor role, you will evaluate AI-generated medical content and develop...  ...medical content against reliable sources using consistent reasoning Profile Requirements...  ...skills: differential diagnosis, risk stratification, red-flag recognition ~... 
    Risk
    Hourly pay
    Temporary work
    For contractors
    Remote work

    CNTXT AI

    Miami, FL
    7 days ago
  •  ...Sensitive Advice Boundary Risk Evaluator is a remote evaluation track for reviewing sensitive advice boundary risk evaluation prompts and...  ...and write the kind of structured feedback the modeling team can use to retrain. Why this role matters AI data reviewers help turn... 
    Risk
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  •  ...a Senior Quantitative Analyst in Baltimore, MD to conduct research into energy products, including renewables, battery and other...  ...green energy products; develop new models for pricing and risk evaluation using advanced knowledge and skills including mathematical modeling... 
    Risk
    Permanent employment
    Remote work

    Association for Financial Professionals

    Baltimore, MD
    2 days ago
  • $105.1k - $192.6k

     ...Tax Manager - Indirect Tax - Sales and Use Location: Atlanta Other locations: Anywhere in Country Requisition...  ...insights. Identify potential opportunities and risks and communicate these to our clients. Learn and research current market trends, to maintain your... 
    Risk
    Summer holiday
    Flexible hours

    Ernst & Young Advisory Services Sdn Bhd

    Atlanta, GA
    1 day ago
  • $113k - $197.7k

    Role Description The LTSS and Dual Eligible Program Manager is responsible for managing large...  ...and budget ~Identify, log, and manage risk, implement mitigation strategies,...  ...program issues, hindrances, and blockers using company best practices ~Responsible for... 
    Risk
    Full time
    Work experience placement
    Work at office

    CareSource

    Remote
    17 days ago
  • $105.1k - $192.6k

     ...Tax - Indirect Tax - Sales & Use Lookback Review COE - Manager Location: Anywhere in...  ...to guide others toward quality solutions. Research our clients’ business operations and build...  ...Identify potential overpayment opportunities or risks and communicate these to our clients.... 
    Risk
    Summer holiday
    Flexible hours

    EY

    San Jose, CA
    3 days ago
  •  ...providing in depth analysis on the overall risk management and financial solvency for the...  ...ideates process improvements, researches, and recommends changes to actuarial processes...  ...constituents. Performs data exploration using a combination of statistical programming... 
    Risk
    Work at office
    Remote work

    Univera Healthcare

    Buffalo, NY
    11 hours ago
  •  ...leadership to develop reports that track risk, operational performance, compliance, and...  ...reporting requirements into technical solutions using SQL and Power BI. Oversee and manage...  ...ensuring timely and accurate completion. Research and analyze key business requirements... 
    Risk
    Full time
    Local area
    Remote work

    Oceanview Life and Annuity

    Fort Lauderdale, FL
    4 days ago
  •  ...supports the credit union’s balance sheet risk management, financial analysis, forecasting...  ...‑party vendors, and internal sources for use in balance sheet risk management, forecasting...  ...monitoring, related accounting entries, research of alternatives, and recommendations as... 
    Risk

    Georgia United Credit Union

    Duluth, GA
    11 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Dual-Use Research Risk Evaluator [Remote]. Be the first to apply!