Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Biosecurity Risk Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Biosecurity Risk Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.

Why this role matters

Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.

Responsibilities

  • Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Biosecurity Risk Evaluator assignments.
  • Document every successful attack with reproduction steps and the policy clause it violated.
  • Score model defenses across single-turn and multi-turn conversations.
  • Triage emerging attack vectors and route them to the safety team with severity ratings.
  • Maintain a personal library of attack patterns and propose new red-team rubrics.
  • Calibrate against the broader red-team cohort to keep coverage and severity consistent.

Qualifications

  • Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Biosecurity Risk Evaluator work.
  • Strong written communication — your reports become the patch ticket.
  • Comfort working in policy-grey areas with clear documentation of what was attempted and why.
  • Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
  • Score a model's defenses against a known jailbreak pattern across 20 variants.
  • Propose a new red-team rubric category after spotting an emerging attack vector.
  • Reproduce a failure another reviewer reported and confirm the severity tag.

Nice to have

  • Background in offensive security, AppSec, or trust & safety operations.
  • Experience publishing or reproducing public adversarial-ML research.
  • Multilingual fluency for cross-language attack testing.

Skills

  • Adversarial prompting
  • Red-team analysis
  • Policy taxonomy
  • Failure documentation
  • Biosecurity Risk evaluation
  • AI safety
  • Red-team evaluation
  • Policy rubrics
  • Biosecurity

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Biosecurity Risk Evaluator [Remote] in Remote vacancy
  •  ...expert in Quantitative Finance, the full-time Remote AI Research Evaluator will assess AI-generated financial content, craft relevant...  ...such as stochastic modeling, derivatives pricing, econometrics, risk modeling, or computational finance Strong analytical and critical... 
    Risk
    Full time
    Contract work
    Remote work
    Flexible hours

    Virtual Vocations Inc

    United States
    18 hours ago
  •  ...To minimize risk in real estate secured loans, the fully remote California Licensed Commercial Appraiser will manage the valuation request process, review appraisal reports for compliance, and provide guidance to lending and credit risk staff. Key responsibilities Manage... 
    Risk
    Remote work

    Virtual Vocations Inc

    United States
    2 days ago
  •  ...Senior Real Estate Appraiser Bring your expertise to JPMorgan Chase. As part of Risk Management and Compliance, you are at the center of keeping JPMorgan Chase strong and resilient. You help the firm grow its business in a responsible way by anticipating new and emerging... 
    Risk
    Work at office
    Local area
    Remote work

    Chase

    United States
    3 days ago
  •  ...A biosecurity innovation firm seeks a Software Engineer to enhance evaluations of frontier AI systems, focusing on security and misuse risk. In this remote role, you'll manage evaluations for new AI models, ensuring thorough analysis and collaboration with research scientists... 
    Risk
    Remote work

    SecureBio, LLC

    Boston, MA
    4 days ago
  •  ...Privacy Law AI Evaluator is a remote review track for evaluating AI outputs in privacy law workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on it. Why... 
    Risk
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  • $80 - $120 per hour

     ...General finance / accounting Evaluator is a remote review track for evaluating AI outputs across accounting workflows. Reviewers grade...  ...room for fuzzy reasoning. AuraOne uses experienced finance-and-risk professionals to grade AI outputs the way an audit reviewer would... 
    Risk
    Remote job
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    1 day ago
  •  ...Legal Citation AI Evaluator is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on it.... 
    Risk
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  •  ...Terms of Service AI Evaluator is a remote evaluation track for reviewing terms of service ai evaluation prompts and responses against AuraOne...  ...Service AI evaluation Legal reasoning Policy review Risk analysis Terms Service Work model Remote — US-... 
    Risk
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  •  ...Healthcare Compliance AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade...  ...Clinical review Legal reasoning Policy review Risk analysis Healthcare Compliance Work model Remote —... 
    Risk
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    1 day ago
  • $80 - $120 per hour

     ...Special education / IEP Evaluator is a remote review track for evaluating AI outputs across education review workflows. Reviewers grade...  ...correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can... 
    Risk
    Remote job
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  •  ...Position Summary In this remote, hourly contractor role, you will evaluate AI-generated financial content and develop cases that test...  ...-generated responses across banking, insurance, accounting, and risk management for factual accuracy, analytical soundness, and correct... 
    Risk
    Hourly pay
    Full time
    Temporary work
    For contractors
    Remote work

    CNTXT AI

    New York, NY
    8 days ago
  •  ...Position Summary In this remote, hourly contractor role, you will evaluate AI-generated medical content and develop cases that test...  ...discipline ~ Strong clinical reasoning skills: differential diagnosis, risk stratification, red-flag recognition ~ Solid grounding in... 
    Risk
    Hourly pay
    Temporary work
    For contractors
    Remote work

    CNTXT AI

    Miami, FL
    8 days ago
  •  ...Harmful Instruction Refusal Risk Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety... 
    Risk
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    1 day ago
  •  ...Sensitive Advice Boundary Risk Evaluator is a remote evaluation track for reviewing sensitive advice boundary risk evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback... 
    Risk
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  • $55.2k - $126k

    Risk Management Specialist The Opportunity: Program risks including quality delivery and performance are constantly evolving and understanding them can seem overwhelming to defense organizations. The challenge is how can organizations fully understand their risks and... 
    Risk
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work

    Booz Allen Hamilton

    Tampa, FL
    1 day ago
  • $150 per hour

     ...patients per shift ~ Focus on GYN and OB care with prenatal care required ~ Average 375 deliveries per year ~ Mix of low and high risk pregnancy management ~ OB ultrasounds -- performance and interpretation required ~ Hospital privileges required ~ Paid... 
    Risk
    Hourly pay
    Locum
    Shift work

    Weatherby Healthcare

    Elko, NV
    3 hours ago
  •  ...agricultural technology, specializing in biosecurity systems, compliance automation, and...  ...production systems and common biosecurity risks. Strong attention to detail and commitment...  ...Analytical mindset with the ability to evaluate process compliance. Work Schedule &... 
    Risk
    Hourly pay
    Contract work
    Part time
    Remote work
    10 hours per week
    Flexible hours

    Orbit Farm Technologies

    Cedar Rapids, IA
    19 days ago
  •  ...Policy Senior to enhance its Fraud Prevention Team. The role involves developing policies to mitigate fraud loss, overseeing fraud risk management, and ensuring compliance with laws. A strong background in fraud risk and regulatory experience is required, along with analytical... 
    Risk
    Remote work

    USAA

    Tampa, FL
    4 days ago
  • $106.08k - $176.82k

     ...reassignment and escalation processes Ensure ownership aligns with actual work effort and technical domain Resource Coordination & Risk Management Coordinate resource needs across inter-related initiatives Support scope definition and risk assessment for technical... 
    Risk
    Full time
    Temporary work
    Remote work
    Shift work

    Sentara Health

    Virginia Beach, VA
    12 hours ago
  • $140k - $160k

     ...other value-add services. Maverick’s team includes underwriting, risk management, compliance & legal, technology & product development...  ..., process improvements, and cross‑functional analytics. Evaluate emerging Azure services and tooling for platform improvement.... 
    Risk
    Work at office
    Remote work

    Maverick Payments

    Florida
    1 day ago
  • $29 per hour

     ...IL 60025## OverviewSalary Range$26.00 - $35.00 Hourly## Description**JOB SUMMARY** The Safety Specialist reports to the Director of Risk & Special Projects and assists with the overall District-wide safety and risk management program. The Safety Specialist works collaboratively... 
    Risk
    Hourly pay
    Temporary work
    Immediate start
    Monday to Friday
    Afternoon shift

    Glenviewparks

    Glenview, IL
    18 hours ago
  •  ...execute enterprise-wide strategies to minimize shrink and reduce risk through strong operational compliance Partner with field and...  ...policies and mitigate risk across the organization Oversee and evaluate investigations related to internal and external theft, fraud,... 
    Risk
    Local area
    Home office

    Cavender's

    Dallas, TX
    1 day ago
  • $20 per hour

     ...specialized guarding, mobile guarding, remote guarding, and corporate risk management. Securitas is committed to diversity, equity,...  ..., and share information. Vigilance: Seeing, hearing, and evaluating. A Securitas employee is always attentive and often notices... 
    Risk
    Weekly pay
    Full time
    Temporary work
    Local area
    Remote work
    Shift work
    Night shift
    Afternoon shift

    Securitas Security Services

    Florence, KY
    4 days ago
  • $196.75k - $255.7k

     ...VP of Finance with the management of the Finance Committee. Evaluate business processes for effectiveness and efficiency, while delivering...  ...~15+ years of experience in finance, tax, budget management, risk management, and compliance, and debt and capital planning... 
    Risk
    Work at office
    Remote work

    Emerson College

    Boston, MA
    1 day ago
  •  ...locations ~ Coverage at main hospital and satellite hospital ~ Midwife in-house on weekends for support ~ EMR: EPIC ~ High-risk patient management experience required ~ Collaboration with MFM for high-risk case planning ~ We negotiate better pay and deposit... 
    Risk
    Weekly pay
    Full time
    Locum
    Shift work
    Weekend work
    Weekday work

    CompHealth

    Gastonia, NC
    5 days ago
  •  ...Description The Legal Assistant Coordinator is a critical operational and compliance role within the Risk Management and Legal support functions, responsible for adherence to court-mandated deadlines, regulatory requirements, and corporate legal obligations. The position... 
    Risk
    Full time
    Part time
    Work at office
    Remote work
    Work from home
    Relocation
    Monday to Thursday

    Carnival

    Doral, FL
    4 days ago
  • $9 - $30 per hour

    ALTA Language Services, Inc. is looking for a remote Testing Evaluator in Atlanta, GA. This part-time position involves assisting with language proficiency examinations and evaluating tests according to set criteria. Candidates should have strong communication skills, professionalism... 
    Part time
    Remote work

    ALTA Language Services

    Atlanta, GA
    4 days ago
  • $194k - $276.75k

     .... The AGC leads a team of two direct reports and supports broader corporate legal initiatives including contract review, enterprise risk management, and compliance programs. This role reports to the Vice President, Deputy General Counsel. Key Responsibilities Employment... 
    Risk
    Contract work
    Work at office
    Local area
    Remote work
    Monday to Friday

    BJ's Wholesale Club

    Marlborough, MA
    3 days ago
  • $40 per hour

    A leading data annotation service is seeking a Biology Expert to train AI models. The role involves measuring AI progress, evaluating chatbot outputs, and ensuring quality improvement. Ideal candidates will have a strong background in biology or biochemistry. This independent... 
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    DataAnnotation

    Iowa, LA
    4 days ago
  •  ...Blueprint Technologies, LLC. is seeking a detail-oriented Labeler / Annotator to evaluate AI responses in French. This remote role focuses on side-by-side evaluation across real-world scenarios, not translation, requiring strong judgment and attention to detail. You... 
    Remote work

    Blueprint Consulting Services

    Bellevue, WA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Biosecurity Risk Evaluator [Remote]. Be the first to apply!