Biosecurity Risk Evaluator [Remote]
AuraOne Human Data
- Remote job
Biosecurity Risk Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.
Why this role matters
Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.
Responsibilities
- Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Biosecurity Risk Evaluator assignments.
- Document every successful attack with reproduction steps and the policy clause it violated.
- Score model defenses across single-turn and multi-turn conversations.
- Triage emerging attack vectors and route them to the safety team with severity ratings.
- Maintain a personal library of attack patterns and propose new red-team rubrics.
- Calibrate against the broader red-team cohort to keep coverage and severity consistent.
Qualifications
- Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Biosecurity Risk Evaluator work.
- Strong written communication — your reports become the patch ticket.
- Comfort working in policy-grey areas with clear documentation of what was attempted and why.
- Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
- Score a model's defenses against a known jailbreak pattern across 20 variants.
- Propose a new red-team rubric category after spotting an emerging attack vector.
- Reproduce a failure another reviewer reported and confirm the severity tag.
Nice to have
- Background in offensive security, AppSec, or trust & safety operations.
- Experience publishing or reproducing public adversarial-ML research.
- Multilingual fluency for cross-language attack testing.
Skills
- Adversarial prompting
- Red-team analysis
- Policy taxonomy
- Failure documentation
- Biosecurity Risk evaluation
- AI safety
- Red-team evaluation
- Policy rubrics
- Biosecurity
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
- ...expert in Quantitative Finance, the full-time Remote AI Research Evaluator will assess AI-generated financial content, craft relevant... ...such as stochastic modeling, derivatives pricing, econometrics, risk modeling, or computational finance Strong analytical and critical...RiskFull timeContract workRemote workFlexible hours
- ...To minimize risk in real estate secured loans, the fully remote California Licensed Commercial Appraiser will manage the valuation request process, review appraisal reports for compliance, and provide guidance to lending and credit risk staff. Key responsibilities Manage...RiskRemote work
- ...Senior Real Estate Appraiser Bring your expertise to JPMorgan Chase. As part of Risk Management and Compliance, you are at the center of keeping JPMorgan Chase strong and resilient. You help the firm grow its business in a responsible way by anticipating new and emerging...RiskWork at officeLocal areaRemote work
- ...A biosecurity innovation firm seeks a Software Engineer to enhance evaluations of frontier AI systems, focusing on security and misuse risk. In this remote role, you'll manage evaluations for new AI models, ensuring thorough analysis and collaboration with research scientists...RiskRemote work
- ...Privacy Law AI Evaluator is a remote review track for evaluating AI outputs in privacy law workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on it. Why...RiskRemote jobHourly payFor contractors10 hours per week
$80 - $120 per hour
...General finance / accounting Evaluator is a remote review track for evaluating AI outputs across accounting workflows. Reviewers grade... ...room for fuzzy reasoning. AuraOne uses experienced finance-and-risk professionals to grade AI outputs the way an audit reviewer would...RiskRemote jobFor contractorsWork experience placement10 hours per week- ...Legal Citation AI Evaluator is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on it....RiskRemote jobHourly payFor contractors10 hours per week
- ...Terms of Service AI Evaluator is a remote evaluation track for reviewing terms of service ai evaluation prompts and responses against AuraOne... ...Service AI evaluation Legal reasoning Policy review Risk analysis Terms Service Work model Remote — US-...RiskRemote jobHourly payFor contractors10 hours per week
- ...Healthcare Compliance AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade... ...Clinical review Legal reasoning Policy review Risk analysis Healthcare Compliance Work model Remote —...RiskRemote jobHourly payFor contractors10 hours per week
$80 - $120 per hour
...Special education / IEP Evaluator is a remote review track for evaluating AI outputs across education review workflows. Reviewers grade... ...correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can...RiskRemote jobFor contractorsWork experience placement10 hours per week- ...Position Summary In this remote, hourly contractor role, you will evaluate AI-generated financial content and develop cases that test... ...-generated responses across banking, insurance, accounting, and risk management for factual accuracy, analytical soundness, and correct...RiskHourly payFull timeTemporary workFor contractorsRemote work
- ...Position Summary In this remote, hourly contractor role, you will evaluate AI-generated medical content and develop cases that test... ...discipline ~ Strong clinical reasoning skills: differential diagnosis, risk stratification, red-flag recognition ~ Solid grounding in...RiskHourly payTemporary workFor contractorsRemote work
- ...Harmful Instruction Refusal Risk Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety...RiskRemote jobHourly payFor contractors10 hours per week
- ...Sensitive Advice Boundary Risk Evaluator is a remote evaluation track for reviewing sensitive advice boundary risk evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback...RiskRemote jobHourly payFor contractors10 hours per week
$55.2k - $126k
Risk Management Specialist The Opportunity: Program risks including quality delivery and performance are constantly evolving and understanding them can seem overwhelming to defense organizations. The challenge is how can organizations fully understand their risks and...RiskFull timeContract workPart timeWork at officeLocal areaRemote work$150 per hour
...patients per shift ~ Focus on GYN and OB care with prenatal care required ~ Average 375 deliveries per year ~ Mix of low and high risk pregnancy management ~ OB ultrasounds -- performance and interpretation required ~ Hospital privileges required ~ Paid...RiskHourly payLocumShift work- ...agricultural technology, specializing in biosecurity systems, compliance automation, and... ...production systems and common biosecurity risks. Strong attention to detail and commitment... ...Analytical mindset with the ability to evaluate process compliance. Work Schedule &...RiskHourly payContract workPart timeRemote work10 hours per weekFlexible hours
- ...Policy Senior to enhance its Fraud Prevention Team. The role involves developing policies to mitigate fraud loss, overseeing fraud risk management, and ensuring compliance with laws. A strong background in fraud risk and regulatory experience is required, along with analytical...RiskRemote work
$106.08k - $176.82k
...reassignment and escalation processes Ensure ownership aligns with actual work effort and technical domain Resource Coordination & Risk Management Coordinate resource needs across inter-related initiatives Support scope definition and risk assessment for technical...RiskFull timeTemporary workRemote workShift work$140k - $160k
...other value-add services. Maverick’s team includes underwriting, risk management, compliance & legal, technology & product development... ..., process improvements, and cross‑functional analytics. Evaluate emerging Azure services and tooling for platform improvement....RiskWork at officeRemote work$29 per hour
...IL 60025## OverviewSalary Range$26.00 - $35.00 Hourly## Description**JOB SUMMARY** The Safety Specialist reports to the Director of Risk & Special Projects and assists with the overall District-wide safety and risk management program. The Safety Specialist works collaboratively...RiskHourly payTemporary workImmediate startMonday to FridayAfternoon shift- ...execute enterprise-wide strategies to minimize shrink and reduce risk through strong operational compliance Partner with field and... ...policies and mitigate risk across the organization Oversee and evaluate investigations related to internal and external theft, fraud,...RiskLocal areaHome office
$20 per hour
...specialized guarding, mobile guarding, remote guarding, and corporate risk management. Securitas is committed to diversity, equity,... ..., and share information. Vigilance: Seeing, hearing, and evaluating. A Securitas employee is always attentive and often notices...RiskWeekly payFull timeTemporary workLocal areaRemote workShift workNight shiftAfternoon shift$196.75k - $255.7k
...VP of Finance with the management of the Finance Committee. Evaluate business processes for effectiveness and efficiency, while delivering... ...~15+ years of experience in finance, tax, budget management, risk management, and compliance, and debt and capital planning...RiskWork at officeRemote work- ...locations ~ Coverage at main hospital and satellite hospital ~ Midwife in-house on weekends for support ~ EMR: EPIC ~ High-risk patient management experience required ~ Collaboration with MFM for high-risk case planning ~ We negotiate better pay and deposit...RiskWeekly payFull timeLocumShift workWeekend workWeekday work
- ...Description The Legal Assistant Coordinator is a critical operational and compliance role within the Risk Management and Legal support functions, responsible for adherence to court-mandated deadlines, regulatory requirements, and corporate legal obligations. The position...RiskFull timePart timeWork at officeRemote workWork from homeRelocationMonday to Thursday
$9 - $30 per hour
ALTA Language Services, Inc. is looking for a remote Testing Evaluator in Atlanta, GA. This part-time position involves assisting with language proficiency examinations and evaluating tests according to set criteria. Candidates should have strong communication skills, professionalism...Part timeRemote work$194k - $276.75k
.... The AGC leads a team of two direct reports and supports broader corporate legal initiatives including contract review, enterprise risk management, and compliance programs. This role reports to the Vice President, Deputy General Counsel. Key Responsibilities Employment...RiskContract workWork at officeLocal areaRemote workMonday to Friday$40 per hour
A leading data annotation service is seeking a Biology Expert to train AI models. The role involves measuring AI progress, evaluating chatbot outputs, and ensuring quality improvement. Ideal candidates will have a strong background in biology or biochemistry. This independent...Hourly payContract workRemote workFlexible hours- ...Blueprint Technologies, LLC. is seeking a detail-oriented Labeler / Annotator to evaluate AI responses in French. This remote role focuses on side-by-side evaluation across real-world scenarios, not translation, requiring strong judgment and attention to detail. You...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Biosecurity Risk Evaluator [Remote]. Be the first to apply!




