Behavioral Health Expert, AI Safety and Model Evaluation
$45 - $70 per hourAuraOne
Category: AI Safety & Red Teaming · Pay: $45–$70 / hr · Location: Remote — US-eligible · Contractor
Behavioral Health Expert, AI Safety and Model Evaluation is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.
Why this role matters
Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.
Responsibilities
- Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Behavioral Health Expert, AI Safety and Model Evaluation assignments.
- Document every successful attack with reproduction steps and the policy clause it violated.
- Score model defenses across single-turn and multi-turn conversations.
- Triage emerging attack vectors and route them to the safety team with severity ratings.
- Maintain a personal library of attack patterns and propose new red-team rubrics.
- Calibrate against the broader red-team cohort to keep coverage and severity consistent.
Qualifications
- Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Behavioral Health Expert, AI Safety and Model Evaluation work.
- Strong written communication — your reports become the patch ticket.
- Comfort working in policy-grey areas with clear documentation of what was attempted and why.
- Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
- Score a model's defenses against a known jailbreak pattern across 20 variants.
- Propose a new red-team rubric category after spotting an emerging attack vector.
- Reproduce a failure another reviewer reported and confirm the severity tag.
Nice to have
- Background in offensive security, AppSec, or trust & safety operations.
- Experience publishing or reproducing public adversarial-ML research.
- Multilingual fluency for cross-language attack testing.
Skills
- Adversarial prompting
- Red-team analysis
- Policy taxonomy
- Failure documentation
- Behavioral Health AI Safety and Model Evaluation evaluation
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
$45–$70 / hr
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
$60 per hour
Prolific is seeking Biology Experts and Life Science Professionals to evaluate AI-generated science and ensure compliance with scientific standards. Responsibilities include reviewing biological inquiries, validating technical claims from public databases, and critiquing...SuggestedRemote jobHourly payWork from homeFlexible hours$100 per hour
...Category: Medical & Clinical AI · Pay: $100 / hr ·... ...Contractor Clinical Mental Health Expert — AI Conversation Evaluation is a remote clinical-review... ...guideline adherence; flag patient-safety issues; and document the... ...clinical reasoning so the modeling team can close the gap....SuggestedContract workFor contractorsRemote work10 hours per week$300k - $333k
...align Gemini's style, tone, and behavior with the model specifications and taxonomy,... ...processes for consistent evaluations.Dive deep into technical... ...tolerance for ambiguity inherent in AI research and operates at a... ...discovery, ensuring safety and ethics are always our highest...Suggested$40 - $44 per hour
...About the role Bilingual Portuguese Generalist Expert — AI Safety is a remote red-team track for stress-testing AI systems... ...the safety team can patch the gap. Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like...SuggestedFor contractorsRemote work10 hours per week- ...Robotics & Embodied AI · Pay: Hourly rate confirmed... ...Robotics Expert | Remote AI Data and... ...remote review track for evaluating robotics review outputs... ...perception assumptions, and safety envelopes; flag... ...document the corrected behavior so the modeling team can train on it....SuggestedHourly payContract workFor contractorsRemote work10 hours per week
- ...Category: Frontier Model Evaluation · Pay: Hourly rate confirmed after the interview process... ...Remote — US-eligible · Contractor AI Training Expert - Remote Model Output Review is a... ...linguistics, content moderation, or trust & safety review. Experience with inter-...Hourly payContract workFor contractorsRemote work10 hours per week
$219k - $351k
...bandwidth business. As models scale past what any single... ...grow with context, MoE expert weights spill beyond... ...as the core product of AI inference, not an afterthought... ...who connects model behavior to memory-system design... ...every candidate is evaluated fairly and holistically...Work at officeRemote workFlexible hours$174.72k - $295.68k
...integrating advanced AI and autonomous driving... ...Scientist to drive the modeling and algorithmic development... ..., and infrastructure experts to design, train, and... ..., maps, human driving behaviors, etc.).Research and... ...systematic ablation, evaluation, and visualization of...Full time- Prolific is seeking fluent Hindi speakers for its Expert Network in San Jose, California. The role involves completing AI training tasks, judging AI performance, and improving AI models using legal expertise. Candidates must have strong English skills, attention to detail...Remote jobSelf employmentWork from homeFlexible hours
$50 per hour
...Category: Legal & Policy AI Evaluation · Pay: $50 / hr · Location: Remote — US-eligible · Contractor Legal Domain Researcher — AI Model Evaluation is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory...Hourly payContract workFor contractorsRemote work10 hours per week$70 - $90 per hour
...Category: Finance, Accounting & Economic AI · Pay: $70–$90 / hr · Location: Remote — US-eligible · Contractor Finance Domain Researcher — AI Model Evaluation is a remote review track for evaluating AI outputs across finance and risk workflows. Reviewers grade calculations...Hourly payContract workFor contractorsWork experience placementRemote work10 hours per week$65 - $70 per hour
...About the role Biology Expert (PhD) — AI Safety is a remote red-team track for stress-testing AI systems against adversarial... ...the safety team can patch the gap. Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think...Contract workFor contractorsRemote work10 hours per week$84 per hour
...Category: Scientific AI & Domain Experts · Pay: $84 / hr · Location: Remote — US-eligible · Contractor... ...Chemistry & Synthesis Expert — AI Evaluation (Remote) is a remote review track for... ...document the correct method so the modeling team can train on it. Why this role...Contract workFor contractorsRemote work10 hours per week$90 - $110 per hour
...Location: Remote — US-eligible · Contractor Bioinformatics Experts — AI Evaluation (Remote) is a remote review track for evaluating AI outputs... ...operational risk; and document the right next step so the modeling team can train on it. Why this role matters...Contract workFor contractorsWork experience placementRemote work10 hours per week- ...Category: Creative, Media & Design Evaluation · Pay: Hourly rate confirmed after the interview process · Location: Remote — US-eligible · Contractor CAD Design Expert (Instructor) for AI Model Evaluation is a remote review track for evaluating AI outputs across cad...Hourly payContract workFor contractorsRemote work10 hours per week
$152k - $241.5k
...develop and adopt the next generation of Physical AI, spanning data generation, large-scale multimodal model training, robotics simulation and deployment!We are... ...fine-tuning, RL or other post-training methods, evaluation, and model optimization.Strong expertise in distributed...Full time$174.72k - $295.68k
...innovation, integrating advanced AI and autonomous driving... ...strong expertise in generative modeling and large-scale deep learning... ...will research, implement, and evaluate world models that learn the dynamics... ...with a world-class team of experts in computer vision, generative...Full time$152k - $241.5k
...platforms, software, and AI systems that enable... ...development, integration, evaluation, and deployment of end-to-end driving models across large-scale training... ...localization, mapping, safety systems, and other autonomous... ...debuggability, runtime behavior, and readiness for...Full time$240k - $333k
Prioritize high-impact partner models for Model Garden using a rigorous framework balancing performance, safety, and market demand. Design business frameworks for 3P APIs and... ....Act as the primary product interface for top AI research organizations, proactively resolving...$70 per hour
...trajectory data, and multi-agent behavioral events into structured graph... ...) Develop temporal graph modeling techniques to capture time-varying... ..., road context, and safety-critical driving events Build... ...published papers in top-tier AI/ML, data mining, or computer vision...Hourly payFull timeInternshipSummer internshipRelocation package$184k - $287.5k
NVIDIA is redefining what is possible with AI, and the Relational Foundation Model team is helping lead that transformation. We are building a unified... ...adapting existing models: you will design, build, and evaluate novel Transformer and graph neural network architectures...Full time$50 per hour
...technical talent with leading AI research labs. Headquartered in... ...Language and Literature Expert Type: Contract Compensation... ...Role Responsibilities Evaluate the quality and accuracy of LLM... ...stylistic features to enhance model understanding. Identify model...Contract workSummer workRemote work$120 per hour
Prolific is seeking Licensed Pharmacists in San Jose, CA to train and evaluate AI models in healthcare. As a Domain Expert, your role involves reviewing AI responses for accuracy, performing comparative analyses, and creating content to improve model quality. Candidates...Hourly payRemote workWork from homeFlexible hours$100 - $120 per hour
...Category: Coding, SWE & Agent Evaluation · Pay: $100–$120 / hr · Location: Remote — US-eligible... ...Software & Firmware Engineering Experts — AI Code Evaluation is a remote engineering... ...reproduce failures, write the unit test the model should have written, and explain the fix...Contract workFor contractorsRemote work10 hours per week- ...About the role Agentic AI Expert is a remote review track for evaluating AI outputs across agentic ai specialist... ...document the right next step so the modeling team can train on it. Agentic... ...-use tasks and enterprise agent behavior. Operational judgment is the skill...Hourly payContract workFor contractorsWork experience placementRemote work10 hours per week
- ...About the role Expert Professionals AI Data Science In is a remote review track for evaluating AI outputs across professionals ai data... ...the right next step so the modeling team can train on it. Professionals... ...tasks and enterprise agent behavior. Operational judgment is the...Hourly payContract workFor contractorsWork experience placementRemote work10 hours per week
$190k - $250k
...developed an artificial intelligence (AI) powered technology stack... ...large-scale generative world models that learn to predict... ...LiDAR, and radar outputsDesign evaluation frameworks that measure world... ...One Medical, Gympass, Spring Health through Cigna, Rula (mental health...Temporary workWork at officeVisa sponsorship$165.2k - $223.6k
...the forefront of running a wide range of models and supporting novel architecture alongside... ...push the boundaries of what's possible in AI acceleration. As part of the broader Neuron... ...offers comprehensive benefits including health insurance (medical, dental, vision,...Full timeWork experience placementInternshipLocal areaFlexible hours- ...Corporation seeks a Nemotron Product Manager for Model Risk to shape risk management across model evaluations, guardrails and post-training mitigations. You will... ...requirements, roadmaps, and market positioning, and to bring safety-focused products to market. You will engage...
- ...the role System Administrator Expert is a remote review track for evaluating AI outputs across system administrator... ...the right next step so the modeling team can train on it. System Administrator... ...-use tasks and enterprise agent behavior. Operational judgment is the...Hourly payContract workFor contractorsWork experience placementRemote work10 hours per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Behavioral Health Expert, AI Safety and Model Evaluation. Be the first to apply!
- fulfillment expert San Jose, CA
- technology expert San Jose, CA
- guest service support expert San Jose, CA
- ehs part time San Jose, CA
- ehs safety San Jose, CA
- health and safety and facilities manager San Jose, CA
- occupational health manager San Jose, CA
- occupational health physician San Jose, CA
- ehs San Jose, CA
- occupational health and safety San Jose, CA





