Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Behavioral Health Expert, AI Safety and Model Evaluation

$45 - $70 per hour
Temporary

AuraOne

Category: AI Safety & Red Teaming · Pay: $45–$70 / hr · Location: Remote — US-eligible · Contractor

Behavioral Health Expert, AI Safety and Model Evaluation is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.

Why this role matters

Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.

Responsibilities

  • Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Behavioral Health Expert, AI Safety and Model Evaluation assignments.
  • Document every successful attack with reproduction steps and the policy clause it violated.
  • Score model defenses across single-turn and multi-turn conversations.
  • Triage emerging attack vectors and route them to the safety team with severity ratings.
  • Maintain a personal library of attack patterns and propose new red-team rubrics.
  • Calibrate against the broader red-team cohort to keep coverage and severity consistent.

Qualifications

  • Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Behavioral Health Expert, AI Safety and Model Evaluation work.
  • Strong written communication — your reports become the patch ticket.
  • Comfort working in policy-grey areas with clear documentation of what was attempted and why.
  • Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
  • Score a model's defenses against a known jailbreak pattern across 20 variants.
  • Propose a new red-team rubric category after spotting an emerging attack vector.
  • Reproduce a failure another reviewer reported and confirm the severity tag.

Nice to have

  • Background in offensive security, AppSec, or trust & safety operations.
  • Experience publishing or reproducing public adversarial-ML research.
  • Multilingual fluency for cross-language attack testing.

Skills

  • Adversarial prompting
  • Red-team analysis
  • Policy taxonomy
  • Failure documentation
  • Behavioral Health AI Safety and Model Evaluation evaluation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$45–$70 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Behavioral Health Expert, AI Safety and Model Evaluation in San Jose, CA vacancy
  • $60 per hour

    Prolific is seeking Biology Experts and Life Science Professionals to evaluate AI-generated science and ensure compliance with scientific standards. Responsibilities include reviewing biological inquiries, validating technical claims from public databases, and critiquing... 
    Suggested
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    San Jose, CA
    3 days ago
  • $100 per hour

     ...Category: Medical & Clinical AI · Pay: $100 / hr ·...  ...Contractor Clinical Mental Health Expert — AI Conversation Evaluation is a remote clinical-review...  ...guideline adherence; flag patient-safety issues; and document the...  ...clinical reasoning so the modeling team can close the gap.... 
    Suggested
    Contract work
    For contractors
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    3 days ago
  • $300k - $333k

     ...align Gemini's style, tone, and behavior with the model specifications and taxonomy,...  ...processes for consistent evaluations.Dive deep into technical...  ...tolerance for ambiguity inherent in AI research and operates at a...  ...discovery, ensuring safety and ethics are always our highest... 
    Suggested

    Google

    Mountain View, CA
    3 days ago
  • $40 - $44 per hour

     ...About the role Bilingual Portuguese Generalist Expert — AI Safety is a remote red-team track for stress-testing AI systems...  ...the safety team can patch the gap. Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like... 
    Suggested
    For contractors
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    1 day ago
  •  ...Robotics & Embodied AI · Pay: Hourly rate confirmed...  ...Robotics Expert | Remote AI Data and...  ...remote review track for evaluating robotics review outputs...  ...perception assumptions, and safety envelopes; flag...  ...document the corrected behavior so the modeling team can train on it.... 
    Suggested
    Hourly pay
    Contract work
    For contractors
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    3 days ago
  •  ...Category: Frontier Model Evaluation · Pay: Hourly rate confirmed after the interview process...  ...Remote — US-eligible · Contractor AI Training Expert - Remote Model Output Review is a...  ...linguistics, content moderation, or trust & safety review. Experience with inter-... 
    Hourly pay
    Contract work
    For contractors
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    3 days ago
  • $219k - $351k

     ...bandwidth business. As models scale past what any single...  ...grow with context, MoE expert weights spill beyond...  ...as the core product of AI inference, not an afterthought...  ...who connects model behavior to memory-system design...  ...every candidate is evaluated fairly and holistically... 
    Work at office
    Remote work
    Flexible hours

    Samsung Semiconductor

    San Jose, CA
    5 days ago
  • $174.72k - $295.68k

     ...integrating advanced AI and autonomous driving...  ...Scientist to drive the modeling and algorithmic development...  ..., and infrastructure experts to design, train, and...  ..., maps, human driving behaviors, etc.).Research and...  ...systematic ablation, evaluation, and visualization of... 
    Full time

    XPENG Motors

    Santa Clara, CA
    2 days ago
  • Prolific is seeking fluent Hindi speakers for its Expert Network in San Jose, California. The role involves completing AI training tasks, judging AI performance, and improving AI models using legal expertise. Candidates must have strong English skills, attention to detail... 
    Remote job
    Self employment
    Work from home
    Flexible hours

    Prolific

    San Jose, CA
    3 days ago
  • $50 per hour

     ...Category: Legal & Policy AI Evaluation · Pay: $50 / hr · Location: Remote — US-eligible · Contractor Legal Domain Researcher — AI Model Evaluation is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory... 
    Hourly pay
    Contract work
    For contractors
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    2 days ago
  • $70 - $90 per hour

     ...Category: Finance, Accounting & Economic AI · Pay: $70–$90 / hr · Location: Remote — US-eligible · Contractor Finance Domain Researcher — AI Model Evaluation is a remote review track for evaluating AI outputs across finance and risk workflows. Reviewers grade calculations... 
    Hourly pay
    Contract work
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    2 days ago
  • $65 - $70 per hour

     ...About the role Biology Expert (PhD) — AI Safety is a remote red-team track for stress-testing AI systems against adversarial...  ...the safety team can patch the gap. Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think... 
    Contract work
    For contractors
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    12 days ago
  • $84 per hour

     ...Category: Scientific AI & Domain Experts · Pay: $84 / hr · Location: Remote — US-eligible · Contractor...  ...Chemistry & Synthesis Expert — AI Evaluation (Remote) is a remote review track for...  ...document the correct method so the modeling team can train on it. Why this role... 
    Contract work
    For contractors
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    2 days ago
  • $90 - $110 per hour

     ...Location: Remote — US-eligible · Contractor Bioinformatics Experts — AI Evaluation (Remote) is a remote review track for evaluating AI outputs...  ...operational risk; and document the right next step so the modeling team can train on it. Why this role matters... 
    Contract work
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    2 days ago
  •  ...Category: Creative, Media & Design Evaluation · Pay: Hourly rate confirmed after the interview process · Location: Remote — US-eligible · Contractor CAD Design Expert (Instructor) for AI Model Evaluation is a remote review track for evaluating AI outputs across cad... 
    Hourly pay
    Contract work
    For contractors
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    3 days ago
  • $152k - $241.5k

     ...develop and adopt the next generation of Physical AI, spanning data generation, large-scale multimodal model training, robotics simulation and deployment!We are...  ...fine-tuning, RL or other post-training methods, evaluation, and model optimization.Strong expertise in distributed... 
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $174.72k - $295.68k

     ...innovation, integrating advanced AI and autonomous driving...  ...strong expertise in generative modeling and large-scale deep learning...  ...will research, implement, and evaluate world models that learn the dynamics...  ...with a world-class team of experts in computer vision, generative... 
    Full time

    XPENG Motors

    Santa Clara, CA
    3 days ago
  • $152k - $241.5k

     ...platforms, software, and AI systems that enable...  ...development, integration, evaluation, and deployment of end-to-end driving models across large-scale training...  ...localization, mapping, safety systems, and other autonomous...  ...debuggability, runtime behavior, and readiness for... 
    Full time

    Nvidia

    Santa Clara, CA
    6 days ago
  • $240k - $333k

    Prioritize high-impact partner models for Model Garden using a rigorous framework balancing performance, safety, and market demand. Design business frameworks for 3P APIs and...  ....Act as the primary product interface for top AI research organizations, proactively resolving... 

    Google

    Sunnyvale, CA
    2 days ago
  • $70 per hour

     ...trajectory data, and multi-agent behavioral events into structured graph...  ...) Develop temporal graph modeling techniques to capture time-varying...  ..., road context, and safety-critical driving events Build...  ...published papers in top-tier AI/ML, data mining, or computer vision... 
    Hourly pay
    Full time
    Internship
    Summer internship
    Relocation package

    Waymo

    Mountain View, CA
    3 days ago
  • $184k - $287.5k

    NVIDIA is redefining what is possible with AI, and the Relational Foundation Model team is helping lead that transformation. We are building a unified...  ...adapting existing models: you will design, build, and evaluate novel Transformer and graph neural network architectures... 
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $50 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Language and Literature Expert Type: Contract Compensation...  ...Role Responsibilities Evaluate the quality and accuracy of LLM...  ...stylistic features to enhance model understanding. Identify model... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Jose, CA
    6 days ago
  • $120 per hour

    Prolific is seeking Licensed Pharmacists in San Jose, CA to train and evaluate AI models in healthcare. As a Domain Expert, your role involves reviewing AI responses for accuracy, performing comparative analyses, and creating content to improve model quality. Candidates... 
    Hourly pay
    Remote work
    Work from home
    Flexible hours

    Prolific

    San Jose, CA
    4 days ago
  • $100 - $120 per hour

     ...Category: Coding, SWE & Agent Evaluation · Pay: $100–$120 / hr · Location: Remote — US-eligible...  ...Software & Firmware Engineering Experts — AI Code Evaluation is a remote engineering...  ...reproduce failures, write the unit test the model should have written, and explain the fix... 
    Contract work
    For contractors
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    4 days ago
  •  ...About the role Agentic AI Expert is a remote review track for evaluating AI outputs across agentic ai specialist...  ...document the right next step so the modeling team can train on it. Agentic...  ...-use tasks and enterprise agent behavior. Operational judgment is the skill... 
    Hourly pay
    Contract work
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    12 days ago
  •  ...About the role Expert Professionals AI Data Science In is a remote review track for evaluating AI outputs across professionals ai data...  ...the right next step so the modeling team can train on it. Professionals...  ...tasks and enterprise agent behavior. Operational judgment is the... 
    Hourly pay
    Contract work
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    12 days ago
  • $190k - $250k

     ...developed an artificial intelligence (AI) powered technology stack...  ...large-scale generative world models that learn to predict...  ...LiDAR, and radar outputsDesign evaluation frameworks that measure world...  ...One Medical, Gympass, Spring Health through Cigna, Rula (mental health... 
    Temporary work
    Work at office
    Visa sponsorship

    Kodiak Robotics

    Mountain View, CA
    6 days ago
  • $165.2k - $223.6k

     ...the forefront of running a wide range of models and supporting novel architecture alongside...  ...push the boundaries of what's possible in AI acceleration. As part of the broader Neuron...  ...offers comprehensive benefits including health insurance (medical, dental, vision,... 
    Full time
    Work experience placement
    Internship
    Local area
    Flexible hours

    Annapurna Labs (U.S.) Inc.

    Cupertino, CA
    1 day ago
  •  ...Corporation seeks a Nemotron Product Manager for Model Risk to shape risk management across model evaluations, guardrails and post-training mitigations. You will...  ...requirements, roadmaps, and market positioning, and to bring safety-focused products to market. You will engage... 

    Jobleads-US

    Santa Clara, CA
    4 days ago
  •  ...the role System Administrator Expert is a remote review track for evaluating AI outputs across system administrator...  ...the right next step so the modeling team can train on it. System Administrator...  ...-use tasks and enterprise agent behavior. Operational judgment is the... 
    Hourly pay
    Contract work
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    12 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Behavioral Health Expert, AI Safety and Model Evaluation. Be the first to apply!