Deception Behavior Risk Evaluator
AuraOne, Inc.
Deception Behavior Risk Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap. Why this role matters Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them. Responsibilities Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Deception Behavior Risk Evaluator assignments. Document every successful attack with reproduction steps and the policy clause it violated. Score model defenses across single-turn and multi-turn conversations. Triage emerging attack vectors and route them to the safety team with severity ratings. Maintain a personal library of attack patterns and propose new red-team rubrics. Calibrate against the broader red-team cohort to keep coverage and severity consistent. Qualifications Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Deception Behavior Risk Evaluator work. Strong written communication — your reports become the patch ticket. Comfort working in policy-grey areas with clear documentation of what was attempted and why. Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies. Reliable async availability for at least 10 hours per week. Example tasks Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket. Score a model's defenses against a known jailbreak pattern across 20 variants. Propose a new red-team rubric category after spotting an emerging attack vector. Reproduce a failure another reviewer reported and confirm the severity tag. Nice to have Background in offensive security, AppSec, or trust & safety operations. Experience publishing or reproducing public adversarial-ML research. Multilingual fluency for cross-language attack testing. Skills Adversarial prompting Red-team analysis Policy taxonomy Failure documentation Deception Behavior Risk evaluation AI safety Red-team evaluation Policy rubrics Deception Behavior Work model Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US. Compensation Hourly rate confirmed after the interview process. Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Deception Behavior Risk Evaluator work. Strong written communication — your reports become the patch ticket. Comfort working in policy-grey areas with clear documentation of what was attempted and why. Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies. Reliable async availability for at least 10 hours per week. #J-18808-Ljbffr AuraOne, Inc.
- AuraOne, Inc. is seeking a remote Deception Behavior Risk Evaluator to stress-test AI systems with adversarial prompts. You will design jailbreak-like prompts, document failures with reproduction steps, and map each incident to the applicable policy clause to enable rapid...RiskRemote jobFor contractors
$30 - $60 per hour
...seeking a part-time, contract-based AI Safety & Evaluation Specialist to test and review privacy-related behavior of AI agents. You will test privacy-focused scenarios... ...of personal or sensitive data, identify privacy risks, document findings with clear evidence, and...RiskRemote jobHourly payContract workPart timeFor contractors$129k
...detailingCRM### Key responsibilities* Listen to and evaluate AI-led sales calls with healthcare... ...flag potential performance or compliance risks.## How this job comparesCompared with 801... ..., and appropriate compliance behavior.• Identify weak messaging, poor objection...RiskContract workPart timeFor contractorsRemote work10 hours per weekFlexible hours$30 - $49 per hour
AI Generalist Digital Workflow Evaluator Review AI-generated outputs and workflow screenshots... ...clearly so feedback can improve model behavior. Maintain consistent, accurate quality across... ...suppliers, bids, contracts, and vendor risk. This flexible remote contractor role...RiskHourly payContract workPart timeFor contractorsRemote workFlexible hours$30 per hour
...professionals to review real-world wellness scenarios used to train AI wellness assistants. As a reviewer, you will identify risks, contraindications, and behavior patterns to upgrade scenarios for testing professional judgment. This is a task-based engagement paying US$30 per...RiskHourly pay- ...Occupational Therapist Evaluator Administrative Office - New York, NY 10001 Our OT Evaluators... ...of the child's performance and behavior during evaluation referencing his/her sensory... ...the individual based on skill level and risks and support the safety of all...RiskWork experience placementWork at officeDay shiftAfternoon shift
- AuraOne, Inc. seeks a Finance Research Expert — AI Evaluation (Remote) to review AI outputs in finance and risk workflows, ensuring accuracy and policy adherence. You will flag rounding, classification, and treatment issues, documenting corrections with citations for model...RiskRemote job
$30 - $50 per hour
OpenTrain AI, Inc. is seeking an AI Privacy, Safety and Evaluation Specialist for a six-week, part-time project based in the United States... ...will test personal AI agents and review responses for privacy risks, with pay of $30 to $50 per hour. This remote contract offers flexible...RiskRemote jobHourly payContract workPart timeRelocationFlexible hours- Sovrano AI is hiring for a remote, hourly contractor who will evaluate frontier AI models on chemical, biological, radiological, and nuclear questions. You will assess safety framing, flag unsafe guidance, and write reference safe-answers. The role spans four hazard domains...RiskRemote jobHourly payFor contractors
- Learning Progression AI Evaluator is a remote review track for evaluating AI outputs across learning progression ai specialist operations... ..., policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train...RiskHourly payFor contractorsWork experience placementRemote work10 hours per week
- AI Trainer Jobs is seeking a Calibration Technology Evaluation Specialist for a remote contractor role. You will review AI outputs against... ...adherence, and stakeholder fit using structured rubrics; flag risks and document next steps for training. Applicants should have direct...RiskRemote jobFor contractorsWork experience placement
- ...publish a figure we cannot stand behind. About the Role AI Safety Evaluation Project | Remote | Contract Locations: US, Canada, UK, Europe,... ...AI-generated prompts and responses, evaluating safety risks, identifying dual-use content, and assessing technical accuracy...RiskHourly payContract workFor contractorsRemote work
- Position Summary In this remote, hourly contractor role, you will evaluate AI-generated financial content and develop cases that test... ...-generated responses across banking, insurance, accounting, and risk management for factual accuracy, analytical soundness, and correct...RiskRemote jobHourly payFull timeFor contractors
- ...Trainer Jobs is seeking a Pharmacist for a remote review track evaluating AI outputs across pharmacist operations workflows. You will grade... ..., policy adherence, and stakeholder fit; flag operational risk and document next steps for modeling team training. As a contractor...RiskRemote jobFor contractors10 hours per week
$18 - $45 per hour
...Income Subject Matter Experts (SMEs) to support a specialized AI evaluation pilot focused on the financial markets of Mainland China and... ...yield curves, duration, and interest rate sensitivity. Credit & Risk Analysis: Credit ratings, creditworthiness, default risk, and...RiskExtra incomeTemporary workFor contractorsFreelanceRemote workFlexible hours- ...Description Job Description Job Title Prompt Evaluator Location Hybrid / Remote... ...of prompt engineering techniques and LLM behavior. Familiarity with Responsible AI, AI safety... ...techniques Familiarity with NIST AI Risk Management Framework (AI RMF) or ISO/IEC...RiskFull timeRemote work
- ...Description Job Title: Language Model Evaluator Job Summary We are seeking a Language Model... ..., and Product teams to enhance model behavior and user experience. Key Responsibilities... ..., toxicity, harmful content, and safety risks. Perform prompt testing, regression...RiskFull timeRemote work
- ...Talkiatry is seeking a Behavioral Health Case Manager to help patients access, stay engaged in, and transition between needed services.... ...remotely with a multidisciplinary team, recognizing changes in risk and escalating when needed. A bachelor’s degree in social work...RiskRemote work
$190k - $250k
...strategic and dynamic asset allocation, risk budgeting, portfolio construction and manager... ...relationships with the OCIO third party evaluator (TPE) / search consultant community. We... ...and articulation of Franklin’s behavioral/experiential brand for OCIO. This includes...RiskWork at officeLocal area- ...CISC Care Coordinator to coordinate care plans for members with behavioral health needs. You will collaborate with clinicians, social... ...services are delivered and documented. The role involves assessing risks, developing care plans, and monitoring progress to improve health...Risk
$137.9k - $256.1k
...AI Prompter / EvaluatorJob DescriptionSr. Legal AI Prompters / Evaluators are responsible for improving CoCounsel Legal by writing and refining... ...in the legal profession, who can think critically about AI risks and opportunities and translate legal expertise into practical,...RiskFull timeWork at officeLocal areaFlexible hours- ...Bring your expertise to JPMorganChase. As part of Risk Management and Compliance, you play a crucial role in maintaining JPMorganChase... ...of models for specific products and structures. Evaluate model behavior and ensure the suitability of pricing models and engines for...Risk
- ...for Capital One in the face of shifting consumer and regulatory behavior Business ownership: Have an ownership mindset, and potentially... ...designed to deliver on new go-to-market strategies Credit Risk: Drive step-change improvements in credit performance by connecting...RiskFull timeTemporary workShift work
$115k - $125k
...Job Description Job Description Clinical Psychologist – Behavioral Health Location: Bronx, NY Salary: $115,000–$125,000/year... ...make appropriate referrals. Perform crisis intervention and risk assessments as needed. Coordinate care with healthcare providers...RiskRemote jobFull time- The Cigna Group is seeking a Behavioral Licensed Clinician for its Evernorth 24/7 Clinical Support team, offering evening hours and remote... ...United States. You will provide expert crisis support, assess risks, and guide members through their wellness journey with evidence...RiskRemote jobAfternoon shift
- ...complete intake and crisis consultations, coordinate perinatal behavioral health, and support improved patient outcomes across the continental... .... Reporting to the Behavioral Health Lead, you will assess risk, collaborate with obstetricians, nurses, and therapists, and...RiskRemote jobNight shift
- The Cigna Group is seeking a Behavioral Licensed Clinician to join our 24/7 Clinical Support Team for telephonic behavioral health care in the United States. You will provide crisis intervention, risk assessment, and care navigation while ensuring HIPAA-compliant documentation...RiskFull timeAfternoon shift
- ...This role supports initial intake and crisis consultation, reporting to the Behavioral Health Lead, and is open to candidates located in the continental US. The successful nurse will assess risk, collaborate with a multidisciplinary team, develop individualized care...RiskRemote job
- ...recommendations, and continuously refine product functionality Credit Risk: Drive step-change improvements in credit performance by connecting drivers of future consumer credit trends to historical behavior, creating risk models, and testing hypotheses using rigorous...RiskFull timeTemporary workShift work
$80k - $90k
...: We are seeking a highly motivated and skilled Board Certified Behavior Analyst (BCBA) to join our team. The BCBA will play a key role in... ...Analyst” roles. Behavioral Insights Fraud Analyst - Special Risk United States $130,000.00-$150,000.00 1 week ago BCBA-Board Certified...RiskFull timePart timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Deception Behavior Risk Evaluator. Be the first to apply!
- evaluator New York, NY
- work from home web search evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- work from home social media evaluator New York, NY
- ai evaluator New York, NY
- ads evaluator New York, NY
- education evaluator New York, NY
- quality evaluator New York, NY
- social media evaluator New York, NY



