Phishing Simulation Security Evaluator [Remote]
AuraOne Human Data
- Remote job
Phishing Simulation Security Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.
Why this role matters
Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.
Responsibilities
- Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Phishing Simulation Security Evaluator assignments.
- Document every successful attack with reproduction steps and the policy clause it violated.
- Score model defenses across single-turn and multi-turn conversations.
- Triage emerging attack vectors and route them to the safety team with severity ratings.
- Maintain a personal library of attack patterns and propose new red-team rubrics.
- Calibrate against the broader red-team cohort to keep coverage and severity consistent.
Qualifications
- Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Phishing Simulation Security Evaluator work.
- Strong written communication — your reports become the patch ticket.
- Comfort working in policy-grey areas with clear documentation of what was attempted and why.
- Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
- Score a model's defenses against a known jailbreak pattern across 20 variants.
- Propose a new red-team rubric category after spotting an emerging attack vector.
- Reproduce a failure another reviewer reported and confirm the severity tag.
Nice to have
- Background in offensive security, AppSec, or trust & safety operations.
- Experience publishing or reproducing public adversarial-ML research.
- Multilingual fluency for cross-language attack testing.
Skills
- Adversarial prompting
- Red-team analysis
- Policy taxonomy
- Failure documentation
- Phishing Simulation Security evaluation
- Security review
- Adversarial testing
- Threat modeling
- Phishing
- Simulation
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
- ...USAA, our mission is to empower our members to achieve financial security through highly competitive products, exceptional service and... ...will work within defined guidelines and framework, investigate, evaluate, negotiate and settle complex property insurance claims presented...SuggestedHourly payFull timeLocal areaRemote workRelocationAfternoon shift
- ...Simulation-to-Real Task Evaluator is a remote evaluation track for reviewing simulation to real task evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling...SuggestedRemote jobHourly payFor contractors10 hours per week
$75 per hour
...Develop and deliver sociology content through AI training initiatives for postsecondary education. Evaluate and review AI-generated coursework, assignments, and simulated academic papers. Create lectures, learning modules, and case studies across core sociological topics...SuggestedHourly payContract workRemote work- ...Security Policy Bypass Security Evaluator is a remote review track for evaluating AI outputs in policy review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can...SuggestedRemote jobHourly payFor contractors10 hours per week
- ...or who are currently residing in a nursing facility whose physical and/or mental functioning has significantly changed. You will evaluate individuals to help determine appropriate next-level-of-care recommendations, supporting continuity of quality care while ensuring...SuggestedReliefWork at officeLocal areaWork from home
- ...The Mental Health Evaluator (MHE) is a critical role dedicated to delivering comprehensive, clinically appropriate, culturally competent, and trauma-informed patient behavioral health interventions in the hospital Emergency Department. Responsibilities include conducting...
$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Hourly payPart timeRemote workFlexible hours- ...Seeking PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content and contribute to the evaluation of advanced AI models in a flexible, remote contract role. Key Responsibilities Assessing the factuality...Full timeContract workRemote workFlexible hours
$166.4k
...PRN Bilingual Forensic Evaluator – Competency Restoration Program Correctional Healthcare Partners (CHP) Location: Remote Employment... .... Ability to obtain and maintain correctional facility security clearance. Willingness to support correctional...Hourly payDaily paidReliefWork at officeRemote work$54.28k - $87.05k
...advancement and more. Explore more details on the Benefits of Working at HHS webpage. Functional Title: 988 Suicide and Crisis Lifeline Evaluator Job Title: Program Specialist V Agency: Health & Human Services Comm Department: BHS MHP Mental Health Block Gr...Full timeContract workTemporary workPart timeFor contractorsWork at officeLocal areaRemote workShift work$100 per hour
.... Position: Clinical Mental Health Expert — AI Conversation Evaluation Type: Contract Compensation: $100/hour Location: Remote Role Responsibilities Review pairs of simulated conversations involving clinical mental health scenarios. Evaluate...Contract workSummer workRemote work- ...Mystery Evaluators (Gig / project-based work) - Freelance work - Multiple Opportunities Available in PAN India. Gujarat - Chikhli, Palanpur, Patan, Bhuj, Bharuch Karnataka - Bangalore Odisha - Bhubaneswar Tamil Nadu - Salem, Hosur, Madurai, Vellore, Tiruppur...Extra incomeFreelance
- ...To support the Overdose Data to Action initiative, the hybrid Program Evaluator will design, implement, and maintain evaluation frameworks for monitoring projects, ensuring effective program progression and improvement. Key responsibilities Design and evaluate program...Work experience placementRemote work
$60k
...Position Highlights Position Title: Program Evaluator Location: Remote, Hartford, CT (Connecticut Department of Public Health) Position End Date: 09/29/27 Salary: $60,000 plus benefits Overview The CDC Foundation is working with CDC and state and local authorities...Full timeFor contractorsWork experience placementLocal areaRemote workRelocationFlexible hours$39.52k - $43.68k
...The MID Intake Evaluator will work in a community behavioral health and addiction setting, providing services to individuals who have been... ...and organizations to promote programs and to identify and secure potential new alliances, partnerships and funding sources. Pursue...Hourly payFull timeTemporary workLocal areaRemote workTrial periodFlexible hours- ...Alignerr Corp. is seeking Creative Writing Evaluators to shape AI training by judging AI-generated writing across fiction, poetry, essays, and more. You will provide structured feedback on style, voice, coherence, and reader engagement. Work is fully remote on an hourly...Hourly payContract workRemote work10 hours per week
- ...Web Browsing Evaluator Contractor Remote Micro1 is engaging Web Browsing Evaluators to contribute high-quality web interaction... ...confidentiality and adhere to all project compliance and security protocols. Preferred Qualifications Demonstrated expertise...For contractorsRemote work
$14.5 per hour
...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years of experience in...Bi-weekly payHourly payPart timeImmediate startRemote workWork from homeFlexible hours- A global leader in customer experience seeks luxury brand evaluators to assess customer experiences with premium brands. As an evaluator, you will enjoy flexible assignments tailored to your interests. Responsibilities include visiting stores or evaluating online, observing...Flexible hours
$14.5 per hour
...AI Web Search Evaluator As a Web Search Evaluator, you will play a key role in improving the quality of search engine results, ensuring users find the most relevant and useful information. Your work will directly impact the development of AI algorithms, making search...Hourly payPart timeCurrently hiringImmediate startRemote workWork from home10 hours per weekFlexible hours- ...alongside iconic names like Louis Vuitton, Dolce & Gabbana, Bentley, Prada, Versace, and more. About the Role As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands...Contract workWorldwideFlexible hours
$80k - $130k
...Join our team to make work better for humans and humans better at work.Work You’ll DoAs a Project - Program Analytics & Insights Evaluator II on the project, you will be responsible for:Supporting the design and implementation of large, multi-site evaluations of public...Local area$55 per hour
...Charter Trauma Clinic, a division of The Key Program, Inc., is seeking to hire a part-time (15-20 hrs. per week) fee-for-service evaluator. Founded in 1985, the Forensic Services Team has a long-standing reputation as the leading provider of Child Trauma and Parental Capacity...Hourly payPart timeRemote workFlexible hours- CXG invites you to join as a luxury brand evaluator, a role that lets you explore premium boutiques and online experiences while shaping the future of luxury customer service. You’ll complete missions on your schedule, visiting stores or evaluating online, and provide candid...
- ...Luxury Brand Evaluator CXG is a global Customer Experience consulting firm specializing exclusively in serving premium and luxury brands. We partner with premium and luxury brands to transform experiences for meaningful impact. We provide valuable insights and support...WorldwideFlexible hours
- A leading AI research firm is looking for a contractor in internal or emergency medicine to help enhance language models by providing expert feedback based on real-world medical scenarios. Candidates should possess an MD and have relevant experience, including board certification...Remote jobFor contractors
- CXG is a global Customer Experience consulting firm specializing in premium and luxury brands. We hire luxury brand evaluators to discreetly assess customer experiences across stores and online, providing feedback that helps brands refine services. Assignments are brief...Flexible hours
- Aston Carter seeks a Legal AI Evaluation Specialist to design and evaluate AI-driven legal analysis across multiple practice areas. You will craft realistic tasks, grade AI outputs, and provide feedback to improve accuracy and reasoning. Ideal candidates have hands-on...Remote jobFull timeFlexible hours
- Luxury Brand Evaluator Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are looking for you! As a Luxury Brand Evaluator, you will step into the world of luxury to discreetly assess customer experiences...Worldwide
- CXG is seeking a luxury brand evaluator to discreetly assess customer experiences across fashion, beauty, jewelry, and automobiles. You will choose assignments that fit your profile and complete missions through in-store visits or online evaluations from home. As part of...Flexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Phishing Simulation Security Evaluator [Remote]. Be the first to apply!






