Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Phishing Simulation Security Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Phishing Simulation Security Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.

Why this role matters

Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.

Responsibilities

  • Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Phishing Simulation Security Evaluator assignments.
  • Document every successful attack with reproduction steps and the policy clause it violated.
  • Score model defenses across single-turn and multi-turn conversations.
  • Triage emerging attack vectors and route them to the safety team with severity ratings.
  • Maintain a personal library of attack patterns and propose new red-team rubrics.
  • Calibrate against the broader red-team cohort to keep coverage and severity consistent.

Qualifications

  • Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Phishing Simulation Security Evaluator work.
  • Strong written communication — your reports become the patch ticket.
  • Comfort working in policy-grey areas with clear documentation of what was attempted and why.
  • Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
  • Score a model's defenses against a known jailbreak pattern across 20 variants.
  • Propose a new red-team rubric category after spotting an emerging attack vector.
  • Reproduce a failure another reviewer reported and confirm the severity tag.

Nice to have

  • Background in offensive security, AppSec, or trust & safety operations.
  • Experience publishing or reproducing public adversarial-ML research.
  • Multilingual fluency for cross-language attack testing.

Skills

  • Adversarial prompting
  • Red-team analysis
  • Policy taxonomy
  • Failure documentation
  • Phishing Simulation Security evaluation
  • Security review
  • Adversarial testing
  • Threat modeling
  • Phishing
  • Simulation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the Phishing Simulation Security Evaluator [Remote] in Remote vacancy
  •  ...USAA, our mission is to empower our members to achieve financial security through highly competitive products, exceptional service and...  ...will work within defined guidelines and framework, investigate, evaluate, negotiate and settle complex property insurance claims presented... 
    Suggested
    Hourly pay
    Full time
    Local area
    Remote work
    Relocation
    Afternoon shift

    USAA

    Portland, OR
    13 days ago
  •  ...Simulation-to-Real Task Evaluator is a remote evaluation track for reviewing simulation to real task evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  • $75 per hour

     ...Develop and deliver sociology content through AI training initiatives for postsecondary education. Evaluate and review AI-generated coursework, assignments, and simulated academic papers. Create lectures, learning modules, and case studies across core sociological topics... 
    Suggested
    Hourly pay
    Contract work
    Remote work

    Crossing Hurdles

    United States
    3 days ago
  •  ...Security Policy Bypass Security Evaluator is a remote review track for evaluating AI outputs in policy review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  •  ...or who are currently residing in a nursing facility whose physical and/or mental functioning has significantly changed. You will evaluate individuals to help determine appropriate next-level-of-care recommendations, supporting continuity of quality care while ensuring... 
    Suggested
    Relief
    Work at office
    Local area
    Work from home

    Astyra Corporation

    Scottsbluff, NE
    6 days ago
  •  ...The Mental Health Evaluator (MHE) is a critical role dedicated to delivering comprehensive, clinically appropriate, culturally competent, and trauma-informed patient behavioral health interventions in the hospital Emergency Department. Responsibilities include conducting... 

    WMCHealth

    Kingston, OK
    5 days ago
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical... 
    Hourly pay
    Part time
    Remote work
    Flexible hours

    Welo Data

    United States
    3 days ago
  •  ...Seeking PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content and contribute to the evaluation of advanced AI models in a flexible, remote contract role. Key Responsibilities Assessing the factuality... 
    Full time
    Contract work
    Remote work
    Flexible hours

    Virtual Vocations Inc

    United States
    3 days ago
  • $166.4k

     ...PRN Bilingual Forensic Evaluator – Competency Restoration Program Correctional Healthcare Partners (CHP) Location: Remote Employment...  .... Ability to obtain and maintain correctional facility security clearance. Willingness to support correctional... 
    Hourly pay
    Daily paid
    Relief
    Work at office
    Remote work

    CHP Health

    Remote
    3 days ago
  • $54.28k - $87.05k

     ...advancement and more. Explore more details on the Benefits of Working at HHS webpage. Functional Title: 988 Suicide and Crisis Lifeline Evaluator Job Title: Program Specialist V Agency: Health & Human Services Comm Department: BHS MHP Mental Health Block Gr... 
    Full time
    Contract work
    Temporary work
    Part time
    For contractors
    Work at office
    Local area
    Remote work
    Shift work

    Texas Health & Human Services Commission

    Remote
    2 days ago
  • $100 per hour

     .... Position: Clinical Mental Health Expert — AI Conversation Evaluation Type: Contract Compensation: $100/hour Location: Remote Role Responsibilities Review pairs of simulated conversations involving clinical mental health scenarios. Evaluate... 
    Contract work
    Summer work
    Remote work

    Mercor

    Houston, TX
    5 days ago
  •  ...Mystery Evaluators (Gig / project-based work) - Freelance work - Multiple Opportunities Available in PAN India. Gujarat - Chikhli, Palanpur, Patan, Bhuj, Bharuch Karnataka - Bangalore Odisha - Bhubaneswar Tamil Nadu - Salem, Hosur, Madurai, Vellore, Tiruppur... 
    Extra income
    Freelance

    BARE International

    Remote
    5 days ago
  •  ...To support the Overdose Data to Action initiative, the hybrid Program Evaluator will design, implement, and maintain evaluation frameworks for monitoring projects, ensuring effective program progression and improvement. Key responsibilities Design and evaluate program... 
    Work experience placement
    Remote work

    Virtual Vocations Inc

    United States
    3 days ago
  • $60k

     ...Position Highlights Position Title: Program Evaluator Location: Remote, Hartford, CT (Connecticut Department of Public Health) Position End Date: 09/29/27 Salary: $60,000 plus benefits Overview The CDC Foundation is working with CDC and state and local authorities... 
    Full time
    For contractors
    Work experience placement
    Local area
    Remote work
    Relocation
    Flexible hours

    CDC Foundation

    Remote
    5 days ago
  • $39.52k - $43.68k

     ...The MID Intake Evaluator will work in a community behavioral health and addiction setting, providing services to individuals who have been...  ...and organizations to promote programs and to identify and secure potential new alliances, partnerships and funding sources. Pursue... 
    Hourly pay
    Full time
    Temporary work
    Local area
    Remote work
    Trial period
    Flexible hours

    Mental Health Association - Western MA

    Remote
    2 days ago
  •  ...Alignerr Corp. is seeking Creative Writing Evaluators to shape AI training by judging AI-generated writing across fiction, poetry, essays, and more. You will provide structured feedback on style, voice, coherence, and reader engagement. Work is fully remote on an hourly... 
    Hourly pay
    Contract work
    Remote work
    10 hours per week

    Alignerr Corp.

    United States
    1 day ago
  •  ...Web Browsing Evaluator Contractor Remote Micro1 is engaging Web Browsing Evaluators to contribute high-quality web interaction...  ...confidentiality and adhere to all project compliance and security protocols. Preferred Qualifications Demonstrated expertise... 
    For contractors
    Remote work

    ESR Healthcare

    New York, NY
    4 days ago
  • $14.5 per hour

     ...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years of experience in... 
    Bi-weekly pay
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Welo Data

    United States
    2 days ago
  • A global leader in customer experience seeks luxury brand evaluators to assess customer experiences with premium brands. As an evaluator, you will enjoy flexible assignments tailored to your interests. Responsibilities include visiting stores or evaluating online, observing... 
    Flexible hours

    CXG

    Florida
    7 hours ago
  • $14.5 per hour

     ...AI Web Search Evaluator As a Web Search Evaluator, you will play a key role in improving the quality of search engine results, ensuring users find the most relevant and useful information. Your work will directly impact the development of AI algorithms, making search... 
    Hourly pay
    Part time
    Currently hiring
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Welo Data

    United States
    2 days ago
  •  ...alongside iconic names like Louis Vuitton, Dolce & Gabbana, Bentley, Prada, Versace, and more. About the Role As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands... 
    Contract work
    Worldwide
    Flexible hours

    CXG

    Florida
    7 hours ago
  • $80k - $130k

     ...Join our team to make work better for humans and humans better at work.Work You’ll DoAs a Project - Program Analytics & Insights Evaluator II on the project, you will be responsible for:Supporting the design and implementation of large, multi-site evaluations of public... 
    Local area

    Deloitte

    Atlanta, GA
    1 day ago
  • $55 per hour

     ...Charter Trauma Clinic, a division of The Key Program, Inc., is seeking to hire a part-time (15-20 hrs. per week) fee-for-service evaluator. Founded in 1985, the Forensic Services Team has a long-standing reputation as the leading provider of Child Trauma and Parental Capacity... 
    Hourly pay
    Part time
    Remote work
    Flexible hours

    Key Program, Inc.

    Waltham, MA
    23 days ago
  • CXG invites you to join as a luxury brand evaluator, a role that lets you explore premium boutiques and online experiences while shaping the future of luxury customer service. You’ll complete missions on your schedule, visiting stores or evaluating online, and provide candid... 

    CXG

    Washington DC
    1 day ago
  •  ...Luxury Brand Evaluator CXG is a global Customer Experience consulting firm specializing exclusively in serving premium and luxury brands. We partner with premium and luxury brands to transform experiences for meaningful impact. We provide valuable insights and support... 
    Worldwide
    Flexible hours

    CXG

    San Francisco, CA
    4 days ago
  • A leading AI research firm is looking for a contractor in internal or emergency medicine to help enhance language models by providing expert feedback based on real-world medical scenarios. Candidates should possess an MD and have relevant experience, including board certification...
    Remote job
    For contractors

    Turing

    Boston, MA
    1 day ago
  • CXG is a global Customer Experience consulting firm specializing in premium and luxury brands. We hire luxury brand evaluators to discreetly assess customer experiences across stores and online, providing feedback that helps brands refine services. Assignments are brief... 
    Flexible hours

    CXG

    Berkeley, CA
    1 day ago
  • Aston Carter seeks a Legal AI Evaluation Specialist to design and evaluate AI-driven legal analysis across multiple practice areas. You will craft realistic tasks, grade AI outputs, and provide feedback to improve accuracy and reasoning. Ideal candidates have hands-on... 
    Remote job
    Full time
    Flexible hours

    Aston Carter

    Miami, FL
    2 days ago
  • Luxury Brand Evaluator Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are looking for you! As a Luxury Brand Evaluator, you will step into the world of luxury to discreetly assess customer experiences... 
    Worldwide

    CXG

    New York, NY
    3 days ago
  • CXG is seeking a luxury brand evaluator to discreetly assess customer experiences across fashion, beauty, jewelry, and automobiles. You will choose assignments that fit your profile and complete missions through in-store visits or online evaluations from home. As part of... 
    Flexible hours

    CXG

    Mc Cordsville, IN
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Phishing Simulation Security Evaluator [Remote]. Be the first to apply!