Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Vulnerability Triage Security Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Vulnerability Triage Security Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.

Why this role matters

Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.

Responsibilities

  • Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Vulnerability Triage Security Evaluator assignments.
  • Document every successful attack with reproduction steps and the policy clause it violated.
  • Score model defenses across single-turn and multi-turn conversations.
  • Triage emerging attack vectors and route them to the safety team with severity ratings.
  • Maintain a personal library of attack patterns and propose new red-team rubrics.
  • Calibrate against the broader red-team cohort to keep coverage and severity consistent.

Qualifications

  • Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Vulnerability Triage Security Evaluator work.
  • Strong written communication — your reports become the patch ticket.
  • Comfort working in policy-grey areas with clear documentation of what was attempted and why.
  • Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
  • Score a model's defenses against a known jailbreak pattern across 20 variants.
  • Propose a new red-team rubric category after spotting an emerging attack vector.
  • Reproduce a failure another reviewer reported and confirm the severity tag.

Nice to have

  • Background in offensive security, AppSec, or trust & safety operations.
  • Experience publishing or reproducing public adversarial-ML research.
  • Multilingual fluency for cross-language attack testing.

Skills

  • Adversarial prompting
  • Red-team analysis
  • Policy taxonomy
  • Failure documentation
  • Vulnerability Triage Security evaluation
  • Security review
  • Adversarial testing
  • Threat modeling
  • Vulnerability
  • Triage

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Vulnerability Triage Security Evaluator [Remote] in Remote vacancy
  • $40 per hour

     ...our team to help train AI models. In this role, you will evaluate AI-generated security content, solve technical cybersecurity problems, and...  ...generated cybersecurity content, including threat analysis, vulnerability assessments, and offensive security techniques Design... 
    Suggested
    Hourly pay
    Full time
    Part time
    Remote work

    DataAnnotation

    Madison, WI
    3 days ago
  • $60 per hour

     ...closely with state-of-the-art AI models on tasks like evaluating AI-generated security content, solving technical security problems, and providing...  ...cybersecurity content — including threat analysis, vulnerability assessments, and offensive security techniques — for real... 
    Suggested
    Remote job
    Hourly pay
    Full time
    Flexible hours

    DataAnnotation

    Nevada, IA
    2 days ago
  • $40 per hour

     ...experienced professionals for a remote position focused on evaluating AI-generated security content. Candidates should have over 2 years of...  ...skills in penetration testing, incident response, and vulnerability assessments. Responsibilities include solving technical... 
    Suggested
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Boston, MA
    4 days ago
  • $40 per hour

    A cybersecurity solutions provider seeks experienced professionals to evaluate AI-generated content related to security issues. You will be solving technical problems, contributing directly to AI models. Required qualifications include 2+ years in cybersecurity, coding... 
    Suggested
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Washington DC
    1 day ago
  • $40 per hour

    A tech company specializing in AI is looking for experienced cybersecurity professionals to evaluate AI-generated security content and solve technical problems. This role involves writing technical explanations and providing feedback to improve AI security models. Candidates... 
    Suggested
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Florida, NY
    1 day ago
  • $40 per hour

     ...technology firm is seeking experienced cybersecurity professionals for a remote position in the United States. You will evaluate AI-generated security content while solving technical problems to strengthen AI models. Ideal candidates have 2+ years in cybersecurity,... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Bismarck, ND
    3 days ago
  • $40 per hour

    A technology company is seeking experienced cybersecurity professionals to join their remote team. The role involves evaluating AI-generated security content, solving technical cybersecurity problems, and providing feedback to enhance AI systems. Candidates should have... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Little Rock, AR
    3 days ago
  • $40 per hour

     ...provider is seeking experienced cybersecurity professionals to help train AI models by evaluating cybersecurity content. Responsibilities include evaluating AI outputs, solving security problems, and providing can improve AI security reasoning. Ideal candidates should... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    4 days ago
  • $40 per hour

     ...firm is seeking experienced cybersecurity professionals for a remote position in the United States. The role involves evaluating AI-generated security content, solving technical cybersecurity problems, and providing feedback to improve AI systems. Candidates should have... 
    Hourly pay
    Remote work

    DataAnnotation

    Providence, RI
    3 days ago
  • $40 per hour

    A technology company is seeking experienced cybersecurity professionals to help train AI models. The role involves evaluating AI-generated security content and solving technical cybersecurity problems. Candidates should have hands-on cybersecurity experience and strong... 
    Hourly pay
    Full time
    Part time
    Remote work

    DataAnnotation

    Juneau, AK
    3 days ago
  • $40 per hour

    A leading cybersecurity firm is seeking experienced cybersecurity professionals to evaluate AI-generated security content. In this role, you will analyze threats, design solutions for AI training, and provide feedback. This position offers the flexibility of working remotely... 
    Hourly pay
    Remote work

    DataAnnotation

    Little Rock, AR
    3 days ago
  • $40 per hour

    A cybersecurity company is seeking experienced professionals to join their team in evaluating AI-generated security content and solving technical cybersecurity problems. This is a flexible role that can be done from anywhere in the US, Canada, UK, Ireland, Australia, and... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    4 days ago
  • A cybersecurity-focused company is looking for experienced professionals to evaluate AI-generated security content and solve technical problems. This role offers the flexibility of choosing projects and working hours, making it suitable for professionals with 2+ years... 
    Remote work

    DataAnnotation

    Brooklyn, NY
    4 days ago
  • $40 per hour

    A cybersecurity technology firm is looking to hire experienced cybersecurity professionals to evaluate AI-generated security content and design technical problems for AI training. This remote position allows you to work on a flexible schedule with hourly pay starting at... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Phoenix, AZ
    3 days ago
  • $40 per hour

    A cybersecurity solutions company is seeking experienced professionals to evaluate AI-generated security content and solve technical cybersecurity problems. This role is remote, offering flexible schedules and payment starting at $40+ per hour. Candidates should have at... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    California, MO
    3 days ago
  • $40 per hour

    A cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and solve technical problems for training AI models. The ideal candidates will have over 2 years of relevant cybersecurity experience and strong writing skills. This role... 
    Hourly pay
    Remote work

    DataAnnotation

    Charleston, WV
    3 days ago
  • $40 per hour

     ...cybersecurity-focused company is seeking experienced cybersecurity professionals for a remote position. This role involves evaluating AI-generated security content and solving technical cybersecurity problems while contributing to the development of AI systems. Candidates... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Juneau, AK
    2 days ago
  • $40 per hour

    A leading cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and solve technical problems. This remote role offers flexibility in project selection and scheduling, with compensation starting at $40+ per hour. Ideal candidates... 
    Hourly pay
    Remote work

    DataAnnotation

    Bismarck, ND
    3 days ago
  • A cybersecurity solutions company is seeking experienced professionals to train AI models through evaluating and improving AI-generated security content. Responsibilities include assessing technical cybersecurity problems, providing feedback for AI systems, and contributing... 
    Remote work
    Flexible hours

    DataAnnotation

    Madison, WI
    3 days ago
  • $40 per hour

    A cybersecurity technology company is seeking experienced professionals to evaluate AI-generated security content. You will work remotely and choose projects that fit your schedule while earning competitive hourly rates starting at $40+. Ideal candidates should have over... 
    Hourly pay
    Remote work

    DataAnnotation

    Charleston, WV
    3 days ago
  • $40 per hour

    A leading AI cybersecurity firm is seeking experienced cybersecurity professionals to evaluate AI-generated security content and design technical solutions. You will work remotely and can choose your projects, with pay starting at $40 per hour. The ideal candidate has... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Helena, MT
    4 days ago
  • A cybersecurity-focused firm is looking for experienced professionals to evaluate AI-generated security content and solve technical cybersecurity problems. This role is remote and offers flexible scheduling, with positions available for full-time or part-time work. Candidates... 
    Remote job
    Hourly pay
    Full time
    Part time
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  • $40 per hour

    A cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and solve cybersecurity problems. This remote position offers flexibility in project selection and scheduling. Candidates should have 2+ years in cybersecurity, some coding... 
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    1 day ago
  • A cybersecurity consulting firm based in the U.S. is seeking experienced professionals to evaluate AI-generated security content and solve technical problems in cybersecurity. This remote position offers flexible scheduling, allowing you to choose projects that fit your... 
    Remote job
    Flexible hours

    DataAnnotation

    Vermont
    4 days ago
  • $40 per hour

    A cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and solve technical cybersecurity problems. You'll train AI models by assessing their outputs and providing feedback to improve real-world threat handling. The ideal candidate... 
    Remote job
    Hourly pay
    Full time
    Part time

    DataAnnotation

    Saint Paul, MN
    1 day ago
  • $40 per hour

    A leading cybersecurity firm is seeking experienced cybersecurity professionals for a remote role focused on evaluating AI-generated security content and solving technical problems. Responsibilities include assessing AI outputs for accuracy and providing necessary feedback... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Sioux Falls, SD
    4 days ago
  • $40 per hour

    A cybersecurity solutions company is seeking experienced professionals to evaluate AI-generated security content. The role requires 2+ years of hands-on cybersecurity experience, coding skills, and strong analytical abilities. This is a remote position that offers flexible... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Raleigh, NC
    4 days ago
  • $40 per hour

    A cybersecurity technology firm is seeking experienced cybersecurity professionals to evaluate AI-generated content, design security solutions, and provide feedback to improve AI systems. This remote role requires 2+ years of hands-on cybersecurity experience, some coding... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Montgomery, AL
    4 days ago
  • A cybersecurity platform is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve technical problems. This role offers flexibility with remote work, allowing you to choose projects and work on your own schedule. Candidates... 
    Remote job

    DataAnnotation

    Wyoming, OH
    1 day ago
  • $40 per hour

     ...leading cybersecurity firm is seeking experienced cybersecurity professionals to join their team. In this role, you will evaluate AI-generated security content and solve technical problems to train AI models. The position is remote and flexible, with payment starting at... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    California, MO
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Vulnerability Triage Security Evaluator [Remote]. Be the first to apply!