Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

SOC Alert Security Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

SOC Alert Security Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.

Why this role matters

Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.

Responsibilities

  • Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for SOC Alert Security Evaluator assignments.
  • Document every successful attack with reproduction steps and the policy clause it violated.
  • Score model defenses across single-turn and multi-turn conversations.
  • Triage emerging attack vectors and route them to the safety team with severity ratings.
  • Maintain a personal library of attack patterns and propose new red-team rubrics.
  • Calibrate against the broader red-team cohort to keep coverage and severity consistent.

Qualifications

  • Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for SOC Alert Security Evaluator work.
  • Strong written communication — your reports become the patch ticket.
  • Comfort working in policy-grey areas with clear documentation of what was attempted and why.
  • Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
  • Score a model's defenses against a known jailbreak pattern across 20 variants.
  • Propose a new red-team rubric category after spotting an emerging attack vector.
  • Reproduce a failure another reviewer reported and confirm the severity tag.

Nice to have

  • Background in offensive security, AppSec, or trust & safety operations.
  • Experience publishing or reproducing public adversarial-ML research.
  • Multilingual fluency for cross-language attack testing.

Skills

  • Adversarial prompting
  • Red-team analysis
  • Policy taxonomy
  • Failure documentation
  • SOC Alert Security evaluation
  • Security review
  • Adversarial testing
  • Threat modeling
  • Alert

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the SOC Alert Security Evaluator [Remote] in Remote vacancy
  • $40 per hour

     ...leading cybersecurity solutions provider is seeking experienced cybersecurity professionals for a remote position. You will evaluate AI-generated security content, solve technical problems, and provide essential feedback to improve AI systems. The ideal candidate will have... 
    Suggested
    Hourly pay
    Remote work

    DataAnnotation

    Helena, MT
    3 days ago
  • $40 per hour

     ...are looking for experienced cybersecurity professionals to join our team to help train AI models. In this role, you will evaluate AI-generated security content, solve technical cybersecurity problems, and provide feedback to improve how AI systems reason about real-world... 
    Suggested
    Hourly pay
    Full time
    Part time
    Remote work

    DataAnnotation

    New York, NY
    2 days ago
  • $40 per hour

    A leading cybersecurity firm is looking for experienced cybersecurity professionals to evaluate AI-generated content and solve technical problems. The role involves working with advanced AI models, providing feedback, and contributing to the cybersecurity industry's future... 
    Suggested
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Washington DC
    2 days ago
  • $40 per hour

     ...prominent tech firm is searching for experienced cybersecurity professionals to join their remote team. In this role, you will evaluate AI-generated security content, design solutions to cybersecurity problems, and provide essential feedback for improving AI models. Candidates... 
    Suggested
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Kansas City, MO
    3 days ago
  • A leading cybersecurity platform is seeking experienced professionals to evaluate AI-generated security content and solve technical cybersecurity issues. This role offers the flexibility of full-time or part-time remote work, allowing you to choose projects and set your... 
    Suggested
    Full time
    Part time
    Remote work

    DataAnnotation

    Topeka, KS
    2 days ago
  • $40 per hour

    A leading AI training firm is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve technical problems. This role is remote, allowing you to choose your projects and work schedule. Candidates should have over 2 years of hands... 
    Hourly pay
    Remote work

    DataAnnotation

    Charleston, WV
    2 days ago
  • $40 per hour

    A cybersecurity-focused company is looking for experienced professionals to evaluate AI-generated security content and provide feedback to improve AI systems' understanding of threats. This role, which can be full-time or part-time, allows for flexible project selection... 
    Remote job
    Hourly pay
    Full time
    Part time
    Flexible hours

    DataAnnotation

    Boston, MA
    3 days ago
  • $40 per hour

    A cybersecurity innovation company is seeking experienced professionals to evaluate AI-generated security content and solve technical cybersecurity problems. In this remote position, you will work with advanced AI models and contribute to improving cybersecurity tools.... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Lansing, MI
    19 hours ago
  •  ...solutions company is looking for experienced cybersecurity professionals to help train AI models. You will work remotely to evaluate AI-generated security content, solve technical problems, and provide feedback to improve AI systems. Ideal candidates have 2+ years of hands-... 
    Remote job
    Flexible hours

    DataAnnotation

    New York, NY
    19 hours ago
  • A leading cybersecurity firm is seeking experienced professionals to evaluate AI-generated cybersecurity content and solve technical security problems. You will play a significant role in training AI models, providing critical feedback, and improving system accuracy. This... 
    Remote job
    Flexible hours

    DataAnnotation

    New York, NY
    3 days ago
  • $40 per hour

    A leading cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and solve technical problems in a flexible remote role. Ideal candidates should have over 2 years in cybersecurity, coding experience, strong analytical and writing... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Sioux Falls, SD
    19 hours ago
  • $40 per hour

    A cybersecurity firm is looking for experienced professionals to join its team. This remote role involves evaluating AI-generated security content and solving technical cybersecurity problems. Candidates should have over 2 years of hands-on experience in cybersecurity... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    3 days ago
  • $40 per hour

    A leading cybersecurity firm is seeking qualified professionals to evaluate AI-generated security content and solve technical problems. This remote role requires hands-on experience in cybersecurity, including penetration testing or related areas. Candidates should possess... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Oklahoma City, OK
    3 days ago
  • $40 per hour

     ...cybersecurity training firm is seeking professionals with over 2 years of hands-on experience in the field. You will assess AI-generated security content and contribute to improving AI models. Ideal candidates should have a background in areas such as penetration testing and... 
    Remote job
    Hourly pay

    DataAnnotation

    Raleigh, NC
    3 days ago
  • $40 per hour

     ...cybersecurity firm is seeking experienced cybersecurity professionals to join their team in a remote capacity. You will evaluate AI-generated security content and solve technical cybersecurity problems. The ideal candidate will have a minimum of 2 years hands-on... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Madison, WI
    3 days ago
  • $40 per hour

    A cybersecurity company is seeking experienced professionals to evaluate AI-generated security content and solve technical problems. This remote position offers the flexibility to choose projects and work on your own schedule, with projects starting at $40 per hour. Candidates... 
    Remote job
    Hourly pay

    DataAnnotation

    Columbia, SC
    3 days ago
  • $40 per hour

    A leading AI-focused cybersecurity firm is looking for experienced cybersecurity professionals to evaluate AI-generated content and solve technical security problems. In this flexible role, you can work remotely and choose your projects. Ideal candidates will have 2+ years... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    19 hours ago
  • $40 per hour

    A leading cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and solve technical cybersecurity problems. You will enhance how AI systems handle real-world threats while working remotely on an hourly project basis starting... 
    Remote job
    Hourly pay

    DataAnnotation

    California, MO
    3 days ago
  • $40 per hour

    A cybersecurity solutions provider is seeking experienced cybersecurity professionals for a REMOTE position. You will evaluate AI-generated security content, solve technical problems, and contribute to cybersecurity tools using your expertise. Candidates should have 2+... 
    Remote job
    Hourly pay

    DataAnnotation

    Oregon, WI
    3 days ago
  • $40 per hour

    A technology company specializing in cybersecurity is seeking experienced professionals to evaluate AI-generated security content and solve technical problems. This remote position is suitable for candidates with 2+ years in cybersecurity and a background in penetration... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Springfield, IL
    19 hours ago
  • $40 per hour

    A leading AI security solutions provider is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve real-world technical problems. In this remote role, candidates will require over 2 years of cybersecurity experience, fluency... 
    Remote job
    Hourly pay

    DataAnnotation

    Brooklyn, NY
    3 days ago
  • $40 per hour

    A tech company specializing in AI is looking for experienced cybersecurity professionals to evaluate AI-generated security content and solve technical problems. This role involves writing technical explanations and providing feedback to improve AI security models. Candidates... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Florida, NY
    19 hours ago
  • $40 per hour

    A cybersecurity solutions provider seeks experienced professionals to evaluate AI-generated content related to security issues. You will be solving technical problems, contributing directly to AI models. Required qualifications include 2+ years in cybersecurity, coding... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Washington DC
    19 hours ago
  • $40 per hour

    A cybersecurity company is seeking experienced professionals to join their team in evaluating AI-generated security content and solving technical cybersecurity problems. This is a flexible role that can be done from anywhere in the US, Canada, UK, Ireland, Australia, and... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    3 days ago
  • $40 per hour

     ...firm is seeking experienced cybersecurity professionals for a remote position in the United States. The role involves evaluating AI-generated security content, solving technical cybersecurity problems, and providing feedback to improve AI systems. Candidates should have... 
    Hourly pay
    Remote work

    DataAnnotation

    Providence, RI
    2 days ago
  • $40 per hour

     ...provider is seeking experienced cybersecurity professionals to help train AI models by evaluating cybersecurity content. Responsibilities include evaluating AI outputs, solving security problems, and providing can improve AI security reasoning. Ideal candidates should... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    3 days ago
  • $40 per hour

    A cybersecurity technology firm is looking to hire experienced cybersecurity professionals to evaluate AI-generated security content and design technical problems for AI training. This remote position allows you to work on a flexible schedule with hourly pay starting at... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Phoenix, AZ
    2 days ago
  • $40 per hour

    A technology company is seeking experienced cybersecurity professionals to join their remote team. The role involves evaluating AI-generated security content, solving technical cybersecurity problems, and providing feedback to enhance AI systems. Candidates should have... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Little Rock, AR
    2 days ago
  • $40 per hour

     ...technology firm is seeking experienced cybersecurity professionals for a remote position in the United States. You will evaluate AI-generated security content while solving technical problems to strengthen AI models. Ideal candidates have 2+ years in cybersecurity,... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Bismarck, ND
    2 days ago
  • $40 per hour

     ...cybersecurity-focused company is seeking experienced cybersecurity professionals for a remote position. This role involves evaluating AI-generated security content and solving technical cybersecurity problems while contributing to the development of AI systems. Candidates... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Juneau, AK
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to SOC Alert Security Evaluator [Remote]. Be the first to apply!