Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

SOC Alert Security Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

SOC Alert Security Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.

Why this role matters

Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.

Responsibilities

  • Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for SOC Alert Security Evaluator assignments.
  • Document every successful attack with reproduction steps and the policy clause it violated.
  • Score model defenses across single-turn and multi-turn conversations.
  • Triage emerging attack vectors and route them to the safety team with severity ratings.
  • Maintain a personal library of attack patterns and propose new red-team rubrics.
  • Calibrate against the broader red-team cohort to keep coverage and severity consistent.

Qualifications

  • Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for SOC Alert Security Evaluator work.
  • Strong written communication — your reports become the patch ticket.
  • Comfort working in policy-grey areas with clear documentation of what was attempted and why.
  • Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
  • Score a model's defenses against a known jailbreak pattern across 20 variants.
  • Propose a new red-team rubric category after spotting an emerging attack vector.
  • Reproduce a failure another reviewer reported and confirm the severity tag.

Nice to have

  • Background in offensive security, AppSec, or trust & safety operations.
  • Experience publishing or reproducing public adversarial-ML research.
  • Multilingual fluency for cross-language attack testing.

Skills

  • Adversarial prompting
  • Red-team analysis
  • Policy taxonomy
  • Failure documentation
  • SOC Alert Security evaluation
  • Security review
  • Adversarial testing
  • Threat modeling
  • Alert

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the SOC Alert Security Evaluator [Remote] in Remote vacancy
  •  ...Cloud Security AI Evaluator is a remote evaluation track for reviewing cloud security ai evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  • Title: Forensic EvaluatorState Role Title: Psych III/Psychology Assoc IIIHiring Range: $123,326.00 - $161,762.00Pay Band: 6Agency: Dept Behavioral Health/DevelopLocation: Va Center for Behavioral RehabAgency Website: Type: General Public - GJob DutiesThis position has ...
    Suggested
    Work experience placement
    Work at office
    Local area
    Remote work

    Commonwealth of Virginia, USA

    Nottoway, VA
    1 hour ago
  •  ...Staffco, LLC · MENTAL HEALTH SERV.Poughkeepsie, NYAllied Health Prof/TechnicalPer DiemAll ShiftsvariedJob SummaryThe Mental Health Evaluator (MHE) is a critical role dedicated to delivering comprehensive, clinically appropriate, culturally competent, and trauma-informed... 
    Suggested

    HealthAlliance of the Hudson Valley

    Poughkeepsie, NY
    4 days ago
  •  ...Overview Become a Luxury Brand Evaluator in NYC, NY - Apply Now. Join to apply for the Become a Luxury Brand Evaluator in NYC, NY - Apply Now role at CXG. About the Role As a luxury brand evaluator, you will discreetly assess customer experiences, providing... 
    Suggested
    Full time
    Contract work
    Flexible hours

    CXG

    Hoboken, NJ
    5 days ago
  • $16 - $20 per hour

     ...Research Evaluator Position The research team at Penn State Ross and Carol Nese College of Nursing is hiring part-time research evaluators for projects focused on dementia care in assisted living settings. The research evaluator will assist with in-person recruitment... 
    Suggested
    Hourly pay
    Part time
    Summer work

    Penn State University

    State College, PA
    2 days ago
  • $52k - $57k

     ...POSITION TITLE: Program Evaluator REPORTS TO: Director of Quality BROAD FUNCTION: Collects, analyzes, and reports on data to evaluate effectiveness of program services. I. CORE VALUES: CULTURAL PROFICIENCY: Articulates and applies historical context of racism and understands... 
    Full time
    Summer work
    Local area

    Family-Connections,-Inc.-

    Cranford, NJ
    4 days ago
  •  ...Web Browsing Evaluator Contractor Remote Micro1 is engaging Web Browsing Evaluators to contribute high-quality web interaction...  ...confidentiality and adhere to all project compliance and security protocols. Preferred Qualifications Demonstrated expertise... 
    For contractors
    Remote work

    ESR Healthcare

    New York, NY
    5 days ago
  • $9 - $30 per hour

    ALTA Language Services, Inc. is looking for a remote Testing Evaluator in Atlanta, GA. This part-time position involves assisting with language proficiency examinations and evaluating tests according to set criteria. Candidates should have strong communication skills, professionalism... 
    Part time
    Remote work

    ALTA Language Services

    Atlanta, GA
    3 days ago
  • $14.5 per hour

     ...AI Web Search Evaluator Unlock the Power of the Internet! Are you curious, tech-savvy, and passionate about improving online search experiences? Join our team as a Web Search Evaluator and help shape the future of search engines from the comfort of your home! As... 
    Bi-weekly pay
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Welo Data

    United States
    2 days ago
  •  ...BAM Ventures is seeking Swedish-speaking remote annotators to evaluate AI-generated content, ensuring that it's coherent and aligns with real-world expectations. Your role will involve reviewing outputs, identifying deviations, and providing structured feedback to enhance... 
    Remote work

    BAM VENTURES LLC

    New York, NY
    2 days ago
  • $11.5 per hour

     ...A leading educational institution is offering a part-time remote position as an Online Task Contributor. In this role, you will evaluate and provide feedback on content to enhance search engine results and quality. No prior experience is needed, but proficiency in English... 
    Hourly pay
    Part time
    Remote work

    University of Delaware

    United States
    4 days ago
  • $58 per hour

     ...Clinical Faculty Evaluator | College of Nursing, WSU Tri Cities (Richland, WA) Washington State University Tri-Cities College of Nursing invites applications for caring, committed nurse practitioners to work as part-time/hourly Clinical Faculty Evaluators (CFEs) in the... 
    Hourly pay
    Part time
    Fixed term contract

    Washington State University

    Richland, WA
    4 days ago
  • $185 per hour

     ...Job Description Position Vacancy Physical Therapy Evaluator The Home and Community-Based Program evaluates preschoolers for special education for the New York City Public Schools (NYCPS) Committee on Preschool Special Education (CPSE). Physical Therapy Evaluations... 
    Immediate start
    Work from home

    Bank Street College of Education

    New York, NY
    5 days ago
  •  ...Luxury Brand Evaluator CXG is a global Customer Experience consulting firm specializing exclusively in serving premium and luxury brands. We partner with premium and luxury brands to transform experiences for meaningful impact. We provide valuable insights and support... 
    Worldwide
    Flexible hours

    CXG

    Chicago, IL
    5 days ago
  • A leading tech organization is seeking candidates aged 18 to 19 to evaluate North American teen humor through structured rating and comparative ranking. This role requires familiarity with teen internet culture and humor, and the ability to articulate why content resonates... 
    Remote job
    Part time
    For contractors
    Freelance
    Flexible hours

    Turing

    Los Angeles, CA
    2 days ago
  • CXG group is seeking a Luxury Brand Evaluator to discreetly assess customer experiences across luxury stores and online channels. You will visit boutiques, observe service quality, ambiance, and overall experience, then share honest feedback through our platform. This role... 
    Flexible hours

    CXG group

    Miami, FL
    4 days ago
  • CXG is a global leader in customer experience, connecting premium brands with thousands of evaluators. We offer flexible fashion, beauty, jewelry, and automotive assignments to discreetly assess shopping experiences. As a luxury brand evaluator, you will visit stores or... 
    Flexible hours

    CXG group

    Livermore, CA
    5 days ago
  • A leading luxury brand evaluation company seeks evaluators to provide critical feedback on premium brands. As a luxury brand evaluator, you'll assess customer experiences discreetly, visiting stores or engaging online. The role offers flexibility and compensation for your... 

    CXG

    Florida, NY
    1 day ago
  • A luxury brand evaluation company in Charlotte, NC is seeking a Freelance Luxury Brand Evaluator to assess customer experiences with premium brands. This role offers flexibility in assignments, allowing you to choose visits to luxury stores or online evaluations. Ideal... 
    Remote job
    Freelance

    CXG

    Charlotte, NC
    2 days ago
  • A global leader in customer experience is seeking luxury brand evaluators to assess customer experiences discreetly. In this role, you will visit luxury stores or evaluate online, providing valuable feedback that helps refine services. As a part of this unique opportunity... 
    Flexible hours

    CXG

    Charlotte, NC
    4 days ago
  • CXG is seeking luxury brand evaluators to discreetly assess customer experiences across premium brands worldwide. You will visit stores or evaluate online, providing detailed feedback to help brands refine their services and elevate the luxury experience. No prior experience... 
    Worldwide

    CXG group

    Fort Myers, FL
    4 days ago
  • Mercor is seeking experts in Spreadsheet QA and workbook maintenance to review AI-generated documents, spreadsheets, and slide decks for accuracy and quality. This is a remote, hourly engagement. Ideal candidates have 5+ years in Spreadsheet QA, fluent English, and strong...
    Remote job
    Hourly pay
    Work at office

    Mercor

    Miami, FL
    5 days ago
  • Mercor is seeking expert Evaluators in Privacy/regulatory compliance to review AI-generated documents, spreadsheets, and slide decks for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs. This is a remote, hourly engagement... 
    Remote job
    Hourly pay
    Work at office

    Mercor

    New York, NY
    2 days ago
  • CXG invites you to turn your passion for luxury into a flexible, home-based role evaluating premium brands. Visit stores or evaluate online, then share your observations through our platform. No prior experience required; honest feedback from genuine customers is valued... 
    Work from home
    Flexible hours

    CXG

    Walnut Creek, CA
    1 day ago
  • A luxury brand evaluation company is seeking a Luxury Brand Evaluator to assess customer experiences with premium brands. The role offers flexibility in choosing assignments and entails evaluating services in-store or online. Ideal candidates are detail-oriented, observant... 
    Flexible hours

    CXG

    Belvedere Tiburon, CA
    1 day ago
  • YO AI Labs in the United States (remote) seeks Dutch bilingual experts to evaluate AI-generated Dutch speech for nativeness, fluency, and overall quality. You will provide detailed feedback to support language model improvements and ensure linguistic authenticity. No prior... 
    Remote job

    YO AI Labs

    Miami, FL
    1 day ago
  • A premier customer experience assessment company seeks a Freelance Luxury Brand Evaluator in Newtown Square. This role requires evaluating high-end automotive brands through in-store visits or online assessments. Candidates should be 18+, possess a strong understanding... 
    Freelance
    Flexible hours

    CXG

    Newtown Square, PA
    2 days ago
  • CXG in Boise, Idaho, is looking for a Luxury Brand Evaluator to assess customer experiences for iconic brands. You will have the flexibility to choose your assignments, from in-store visits to online evaluations. This role is perfect for someone passionate about luxury... 
    Flexible hours

    CXG

    Boise, ID
    2 days ago
  • A leading customer experience company in New Jersey is seeking a luxury brand evaluator to help refine services for top brands. This role involves assessing customer experiences through in-store visits or online interactions, providing critical feedback that influences... 
    Flexible hours

    CXG

    Paramus, NJ
    1 day ago
  • Freelance Luxury Brand Evaluator Automotive Project - Newtown Square Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are looking for you! As a Luxury Brand Evaluator, you will step into the world of... 
    Freelance
    Worldwide
    Flexible hours

    CXG

    Newtown Square, PA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to SOC Alert Security Evaluator [Remote]. Be the first to apply!