Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

SOC Alert Security Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

SOC Alert Security Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.

Why this role matters

Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.

Responsibilities

  • Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for SOC Alert Security Evaluator assignments.
  • Document every successful attack with reproduction steps and the policy clause it violated.
  • Score model defenses across single-turn and multi-turn conversations.
  • Triage emerging attack vectors and route them to the safety team with severity ratings.
  • Maintain a personal library of attack patterns and propose new red-team rubrics.
  • Calibrate against the broader red-team cohort to keep coverage and severity consistent.

Qualifications

  • Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for SOC Alert Security Evaluator work.
  • Strong written communication — your reports become the patch ticket.
  • Comfort working in policy-grey areas with clear documentation of what was attempted and why.
  • Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
  • Score a model's defenses against a known jailbreak pattern across 20 variants.
  • Propose a new red-team rubric category after spotting an emerging attack vector.
  • Reproduce a failure another reviewer reported and confirm the severity tag.

Nice to have

  • Background in offensive security, AppSec, or trust & safety operations.
  • Experience publishing or reproducing public adversarial-ML research.
  • Multilingual fluency for cross-language attack testing.

Skills

  • Adversarial prompting
  • Red-team analysis
  • Policy taxonomy
  • Failure documentation
  • SOC Alert Security evaluation
  • Security review
  • Adversarial testing
  • Threat modeling
  • Alert

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the SOC Alert Security Evaluator [Remote] in Remote vacancy
  • $63.59k - $121.53k

     ...USAA, our mission is to empower our members to achieve financial security through highly competitive products, exceptional service and...  ...will work within defined guidelines and framework, investigate, evaluate, negotiate and settle complex property insurance claims presented... 
    Suggested
    Hourly pay
    H1b
    Local area
    Remote work
    Relocation
    Afternoon shift

    USAA

    Portland, OR
    1 day ago
  • $60k - $63k

     ...professional team members who educate stakeholders through our reports, alerts, and reviews. Since 1969, our office has continued to innovate,...  .... We look forward to working with you! Accounting Compliance Evaluator Job Location: Address: 2910 N. 44th Street Phoenix, AZ 85018... 
    Suggested
    Temporary work
    Casual work
    Work at office
    Local area
    Remote work
    Flexible hours

    AZ State Jobs

    Phoenix, AZ
    1 day ago
  •  ...Identity Abuse Security Evaluator is a remote evaluation track for reviewing identity abuse security evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  •  ...Security Policy Bypass Security Evaluator is a remote review track for evaluating AI outputs in policy review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    5 days ago
  • Overview At PAM Health, we care for chronically and critically ill patients who require extended hospital care. PAM Health has over 80 hospital locations and employs over 11,000 people across the country. Our teams work together to deliver the highest level of compassionate...
    Suggested
    Full time
    Local area

    PAM Health

    Humble, TX
    3 days ago
  •  ...Staffco, LLC · MENTAL HEALTH SERV.Poughkeepsie, NYAllied Health Prof/TechnicalPer DiemAll ShiftsvariedJob SummaryThe Mental Health Evaluator (MHE) is a critical role dedicated to delivering comprehensive, clinically appropriate, culturally competent, and trauma-informed... 

    HealthAlliance of the Hudson Valley

    Poughkeepsie, NY
    3 days ago
  • $80 - $120 per hour

     ...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Houston, TX
    4 days ago
  • $16 - $20 per hour

     ...Research Evaluator Position The research team at Penn State Ross and Carol Nese College of Nursing is hiring part-time research evaluators for projects focused on dementia care in assisted living settings. The research evaluator will assist with in-person recruitment... 
    Hourly pay
    Part time
    Summer work

    Penn State University

    State College, PA
    10 hours ago
  • $9 - $30 per hour

    ALTA Language Services, Inc. is looking for a remote Testing Evaluator in Atlanta, GA. This part-time position involves assisting with language proficiency examinations and evaluating tests according to set criteria. Candidates should have strong communication skills, professionalism... 
    Part time
    Remote work

    ALTA Language Services

    United States
    1 day ago
  • A leading digital solutions provider is seeking a Personalized Ads Evaluator for a part-time position. This entry-level role involves reviewing online advertisements to assess their relevance to search terms, providing detailed feedback on content and cultural context.... 
    Part time
    Remote work

    TELUS Digital AI Data Solutions

    United States
    3 days ago
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical... 
    Hourly pay
    Part time
    Remote work
    Flexible hours

    Welo Data

    United States
    3 days ago
  • $80 - $120 per hour

     ...This role is for one of our clients Compensation: $80 - $120 per hour We are hiring expert Evaluators in Special education / IEP to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality.... 
    Hourly pay
    Contract work
    For contractors
    Work at office
    Remote work

    Weekday 1

    New York, NY
    4 days ago
  •  ...Weekday 1 is seeking expert Evaluators to review AI-generated real estate, hospitality and events outputs for accuracy, rigor and domain quality. You will apply deep expertise to grade documents, spreadsheets and slide decks. Requirements include 5+ years in Real estate... 
    Hourly pay
    Weekly pay
    Contract work
    Work at office
    Remote work
    Weekday work

    Weekday 1

    United States
    10 hours ago
  •  ...Luxury Brand Evaluator Turn your passion for luxury into a career opportunity. Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in customer experience, and work alongside iconic names... 
    Remote work
    Worldwide
    Flexible hours

    CXG

    United States
    3 days ago
  •  ...Shore Staffing, Inc. is seeking aMaryland Licensed Psychologistto join our growing behavioral health evaluation team. This flexible opportunity allows you toconduct comprehensive psychological evaluationsorprovide remote clinical supervision and oversight to a Psychology... 
    Relief
    Private practice
    Remote work
    Flexible hours

    Shore Staffing Inc

    Lexington Park, MD
    5 days ago
  •  ...Seeking a full-time Remote AI Research Evaluator with a PhD in Quantitative Finance to assess and enhance AI models' capabilities in financial reasoning and quantitative analysis through flexible, contract-based work. Key responsibilities Assessing the factuality and... 
    Full time
    Contract work
    Remote work
    Flexible hours

    Virtual Vocations Inc

    United States
    2 days ago
  •  ...About the role Swahili Evaluation AI Evaluator is a remote evaluation track for reviewing swahili generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback... 
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AI Trainer Jobs

    New York, NY
    3 days ago
  • $80 - $120 per hour

     ...Special Education Iep Evaluator This role is for one of our clients. Compensation: $80 - $120 per hour. We are hiring expert Evaluators in special education / IEP to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy... 
    Hourly pay
    Remote work

    Weekday

    United States
    4 days ago
  •  ...Obsidian is hiring expert Evaluators in Real estate, hospitality, and events to review AI-generated work for accuracy, rigor, and domain quality. This remote position requires deep expertise and involves grading outputs like documents and presentations. Applicants... 
    Work at office
    Remote work

    Obsidian

    San Francisco, CA
    4 days ago
  • $52k - $57k

     ...POSITION TITLE: Program Evaluator REPORTS TO: Director of Quality      BROAD FUNCTION:   Collects, analyzes, and reports on data to evaluate effectiveness of program services.  I. CORE VALUES: # CULTURAL PROFICIENCY: Articulates and applies historical context... 
    Full time
    Summer work
    Local area

    Family Connections

    East Orange, NJ
    10 hours ago
  •  ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional... 
    Work at office
    Remote work

    Obsidian

    New York, NY
    10 hours ago
  • $52 per hour

     ...Program Evaluator ATA Services is seeking Program Evaluators to provide evaluation and epidemiological support to the Adult Mental Health Division (AMHD) for reports to the legislature on emergency transportations, assisted community treatment petitions and orders,... 
    Hourly pay
    Contract work
    Local area
    Remote work
    Monday to Friday

    ATA Services, Inc.

    Honolulu, HI
    1 hour ago
  • $20 per hour

    A tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’s understanding of aesthetics. An ideal candidate will have a strong background in UI/UX design and... 
    Remote work
    Flexible hours

    DataAnnotation

    United States
    3 days ago
  • $14.5 per hour

     ...global community of over 500,000 AI training and domain experts...and we'd like you to join us! Job Description As a Web Search Evaluator, you will play a key role in improving the quality of search engine results, ensuring users find the most relevant and useful... 
    Part time
    Currently hiring
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Jobs for Humanity

    United States
    4 days ago
  • $11.5 per hour

     ...A leading educational institution is offering a part-time remote position as an Online Task Contributor. In this role, you will evaluate and provide feedback on content to enhance search engine results and quality. No prior experience is needed, but proficiency in English... 
    Hourly pay
    Part time
    Remote work

    University of Delaware

    United States
    3 days ago
  •  ...Alignerr is seeking Creative Writing Evaluators to assess AI-generated stories, essays, poetry, and other writings to shape how AI learns compelling prose. This fully remote, flexible contract roles welcomes avid readers and writers with no publishing credits required... 
    Contract work
    Remote work
    Flexible hours

    Alignerr Corp.

    United States
    10 hours ago
  • Title: Forensic EvaluatorState Role Title:Psych III/Psychology Assoc IIIHiring Range: $123,326.00 - $161,762.00Pay Band: 6Agency: Dept Behavioral Health/DevelopLocation: Va Center for Behavioral RehabAgency Website: Type: General Public - GJob DutiesThis position has the...
    Work experience placement
    Work at office
    Local area
    Remote work

    DHRM

    Virginia, MN
    10 hours ago
  • $14.5 per hour

     ...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years of experience in... 
    Bi-weekly pay
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Welo Data

    United States
    1 day ago
  • $50 - $70 per hour

     ...Expert (US/Canada) Type: Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for quality and correctness. Provide clear, well-reasoned written... 
    Contract work
    Summer work
    Remote work
    Flexible hours

    Mercor

    San Francisco, CA
    27 days ago
  • $75 per hour

     ...Role Responsibilities Develop and deliver sociology content through AI training initiatives for postsecondary education. Evaluate and review AI-generated coursework, assignments, and simulated academic papers. Create lectures, learning modules, and case studies... 
    Hourly pay
    Contract work
    Remote work

    Crossing Hurdles

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to SOC Alert Security Evaluator [Remote]. Be the first to apply!