Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Jailbreak Exploit Security Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Jailbreak Exploit Security Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.

Why this role matters

Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.

Responsibilities

  • Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Jailbreak Exploit Security Evaluator assignments.
  • Document every successful attack with reproduction steps and the policy clause it violated.
  • Score model defenses across single-turn and multi-turn conversations.
  • Triage emerging attack vectors and route them to the safety team with severity ratings.
  • Maintain a personal library of attack patterns and propose new red-team rubrics.
  • Calibrate against the broader red-team cohort to keep coverage and severity consistent.

Qualifications

  • Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Jailbreak Exploit Security Evaluator work.
  • Strong written communication — your reports become the patch ticket.
  • Comfort working in policy-grey areas with clear documentation of what was attempted and why.
  • Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
  • Score a model's defenses against a known jailbreak pattern across 20 variants.
  • Propose a new red-team rubric category after spotting an emerging attack vector.
  • Reproduce a failure another reviewer reported and confirm the severity tag.

Nice to have

  • Background in offensive security, AppSec, or trust & safety operations.
  • Experience publishing or reproducing public adversarial-ML research.
  • Multilingual fluency for cross-language attack testing.

Skills

  • Adversarial prompting
  • Red-team analysis
  • Policy taxonomy
  • Failure documentation
  • Jailbreak Exploit Security evaluation
  • Security review
  • Adversarial testing
  • Threat modeling
  • Jailbreak
  • Exploit

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 27 days ago
Similar jobs that could be interesting for youBased on the Jailbreak Exploit Security Evaluator [Remote] in Remote vacancy
  •  ...CTF Challenge Security Evaluator is a remote evaluation track for reviewing ctf challenge security evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    14 days ago
  •  ...Security Policy Bypass Security Evaluator is a remote review track for evaluating AI outputs in policy review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    27 days ago
  •  ...The Mental Health Evaluator (MHE) is a critical role dedicated to delivering comprehensive, clinically appropriate, culturally competent, and trauma-informed patient behavioral health interventions in the hospital Emergency Department. Responsibilities include conducting... 
    Suggested

    WMCHealth

    Poughkeepsie, NY
    17 hours ago
  • Overview At PAM Health, we care for chronically and critically ill patients who require extended hospital care. PAM Health has over 80 hospital locations and employs over 11,000 people across the country. Our teams work together to deliver the highest level of compassionate...
    Suggested
    Full time
    Local area

    PAM Health

    Humble, TX
    2 days ago
  • Title: Forensic EvaluatorState Role Title: Psych III/Psychology Assoc IIIHiring Range: $123,326.00 - $161,762.00Pay Band: 6Agency: Dept Behavioral Health/DevelopLocation: Va Center for Behavioral RehabAgency Website: Type: General Public - GJob DutiesThis position has ...
    Suggested
    Work experience placement
    Work at office
    Local area
    Remote work

    Commonwealth of Virginia, USA

    Nottoway, VA
    4 days ago
  • $110k

     ...Clinician is a hybrid clinical role designed for experienced clinicians who split their time between neurodevelopmental diagnostic evaluations and ongoing psychotherapy services. This role allows flexibility to tailor each clinician's mix of diagnostic evaluations and... 
    Full time
    Contract work
    Remote work
    Flexible hours
    Weekend work
    1 day per week
    Weekday work

    Blackbird Health

    Pittsburgh, PA
    11 days ago
  • $20 per hour

    A tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’s understanding of aesthetics. An ideal candidate will have a strong background in UI/UX design and... 
    Remote work
    Flexible hours

    DataAnnotation

    Columbia, SC
    2 days ago
  • $80 - $120 per hour

     ...Special Education / IEP Evaluator $80-$120 per hour Hourly contract, remote About the Role We are hiring expert Evaluators in Special Education / IEP to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor... 
    Hourly pay
    Contract work
    For contractors
    Work at office
    Remote work

    Dorado

    United States
    1 day ago
  • $19.25 per hour

     ...standing in order to operate a company vehicle. Assist in Fruit Evaluation Management team duties Monitor crop volumes and fruit sizing...  ...vision and dental plans, and a 401k with match eligibility to secure your financial future and including: 24/7 online physician consultations... 
    Seasonal work
    Work at office
    Local area
    Worldwide
    Flexible hours
    Afternoon shift

    The Wonderful Company

    Del Rey, CA
    2 days ago
  • A leading digital solutions provider is seeking a Personalized Ads Evaluator for a part-time position. This entry-level role involves reviewing online advertisements to assess their relevance to search terms, providing detailed feedback on content and cultural context.... 
    Part time
    Remote work

    TELUS Digital AI Data Solutions

    New York, NY
    2 days ago
  •  ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional... 
    Work at office
    Remote work

    Obsidian

    New York, NY
    1 day ago
  •  ...BAM Ventures is seeking Swedish-speaking remote annotators to evaluate AI-generated content, ensuring that it's coherent and aligns with real-world expectations. Your role will involve reviewing outputs, identifying deviations, and providing structured feedback to enhance... 
    Remote work

    BAM VENTURES LLC

    New York, NY
    1 day ago
  • $52k - $57k

     ...POSITION TITLE: Program Evaluator REPORTS TO: Director of Quality BROAD FUNCTION: Collects, analyzes, and reports on data to evaluate effectiveness of program services. I. CORE VALUES: CULTURAL PROFICIENCY: Articulates and applies historical context of racism and understands... 
    Full time
    Summer work
    Local area

    Family-Connections,-Inc.-

    Cranford, NJ
    3 days ago
  •  ...Alignerr is seeking a Search Quality Evaluator to assess search engine results, AI-generated answers, and content recommendations. This fully remote, flexible contract role values strong critical thinking and quality instincts, with no technical background required beyond... 
    Contract work
    Remote work
    Flexible hours

    Alignerr

    Peru, IL
    2 days ago
  • $9 - $30 per hour

    ALTA Language Services, Inc. is looking for a remote Testing Evaluator in Atlanta, GA. This part-time position involves assisting with language proficiency examinations and evaluating tests according to set criteria. Candidates should have strong communication skills, professionalism... 
    Part time
    Remote work

    ALTA Language Services

    Atlanta, GA
    2 days ago
  •  ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers... 
    Contract work
    Temporary work
    Immediate start
    Remote work

    MERIT Beauty

    New York, NY
    3 days ago
  •  ...hackajob is collaborating with Mercor to connect them with exceptional professionals for this role. About the role We are hiring expert Evaluators in Program management / implementation planning to review and assess AI-generated work products (documents, spreadsheets, and... 
    Hourly pay
    Work at office
    Remote work

    Mercor Inc

    United States
    2 days ago
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical... 
    Hourly pay
    Part time
    Remote work
    Flexible hours

    Welo Data

    New York, NY
    2 days ago
  • $30 - $45 per hour

     ...Job Description: Web Browsing Evaluator remote $30 - $45/hour pay Required Skills Attention to Detail Data Annotation...  ...confidentiality and adhere to all project compliance and security protocols. Preferred Qualifications Demonstrated... 
    For contractors
    Remote work

    ESR Healthcare

    United States
    4 days ago
  •  ...team of experts passionate about our mission and embracing our core values in everything we do. NATURE AND SCOPE: The Lead Evaluator, Early Learning will provide high quality personalized and customized service to early learning institutions (birth through kindergarten... 
    Part time
    Work experience placement
    Work at office
    Local area
    Remote work

    Cognia, Inc.

    Alpharetta, GA
    12 days ago
  • $14.5 per hour

     ...the Internet! Are you curious, tech-savvy, and passionate about improving online search experiences? Join our team as a Web Search Evaluator and help shape the future of search engines from the comfort of your home! What You’ll Do: As a Web Search Evaluator, you will:... 
    Bi-weekly pay
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Jobs for Humanity

    Jacksonville, FL
    23 hours ago
  • $45 - $85 per hour

     ...Ixolabs is seeking an Animation Quality Evaluator to refine AI-generated animations. The ideal candidate will evaluate motion fluidity and naturalness, ensuring animations convey believable narratives. The role is part-time (15-25 hours/week) and offers competitive compensation... 
    Part time
    Remote work

    Ixolabs

    Washington DC
    1 day ago
  •  ...A luxury brand evaluation company in Charlotte, NC is seeking a Freelance Luxury Brand Evaluator to assess customer experiences with premium brands. This role offers flexibility in assignments, allowing you to choose visits to luxury stores or online evaluations. Ideal... 
    Freelance
    Remote work

    CXG

    Charlotte, NC
    23 hours ago
  •  ...with native Turkish fluency for a remote freelance opportunity. This role will focus on AI-related projects that involve prompt evaluation and multimedia content understanding. Ideal candidates will have a strong command of English and experience as reviewers or evaluators... 
    Freelance
    Remote work

    Lilt

    New York, NY
    23 hours ago
  • $16 - $20 per hour

     ...DESCRIPTION AND POSITION REQUIREMENTS The research team at Penn State Ross and Carol Nese College of Nursing is hiring part‑time research evaluators for projects focused on dementia care in assisted living settings. The research evaluator will assist with in‑person recruitment,... 
    Hourly pay
    Part time
    Summer work

    The Pennsylvania State University

    Hershey, PA
    2 days ago
  • $14.5 per hour

     ...training and domain experts. Key Responsibilities Analyze search result performance and provide insights on relevance and quality. Evaluate and rate the effectiveness of search engine results to ensure they meet user expectations. Offer feedback and recommendations to... 
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Kanz.us

    Dallas, TX
    2 days ago
  • $19 - $21 per hour

     ...Description We are seeking a motivated and experienced MID Intake Evaluator to join our organization! The MID Intake Evaluator will work...  ...and organizations to promote programs and to identify and secure potential new alliances, partnerships and funding sources. 10... 
    Hourly pay
    Full time
    Local area
    Remote work
    Trial period

    Mental Health Association - Western MA

    Chicopee, MA
    3 days ago
  • $100 per hour

    Role Description We’re looking for a highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code. This is not a traditional engineering role. You won’t be writing production code... 
    Contract work
    Immediate start

    G2i Inc.

    Remote
    3 days ago
  • Job Description Job Description Company Description Chamberlain With more than 135 years of history in healthcare education and as the largest nursing school in the country, Chamberlain University is committed to delivering a high-value education that prepares...
    Work at office
    Worldwide
    Flexible hours
    Weekday work

    Chamberlain University

    Monroe, LA
    4 days ago
  •  ...United States is seeking a Hematology Expert to contribute clinical expertise to a healthcare AI project. Remote contractor role evaluating clinical content, reviewing trial data, and providing expert medical judgment. Candidates should hold board certification in Medical... 
    Remote job
    For contractors

    Jobleads-US

    Houston, TX
    23 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Jailbreak Exploit Security Evaluator [Remote]. Be the first to apply!