Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Vulnerability Expert - Fully Remote | Upto $90/hr

$90 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: LLM Red Team Specialist — Failure Modes & Edge Cases
Type: Contract
Compensation: $60–$90/hour
Location: Remote
Commitment: 35 hours/week

Role Responsibilities

  • Probe models to explore how frontier AI models handle coding , ML , and analysis tasks. Identify spots where models quietly fail.
  • Design challenges by turning identified weaknesses into well-crafted tasks that are challenging for models but fair to grade.
  • Document findings clearly with reproducible evidence and steps.
  • Strengthen tasks by collaborating with task authors to close loopholes, shortcuts, and grading gaps.
  • Work as a team by sharing insights with researchers and fellow experts to continually improve the benchmark.

Qualifications

Must-Have

  • MSc or PhD in a STEM field or equivalent practical experience.
  • 1+ years of experience in research, research-engineering, security, or AI-evaluation roles.
  • Ability to identify vulnerabilities, edge cases, or failure modes in LLMs or ML systems .
  • Proficiency in Python and Git for scripting probes and analyses.
  • Familiarity with LLM capabilities , limitations, and evaluation techniques.
  • Ability to engage reliably for approximately 35 hours/week .

Preferred

  • Experience in AI training , model evaluation, or benchmark/task authoring.
  • High attention to detail, creativity, and strong written communication skills.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Vulnerability Expert - Fully Remote | Upto $90/hr in San Francisco, CA vacancy
  • $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week...  ...ML , and analysis tasks to identify vulnerabilities and failure modes. Design complex... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    11 days ago
  • $90 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Task Auditor Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality and correctness... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    12 days ago
  • $22 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Dorsey . Position: AI Safety Experts — English & Malayalam Type...  ...$16–$22/hour Location: Remote Role Responsibilities...  ...annotating failures, classifying vulnerabilities, and flagging systemic risks.... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    a month ago
  • $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: Chess Expert (1800+ ELO) — Game Reconstruction & Transcript...  ...Type: Contract Compensation: $90/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Flexible hours

    Mercor

    San Francisco, CA
    10 days ago
  • $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: Visual Quality Expert (Film, VFX & Animation) Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 20 hours/week Role Responsibilities... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    2 days ago
  • $90 per hour

     ...working with a leading foundational AI lab to find experienced IT...  ...dashboards. Compensation $90/hour Commitment Flexible, 5-...  ...or more if desired) Location Fully remote, work on your own schedule Start...  ...or audit framework Expert-level document, spreadsheet, and... 
    Remote work
    Immediate start
    Flexible hours

    Ethos

    New York, NY
    1 day ago
  • $70 - $90 per hour

     ...Network Engineering (Remote | $70–$90/hr) Position: Network Engineering Type: Hourly Contract Compensation: Writers: $70–$80...  ...Location: Remote About the Opportunity Contribute to an AI research project focused on enterprise, data-center, cloud,... 
    Remote work
    Hourly pay
    Contract work

    Synthires

    United States
    2 days ago
  • $140 per hour

     ...technical talent with leading AI research labs....  ...Contract Compensation: $90–$140/hour Location: Remote Role Responsibilities...  ...AI systems for security vulnerabilities, unsafe behavior, and policy...  ...with other subject matter experts to ensure consistency... 
    Remote job
    Contract work
    Part time
    Summer work
    Weekday work

    Mercor

    New York, NY
    9 days ago
  • $90 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Simulation Specialist Type: Contract Compensation: $60–$90/hour Location: Remote Role Responsibilities Develop simulations and... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    10 days ago
  • $145 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications) Type...  ...Compensation: $110–$145/hour Location: Remote Role Responsibilities Evaluate the... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    10 days ago
  • $90 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Dorsey . Position: Product Management Expert Type: Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct enterprise... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    6 days ago
  • $90 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Dorsey . Position: Product Management Expert Type: Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct enterprise... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    28 days ago
  • $90 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Jack Dorsey . Position: Architecture Expert Type: Contract Compensation: $65–$90/hour Location: Remote Commitment: 10 hours/week Role Responsibilities... 
    Remote job
    Contract work
    Part time
    Summer work
    10 hours per week

    Mercor

    San Francisco, CA
    8 days ago
  • $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ..., and Jack Dorsey . Position: CVE Vulnerability Expert Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    24 days ago
  • $160 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-specific documents... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    15 days ago
  • $45 - $90 per hour

    Undisclosed is seeking a fully remote, worldwide contract HR/People Operations specialist to develop realistic evaluation...  ...apply hands-on expertise to assess AI system capabilities and create...  ...a market-rate hourly compensation of $45 to $90. #J-18808-Ljbffr Undisclosed
    Remote job
    Hourly pay
    Contract work
    Worldwide
    Flexible hours

    Undisclosed

    New York, NY
    1 day ago
  • $90 - $140 per hour

     ...Job Description Mathematics Expert Position: Mathematics Expert (...  ...Contractor Compensation: $90–$140 per hour Location: Global, fully remote About the Opportunity This...  ...mathematics experts to contribute to AI training projects involving advanced... 
    Remote job
    Hourly pay
    For contractors
    Immediate start
    Flexible hours

    Synthires

    West Virginia
    8 days ago
  • $45 - $90 per hour

    Contribute to AI evaluation projects by creating realistic HR and People Operations tasks. Apply hands-on professional...  ...projects to quality standards. Fully remote, worldwide contract role with flexible...  .... Compensation between $45 and $90 USD per hour depending on... 
    Remote job
    Hourly pay
    Contract work
    Worldwide
    Flexible hours

    Undisclosed

    New York, NY
    1 day ago
  • $45 - $90 per hour

    HR & People Operations Expert - AI Training Projects | 100% Remote Contract Our client is an organization developing and evaluating...  ...evaluation projects. In this fully remote, project-based contractor...  ...- Worldwide Compensation: $45-$90 USD per hour, depending on qualifications... 
    Remote job
    Hourly pay
    Contract work
    For contractors
    Worldwide
    Flexible hours

    Elitebrain

    Tallahassee, FL
    1 day ago
  • $90 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...: Knowledge Management Expert Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate...  ...and workplace AI tools on HR topics within your area of expertise... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    12 days ago
  • $110 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Compliance Engagements Type: Contract Compensation: $90–$110/hour Location: Remote Role Responsibilities Complete a ~15 minute written... 
    Remote job
    Hourly pay
    Contract work
    For contractors
    Summer work

    Mercor

    New York, NY
    12 days ago
  • $100 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Position: Investor Relations Expert Type: Contract...  ...$100/hour Location: Remote Role Responsibilities Draft...  ...ownership base, assess activist vulnerability, and draft dividend and capital... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    8 days ago
  • $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role...  .... Collaborate with researchers and experts to maintain task consistency and rigor... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    1 day ago
  • $90 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Experimentation Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities... 
    Remote work
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work

    Mercor

    New York, NY
    a month ago
  • $90 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Test Engineer Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    12 days ago
  • $90 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Task Auditor Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality and correctness... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    12 days ago
  • $90 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...: Data Science & Quantitative Analysis Expert Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    a month ago
  • $90 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...: Data Science & Quantitative Analysis Expert Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities... 
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work

    Mercor

    New York, NY
    13 days ago
  • $90 per hour

     ...working with a leading foundational AI lab to find experienced heads...  ...stakeholders. Compensation: $90/hour Commitment: Flexible, 5...  ...more if desired) Location: Fully remote, work on your own schedule...  ...models in Excel or Google Sheets Expert-level document, spreadsheet,... 
    Remote work
    Immediate start
    Flexible hours

    Ethos

    New York, NY
    2 days ago
  • $77 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $61–$77/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities...  ...question's difficulty as Medium, Hard, or Expert, providing 1 correct answer and 9... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Vulnerability Expert - Fully Remote | Upto $90/hr. Be the first to apply!