Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Safety Expert - Red Teaming

Obsidian

Location Remote Fluent Language Skills Required English & Punjabi. Native fluency in both languages is required. Why This Role Exists At Mercor, we believe the safest AI is the one that’s already been attacked — by us. We are assembling a red team for this project – human data experts who probe AI models with adversarial inputs, surface vulnerabilities, and generate the red team data that makes AI safer for our customers. This project involves reviewing AI outputs that touch on sensitive topics such as bias, misinformation, or harmful behaviors. All work is text‑based, and participation in higher‑sensitivity projects is optional and supported by clear guidelines and wellness resources. Before being exposed to any content, the topics will be clearly communicated. What You’ll Do Red team conversational AI models and agents: jailbreaks, prompt injections, misuse cases, bias exploitation, multi‑turn manipulation Generate high‑quality human data: annotate failures, classify vulnerabilities, and flag systemic risks Apply structure: follow taxonomies, benchmarks, and playbooks to keep testing consistent Document reproducibly: produce reports, datasets, and attack cases customers can act on Who You Are You bring prior red‑teaming experience (AI adversarial work, cybersecurity, socio‑technical probing) You’re curious and adversarial: you instinctively push systems to breaking points You’re structured: you use frameworks or benchmarks, not just random hacks You’re communicative: you explain risks clearly to technical and non‑technical stakeholders You’re adaptable: thrive on moving across projects and customers Nice‑to‑Have Specialties Adversarial ML: jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction Cybersecurity: penetration testing, exploit development, reverse engineering Socio‑technical risk: harassment/disinfo probing, abuse analysis, conversational AI testing Creative probing: psychology, acting, writing for unconventional adversarial thinking What Success Looks Like You uncover vulnerabilities automated tests miss You deliver reproducible artifacts that strengthen customer AI systems Evaluation coverage expands: more scenarios tested, fewer surprises in production Mercor customers trust the safety of their AI because you’ve already probed it like an adversary Why Join Mercor Build experience in human data‑driven AI red teaming at the frontier of safety Play a direct role in making AI systems more robust, safe, and trustworthy #J-18808-Ljbffr Obsidian

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Safety Expert - Red Teaming in San Francisco, CA vacancy
  • $29 - $45 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Summers , and Jack Dorsey . Position: AI Safety Experts — English & Portuguese (global) Type: Contract...  ...: Remote Role Responsibilities Red team conversational AI models and agents by performing... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor Inc

    San Francisco, CA
    4 days ago
  • $48 - $62 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ..., and Jack Dorsey . Position: AI Safety Experts — English & Danish Type: Contract...  ...: Remote Role Responsibilities Red team conversational AI models and agents to... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    13 days ago
  • $48 - $62 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ..., and Jack Dorsey . Position: AI Safety Experts — English & Finnish Type: Contract...  ...: Remote Role Responsibilities Red team conversational AI models and agents to... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    15 days ago
  • $70 - $84 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Summers , and Jack Dorsey . Position AI Safety Red Teamer Type Contract Compensation $70-$84...  ...contribute to safety benchmarking and red-teaming reports. Collaborate with AI researchers... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • We are seeking experienced AI Safety Red Teamers to identify vulnerabilities in frontier AI systems through adversarial testing. You will...  ...vulnerabilities and contribute to safety benchmarking and red-teaming reports. Collaborate with AI researchers to improve model alignment... 
    Suggested

    Obsidian

    San Francisco, CA
    1 day ago
  • $80 - $150 per hour

     ...are partnering with a leading AI research organisation to develop...  ...for this important AI safety initiative. Responsibilities Author...  ...generated conversations and provide expert judgment to calibrate...  ...in multidisciplinary clinical teams. Role Details Commitment: Approximately... 
    Hourly pay
    Traineeship
    10 hours per week

    Obsidian

    San Francisco, CA
    1 day ago
  • YO AI Labs is seeking a Pharmacovigilance Expert to contribute drug safety expertise to a healthcare AI project. You will review pharmacovigilance documentation, safety...  ...guidelines. Remote contractor arrangement with flexible collaboration across teams. #J-18808-Ljbffr YO AI Labs
    Remote job
    For contractors
    Flexible hours

    YO AI Labs

    San Francisco, CA
    4 days ago
  • Obsidian is seeking experienced AI Safety Practitioners to evaluate safety, quality, and alignment of frontier AI models across complex...  ...violence, cyber, biosecurity, and other sensitive domains, and collaborate with researchers and safety teams to #J-18808-Ljbffr Obsidian

    Obsidian

    San Francisco, CA
    1 day ago
  • $60 - $70 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Summers , and Jack Dorsey . Position: AI Safety Practitioner Type: Contract Compensation...  ...with AI researchers and safety teams on ongoing evaluation initiatives. Qualifications... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    5 days ago
  • We are seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex,...  ...safety performance. Collaborate with AI researchers and safety teams on ongoing evaluation initiatives. Required Qualifications Bachelor... 
    Worldwide

    Obsidian

    San Francisco, CA
    3 days ago
  • Obsidian is seeking clinicians and researchers to help design a clinician-informed benchmark evaluating how AI chatbots respond to adolescents facing mental health challenges. You will author realistic case scenarios, review clinical realism and ethics, and help calibrate... 

    Obsidian

    San Francisco, CA
    1 day ago
  • $293.5k

     ...Information Job Title Expert Senior Manager, AI Engineering Job ID 104...  ...seven times. Extraordinary teams are at the heart of our business...  ...performance, safety, responsible AI principles,...  ...Implement guardrails, fallbacks, red-teaming strategies, and human... 
    Permanent employment
    Full time
    Apprenticeship
    Work at office
    Local area
    Work from home
    Home office
    3 days per week

    Bain & Company

    San Francisco, CA
    10 hours ago
  •  ...YO AI Labs is seeking a Hematology Expert for remote contractor work. You will contribute clinical expertise in Oncology and Hematology to evaluate trial...  ...written explanations of findings. Remote collaboration with global teams is expected. #J-18808-Ljbffr Jobleads-US
    Remote job
    For contractors

    Jobleads-US

    San Francisco, CA
    4 days ago
  • Mercor is seeking a Music Audio Expert (Swedish) for a remote, contract-based opportunity. The role involves evaluating AI-generated music outputs, scoring training data quality, and collaborating with AI research teams to improve model performance. The candidate should... 
    Remote job
    Contract work
    Immediate start
    10 hours per week

    Mercor

    San Francisco, CA
    2 days ago
  •  ...Physics PhD to tackle complex physics problems and ensure the accuracy of AI-generated solutions. The role involves independently solving physics challenges and collaborating with AI research teams. Ideal candidates will have a PhD in Physics from a top program, a strong... 
    Remote job
    Immediate start

    Mercor

    San Francisco, CA
    4 days ago
  • $145 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications) Type...  ...clear, structured feedback to AI research teams to improve training data quality and downstream... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    13 days ago
  •  ...vivo work. You will operate independently during overnight periods, then hand off clean, well-documented work to the day team, contributing to safety and efficacy evaluations for potential new therapies. The role involves dosing mice via IP/IV/SC/PO routes, collecting... 
    Visa sponsorship
    Night shift

    Capable Labs

    San Francisco, CA
    2 days ago
  •  ...Growth Associate in San Francisco to architect and scale the expert supply engine driving frontier AI training. You will own both manual and automated...  ...thousands, working with a high-velocity, cross-functional team. The role blends technical, operational, and strategic work... 

    David Joseph

    San Francisco, CA
    10 hours ago
  •  ..., Inc. in San Francisco seeks a Growth Associate to connect AI companies with specialized experts. This role involves sourcing top professionals, managing recruitment pipelines, and collaborating across teams to support Mercor’s expansion. The ideal candidate will have... 

    Mercor, Inc.

    San Francisco, CA
    3 days ago
  • Cincinnatus LLC is seeking a Marketing SME to join a leading GenAI team focused on evaluating AI outputs against rubrics and strengthening brand strategy in AI training data. We require 8+ years of marketing experience with top-tier brands, plus hands-on evaluation of LLM... 
    Weekday work

    Mercor

    San Francisco, CA
    3 days ago
  • Masons of California is seeking an Information Technology Supervisor in San Francisco to lead the helpdesk team, mentor staff, and ensure timely resolution of requests. The role combines executive end-user support, software support, resident services, and systems administration... 

    Freemason

    San Francisco, CA
    10 hours ago
  • $85 - $120 per hour

     ...Francisco, seeks a Senior Counsel — Legal Domain Expert for a 40-hour weekly contract role in the...  ...will evaluate legal knowledge work and AI outputs, develop high-quality instruction...  ...design evaluation sets with the research team. The role requires a JD and 8-15 years of... 
    Hourly pay
    Contract work

    Mercor

    San Francisco, CA
    2 days ago
  • $164.5k - $219k

    General Information Job Title Expert Senior Manager, Data Sciences, Software and Data...  ...overall spot a record seven times.Extraordinary teams are at the heart of our business strategy,...  ...have opportunities to work with major AI ecosystem partners through Bain's... 
    Permanent employment
    Full time
    Apprenticeship
    Local area
    Home office
    3 days per week

    Bain & Company

    San Francisco, CA
    2 days ago
  •  ...seeks experienced Adult Inpatient Nurses (RNs) to train and evaluate AI systems used in clinical settings. You will translate bedside...  ...annotating inpatient nursing data, and collaborating with technical teams to improve model performance. Experience in acute care and Epic... 

    Mercor

    San Francisco, CA
    3 days ago
  •  ...committed Home Health Registered Nurse to join our Marin County team in California. You will provide skilled nursing care to patients...  ...to create and implement individualized care plans that promote safety, comfort, and quality of life. The role emphasizes comprehensive... 

    Crossroads-Home-Health-and-Hospice

    San Francisco, CA
    4 days ago
  •  ...Consultant - Planning, Budgeting & Cash Flow Expert Oracle EPM Consultant - Planning,...  ...Planning Collaborate with finance and business teams to understand financial processes and translate...  ...directly into each article, started with the help of AI. #J-18808-Ljbffr Nexwave
    Contract work
    Fixed term contract
    Work at office

    Nexwave

    San Francisco, CA
    10 hours ago
  •  ...Ground Ramp Lead to oversee daily ramp operations, supervise a team of ramp agents, and ensure safe, efficient handling of aircraft...  ...the ground. You will coordinate ground support equipment, monitor safety compliance, train staff, and liaise with flight crews to minimize... 

    Alliance Ground International

    San Francisco, CA
    3 days ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...outputs. Collaborate with subject matter experts to ensure consistency and quality. Work...  ...reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    3 days ago
  • $90 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...any help or support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and... 
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    8 days ago
  • $60 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...content . Collaborate with subject matter experts to ensure task relevance and accuracy....  ...reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Safety Expert - Red Teaming. Be the first to apply!