Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Safety Experts — English & Swedish

Part-time

Mercor

Location: Remote

Fluent Language Skills Required: English & Swedish. Native fluency in English and Swedish is required for this position.

Why This Role Exists

At Mercor, we believe the safest AI is the one that’s already been attacked — by us. We are assembling a red team for this project - human data experts who probe AI models with adversarial inputs, surface vulnerabilities, and generate the red team data that makes AI safer for our customers.

This project involves reviewing AI outputs that touch on sensitive topics such as bias, misinformation, or harmful behaviors. All work is text-based, and participation in higher-sensitivity projects is optional and supported by clear guidelines and wellness resources. Before being exposed to any content, the topics will be clearly communicated.

What You’ll Do

Red team conversational AI models and agents: jailbreaks, prompt injections, misuse cases, bias exploitation, multi-turn manipulation

Generate high-quality human data: annotate failures, classify vulnerabilities, and flag systemic risks

Apply structure: follow taxonomies, benchmarks, and playbooks to keep testing consistent

Document reproducibly: produce reports, datasets, and attack cases customers can act on

Who You Are

You bring prior red teaming experience (AI adversarial work, cybersecurity, socio-technical probing)

You’re curious and adversarial: you instinctively push systems to breaking points

You’re structured: you use frameworks or benchmarks, not just random hacks

You’re communicative: you explain risks clearly to technical and non-technical stakeholders

You’re adaptable: thrive on moving across projects and customers

Nice-to-Have Specialties

Adversarial ML: jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction

Cybersecurity: penetration testing, exploit development, reverse engineering

Socio-technical risk: harassment/disinfo probing, abuse analysis, conversational AI testing

Creative probing: psychology, acting, writing for unconventional adversarial thinking

What Success Looks Like

You uncover vulnerabilities automated tests miss

You deliver reproducible artifacts that strengthen customer AI systems

Evaluation coverage expands: more scenarios tested, fewer surprises in production

Mercor customers trust the safety of their AI because you’ve already probed it like an adversary

Why Join Mercor

Build experience in human data-driven AI red teaming at the frontier of safety

Play a direct role in making AI systems more robust, safe, and trustworthy

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Vacancy posted 16 days ago
Similar jobs that could be interesting for youBased on the AI Safety Experts — English & Swedish in San Francisco, CA vacancy
  • $48 - $62 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ..., Larry Summers , and Jack Dorsey . Position: AI Safety Experts — English & Swedish Type: Contract Compensation: $48–$62/hour... 
    English language skills
    Swedish
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    4 days ago
  • $20 - $22 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Angelo , Larry Summers , and Jack Dorsey . Position: AI Safety Experts — English & Punjabi Type: Contract Compensation: $20–$22/... 
    English language skills
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    5 days ago
  • $16 - $22 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Angelo , Larry Summers , and Jack Dorsey . Position: AI Safety Experts — English & Kannada Type: Contract Compensation: $16–$22/... 
    English language skills
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    3 days ago
  • $60 - $70 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Summers , and Jack Dorsey . Position: AI Safety Practitioner Type: Contract Compensation...  ...a related field. ~ Excellent written English , critical thinking, and analytical... 
    English language skills
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • $62 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ..., Larry Summers , and Jack Dorsey . Position: AI Safety Experts — English & Swedish Type: Contract Compensation: $48–$62/hour... 
    English language skills
    Swedish
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    26 days ago
  • $39 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: Music Audio Expert - Swedish Type: Contract Compensation:...  ...native proficiency in both Swedish and English . Preferred Evidence of understanding... 
    English language skills
    Swedish
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    12 days ago
  • $90 per hour

     ...and radiological professionals to audit how AI models respond to sensitive questions in...  ...national labs), health physicists and radiation safety officers, radiochemists, and former...  ...European Union. Skills: Nuclear Physics, English, physics reasoning, AI Training,... 
    English language skills
    Contract work

    SuperAnnotate

    San Francisco, CA
    13 days ago
  • $100 per hour

     ...Description SME Careers is hiring chemists and chemical safety professionals to audit how AI models respond to sensitive questions in the field. Each...  ..., or harmful experimentation. ~ Excellent written English skills, with the ability to provide clear, structured feedback... 
    English language skills
    Permanent employment
    Full time

    SuperAnnotate

    San Francisco, CA
    13 days ago
  • $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Clinician (MD/DO) - HLS Expert Pool Type: Contract...  ...clinical dialogues for accuracy safety completeness and appropriate escalation...  ...~ Written and spoken English fluency ~ Minimum 20 hours... 
    English language skills
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    9 days ago
  • $50 - $150 per hour

     ...United States | Canada + 6 more We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract work where...  ...errors in technical reasoning Fluent written English and the ability to communicate complex ideas clearly... 
    English language skills
    Contract work
    Temporary work
    Remote work
    Flexible hours

    Braintrust

    San Francisco, CA
    4 days ago
  • $93 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...systems and billing platforms. ~ Exceptional written and verbal English communication skills. ~ High attention to detail with the... 
    English language skills
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • $70 - $85 per hour

    Mercor connects elite creative and technical talent with leading AI research labs. A remote contract role for a Professional...  ..., reviewing outputs, and ensuring regulatory compliance. Strong English and independent work are required. The position emphasizes independent... 
    English language skills
    Remote job
    Contract work

    mercor

    San Francisco, CA
    3 days ago
  • $70 - $84 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Angelo , Larry Summers , and Jack Dorsey . Position: AI Safety Red Teamer Type: Contract Compensation: $70–$84/hour... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    24 days ago
  • $30 per hour

     ...to $30/hour ## About SME Careers As AI systems become more sophisticated, they rely...  ...captures the full picture of how expert work actually gets done, the sequence of actions...  ...follow and reproduce, in clear professional English. - Define verification and success criteria... 
    English language skills
    Hourly pay
    Full time
    Contract work
    Freelance
    Local area
    Remote work
    Flexible hours

    SuperAnnotate

    San Francisco, CA
    4 days ago
  • $90 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Comfort in a terminal for local server setup. ~ Strong written English and discipline to justify judgments. Preferred Prior RLHF... 
    English language skills
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    5 days ago
  • $130 per unit

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...work in the task README and submit for expert review, addressing reviewer feedback on returned...  ...the standard library. ~ Precise written English for crafting questions and rubrics. ~ Comfortable... 
    English language skills
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • $65 - $75 per unit

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: Radiologicals Safety for Redteaming Type: Contract Compensation...  ...correct responses. Collaborate with experts to ensure models correctly judge misuse... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    19 days ago
  •  ...evaluation and Figma workflow scenarios frontier AI labs use to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure...  ...make it look good. People with strong written English who can turn design intuition into clear, teachable... 
    English language skills
    Weekly pay
    Contract work
    Temporary work
    For contractors
    Live in
    Remote work
    10 hours per week

    AfterQuery

    San Francisco, CA
    4 days ago
  • $28 per hour

     ...our team as Data Labeling Analysts, supporting speech and voice AI systems. This is a high-impact production role focused on building...  ...sessions  What We’re Looking For ~ Native-level fluency in Swedish  ~ Strong written communication skills and language... 
    Swedish
    Full time
    Work experience placement
    Remote work
    Visa sponsorship

    Welo Data

    San Francisco, CA
    28 days ago
  • $30 - $65 per hour

     ...Role Directly responsible for improving the quality, safety, and intelligence of cutting-edge AI models. Key Responsibilities Create High-Quality...  ...For Required: Native or near-native fluency in English, with exceptional writing, grammar, and communication... 
    English language skills
    Hourly pay
    Full time
    Remote work

    RemoExperts

    San Francisco, CA
    1 day ago
  • Obsidian is looking for data experts to join a red team that probes AI models with adversarial inputs. This role requires fluency in both English and Punjabi, and involves tasks such as testing...  ..., emphasizing the importance of AI safety. Work will be structured, with clear... 
    Remote job

    Obsidian

    San Francisco, CA
    3 days ago
  • Obsidian is assembling a team of native English speakers to evaluate AI-narrated audiobooks in US / North American English. You’ll listen like a devoted audiobook fan but with a careful, analytical ear to flag moments where narration slips. This remote, part-time role offers... 
    English language skills
    Remote job
    Part time

    Obsidian

    San Francisco, CA
    3 days ago
  • Mercor is hiring an AI Session Annotator (English) to review and score AI-assisted sessions, ensuring accuracy and safety warnings. You will work remotely, using an Android phone with camera and microphone, and provide detailed notes from each session. Immediate start with... 
    English language skills
    Remote job
    Immediate start

    Mercor

    San Francisco, CA
    3 days ago
  •  ...use your professional design expertise to evaluate and improve AI-generated creative outputs and contribute high-quality human feedback...  ...workflows and quality standards. ~ Strong written and verbal English communication skills ( B2 level or above ). ~ No formal degree... 
    English language skills
    Remote job
    For contractors
    Worldwide
    Flexible hours

    YO AI Labs

    San Francisco, CA
    5 days ago
  • Mercor is seeking a Music Audio Expert to evaluate AI-generated lyrics, vocal outputs, and training data quality. This remote contract role focuses on English-language content within the UK/Australia market. You will score outputs, help define evaluation criteria, and... 
    English language skills
    Remote job
    Contract work

    mercor

    San Francisco, CA
    3 days ago
  • $120 - $175 per hour

     ...and technical talent with leading AI research labs. Headquartered in...  ...Dorsey . Position: CNC Machining Expert Type: Contract...  ...Strong production judgment to assess safety and feasibility on real machines. ~ Written English fluency for text-based deliverables... 
    English language skills
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • $80 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Adolescent Mental Health Clinical Advisor (AI Safety Benchmark Project) Type: Contract...  ...of AI-generated conversations and provide expert judgment to calibrate automated evaluation... 
    Contract work
    Traineeship
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • $10 - $30 per hour

     ...Canada + 2 more About the Role We are looking for experienced English-speaking professional callers to support our company with...  ...experience. A strong background in technology, software development, AI/ML, IT, or technical recruiting/outreach is highly preferred.... 
    English language skills
    Temporary work
    Part time
    Flexible hours

    Braintrust

    San Francisco, CA
    4 days ago
  • $105 - $140 per unit

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...questions about live scores, player stats, and expert analysis. Run questions on two AI products...  ...Based in the United Kingdom or Spain. Native English or Spanish speaker. Strong written English... 
    English language skills
    Contract work
    Summer work
    Remote work
    Flexible hours

    Mercor Inc

    San Francisco, CA
    3 days ago
  •  ...Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced...  ...language models (like ChatGPT) using your strong analytical and english comprehension skills.The ideal candidate should have a solid... 
    English language skills
    Contract work
    For contractors
    Freelance
    Remote work

    Turing

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Safety Experts — English & Swedish. Be the first to apply!