AI Safety Red Teamer, English & Assamese

Role Overview

Help strengthen conversational AI systems by probing them with adversarial inputs, identifying vulnerabilities, and creating human-reviewed data that supports safer, more reliable AI. This text-based remote role includes reviewing AI outputs that may address sensitive topics, including bias, misinformation, and harmful behavior.

Key Responsibilities

• Test conversational AI models and agents for jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation.
• Review AI outputs, annotate failures, classify vulnerabilities, and identify systemic risks.
• Follow established taxonomies, benchmarks, playbooks, guidelines, and quality standards to produce consistent testing results.
• Create reproducible reports, datasets, and attack cases that teams can use to improve AI systems.
• Expand evaluation coverage by testing additional scenarios and surfacing issues that automated testing may miss.

Qualifications

• Native fluency in both English and Assamese is required.
• Strong judgment about language and content, including the ability to assess whether an AI response is accurate, complete, and appropriate, and explain the reasoning.
• Careful attention to subtle errors, inconsistencies, and gaps.
• Ability to communicate clearly with technical and non-technical audiences.
• Adaptability across projects, task types, and customer needs.

Preferred Expertise

• Adversarial machine learning, including jailbreak datasets, prompt injection, RLHF or DPO attacks, or model extraction.
• Cybersecurity, including penetration testing, exploit development, or reverse engineering.
• Socio-technical risk assessment, including harassment or misinformation probing, abuse analysis, or conversational AI testing.
• Creative adversarial thinking through psychology, acting, or writing.

Work Terms

• Remote, hourly engagement.
• All work is text-based.
• Higher-sensitivity assignments are optional. Topics will be communicated before exposure, with clear guidelines and wellness resources available.

Compensation

$16 to $22 per hour.