Remote | Urdu-English AI Safety Red Team Evaluator — $20-$30/hour

We are sharing a specialised part-time consulting opportunity for Urdu-English bilingual professionals experienced in AI safety evaluation, red team testing, adversarial review, vulnerability classification, and structured feedback on sensitive text-based AI outputs.

This role supports current and upcoming remote consulting opportunities focused on AI safety evaluation, bilingual red team testing, conversational model assessment, misuse-risk review, vulnerability annotation, and high-quality project execution. Selected professionals will test AI systems using structured adversarial scenarios, identify safety weaknesses, classify risks, and produce clear English-language evaluation artifacts across English and Urdu contexts.

Key Responsibilities

Professionals in this role may contribute to:

Bilingual AI Safety & Red Team Testing

• Review English and Urdu AI outputs for safety, reliability, bias, misinformation, and harmful-behavior risks
• Stress-test conversational AI models and agents using structured adversarial scenarios
• Evaluate model behavior across multi-turn conversations, sensitive topics, and edge-case prompts
• Identify vulnerabilities that require stronger safety controls, clearer refusals, or improved response quality

Vulnerability Classification & Risk Review

• Annotate failures, classify vulnerabilities, and flag recurring safety patterns
• Apply taxonomies, benchmarks, and project-specific playbooks to keep testing consistent
• Assess misuse cases, bias exploitation, prompt-injection scenarios, and socio-technical risk patterns at a high level
• Generate high-quality human evaluation data through careful review and structured judgment

Reproducible Documentation & Evaluation Artifacts

• Produce clear reports, datasets, test cases, and written summaries that support model improvement
• Document findings reproducibly so results can be reviewed, compared, and acted upon
• Explain risks clearly for both technical and non-technical audiences
• Maintain accuracy, consistency, and strong attention to detail across submitted evaluations

Ideal Profile

Strong candidates may have:

• Native-level fluency in both English and Urdu
• Prior experience in AI red teaming, adversarial testing, cybersecurity, trust and safety, socio-technical risk review, or conversational AI evaluation
• Ability to think adversarially while staying structured, careful, and methodical
• Experience using frameworks, benchmarks, or rubrics rather than unstructured testing alone
• Strong written communication skills and ability to explain safety findings clearly
• Comfort reviewing text-based content involving sensitive topics under clear guidelines
• Adaptability across project types, safety categories, and evaluation workflows

Educational Background

• Formal degree requirements may vary based on project needs
• Backgrounds in AI safety, cybersecurity, linguistics, policy, trust and safety, social science, psychology, writing, data evaluation, or technical analysis may be highly relevant
• Practical experience in red team testing, model evaluation, content risk analysis, or structured review work may also be valuable

Nice to Have

• Experience with adversarial ML concepts, jailbreak datasets, prompt injection, RLHF/DPO attack patterns, or model behavior testing
• Cybersecurity experience such as penetration testing, exploit analysis, reverse engineering, or security assessment
• Socio-technical risk experience involving harassment, misinformation, abuse analysis, bias testing, or conversational AI safety
• Creative probing background, including psychology, acting, writing, role-play design, or unconventional adversarial thinking
• Experience producing reproducible reports, labeled datasets, structured risk notes, or benchmark-style evaluation artifacts

Why This Opportunity

• Apply Urdu-English bilingual expertise to structured AI safety and red team evaluation work
• Contribute to stronger, safer, and more reliable AI systems through careful adversarial testing
• Work on flexible assignments aligned with language skills, safety judgment, and structured analysis
• Build experience in human data-driven AI safety evaluation and bilingual risk review
• Remote structure with competitive hourly compensation

Contract Details

• Independent contractor role
• Fully remote with flexible scheduling
• Eligible professionals may be based in approved project locations depending on project needs
• Native-level English and Urdu fluency are required for project work
• Work is text-based and may involve sensitive topics such as bias, misinformation, harassment, or harmful-behavior risks
• Topic areas will be communicated before exposure to content, and participation in higher-sensitivity projects may depend on candidate comfort and project fit
• Part-time commitment depending on project availability
• Competitive rates between $20–$30 per hour depending on expertise and project scope
• Weekly payments via Stripe or Wise
• Projects may be extended, shortened, or adjusted depending on scope and performance
• Work will not involve access to confidential or proprietary information from any employer, client, or institution

About the Platform

This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.

By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: .