AI Safety Practitioner for AI Model Evaluation

Role Overview

Help shape the safety, quality, and alignment of frontier AI models by evaluating responses to complex, policy-sensitive, and ambiguous topics. This role contributes structured assessments and feedback that improve model behavior across high-impact domains.

Key Responsibilities

• Assess AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
• Review content related to misinformation, political persuasion, self-harm, violence, cybersecurity, biosecurity, and other sensitive subjects.
• Apply and refine evaluation rubrics used for RLHF, SFT, and AI safety benchmarking.
• Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
• Provide structured feedback to strengthen model alignment and safety performance.
• Partner with AI researchers and safety teams on ongoing evaluation initiatives.

Qualifications

• Bachelor''s degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
• At least 5 years of professional experience in AI safety, trust and safety, journalism, public policy, scientific research, security, or a related field.
• Excellent written English, critical-thinking, and analytical-reasoning skills.
• Ability to evaluate nuanced, policy-sensitive scenarios consistently.

Preferred Qualifications

• Experience in AI safety, RLHF, SFT, trust and safety, or AI evaluation.
• Familiarity with safety policies, content moderation, or developing evaluation rubrics.
• Experience reviewing complex, high-risk, or ambiguous content.

Work Terms

• Remote, hourly engagement.

Compensation

• $60 to $70 per hour.

Opportunity

• Contribute to frontier AI systems used by millions worldwide.
• Work on real-world safety evaluations spanning nuanced, high-impact domains.
• Collaborate with AI researchers, engineers, and safety teams.