AI Safety Expert

Role Description

mpathic is seeking AI Safety Experts for a temporary project to support confidential projects evaluating and improving the safety, reliability, and real-world behavior of frontier AI systems. Priority will be given to applicants who can start immediately.

This role is ideal for professionals with expertise in human behavior, communication, policy, education, healthcare, technology, trust & safety, or other domains where judgment, critical thinking, and nuanced decision-making matter. You'll help identify model strengths and weaknesses, uncover failure modes, and provide the high-quality human feedback that makes AI systems safer and more useful.

What You'll Be Doing

• Evaluating AI-generated conversations, responses, and reasoning for quality, safety, and usefulness
• Rating model outputs using structured evaluation rubrics and project guidelines
• Annotating conversational data to support AI training and benchmarking
• Identifying emerging risks, behavioral patterns, and opportunities for model improvement
• Providing written feedback that helps researchers and engineers improve model performance
• Maintaining strict confidentiality while working with proprietary AI systems and sensitive content
• Participating in calibration sessions and quality reviews to ensure consistent evaluations

Qualifications

• Professional experience or subject matter expertise in a relevant field such as psychology, behavioral science, social work, trust & safety, research, or a related discipline
• Strong written communication skills with excellent attention to detail
• Comfortable learning structured evaluation frameworks and applying them consistently
• Strong critical thinking and problem-solving skills
• High ethical standards and sound judgment when working with sensitive or ambiguous content
• Comfortable using AI tools, Google Workspace, Slack, and other web-based collaboration platforms
• Willingness to sign NDAs and work on confidential projects