Behavioral Health Professional for AI Model Evaluation

Help shape how AI models respond to sensitive everyday conversations involving relationships, family dynamics, emotional wellbeing, personal beliefs and difficult life decisions. You will evaluate model interactions and define standards for responses that are balanced, respectful, neutral and safely bounded, particularly in non-crisis situations where sound judgment matters.

• Review user and AI conversations covering relationship and family advice, emotional wellbeing, spiritual or metaphysical questions, and unconventional or unfounded beliefs.
• Assess whether model responses are neutral, appropriate and safe.
• Identify and document concerns such as excessive agreement, taking sides, reinforcing distorted or unfounded beliefs, moralizing, or providing overly clinical or directive advice.
• Create rubrics, guidelines and reference responses for supportive, balanced and appropriately limited replies grounded in counseling and behavioral-health practice.
• Develop test scenarios that assess model behavior in sensitive, non-crisis conversations.
• Work with researchers and fellow experts to maintain consistent, calibrated and well-documented evaluation standards.

• Degree in psychology, counseling, social work, behavioral health, behavioral science, human services or a closely related field, or equivalent mental-health professional experience.
• At least 3 years of professional experience supporting people in a mental health, counseling or social-services setting, such as therapist, counselor, clinical social worker, psychologist, psychiatric nurse, case manager, crisis counselor, peer support specialist or mental health advocate.
• Ability to remain neutral and nonjudgmental across diverse perspectives, relationships, belief systems and worldviews, and clearly explain professional judgments.
• Working knowledge of sycophancy, cognitive distortions, healthy boundaries and client-centered approaches such as motivational interviewing.
• Strong written communication skills and the ability to provide precise, well-structured feedback.

Clinical licensure, including LMFT, LCSW, LPC, LMHC, PsyD or PhD, is valued but not required. Helpful backgrounds include AI safety, applied ethics, trust and safety, content policy, couples or family counseling, spiritual care, religious or alternative belief communities, misinformation or conspiracy-belief psychology, and AI evaluation, annotation or red teaming. Candidates do not need every preferred qualification to apply.

• United States-based hourly W-2 employment.
• Part-time commitment of at least 20 hours per week, with the option to work up to 40 hours per week.
• Reliable weekday availability is required.
• Employees may be placed with a leading AI lab as part of its extended workforce.

$45 to $70 per hour.

Employment decisions are made without discrimination based on race, religion, color, national origin, sex, pregnancy or related conditions, sexual orientation, gender identity or expression, age, protected veteran status, disability, genetic information, political views or activity, or any other legally protected characteristic.