Clinical Mental Health Expert, AI Conversation Evaluation
$100 per hourTemporary
Mercor
Mercor is seeking Clinical Mental Health Experts to support an AI research initiative focused on evaluating the realism and quality of simulated clinical conversations. This is a short-term, fully remote evaluation task designed for mental health professionals who can apply their clinical experience and professional judgment to assess realistic conversational scenarios. The task will take up to 30 minutes to complete.
What You’ll Do
- Review pairs of simulated conversations involving clinical mental health scenarios.
- Evaluate the conversations based on their realism and authenticity .
- Determine which conversation more closely reflects a realistic clinical interaction.
- Apply your clinical experience and professional judgment when making evaluations.
- Complete the evaluation independently through an online interface.
Ideal Background
We welcome professionals with a relevant degree and clinical mental health expertise . Suitable backgrounds may include:
- Clinical Psychology
- Counselling Psychology
- Mental Health Counselling
- Clinical Social Work
- Psychiatry
- Psychotherapy
- Behavioural Health
- Marriage and Family Therapy
- Other closely related clinical mental health disciplines
Candidates should have:
- A relevant degree or professional qualification in a mental health-related field.
- Practical experience working in a clinical mental health or behavioural health setting.
- Familiarity with real-world conversations between mental health professionals and patients or clients.
- Strong professional judgment and the ability to identify whether clinical interactions feel realistic and authentic.
- Strong attention to detail and the ability to make independent qualitative assessments.
Why Join
- Apply your clinical expertise to the evaluation of advanced AI systems.
- Contribute to research aimed at improving the realism and quality of AI-generated interactions.
- Be considered for future AI evaluation and research opportunities requiring clinical mental health expertise.
Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Clinical Mental Health Expert, AI Conversation Evaluation in Remote vacancy
$100 per hour
...Clinical Mental Health Expert — AI Conversation Evaluation is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the...SuggestedRemote jobFor contractors10 hours per week- ...are seeking Family Medicine Physicians to support the training and evaluation of next-generation AI systems using their primary care expertise. You will review medical records, assess AI-generated clinical content for accuracy and safety, and apply evidence-based medical...SuggestedContract workRemote work
- ...seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare... ...remotely and on your own schedule. Through Outlier's evaluation and feedback loop, your work helps shape how...SuggestedRemote job
- ...Group is seeking experienced Licensed Clinical Social Workers to contribute their... ...clinical expertise to the development and evaluation of next-generation AI systems. This remote, contract... ...realistic clinical scenarios, develop expert reference responses, and evaluate AI...SuggestedRemote jobContract work
- ...Prolific is recruiting Mental Health Professionals to help train and evaluate AI models. If you have licensing and relevant experience, you’ll complete a quick test and, if successful, join as a Domain Expert participant and get paid per AI task. You’ll review AI-generated...SuggestedSelf employmentRemote work
Prolific
New York, NY4 days ago $150 - $180 per hour
...Prolific in Virginia Beach is seeking Mental Health Professionals to train and evaluate AI models. The role involves reviewing AI responses to psychological... ...detail, and a reliable internet connection. Join our Expert Network to influence future AI innovations and work...Remote workWork from homeProlific
Virginia Beach, VA4 days ago$8 - $65 per unit
Prolific is seeking Mental Health Professionals to train and evaluate AI models. In this role, you will review AI responses, analyze psychology-related content, and provide feedback to improve models. Applicants must have verified status as a Mental Health Professional...Remote jobFlexible hours- Prolific is seeking Mental Health Professionals in Indianapolis, Indiana, to assist in training and evaluating AI models. Ideal candidates will have a verified status as a Mental Health Professional, an understanding of psychological theory, and the ability to focus on...Remote jobHourly payFlexible hours
$8 - $65 per hour
Prolific is looking for Mental Health Professionals to help train and evaluate AI models in Phoenix, Arizona. As a Domain Expert participant, you'll review AI-generated psychological responses, complete training tasks, and improve models utilizing your expertise. Competitive...Remote jobFlexible hours$8 - $65 per hour
Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates...Remote jobHourly payWork from homeFlexible hours$8 - $65 per hour
Prolific is seeking Mental Health Professionals to train and evaluate AI models from home. Responsibilities include reviewing AI responses and enhancing model performance using psychological expertise. Ideal candidates will have verified professional status, a solid understanding...Remote jobFlexible hours- Prolific is seeking Mental Health Professionals to train and evaluate AI models. Candidates will review psychological scenarios, analyze content, and improve... ...and must complete a quick skills assessment to join Prolific’s Domain Expert Network. #J-18808-Ljbffr ProlificRemote jobFlexible hours
- ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded off, all remotely and on your own schedule. Responsibilities...FreelanceRemote workFlexible hours
Outlier
Houston, TX18 hours ago $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Clinician (MD/DO) - HLS Expert Pool Type: Contract... ...grading criteria by breaking clinical questions into discrete checkable... ...model response grading. Evaluate clinical dialogues for accuracy...Full timeContract workSummer workRemote work$180 per hour
...Prolific in Tucson, Arizona is seeking Mental Health Professionals to assist in training AI models. Ideal candidates will have verified mental health qualifications and a strong grasp of psychological theories. You'll have the opportunity to influence AI development and...Remote workWork from homeFlexible hoursProlific
Tucson, AZ4 days ago$150 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Healthcare Expert Type: Contract... ...Role Responsibilities Evaluate and compare AI-generated responses... ...outperforms another focusing on clinical accuracy safety and quality of...Full timeContract workSummer workImmediate startRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ..., Larry Summers , and Jack Dorsey . Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote work$150 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Healthcare Expert Type: Contract... ...Role Responsibilities Evaluate and compare AI-generated responses... ...Analyze model reasoning to ensure clinical accuracy and evidence-based...Full timeContract workSummer workImmediate startRemote workFlexible hours$8 - $65 per hour
Prolific in Portland, Oregon is looking for Mental Health Professionals to help train AI models. You will review AI-generated responses, complete psychology... ..., and you will need to complete a skills screener to join Prolific's Domain Expert pool. #J-18808-Ljbffr ProlificRemote jobHourly payFlexible hours$8 - $65 per hour
Prolific is looking for Mental Health Professionals in Washington, DC to help train advanced AI models. Participants will review AI-generated content, analyze psychological scenarios, and provide feedback to enhance AI responses. Ideal candidates should have verified mental...Remote jobHourly payWork from homeFlexible hours$8 - $65 per unit
Prolific is seeking Mental Health Professionals to train AI models. Join our Expert Network for flexible hours and competitive pay ranging from $8 to $65 per task. Responsibilities include reviewing AI responses, analyzing content, and providing feedback to improve AI performance...Remote jobWork from homeFlexible hours- A leading AI research accelerator is seeking an Associate to leverage expertise in internal or emergency medicine. This role involves designing and evaluating clinical scenarios to enhance AI diagnostics. Candidates should have an MD and active practice within the last...Remote job
$150 - $180 per hour
Prolific is seeking licensed Mental Health Professionals to join its Domain Expert pool for AI training tasks. The role pays by AI task, with typical pay up to $150-180/hr, and tasks may require standard one-hour uninterrupted work. Applicants should have current licensure...Remote jobWork from homeFlexible hours$8 - $65 per hour
Prolific seeks Mental Health Professionals in Jacksonville to participate in training AI models. The role requires verified status as a Mental Health Professional and offers competitive pay rates ranging from $8-$65/hr for tasks, which can be completed remotely. Candidates...Remote jobWork from homeFlexible hours$150 - $180 per hour
Prolific invites Mental Health Professionals to join our Domain Expert network to train and evaluate AI models. You will review psychology-related prompts, provide insights, and help improve models with your clinical perspective. Paid tasks are hourly ($150-$180/hr) with...Remote jobHourly payFlexible hours$80 - $150 per hour
...technical talent with leading AI research labs.... ...Position: Child & Adolescent Mental Health Clinical Advisor (AI Safety Benchmark... ...clinician-informed evaluation rubrics for AI chatbot responses... ...a subset of AI-generated conversations and provide expert judgment to calibrate...Contract workTraineeshipSummer workRemote work$45 - $70 per hour
...technical talent with leading AI research labs.... ...Position: Behavioral Health Expert, AI Safety and Model Evaluation Type: Contract Compensation... ...Evaluate conversations between users and AI models... ...professional experience in mental health, counseling, or social...Contract workSummer workRemote workWeekday workMercor
Atlanta, GA25 days ago- ...technical talent with leading AI research labs. Headquartered... ...Role Responsibilities Evaluate AI answers to obstetrics and gynecology questions for clinical accuracy and safety.... ...resume. Complete a 25-minute conversational interview on your background...Full timeContract workPart timeSummer workImmediate startRemote workFlexible hours
$45 - $70 per hour
...Help a leading AI lab ensure its models respond... ...seeking behavioral health experts to help evaluate and improve how its... ...sensitive, everyday conversations. People increasingly... ...experience in mental health, counseling,... ...or overstepping into clinical or directive advice,...Contract workPart timeWeekday work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Clinical Mental Health Expert, AI Conversation Evaluation. Be the first to apply!
Related searches