Remote Clinical Psychologist: AI Conversation Evaluator
Mercor
- Remote job
Mercor is seeking Clinical Mental Health Experts to support an AI research initiative that tests realism of simulated clinical conversations. This short-term, fully remote evaluation task lasts up to 30 minutes and invites mental health professionals to apply their clinical judgment to rating authenticity. You will review paired conversations, assess realism, and determine which reflects a more credible clinical interaction. Prior clinical experience and attention to detail are essential. #J-18808-Ljbffr Mercor
$100 per hour
...and technical talent with leading AI research labs. Headquartered in... ...and Jack Dorsey . Position: Clinical Mental Health Expert — AI Conversation Evaluation Type: Contract Compensation: $100/hour Location: Remote Role Responsibilities Review...Remote workContract workSummer work- Mercor is seeking Clinical Mental Health Experts to support an AI research initiative that evaluates the realism and quality of simulated clinical conversations. This is a short-term, fully remote evaluation task designed for mental health professionals who can apply clinical...Remote jobTemporary work
- ...Conversational AI Evaluator is a remote evaluation track for reviewing conversational ai evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can...Remote jobHourly payFor contractors10 hours per week
- RWS Group is seeking a Speech AI Evaluation Specialist to support the improvement of AI-generated... ...freelance, part-time position offers remote work from home in the USA, with a... ...start. You will participate in short voice conversations, follow prompts, evaluate responses for...Remote jobPart timeFreelanceImmediate startWork from home10 hours per weekFlexible hours
- A virtual AI evaluation firm is seeking individuals to review and evaluate AI-generated responses in therapeutic conversations. The ideal candidate will possess strong written communication... ...role with immediate onboarding and a remote work environment, making it ideal...Remote jobImmediate start
- ...Tutor Conversation AI Evaluator is a remote review track for evaluating AI outputs across tutor conversation ai specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next...Remote jobHourly payFor contractorsWork experience placement10 hours per week
- Agency seeks a Hindi Audio Specialist - AI Trainer to design and run evaluation sessions for agentic audio models in remote settings. You’ll craft role-play scenarios spanning... ...to improve model clarity, efficiency, and conversational flow in real customer interactions. #J-18...Remote job
$15 per hour
...most innovative companies improve their AI models by providing human feedback. Are you... ...models. This freelance opportunity is remote and hours are flexible, so you can work whenever... ...by… Holding a live, scenario-based conversation in English with AI voice models, then ranking...Remote workHourly payContract workFreelanceInternshipFlexible hours- ...focused on safeguarding and refining AI systems. This role centers on evaluating clinical precision, safety standards, and... ...100 company. This position is remote until further notice. Responsibilities... ..."sweeps" where they dynamically converse with the model to probe specific...Remote workPart timeFor contractorsWork at officeLocal areaImmediate startMonday to FridayFlexible hours
- OpenTrain AI, Inc. is seeking contractors for remote evaluation of AI-generated health coaching conversations. This entry-level role requires strong written English and attention to detail, with 20+ hours per week available. You will review materials, apply rubrics, and...Remote jobFor contractorsWorldwideFlexible hours
- Feitong Buke is hiring a Lead AI Trainer to oversee and enhance the quality of AI model dialogues... ...should have experience in annotation for conversational AI and a keen ability to analyze conversational responses. This is a remote full-time position offering substantial...Remote jobFull time
- ...is looking for detail-oriented and motivated AI Data Annotators proficient in Canadian French to enhance AI-powered conversational systems. This role involves reviewing AI-... ...levels of experience. The position is fully remote, offering a flexible work environment and collaboration...Remote jobFlexible hours
- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...Remote workContract workTemporary workImmediate start
- ...Seeking a full-time Remote AI Research Evaluator with a PhD in Quantitative Finance to assess and enhance AI models' capabilities in financial reasoning and quantitative analysis through flexible, contract-based work. Key responsibilities Assessing the factuality and...Remote workFull timeContract workFlexible hours
- ...About the role Swahili Evaluation AI Evaluator is a remote evaluation track for reviewing swahili generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback...Remote workHourly payFor contractors10 hours per week
$14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are... ...optimization or data analysis is beneficial. Seeks a flexible, remote job that can easily fit around other commitments. Pay...Remote workHourly payPart timeImmediate startWork from home10 hours per weekFlexible hours$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Remote workHourly payPart timeFlexible hours- Hippocratic AI Inc. is seeking a Registered Nurse with 5+ years of clinical experience to join our remote data annotation team evaluating AI-driven clinical agents. You will review agent conversations across primary care, chronic disease management, and scheduling, labeling...Remote job
$9 per hour
Thai AI Product Evaluator The Project Productive Playhouse is building a talent pool of Thai speakers... ...). Pay Rate: $9.00 USD per hour 100% remote You choose which tasks to take, set... ...or language models through structured conversations, using assigned goals and prompts. Voice...Remote workHourly payFor contractorsFreelanceWorldwideFlexible hours- ...Prolific is seeking talented Product Designers and UX Specialists to join our Expert Network for training and evaluation of cutting-edge AI models. Candidates should have a relevant educational background and at least one year of experience in design-related fields. Responsibilities...Remote workWork from homeFlexible hours
- ...Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design...Remote workWork from homeFlexible hours
$20 - $26 per hour
Prolific is seeking a fluent Punjabi speaker to act as an AI trainer/evaluator. You will listen to audio and compare it with text, rating naturalness and authenticity. The role requires strong linguistic intuition and the ability to provide precise feedback to help models...Remote jobHourly payWork from homeFlexible hours$60 per hour
Prolific is seeking Chemistry Experts and Chemical Engineers to join our Expert Network to train and evaluate AI models using real-world chemical knowledge. A quick 10- to 15-minute test will assess your skills; successful candidates join Prolific as participants and are...Remote jobHourly payWork from homeFlexible hours$50 per hour
Prolific seeks Product Designers and UX Specialists to help train AI models using your expertise. You'll evaluate AI-generated designs and ensure usability and accessibility while working from home. Ideal candidates hold a BS, MS, or PhD in a relevant field and have at...Remote jobWork from homeFlexible hours$20 per hour
A leading AI development company in the United States is seeking detail-oriented individuals for remote opportunities in training AI chatbots. Responsibilities include developing... ..., writing high-quality responses, and evaluating AI outputs. The ideal candidates are fluent...Remote workHourly payFlexible hours- ...About the role Registered Nurse AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch nursing. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning...Remote workHourly payFor contractors10 hours per week
- ...is seeking experienced Nurse Practitioners and advanced practice nursing professionals to join a remote project in the United States. You will evaluate AI-driven clinical content and provide expert feedback to improve accuracy and reliability of patient care materials....Remote job
- Codefeast is seeking a Finance Expert to contribute to LLM training and evaluation workflows. The role is remote and contracted, focusing on reviewing financial questions, scenarios, and AI-generated responses. You will assess outputs for accuracy and reasoning, create...Remote job
- Benture is seeking individuals to evaluate AI assistants live during MLB postseason games. Work remotely from the United States, on scheduled game days, asking questions and scoring AI responses for accuracy, usefulness, and clarity. Each task lasts about 2 to 2.5 hours...Remote job
- Archangel Health AI is seeking Clinical AI Evaluators to review AI-generated clinical outputs, benchmark diagnostic reasoning, and refine responses to... ...to train medical AI models. This is a flexible remote role with no patient care responsibilities. Work from anywhere...Remote workFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Clinical Psychologist: AI Conversation Evaluator. Be the first to apply!
- clinical psychologist Houston, TX
- evaluator Houston, TX
- education evaluator Houston, TX
- social media evaluator Houston, TX
- quality evaluator Houston, TX
- ai evaluator Houston, TX
- c++ remote Houston, TX
- senior devops engineer remote Houston, TX
- remote .net full stack web developer Houston, TX
- nursing recruiter (remote) Houston, TX

