Context Elicitation & Conversation Evaluation Specialists - Latam, Southeastern Europe, Asia, Africa
Turing
Review AI conversations to assess context and improve recommendations. About Turing: Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM, and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies. Role overview : We are seeking Subject Matter Experts (SMEs) with expertise in psychology, social work, counseling, qualitative research, HCI, communication, conflict resolution, coaching, or related advisory fields to support AI conversation evaluation research. SMEs will review conversations between participants and AI models, assess whether sufficient context was gathered before recommendations were made, identify missed opportunities for clarification, and provide structured feedback to improve conversational quality. Job Responsibilities: Review AI conversations involving real-world interpersonal and everyday decision-making scenarios. Identify missing context and recommend relevant follow-up questions. Evaluate whether additional information would have changed the AI's recommendations. Distinguish between critical ("load-bearing") and non-essential information. Conduct qualitative reviews and document findings using structured evaluation guidelines. Collaborate with research teams to ensure consistent, high-quality assessments.. Required Qualification: Candidates should have at least 3–5 years of direct practicerelevant qualifications and professional experience in at least one of the following areas: Licensed Social Work MSW or equivalent graduate-level qualification in Social Work. LCSW, LICSW, LMSW, or equivalent applicable social work license/credential. Experience with client assessment, case review, interviewing, counseling, or related social-work practice. Counseling, Therapy, or Psychology MA/MS with LMFT, LPC, LCPC, or equivalent counseling/therapy license or credential; or PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology. Experience with counseling, therapy, psychological assessment, interviewing, case review, or other relevant client-facing work. Qualitative Research, HCI, or Communication MA/PhD or equivalent advanced expertise in Human-Computer Interaction (HCI), Communication, Anthropology, Sociology, Qualitative Research, or a closely related discipline. Experience conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, qualitative coding, or similar research activities. Relevant backgrounds may include Qualitative Research, HCI Research, UX/User Research, Communication Research, Anthropology, Sociology, or related disciplines. Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields Relevant professional qualification, credential, or demonstrated subject-matter expertise. Significant direct experience in advisory, client-facing, coaching, mediation, student advising/services, organizational consulting, or comparable work. Experience gathering context, understanding individual or organizational needs, and providing informed recommendations or guidance. Preferred experience: Experience eliciting relevant context when clients initially provide incomplete information Experience working across relationships, work, education, family, planning, wellbeing, and resource constraints, considering biological, psychological, social, spiritual/existential, financial, and practical factors Qualitative coding or structured case review Ability to distinguish between context that is load-bearing for the recommendation and that is merely descriptive/non-informative Experience reviewing interviews, consultations, coaching sessions, or client interactions to identify missed opportunities for clarification or information gathering Project Details : Project duration - 3 weeks (short term project) Project type - Pay-per-task (PPT) AHT - 75 minutes (approx.) Engagement - Full time Estimated project start date - 1st October (estimated) Must be based in Latam, southeastern Europe, Asia, Africa Skills: Business Analysis #J-18808-Ljbffr Turing
- Review AI conversations, identify missing context, and suggest follow-up questions that improve recommendations... ...Philippines Romania Serbia South Africa The work You will review conversations... ...they are useful. Conversation evaluators help improve how AI understands context...SuggestedContract workPart timeFor contractorsRemote work
- ...AI is seeking subject matter experts to review AI conversations and assess whether sufficient context was gathered before recommendations were made. You... ...systems. The role focuses on rigorous qualitative evaluation and documentation. Successful candidates will have...SuggestedRemote job
- ...Overview We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation... ...through simulated interactions, audit conversational AI outputs, and generate clean, reliable... ...structured data within a support context. Representative Dataset Generation: Contributing...SuggestedHourly payFor contractorsFreelanceRemote work
- ...About the role Calibration Technology Evaluation Specialist is a remote review track for evaluating AI outputs across calibration technology... ...role, the visible terms, and source attribution for reviewer context. 01 Confirm profile and eligibility details. 02 Attach this...SuggestedHourly payFor contractorsWork experience placementRemote work10 hours per week
- ...Agency is seeking someone to create and execute role-play-based evaluation scenarios that simulate realistic customer service... ...real customer expectations for clarity, efficiency, and natural conversational flow, supporting benchmarking efforts. #J-18808-Ljbffr...Suggested
$500 per month
...About the role The CRO Specialist owns the testing and optimization of our direct-response... ..., and dev/tech teams. They focus on conversion rate, cost-per-lead efficiency, and lead... ...look past top-line conversion rate and evaluate lead quality and downstream results. Solid...Local areaRemote workWork from homeFlexible hours$66.3k - $74k
...administrative teams based in New York. The Monitoring, Evaluation and Learning (MEL) function supports data-informed decision... ..., partners, and colleagues spanning the Middle East, Europe, South Asia, East Africa, Latin America, and beyond. This is an entry-level position...Temporary workWork at officeLocal areaWorldwide- ...is a leading digital marketing agency helping brands grow in Europe. We seek a senior performance marketing expert with 3+ years of... ...across Europe, shaping strategy, tracking, optimisation and client conversations, with influence on how accounts are run and measurable impact...Remote job
- Agency is seeking a qualified evaluator to design and run role-play based scenarios that mimic real customer service conversations. The role involves helping build diverse datasets for audio agents and assessing model performance across multiple metrics. You will ensure...
$12 - $18 per hour
Globik AI is seeking TTS Pronunciation Evaluation Specialists to assess whether text-to-speech output correctly pronounces words, names, and phrases across languages and contexts to support model refinement. Responsibilities Listen to TTS output and verify correct pronunciation...- Ecommerce - Conversion Rate Optimization Specialist Remote SUMMARY At Magnolia, the Conversion Rate Optimization Specialist is responsible for improving... ...customer behavior, surface opportunity areas, and evaluate the impact of site improvements. This position works from...Work experience placementWork at officeLocal areaRemote work
- ...audio models used in real-world customer support scenarios. You will design and execute role-play-based evaluations across travel, finance, and telecommunications contexts to simulate authentic customer interactions. Contribute to datasets, measure model performance with...
- Invisible Technologies is seeking independent Audio Evaluation Specialists for an AI benchmark project evaluating agentic audio models in real... ...professional experience in complex customer support or conversational AI evaluation, be bilingual, and possess #J-18808-Ljbffr...Remote job
$47.99k
Online Performance Evaluation Specialist Remote jobs have changed how we work, and here’s a role that’s at the heart of it—Online Performance... ...trends that others might miss. Empathy to guide tough conversations without making them awkward. Confidence in suggesting talent...Immediate startRemote workWork from homeWorldwideHome officeFlexible hoursShift workNight shiftDay shift- ...seeking a French Audio Recording Expert (Canada) for remote evaluation. You will review prompts and responses, compare outputs, and... ...role focuses on assessing pronunciation, voice quality, and conversation robustness for high-quality data labeling. Role requires prior...Remote job
- Role: English Speech & Audio Evaluation Specialist Employment Type: 3-Month Contractual Role Roles and Responsibilities Listen to English audio recordings and conversations and evaluate the quality of spoken English. Assess pronunciation, accent, fluency, clarity,...
$8 - $65 per hour
Epidemiology Specialist - Freelance AI Trainer Project United States of America Are you a... ...reasoning. On a typical day, you will converse with the model on real-world epidemiological... ...to our prompt engineering and evaluation metrics. A PhD degree in epidemiology,...Remote jobHourly payContract workFor contractorsFreelanceImmediate start- Capacity Building Specialist (Media and Communication) Job Category... .... About the Region The Europe and Central Asia Regional Office (ECR), based... ...UNHCR and UNEP. Job Specific Context The “Support to European... ...pursues continuous improvements. Evaluates data and courses of action...Contract workWork at officeLocal areaWork from homeFlexible hours
- ...customer service role-plays in travel, finance, and tech support. Evaluate AI audio responses using structured criteria for accuracy,... ...work with flexible scheduling. Meaningful impact on conversational AI quality and reliability. Jobgether Jobgether is an AI-powered...Remote jobHourly payFreelanceFlexible hours
$35 per hour
...an EXL company, is looking for detail oriented analysts to evaluate and rank AI generated responses to image based prompts. You... ...matter far more than speed here. Responsibilities Interpret conversational context and identify what the user really wanted. Rate and rank...For contractorsRemote workFlexible hours- About the role Meridial seeks independent Audio Evaluation Specialists for an AI benchmark evaluation project. You will design evaluation frameworks... ...complex customer support, technical troubleshooting, or conversational AI evaluation Native or bilingual proficiency in the...Hourly payFor contractorsFreelanceWork at officeRemote workWorldwide
- ABA Intake Specialist and Rethink Coordinator (South Africa) Preferred Candidate Region Philippines; South Africa Job Type Full time Job Opening Status Waiting for Clients Response Work Schedule Fixed Schedule Job Category Operations and Project Management Required...Full timeRemote workShift work
- Evaluate audio-based conversational AI in realistic customer support scenarios. Contribute to high-quality datasets for advanced AI models. Work remotely as a freelance independent contractor. Responsibilities: Design and conduct role-play scenarios across travel, finance...Remote jobHourly payFor contractorsFreelanceFlexible hours
$40 per hour
AuraOne is seeking remote contractors to review multimodal signals evaluation prompts and responses. You will judge model outputs across text, images, and documents, label edge cases, and generate structured feedback to retrain the system. Ideal candidates have experience...Remote jobHourly payPart timeFor contractorsFlexible hours$75 - $110 per hour
...Neurology Evaluation Specialist is a remote clinical-review track for evaluating AI outputs that touch neurology. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so...Hourly payFor contractorsRemote work10 hours per week- AuraOne is seeking a Rubric Expert to review rubric evaluation prompts and responses, compare outputs, label edge cases, and provide structured feedback for retraining the model. AI data reviewers help turn rubric evaluation outputs into auditable labels, rationales, and...Remote jobFor contractors
$28 per hour
The HR Specialist II Corporate Accommodations serves as a subject matter expert for disability... ...job site analyses as needed to evaluate job demands and potential... ...With offices across the U.S., Canada, Asia Pacific and Europe, Aston Carter serves many of the Fortune...Remote jobContract workTemporary workLocal area- Crossing Hurdles is seeking a contract-based interview specialist to conduct structured elicitation and interviews with diverse subjects. This remote US-based role requires accurate data collection and adaptive questioning in real-time. You will establish rapport, assess...Remote jobContract workFlexible hours
- AuraOne, Inc. is seeking a remote evaluation contractor to review search generalist prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback for retraining the modeling team. The role emphasizes...Remote jobFor contractorsFlexible hours
- A leading technology firm seeks a CRO Specialist to enhance conversion rates through strategic optimization and testing of landing pages. This role focuses on analyzing visitor behavior and running A/B tests to improve trial signups. Successful candidates will manage landing...Remote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Context Elicitation & Conversation Evaluation Specialists - Latam, Southeastern Europe, Asia, Africa. Be the first to apply!
- live chat specialist New York, NY
- patient safety specialist New York, NY
- credit card specialist New York, NY
- senior specialist New York, NY
- zoning specialist New York, NY
- charge entry specialist New York, NY
- health program specialist New York, NY
- youth specialist New York, NY
- microsoft specialist New York, NY
- transportation specialist New York, NY

