Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Context Elicitation & Conversation Evaluation Specialists - Latam, Southeastern Europe, Asia, Africa

Turing

Review AI conversations to assess context and improve recommendations. About Turing: Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM, and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies. Role overview : We are seeking Subject Matter Experts (SMEs) with expertise in psychology, social work, counseling, qualitative research, HCI, communication, conflict resolution, coaching, or related advisory fields to support AI conversation evaluation research. SMEs will review conversations between participants and AI models, assess whether sufficient context was gathered before recommendations were made, identify missed opportunities for clarification, and provide structured feedback to improve conversational quality. Job Responsibilities: Review AI conversations involving real-world interpersonal and everyday decision-making scenarios. Identify missing context and recommend relevant follow-up questions. Evaluate whether additional information would have changed the AI's recommendations. Distinguish between critical ("load-bearing") and non-essential information. Conduct qualitative reviews and document findings using structured evaluation guidelines. Collaborate with research teams to ensure consistent, high-quality assessments.. Required Qualification: Candidates should have at least 3–5 years of direct practicerelevant qualifications and professional experience in at least one of the following areas: Licensed Social Work MSW or equivalent graduate-level qualification in Social Work. LCSW, LICSW, LMSW, or equivalent applicable social work license/credential. Experience with client assessment, case review, interviewing, counseling, or related social-work practice. Counseling, Therapy, or Psychology MA/MS with LMFT, LPC, LCPC, or equivalent counseling/therapy license or credential; or PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology. Experience with counseling, therapy, psychological assessment, interviewing, case review, or other relevant client-facing work. Qualitative Research, HCI, or Communication MA/PhD or equivalent advanced expertise in Human-Computer Interaction (HCI), Communication, Anthropology, Sociology, Qualitative Research, or a closely related discipline. Experience conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, qualitative coding, or similar research activities. Relevant backgrounds may include Qualitative Research, HCI Research, UX/User Research, Communication Research, Anthropology, Sociology, or related disciplines. Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields Relevant professional qualification, credential, or demonstrated subject-matter expertise. Significant direct experience in advisory, client-facing, coaching, mediation, student advising/services, organizational consulting, or comparable work. Experience gathering context, understanding individual or organizational needs, and providing informed recommendations or guidance. Preferred experience: Experience eliciting relevant context when clients initially provide incomplete information Experience working across relationships, work, education, family, planning, wellbeing, and resource constraints, considering biological, psychological, social, spiritual/existential, financial, and practical factors Qualitative coding or structured case review Ability to distinguish between context that is load-bearing for the recommendation and that is merely descriptive/non-informative Experience reviewing interviews, consultations, coaching sessions, or client interactions to identify missed opportunities for clarification or information gathering Project Details : Project duration - 3 weeks (short term project) Project type - Pay-per-task (PPT) AHT - 75 minutes (approx.) Engagement - Full time Estimated project start date - 1st October (estimated) Must be based in Latam, southeastern Europe, Asia, Africa Skills: Business Analysis #J-18808-Ljbffr Turing

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Context Elicitation & Conversation Evaluation Specialists - Latam, Southeastern Europe, Asia, Africa in New York, NY vacancy
  • Review AI conversations, identify missing context, and suggest follow-up questions that improve recommendations...  ...Philippines Romania Serbia South Africa The work You will review conversations...  ...they are useful. Conversation evaluators help improve how AI understands context... 
    Suggested
    Contract work
    Part time
    For contractors
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    2 days ago
  •  ...AI is seeking subject matter experts to review AI conversations and assess whether sufficient context was gathered before recommendations were made. You...  ...systems. The role focuses on rigorous qualitative evaluation and documentation. Successful candidates will have... 
    Suggested
    Remote job

    Verita Ai

    New York, NY
    2 days ago
  •  ...Overview We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation...  ...through simulated interactions, audit conversational AI outputs, and generate clean, reliable...  ...structured data within a support context. Representative Dataset Generation: Contributing... 
    Suggested
    Hourly pay
    For contractors
    Freelance
    Remote work

    Agency

    New York, NY
    2 days ago
  •  ...About the role Calibration Technology Evaluation Specialist is a remote review track for evaluating AI outputs across calibration technology...  ...role, the visible terms, and source attribution for reviewer context. 01 Confirm profile and eligibility details. 02 Attach this... 
    Suggested
    Hourly pay
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    AuraOne

    New York, NY
    3 days ago
  •  ...Agency is seeking someone to create and execute role-play-based evaluation scenarios that simulate realistic customer service...  ...real customer expectations for clarity, efficiency, and natural conversational flow, supporting benchmarking efforts. #J-18808-Ljbffr... 
    Suggested

    Agency.com

    New York, NY
    3 days ago
  • $500 per month

     ...About the role The CRO Specialist owns the testing and optimization of our direct-response...  ..., and dev/tech teams. They focus on conversion rate, cost-per-lead efficiency, and lead...  ...look past top-line conversion rate and evaluate lead quality and downstream results. Solid... 
    Local area
    Remote work
    Work from home
    Flexible hours

    Tort Experts

    New York, NY
    20 hours ago
  • $66.3k - $74k

     ...administrative teams based in New York. The Monitoring, Evaluation and Learning (MEL) function supports data-informed decision...  ..., partners, and colleagues spanning the Middle East, Europe, South Asia, East Africa, Latin America, and beyond. This is an entry-level position... 
    Temporary work
    Work at office
    Local area
    Worldwide

    Columbia University

    New York, NY
    2 days ago
  •  ...is a leading digital marketing agency helping brands grow in Europe. We seek a senior performance marketing expert with 3+ years of...  ...across Europe, shaping strategy, tracking, optimisation and client conversations, with influence on how accounts are run and measurable impact... 
    Remote job

    Monsoon Sp. z.o.o.

    New York, NY
    2 days ago
  • Agency is seeking a qualified evaluator to design and run role-play based scenarios that mimic real customer service conversations. The role involves helping build diverse datasets for audio agents and assessing model performance across multiple metrics. You will ensure... 

    Agency

    New York, NY
    2 days ago
  • $12 - $18 per hour

    Globik AI is seeking TTS Pronunciation Evaluation Specialists to assess whether text-to-speech output correctly pronounces words, names, and phrases across languages and contexts to support model refinement. Responsibilities Listen to TTS output and verify correct pronunciation... 

    Globik AI

    New York, NY
    1 day ago
  • Ecommerce - Conversion Rate Optimization Specialist Remote SUMMARY At Magnolia, the Conversion Rate Optimization Specialist is responsible for improving...  ...customer behavior, surface opportunity areas, and evaluate the impact of site improvements. This position works from... 
    Work experience placement
    Work at office
    Local area
    Remote work

    Magnolia

    New York, NY
    2 days ago
  •  ...audio models used in real-world customer support scenarios. You will design and execute role-play-based evaluations across travel, finance, and telecommunications contexts to simulate authentic customer interactions. Contribute to datasets, measure model performance with... 

    Agency

    New York, NY
    2 days ago
  • Invisible Technologies is seeking independent Audio Evaluation Specialists for an AI benchmark project evaluating agentic audio models in real...  ...professional experience in complex customer support or conversational AI evaluation, be bilingual, and possess #J-18808-Ljbffr... 
    Remote job

    Invisible Technologies Inc.

    New York, NY
    2 days ago
  • $47.99k

    Online Performance Evaluation Specialist Remote jobs have changed how we work, and here’s a role that’s at the heart of it—Online Performance...  ...trends that others might miss. Empathy to guide tough conversations without making them awkward. Confidence in suggesting talent... 
    Immediate start
    Remote work
    Work from home
    Worldwide
    Home office
    Flexible hours
    Shift work
    Night shift
    Day shift

    Naukri Mitra

    New York, NY
    2 days ago
  •  ...seeking a French Audio Recording Expert (Canada) for remote evaluation. You will review prompts and responses, compare outputs, and...  ...role focuses on assessing pronunciation, voice quality, and conversation robustness for high-quality data labeling. Role requires prior... 
    Remote job

    Auraone

    New York, NY
    1 day ago
  • Role: English Speech & Audio Evaluation Specialist Employment Type: 3-Month Contractual Role Roles and Responsibilities Listen to English audio recordings and conversations and evaluate the quality of spoken English. Assess pronunciation, accent, fluency, clarity,... 

    Innodata India

    New York, NY
    2 days ago
  • $8 - $65 per hour

    Epidemiology Specialist - Freelance AI Trainer Project United States of America Are you a...  ...reasoning. On a typical day, you will converse with the model on real-world epidemiological...  ...to our prompt engineering and evaluation metrics. A PhD degree in epidemiology,... 
    Remote job
    Hourly pay
    Contract work
    For contractors
    Freelance
    Immediate start

    Meridial

    New York, NY
    4 days ago
  • Capacity Building Specialist (Media and Communication) Job Category...  .... About the Region The Europe and Central Asia Regional Office (ECR), based...  ...UNHCR and UNEP. Job Specific Context The “Support to European...  ...pursues continuous improvements. Evaluates data and courses of action... 
    Contract work
    Work at office
    Local area
    Work from home
    Flexible hours

    UNOPS - United Nations Office for Project Services

    New York, NY
    3 days ago
  •  ...customer service role-plays in travel, finance, and tech support. Evaluate AI audio responses using structured criteria for accuracy,...  ...work with flexible scheduling. Meaningful impact on conversational AI quality and reliability. Jobgether Jobgether is an AI-powered... 
    Remote job
    Hourly pay
    Freelance
    Flexible hours

    Jobgether

    New York, NY
    2 days ago
  • $35 per hour

     ...an EXL company, is looking for detail oriented analysts to evaluate and rank AI generated responses to image based prompts. You...  ...matter far more than speed here. Responsibilities Interpret conversational context and identify what the user really wanted. Rate and rank... 
    For contractors
    Remote work
    Flexible hours

    iMerit Inc.

    New York, NY
    2 days ago
  • About the role Meridial seeks independent Audio Evaluation Specialists for an AI benchmark evaluation project. You will design evaluation frameworks...  ...complex customer support, technical troubleshooting, or conversational AI evaluation Native or bilingual proficiency in the... 
    Hourly pay
    For contractors
    Freelance
    Work at office
    Remote work
    Worldwide

    remote work

    New York, NY
    2 days ago
  • ABA Intake Specialist and Rethink Coordinator (South Africa) Preferred Candidate Region Philippines; South Africa Job Type Full time Job Opening Status Waiting for Clients Response Work Schedule Fixed Schedule Job Category Operations and Project Management Required... 
    Full time
    Remote work
    Shift work

    Slash Staffing LLC

    New York, NY
    4 days ago
  • Evaluate audio-based conversational AI in realistic customer support scenarios. Contribute to high-quality datasets for advanced AI models. Work remotely as a freelance independent contractor. Responsibilities: Design and conduct role-play scenarios across travel, finance... 
    Remote job
    Hourly pay
    For contractors
    Freelance
    Flexible hours

    Jobgether

    New York, NY
    2 days ago
  • $40 per hour

    AuraOne is seeking remote contractors to review multimodal signals evaluation prompts and responses. You will judge model outputs across text, images, and documents, label edge cases, and generate structured feedback to retrain the system. Ideal candidates have experience... 
    Remote job
    Hourly pay
    Part time
    For contractors
    Flexible hours

    Auraone

    New York, NY
    1 day ago
  • $75 - $110 per hour

     ...Neurology Evaluation Specialist is a remote clinical-review track for evaluating AI outputs that touch neurology. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so... 
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne

    New York, NY
    20 hours ago
  • AuraOne is seeking a Rubric Expert to review rubric evaluation prompts and responses, compare outputs, label edge cases, and provide structured feedback for retraining the model. AI data reviewers help turn rubric evaluation outputs into auditable labels, rationales, and... 
    Remote job
    For contractors

    Auraone

    New York, NY
    2 days ago
  • $28 per hour

    The HR Specialist II Corporate Accommodations serves as a subject matter expert for disability...  ...job site analyses as needed to evaluate job demands and potential...  ...With offices across the U.S., Canada, Asia Pacific and Europe, Aston Carter serves many of the Fortune... 
    Remote job
    Contract work
    Temporary work
    Local area

    Aston Carter

    New York, NY
    4 days ago
  • Crossing Hurdles is seeking a contract-based interview specialist to conduct structured elicitation and interviews with diverse subjects. This remote US-based role requires accurate data collection and adaptive questioning in real-time. You will establish rapport, assess... 
    Remote job
    Contract work
    Flexible hours

    Crossing Hurdles

    New York, NY
    2 days ago
  • AuraOne, Inc. is seeking a remote evaluation contractor to review search generalist prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback for retraining the modeling team. The role emphasizes... 
    Remote job
    For contractors
    Flexible hours

    AuraOne, Inc.

    New York, NY
    2 days ago
  • A leading technology firm seeks a CRO Specialist to enhance conversion rates through strategic optimization and testing of landing pages. This role focuses on analyzing visitor behavior and running A/B tests to improve trial signups. Successful candidates will manage landing... 
    Remote job

    Dotcom-Monitor

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Context Elicitation & Conversation Evaluation Specialists - Latam, Southeastern Europe, Asia, Africa. Be the first to apply!