AI Voice Quality Evaluator
Innodata Inc.
Innodata Inc. is seeking detail-oriented Voice Specialists to evaluate AI models via real-time voice conversations. You will compare two models, record your interactions, and provide structured evaluations across five criteria to determine the stronger overall conversational experience. The role emphasizes maintaining consistent turns, careful listening, and objective reporting, with the goal of delivering fair, actionable insights for model improvement. #J-18808-Ljbffr Innodata Inc.
- ...Korean Voice AI Evaluator (Healthcare Front Desk Conversations) About The Role What if your voice could help teach AI how to handle a... ...Follow detailed labeling guidelines consistently and submit high-quality work Who You Are Native or near-native Korean speaker...QualityContract workRemote workFlexible hours
$15 per hour
...Get paid to spot what AI-generated media gets wrong Hold live conversations with AI voice models, compare image and video pairs... ...improve. Through Outlier’s evaluation and feedback loop, your work helps... ...dimensions like adherence, quality, and realism , then writing a...QualityWeekly payContract workFreelanceInternshipRemote workFlexible hours- ...a native or near-native Korean speaker to remotely evaluate healthcare front desk conversations with an AI, role-playing as a patient and recording dialogue for... ...flexible hours and a quiet home workspace for quality contributions to AI research. #J-18808-Ljbffr Alignerr...QualityRemote jobContract workFlexible hours
$15 per hour
...Outlier invites detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare outputs, and explain why something looks off, all from home on your own schedule. This freelance, remote role offers flexible...SuggestedHourly payWeekly payFreelanceRemote workFlexible hours- ...detail-oriented, English-speaking reviewers to evaluate AI-generated media. You will conduct live conversations with AI voice models, compare image and video pairs, and... ...audio, and video, rate them on adherence and quality, and help improve frontier AI systems. This is...QualityWeekly payFreelanceRemote workFlexible hours
- Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models, rank outputs for naturalness and accuracy, and provide written explanations of what went wrong...QualityRemote jobWeekly payFlexible hours
$15 per hour
Outlier is hiring detail-oriented English speakers to review AI-generated media remotely on your own schedule. You will hold live conversations with AI voice models, compare image and video pairs, and explain what’s off in writing. Work from home or while traveling, with...QualityRemote jobHourly payWeekly payWork from homeFlexible hours- ...hourly contractor role supporting AI data and language projects on a... ...generation: writing high-quality prompts and model responses, or recording high-quality voice samples, to guide AI learning across... ...AI training datasets. LLM evaluation: reviewing AI-generated responses...QualityRemote jobHourly payFor contractorsFlexible hours
- ...Corp. is seeking native Korean speakers in the United States to evaluate an AI healthcare receptionist through simulated patient... ...labeling guidelines and contribute to improving the accuracy and safety of voice AI in healthcare #J-18808-Ljbffr Alignerr Corp.Remote jobContract workFlexible hours
- Embedded Shishya is seeking English-speaking Image Quality Evaluators based in South Korea to support AI training and evaluation projects. You will review images, assess quality, and provide English descriptions while considering South Korean culture and local context....QualityRemote jobFor contractorsLocal area
- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...QualityContract workTemporary workImmediate startRemote work
- ...Alignerr Corp. is seeking a Search Quality Evaluator (AI Training) for a fully remote, hourly contract role. You will assess search results, evaluate AI-generated answers, and rate content recommendations to help improve AI performance. The position offers flexible hours...QualityHourly payContract workRemote workFlexible hours
- ...Medical Translation AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade... ...published evidence or specialty guidelines. Maintain reviewer-quality scores in weekly inter-rater calibration cycles. Qualifications...QualityHourly payFor contractorsRemote work10 hours per week
- Innodata India seeks skilled Audio Speech Evaluators Experts to assess speech quality and conversational performance with an AI bot, following established guidelines. Candidates should be near-native English speakers with strong listening and analytical skills, capable...Quality
- AI Trainer Jobs is seeking a detail-oriented evaluator to score prompt-response pairs from large language models. You will use structured rubrics to rate factual accuracy, instruction-following, and coherence across batches, typically 20-50 pairs per session. You will...Quality
$30 per hour
...: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous... ...agent systems using defined rubrics and quality standards. Review multi-step agent... ...Requirements Strong experience in LLM evaluation, AI output analysis, QA/testing, UX research,...QualityRemote jobHourly payContract work$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...QualityRemote jobHourly payPart timeFlexible hours$13 per hour
...years Location: Argentina | Belize | Bolivia + 15 more Help evaluate how an AI assistant uses information from connected Google apps to... ...internet access. AI evaluation, annotation, content review or quality assurance experience is helpful but not required....QualityHourly payFor contractorsRemote work- YO AI Labs is seeking Content Writers & Editors to contribute to a customer project focused on text quality and AI evaluation. You will apply your writing and editing expertise to help train and evaluate next-generation AI systems through high-quality input. No prior AI...QualityRemote job
- RWS is seeking a part-time Search Quality Evaluator to help improve AI-driven search results. You will test how search engines respond to everyday queries from regular users, provide feedback on text, audio, images, and videos, and help refine data used by major platforms...QualityRemote jobPart timeWork from homeFlexible hours
$14.5 per hour
Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages...QualityHourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hours- Anyone AI is seeking a QUALITY EVALUATOR - ENGLISH to help shape the future of AI by evaluating and comparing responses from advanced AI models. This remote, part-time independent contractor role lasts up to 3 months and pays $7-$12 per hour. You’ll work with English-language...QualityRemote jobHourly payPart timeFor contractors
$20 - $30 per hour
...technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing actionable feedback to enhance product quality. Ideal candidates will have strong analytical skills,...QualityRemote jobHourly pay$20 per hour
Review and rate AI-generated Kannada responses, write reference answers, and apply mathematical... ...20+ hours per week. The Work You will evaluate AI-generated Kannada content and help... ...corrections. Create prompts and high-quality reference answers across several writing...QualityHourly payContract workPart timeFor contractorsRemote work- Materials Science AI Evaluator is a remote review track for evaluating AI outputs across materials science reasoning, calculations, and research... ...textbooks, papers, or community standards. Maintain reviewer-quality scores in inter-rater calibration cycles. Qualifications...QualityHourly payFor contractorsRemote work10 hours per week
- Position Summary In this remote, hourly contractor role, you will evaluate AI-generated financial content and develop cases that test... ...proficiency Reliable and self-directed, with consistent output quality in a remote, asynchronous workflow Preferred Experience Prior...QualityRemote jobHourly payFull timeFor contractors
- Brazilian Portuguese AI Evaluator is a remote evaluation track for reviewing portuguese generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling...QualityHourly payFor contractorsRemote work10 hours per week
$18 per hour
AI Linguistic Evaluator - Telugu Dallas, Texas RWS - TrainAI / Temporary/Contract / Remote Freelance Remote from the United States Flexible... ...with strong English skills and a keen eye for language quality? Join a remote AI project where you’ll evaluate AI-generated...QualityRemote jobTemporary workFreelanceImmediate startFlexible hours$18 per hour
Description: Interact with an AI assistant in Telugu. Translate English prompts into... ...to interact with the AI application. Evaluate AI-generated responses according to project... ...linguistic accuracy, naturalness, localization quality, and cultural appropriateness. Provide...QualityHourly payTemporary workFreelanceImmediate startRemote workFlexible hours- Create challenging prompts and evaluate large language model responses for accuracy, reasoning... ...operational execution to assess how well AI handles management-related topics. Create... ..., reasoning, relevance, and overall quality. Find factual errors, logical inconsistencies...QualityContract workPart timeFor contractorsRemote workWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Voice Quality Evaluator. Be the first to apply!
- social media evaluator New York, NY
- work from home social media evaluator New York, NY
- clinical evaluator New York, NY
- program evaluator New York, NY
- evaluator New York, NY
- ai evaluator New York, NY
- work from home web search evaluator New York, NY
- ads evaluator New York, NY
- education evaluator New York, NY
- quality evaluator New York, NY


