Korean Language AI Evaluator
$20 per hourProductive Playhouse Inc.
Responsibilities Test and evaluate AI chatbots and language models through structured conversations Participate in voice-based AI interactions where the project requires them Submit deliverables such as write-ups, ratings, screenshots, or recordings in the format each task specifies Requirements Native or expert-level fluency in Korean as spoken in South Korea Strong English reading, writing, and communication skills 18 years of age or older Hands-on experience using AI models or large language models Own smartphone, computer, reliable internet, and comfort with web-based tools Able to pass a language proficiency and technical literacy assessment Able to start within 48 hours Benefits Flexible remote work on your own schedule, with the freedom to take other clients Task-based pay of $20.00 USD per hour About the Company Productive Playhouse Inc. is a global data and language services company offering transcription, translation, localization, and AI evaluation. #J-18808-Ljbffr Productive Playhouse Inc.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Korean Language AI Evaluator in New York, NY vacancy
$20 per hour
Productive Playhouse Inc. seeks a remote AI evaluation tester to assess chatbots and language models through structured conversations, with occasional voice-... ...required. Requirements include native or expert-level Korean (South Korea dialect) and strong English skills, 18+...Korean language skillsRemote jobFlexible hours- ...Alignerr is seeking Search Quality Evaluators (AI Training) to assess search results, AI-generated answers, and recommendations. This remote, hourly contract offers flexible 10–40 hours per week and the opportunity to contribute to reliable AI information delivery. You...SuggestedHourly payContract workRemote work10 hours per weekFlexible hours
Alignerr Corp.
New York, NY1 day ago - ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...SuggestedContract workTemporary workImmediate startRemote work
MERIT Beauty
New York, NY4 days ago - ...BAM Ventures is seeking freelance, remote German-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll assess accuracy, consistency, and alignment with real-world expectations in German. This is a contract, remote...SuggestedContract workTemporary workFreelanceImmediate startRemote work
BAM Ventures
New York, NY7 hours ago - ...German Voice AI Evaluator (Healthcare Front Desk Conversations) What if your native German fluency could help teach AI how to handle a... ...variants from Germany, Austria, and Switzerland Linguistics or language-focused academic background Familiarity with medical...SuggestedContract workWork at officeRemote workFlexible hours
Alignerr
New York, NY22 hours ago $14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data...Hourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hoursWelo Data
New York, NY3 days ago- ...Alignerr is seeking Chinese language experts to evaluate and improve AI training data for Chinese learning and instruction. You will apply your linguistic expertise to shape how AI understands and assesses learner language, with real impact on students worldwide. This...Hourly payContract workRemote workWorldwideFlexible hours
Alignerr Corp.
New York, NY22 hours ago - ...Alignerr is seeking native German speakers in the New York area to evaluate a healthcare AI receptionist by role-playing as a patient and recording conversations. You will assess how well the AI listens, responds, and takes action, then provide structured feedback....Contract workRemote workFlexible hours
Alignerr Corp.
New York, NY22 hours ago - RWS Group is seeking a remote evaluator to help improve AI search results by providing detailed feedback on text, audio, images, and videos. You’ll work from home, simulating everyday searches to influence how major search engines respond to real users. Ideal candidates...Remote jobWork from home
$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Remote jobHourly payPart timeFlexible hours- Mercor is hiring experienced Sales Representatives (Wholesale and Manufacturing, Except Technical and Scientific Products) to evaluate and improve AI-generated sales content and workflows. You will apply your B2B wholesale and manufacturing sales expertise to assess...Hourly payTemporary workImmediate start
- A leading AI research accelerator is hiring a position focused on contributing to projects that evaluate and enhance AI systems. You will design community service scenarios, write structured explanations, and evaluate AI accuracy. The ideal candidate will have 4+ years...Remote jobFull timeFor contractors
- Feedinkoo is seeking a Graphic Designer to help train and improve AI models focused on UI/UX design, visuals, and user experiences. You will critique AI outputs, provide feedback, and guide model improvements to better reflect aesthetics and usability for designers. The...Remote work
- Alignerr Corp. is seeking AI Chatbot Testers for a fully remote, hourly-contract role. You will engage with cutting-edge AI systems, evaluate responses, and provide actionable feedback to shape safer and smarter tools. No technical background required, and you can work...Remote jobHourly payContract workFlexible hours
- AuraOne, Inc. is seeking a remote evaluator to review food delivery AI response evaluations. You will compare paired outputs, label issues, and provide structured feedback to help retrain the model according to AuraOne's rubric. Ideal candidates have prior annotation experience...Remote jobFor contractors
$30 per hour
...Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent systems using defined rubrics... .... Requirements Strong experience in LLM evaluation, AI output analysis, QA/testing, UX research, or similar analytical...Remote jobHourly payContract work- Productive Playhouse Inc. is a remote AI-evaluation partner assessing French-language chatbots and language models through structured conversations. You will engage in voice-based interactions when needed and provide write-ups, ratings, screenshots, and recordings of your...Remote jobFlexible hours
- Mindrift is seeking actively practicing physicians (MD/DO) with an active, unrestricted US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. You will review vignettes, score reasoning quality, and write concise rationales to improve...Remote job10 hours per week
- Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models, rank outputs for naturalness and accuracy, and provide written explanations of what went wrong...Remote jobWeekly payFlexible hours
- Create challenging prompts and evaluate large language model responses for accuracy, reasoning, and usefulness. This worldwide, part-time role requires... ...planning, and operational execution to assess how well AI handles management-related topics. Create complex prompts...Contract workPart timeFor contractorsRemote workWorldwide
- ...States is seeking proficient bilingual speakers (Finnish and English) to help make advanced AI models safer. You will apply language fluency and cultural judgment to evaluate and strengthen how these models handle sensitive topics in Finnish. No prior AI/ML experience...Part time
$20 - $30 per hour
A remote-focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing actionable feedback to enhance product quality. Ideal candidates will have strong...Remote jobHourly pay$18 per hour
RWS TrainAI is seeking AI Linguistic Evaluators to assess Marathi-language performance for a short collaboration. This remote, freelance role offers flexible scheduling with an estimated 10-15 hours total (about 5 hours per day) at a rate of 18 USD/hour. Start date is immediate...Remote jobFreelanceImmediate startFlexible hours- RWS, a language solutions company, is seeking freelance evaluators to assess AI-generated Tamil responses for accuracy, usefulness, and cultural alignment. This remote role offers flexible scheduling and timely payments. You will score outputs against established quality...Remote jobFreelanceFlexible hours
- Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, compare generated images and videos to judge which follows the prompt better, and explain in writing what...Remote job
- RWS is seeking a part-time Search Quality Evaluator to help improve AI-driven search results. You will test how search engines respond to everyday queries from regular users, provide feedback on text, audio, images, and videos, and help refine data used by major platforms...Remote jobPart timeWork from homeFlexible hours
- AI Trainer Jobs seeks a remote independent contractor to review AI outputs for fintech operations evaluation. You will assess workflow adherence, tone, and escalation logic, assigning severity tags and documenting next steps for model training. The role requires experience...Remote jobHourly payFor contractorsFlexible hours
- Mercor is seeking bilingual Vietnamese-English reviewers to craft expert-level prompts and assess sensitive topics for AI safety. You will apply structured guidelines, classify conversations, and document reasoning. Immediate start with training provided and a part-time...Part timeImmediate startRemote workWorldwide
$20 per hour
Review and rate AI-generated Kannada responses, write reference answers, and apply mathematical... ...20+ hours per week. The Work You will evaluate AI-generated Kannada content and help... ...or higher in Mathematics is required. Language: Professional fluency in Kannada,...Hourly payContract workPart timeFor contractorsRemote work- Rise Data Labs is seeking a Korean AI Training Specialist to enhance AI models through precise data annotation and validation. Your Korean language expertise will ensure training data reflects nuanced linguistic patterns and supports high-quality model performance. You...Korean language skillsRemote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Korean Language AI Evaluator. Be the first to apply!
Related searches
- clinical evaluator New York, NY
- ai evaluator New York, NY
- program evaluator New York, NY
- work from home social media evaluator New York, NY
- education evaluator New York, NY
- evaluator New York, NY
- work from home web search evaluator New York, NY
- social media evaluator New York, NY
- quality evaluator New York, NY
- korean company New York, NY