Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Bilingual Korean AI Evaluation Specialist [Remote]

AuraOne Human Data

Remote
  • Remote job

Bilingual Korean AI Evaluation Specialist is a remote evaluation track for reviewing korean generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.

Why this role matters

AI data reviewers help turn korean generalist evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.

Responsibilities

  • Evaluate korean generalist evaluation model outputs against a versioned rubric and assign severity tags for Bilingual Korean AI Evaluation Specialist assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
  • Document recurring failure modes so the modeling team can target them in the next training run.

Qualifications

  • Prior evaluation, annotation, or human-rater experience on korean generalist evaluation or adjacent content for Bilingual Korean AI Evaluation Specialist work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Compare two korean generalist evaluation model responses to the same prompt and pick the stronger one with rationale.
  • Tag an unsafe response with the correct policy category and severity.
  • Audit a 50-row batch for rubric consistency and report drift to the program lead.
  • Propose a rubric clarification after spotting a recurring failure mode.

Nice to have

  • Background in linguistics, content moderation, or trust & safety review.
  • Experience with inter-rater agreement metrics and calibration cycles.
  • Domain expertise that lets you spot subject-matter errors automated checks miss.

Skills

  • Model output evaluation
  • Rubric-based annotation
  • Severity tagging
  • Inter-rater calibration
  • Korean generalist evaluation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Bilingual Korean AI Evaluation Specialist [Remote] in Remote vacancy
  • $25 - $30 per hour

     ...Bilingual Korean AI Evaluation Specialist is a remote Korean specialist track for evaluating korean evaluation outputs against native-speaker standards. Reviewers spot fluency, register, and cultural-context errors that automated checks miss, and write structured rationale... 
    Bilingual
    Korean language skills
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    7 days ago
  • Invisible Technologies is seeking a Japanese-Korean Bilingual Specialist to help power AI training and evaluation from a remote location. You will review translations, annotate errors, and assist in refining prompts and linguistic guidelines for better accuracy and cultural... 
    Bilingual
    Korean language skills
    Remote job

    Invisible Technologies Inc.

    New York, NY
    2 days ago
  • Agency is seeking a Korean-Japanese bilingual specialist for AI training and evaluation. You will review AI translations, annotate errors, and help improve accuracy, naturalness, and cultural alignment across Korean and Japanese content. As a contractor, you’ll use linguistics... 
    Bilingual
    Korean language skills
    Remote job
    Contract work
    For contractors

    Agency

    New York, NY
    3 days ago
  • $8 - $65 per hour

     ...Korean–Japanese Bilingual Specialist – AI Trainer World Wide - Remote Are you a bilingual professional fluent in Korean and Japanese eager to shape...  ...data. You'll work with cutting-edge AI tools, evaluate translations and conversations between Korean and Japanese... 
    Bilingual
    Korean language skills
    Hourly pay
    For contractors
    Freelance
    Remote work
    Worldwide

    Meridial

    United States
    5 days ago
  •  ...contributors to join our remote, freelance network. You will engage in tasks such as annotation, evaluation, and prompt creation to support AI data quality across Korean, Chinese, and English language projects. Native or near-native Korean and/or Chinese fluency is preferred... 
    Bilingual
    Korean language skills
    Remote job
    Hourly pay
    Freelance
    Flexible hours

    Welo Global

    New York, NY
    2 days ago
  • Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors...  ...based projects in areas such as: Annotation Evaluation Prompt Creation When a suitable project...  ...example: Supporting AI Language Data for Korean, Chinese or both If you have native or... 
    Bilingual
    Korean language skills
    Hourly pay
    Freelance
    Remote work
    Flexible hours

    Welocalize

    New York, NY
    1 day ago
  • AI Trainer Jobs is seeking a Korean bilingual expert for a remote evaluation track. The role involves reviewing Korean generalist prompts and responses against AuraOne's rubric, comparing paired outputs, and writing structured feedback for retraining. As a remote independent... 
    Bilingual
    Korean language skills
    Remote job
    Hourly pay
    For contractors

    Auraone

    New York, NY
    3 days ago
  • AuraOne, Inc. seeks a Korean Language AI Evaluation Specialist to remotely assess Korean model outputs against native-speaker standards. You will review fluency, register, and cultural-context, providing structured rationale for modeling teams to act on in the next training... 
    Korean language skills
    Remote job

    AuraOne Human Data

    New York, NY
    2 days ago
  • $8 - $65 per hour

     ...Job Application for Korean-Japanese Bilingual Specialist - Freelance AI Trainer Project at Meridial Back to jobs Korean-Japanese Bilingual Specialist...  ...training data. You’ll work with cutting-edge AI tools, evaluate translations and conversations between Korean and... 
    Bilingual
    Korean language skills
    Hourly pay
    Contract work
    Part time
    For contractors
    Freelance
    Remote work
    Worldwide

    Invisible Technologies

    San Francisco, CA
    a month ago
  • prolificacademicltd is seeking advanced Korean speakers for a fully remote, contract-based role focused on training and evaluating AI language models. You will review, correct, and rate Korean outputs to influence model handling of Korean text, with tasks that may take... 
    Korean language skills
    Remote job
    Contract work
    For contractors
    Self employment

    prolificacademicltd

    New York, NY
    2 days ago
  • $35 per hour

    Welocalize, Inc. seeks Korean-speaking experts to join a language evaluation project focused on identifying AI output failures related to locale and language nuances. You will search, verify sources, and document evaluation criteria for correct answers. Remote freelance... 
    Korean language skills
    Hourly pay
    Freelance
    Immediate start
    Remote work
    Flexible hours

    Welocalize, Inc.

    New York, NY
    1 day ago
  • $38 per hour

    AI Trainer Jobs is seeking a Bilingual Writer - Spanish (Spain) for a remote evaluation track. You will review Spanish prompts and responses against AuraOne's rubric, label edge cases, and provide structured feedback to retrain the model. Responsibilities include evaluating... 
    Bilingual
    Remote job
    Hourly pay
    Part time
    For contractors

    Auraone

    New York, NY
    5 days ago
  • $30 - $65 per hour

    Review Korean audio for fluency, pronunciation, intonation, and language quality. The remote contractor role pays $30 to $65...  ...and fluently Korean is spoken by a person or produced by an AI model. Your evaluations will help improve AI systems that understand and generate Korean... 
    Bilingual
    Korean language skills
    Hourly pay
    Part time
    For contractors
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    5 days ago
  • Invisible Technologies is seeking independent Audio Evaluation Specialists for an AI benchmark project evaluating agentic audio models. You will...  ...customer support scenarios. Applicants should be native or bilingual in the target language, have basic JSON literacy, strong... 
    Bilingual
    Remote job
    Hourly pay
    Freelance

    Invisible Technologies Inc.

    New York, NY
    1 day ago
  • Invisible Technologies is seeking an entry-level Korean-Japanese Bilingual Specialist for AI training data work. You will review AI translations, annotate errors, and assess naturalness while collaborating with the team to improve prompts and linguistic guidelines. Fluency... 
    Bilingual
    Korean language skills
    For contractors
    Remote work

    Invisible Technologies Inc.

    New York, NY
    2 days ago
  • Remotebridge is seeking a Vietnamese Bilingual Expert on a contract basis to support an AI training project. The role is remote and focuses on high-quality...  ...linguistic input without requiring AI experience. You will evaluate Vietnamese audio for nativeness, pronunciation, and... 
    Bilingual
    Remote job
    Contract work

    Remotebridge

    New York, NY
    5 days ago
  • DataAnnotation is seeking a bilingual Hebrew-English professional to train AI models from your language expertise. You will judge AI outputs with a native...  ...scheduling and hourly pay. You will write prompts, evaluate responses, compare outputs, and explain judgments clearly... 
    Bilingual
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  • Crossing Hurdles is seeking a French bilingual expert to evaluate audio samples for nativeness and fluency...  ...and is ideal for linguists or voice specialists. You will assess pronunciation,...  ...helps clarify requirements and improve AI language understanding. #J-18808-Ljbffr... 
    Bilingual
    Remote job
    Contract work
    Flexible hours

    Crossing Hurdles

    New York, NY
    2 days ago
  • We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project. Contractors will design evaluation frameworks, execute...  ...expertise includes deep customer support knowledge, bilingual fluency, and basic JSON literacy. Engagement is... 
    Bilingual
    Remote job
    For contractors
    Freelance
    Work from home

    Agency

    New York, NY
    1 day ago
  •  ...customer service role-plays in travel, finance, and tech support. Evaluate AI audio responses using structured criteria for accuracy,...  ...reflect real-world customer expectations. Who you are: Native or bilingual German with strong communication and analytical skills. Experienced... 
    Bilingual
    Remote job
    Hourly pay
    Freelance
    Flexible hours

    Jobgether

    New York, NY
    1 day ago
  • Evaluate audio-based conversational AI in realistic customer support scenarios. Contribute to high-quality datasets for advanced AI models. Work remotely...  ..., functions, and simple logic. Requirements: Native or bilingual Portuguese with strong reading, listening, writing, and... 
    Bilingual
    Remote job
    Hourly pay
    For contractors
    Freelance
    Flexible hours

    Jobgether

    New York, NY
    14 hours ago
  • About the role Meridial seeks independent Audio Evaluation Specialists for an AI benchmark evaluation project. You will design evaluation frameworks...  ..., or conversational AI evaluation Native or bilingual proficiency in the target language with strong reading,... 
    Bilingual
    Hourly pay
    For contractors
    Freelance
    Work at office
    Remote work
    Worldwide

    remote work

    New York, NY
    1 day ago
  • Project Overview We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project assessing advanced agentic audio...  ...troubleshooting, or conversational AI evaluation. Native or bilingual proficiency in the target language, including fluency... 
    Bilingual
    Hourly pay
    For contractors
    Freelance
    Remote work

    Agency

    New York, NY
    1 day ago
  • OpenTrain AI, Inc. seeks a remote contractor to review Korean audio for fluency, pronunciation, and language quality. You will assess how naturally Korean is spoken and how well AI-produced speech matches linguistic norms. You will also provide concise English notes with... 
    Bilingual
    Korean language skills
    Remote job
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    5 days ago
  • $8 - $65 per hour

     ...Job Application for Korean-Chinese Bilingual Specialist - Freelance AI Trainer Project at Meridial Back to jobs Korean-Chinese Bilingual Specialist...  ...training data. You’ll work with cutting-edge AI tools, evaluate translations and conversations between Korean and... 
    Bilingual
    Korean language skills
    Hourly pay
    Contract work
    Part time
    For contractors
    Freelance
    Remote work
    Worldwide

    Invisible Technologies

    San Francisco, CA
    a month ago
  •  ...Position Overview: We are seeking an AI DevOps Engineer to design develop deploy and...  ...pipelines and automated deployment processes. Evaluate emerging AI models frameworks and...  ...technical and non-technical stakeholders. ~ Bilingual preferred Additional Information :... 
    Bilingual
    Korean language skills
    Full time
    Remote work

    SBT Global, Inc.

    Plano, TX
    10 days ago
  • $30 per hour

     ...Entry-Level AI Evaluation Specialist is a remote review track for evaluating AI outputs across ai training workflows. Reviewers grade workflow...  ...AI-assisted workflow tooling and its failure modes. Bilingual experience for cross-region operations. Skills Operational... 
    Bilingual
    Remote job
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  • $38 - $43 per hour

     ...Bilingual Korean STEM Evaluation Specialist is a remote review track for evaluating AI outputs across korean stem review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method... 
    Bilingual
    Korean language skills
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  •  ...risk assessments, including medical history review, symptom evaluation, and physical examinations. ~ Develop care plans for...  ...skills. Excellent communication and teamwork abilities. Bilingual in Spanish/Korean is a plus Vivo HealthStaff is a healthcare staffing... 
    Bilingual
    Korean language skills
    Permanent employment
    Full time
    Temporary work
    Remote work
    Work from home
    Relocation package

    Vivo HealthStaff

    Sacramento, CA
    4 days ago
  • AuraOne, Inc. is seeking a Bilingual Medical Doctor (Korean) to remotely review AI outputs for clinical accuracy and safety. You will evaluate model-generated clinical reasoning, dosing logic, and guideline adherence, flag potential patient-safety issues, and document corrected... 
    Bilingual
    Korean language skills
    Remote job

    AuraOne, Inc.

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Bilingual Korean AI Evaluation Specialist [Remote]. Be the first to apply!