Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Korean Evaluation Specialist (Remote) — Rubric QA

AuraOne

New York, NY
  • Remote job

AuraOne is seeking a remote Business Document Expert (Korean Speaker) to review and rate Korean generalist evaluation prompts and responses. You will compare paired outputs, label edge cases, and provide structured feedback to retrain models. The role is CONTRACTOR and remote, with US eligibility and hourly compensation discussed after interviews. The work requires strong attention to detail, clear written reasoning, and experience with multi-page rubrics. #J-18808-Ljbffr AuraOne

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Korean Evaluation Specialist (Remote) — Rubric QA in New York, NY vacancy
  • AuraOne is seeking a Tagalog Language Expert to review generalist evaluation prompts and responses against the company’s quality rubric. This is a remote contractor role focusing on structuring feedback, labeling edge cases, and generating regression data for retraining... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    9 hours ago
  • $50 per hour

    AuraOne is seeking a Korean Audio Evaluation Specialist to remotely review Korean generalist evaluation prompts and responses against AuraOne's quality rubric. You will compare paired outputs, label edge cases, and generate structured feedback for retraining the model.... 
    Remote job
    Korean language skills
    Contract work

    AuraOne

    New York, NY
    1 day ago
  • AuraOne is seeking a Korean Formality Cultural Context Reviewer to remotely evaluate Korean generalist evaluation prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and craft structured feedback to retrain models. Responsibilities... 
    Remote job
    Korean language skills
    For contractors

    AuraOne

    New York, NY
    3 days ago
  • AuraOne is seeking a remote Business Document Expert (Portuguese Speaker) to review prompts and responses against our quality rubric. You will evaluate Portuguese generalist outputs, label edge cases, and provide structured feedback to retrain models. This is a contractor... 
    Remote job
    For contractors
    Flexible hours

    AuraOne

    New York, NY
    9 hours ago
  • AuraOne is seeking a remote Rubric Calibration Model Evaluation Specialist contractor in the United States. The role focuses on evaluating rubric calibration model outputs, labeling issues, and providing structured feedback to retrain the model. You will compare paired... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    4 days ago
  • AuraOne is seeking a remote Humanoid Task Task Evaluator to review and label humanoid task evaluation prompts and responses. You will compare paired outputs, apply a versioned rubric, and produce structured feedback for retraining the model. This contractor role requires... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    9 hours ago
  • $50 per hour

     ...Korean Audio Evaluation Specialist is a remote evaluation track for reviewing korean generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling... 
    Remote job
    Korean language skills
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    17 days ago
  • AuraOne is seeking a remote News Monitoring Task Evaluator to assess evaluation prompts and responses against our quality rubric. You will compare paired outputs, write rationales, and label edge cases to aid model retraining and quality control. Join as a contractor working... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    1 day ago
  • AuraOne is seeking a Prompt Robustness Model Evaluation Specialist to remotely review prompts and model outputs, applying AuraOne's quality rubric. You will compare paired responses, label edge cases, and provide structured feedback for retraining. This contractor role... 
    Remote job
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    1 day ago
  • AuraOne is seeking a remote Retrieval Relevance Task Evaluator to review prompts and responses against our quality rubric. You will compare outputs, assign severity tags, and provide structured feedback for model retraining. This contractor role requires careful reasoning... 
    Remote job
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    3 days ago
  • $38 - $43 per hour

     ...Bilingual Korean STEM Evaluation Specialist is a remote review track for evaluating AI outputs across korean stem review reasoning, calculations, and research...  ...a professional level. Comfort applying multi-page rubrics consistently across long batches. Clear written... 
    Remote job
    Korean language skills
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    17 days ago
  • AuraOne is seeking a remote Pairwise Preference Reward Model Evaluator to review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain the modeling team. This independent contractor... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    3 days ago
  • $20 per hour

     ...are sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI...  ...strong prompts, and clear, well-structured rubrics that generate clean, reliable data for...  ...Type: Freelance / Independent Contractor Workplace Type: Remote... 
    Remote work
    Hourly pay
    Temporary work
    For contractors
    Freelance

    Meridial

    Remote
    1 day ago
  • AuraOne is seeking a Bilingual Korean AI Evaluation Specialist for a remote, contractor role. You will review korean generalist prompts and model outputs, annotate using a versioned rubric, and provide structured feedback to retrain the model. You will compare paired responses... 
    Remote job
    Korean language skills
    For contractors

    AuraOne

    New York, NY
    3 days ago
  • AuraOne seeks a Korean Formality AI Evaluator to review prompts and responses, label edge cases, and provide structured feedback...  ...the model. The role emphasizes consistent rubric application and clear rationale. It is remote, contractor-based, and US-eligible with... 
    Remote job
    Korean language skills
    For contractors
    Flexible hours

    AuraOne

    New York, NY
    9 hours ago
  • AuraOne is seeking a Remote Social Engineering Security Evaluator to review prompts and responses against our quality rubric, producing auditable labels, rationales, and regression cases. This role operates as an independent contractor to support the security evaluation... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    9 hours ago
  • AuraOne is seeking a Czech Bilingual Expert for a remote contractor role to evaluate and label Czech bilingual outputs using AuraOne's rubric. The reviewer will compare responses, assign severity tags, and provide structured feedback to support model retraining. Responsibilities... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    3 days ago
  • AuraOne is seeking a remote Spreadsheet QA / workbook maintenance Evaluator to help ensure high-quality AI outputs. You will review model responses, apply a versioned rubric, and provide structured feedback to retrain the system. As a contractor based in the US, you will... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    1 day ago
  •  ...AuraOne seeks a Remote Constitutional AI Reward Model Evaluator to review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain the model. The role is contractor-based and remote... 
    Remote work
    For contractors

    AuraOne

    New York, NY
    2 days ago
  •  ...AuraOne is seeking a Lingala Bilingual Expert for a remote evaluation track. You will review prompts and responses against a quality rubric, label edge cases, and provide structured feedback for retraining the model. This is a contractor role requiring reliable async availability... 
    Remote work
    For contractors

    AuraOne

    New York, NY
    2 days ago
  •  ...AuraOne is seeking a remote Business Document Expert (Chinese Speaker) to review Chinese evaluation prompts and responses against a quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain models. This contractor... 
    Remote work
    For contractors

    AuraOne

    New York, NY
    2 days ago
  •  ...AuraOne is seeking a remote, independent contractor to evaluate cross-border AI outputs using AuraOne's quality rubric. You will compare paired responses, label issues with structured tags, and provide written rationales to support model retraining. The role emphasizes... 
    Remote work
    Hourly pay
    For contractors
    Flexible hours

    AuraOne

    New York, NY
    2 days ago
  •  ...AuraOne is seeking a Haitian Creole Bilingual Expert for a remote evaluation track. You will review prompts and responses, apply the quality rubric, and provide structured feedback. You’ll label edge cases and contribute to retraining data with clear rationales and severity... 
    Remote work
    Hourly pay
    10 hours per week

    AuraOne

    New York, NY
    2 days ago
  • $9 - $30 per hour

    ALTA Language Services, Inc. is looking for a remote Testing Evaluator in Atlanta, GA. This part-time position involves assisting with language proficiency examinations and evaluating tests according to set criteria. Candidates should have strong communication skills,... 
    Remote work
    Korean language skills
    Part time

    ALTA Language Services

    Atlanta, GA
    2 days ago
  • $10 - $15 per hour

     ...Korean Audio Transcription Specialist $10-15/hr Remote Freelance AUDIO About the Role What if your ear for Korean could directly shape how AI understands spoken...  ...with AI tools, annotation platforms, or language evaluation workflows Proficiency in English (for guideline... 
    Remote work
    Korean language skills
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Worldwide
    Flexible hours

    Alignerr

    United States
    4 days ago
  • Meridial is seeking a Korean Voice Acting Specialist for a freelance AI Trainer project. This remote position requires a highly skilled individual capable of enhancing AI...  ...voice samples. The role involves recording, evaluating AI outputs, and collaborating on voice design... 
    Remote job
    Korean language skills
    Hourly pay
    Freelance

    Meridial

    New York, NY
    2 days ago
  •  ...Description We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project...  ...prompts, complex evaluation rubrics, and technical guidelines. Requirements...  ...Contractor Workplace Type ~Remote Seniority Level ~Mid-Senior Level... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Freelance

    Meridial

    Remote
    5 days ago
  • AuraOne is seeking a French Transcription Expert (Canada) to remotely evaluate French generalist prompts and model outputs against AuraOne's quality rubric. You will review paired responses, label edge cases, and provide structured feedback for retraining. This contractor... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    9 hours ago
  • AuraOne is seeking a remote Video Summarization Evaluator to review and label outputs against our quality rubric. You will compare paired responses, annotate edge cases, and provide structured feedback to help retrain the model. The role emphasizes clear reasoning and consistent... 
    Remote job

    AuraOne

    New York, NY
    2 days ago
  • AuraOne is seeking a remote Cross-Modal Retrieval Model Evaluator to review prompts and model outputs against our quality rubric. This contractor role focuses on labeling edge cases, writing structured feedback, and contributing to retraining efforts for continued model... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Korean Evaluation Specialist (Remote) — Rubric QA. Be the first to apply!