Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

German Language Evaluation Reviewer & Rubric Annotator

Auraone

AI Trainer Jobs in the United States seeks a remote Business Document Expert (German Speaker) to evaluate German generalist prompts and responses against AuraOne's rubric. You will label edge cases, provide structured feedback for retraining, and compare outputs to select the stronger answer with rationale. Role is contractor-based with an hourly rate to be confirmed after interview. Ideal candidates have prior German evaluation experience and strong attention to detail, with reliable async #J-18808-Ljbffr Auraone

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the German Language Evaluation Reviewer & Rubric Annotator in New York, NY vacancy
  • AI Trainer Jobs is seeking a Cantonese Language Evaluator for a remote contractor role. You will review cantonese generalist evaluation prompts and responses, apply AuraOne's quality rubric, and label edge cases with structured feedback to retrain the model. You will compare... 
    Suggested
    Remote job
    For contractors
    10 hours per week

    Auraone

    New York, NY
    3 days ago
  • AuraOne is seeking a Swedish Language Expert (US/Canada Based) for remote evaluation of prompts and responses under AuraOne's quality rubric. You will review paired outputs, label edge cases, and write structured feedback for retraining the model. The role requires prior... 
    Suggested
    Remote job
    Hourly pay
    10 hours per week

    Auraone

    New York, NY
    2 days ago
  • AuraOne, Inc. is seeking a remote contractor to review Australian voice actor evaluation outputs and apply a versioned rubric. You will label edge cases, provide structured feedback, and calibrate scores against gold-standard examples. The role requires strong attention... 
    Suggested
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    2 days ago
  •  ...Inc. is seeking a STEM Expert, German (Germany) for remote review of AI outputs. You will evaluate derivations, reproduce key...  ...contractor role requiring German-language expertise and rigorous reasoning...  ...reproducibility, adherence to rubrics, and consistent results across... 
    German language
    Remote job
    For contractors
    10 hours per week

    AuraOne, Inc.

    New York, NY
    4 days ago
  • $50 per hour

    Mercor is seeking experienced scientists/engineers fluent in German to train and evaluate AI agents on realistic professional tasks. You will build workspaces and files, write prompts, and create grading rubrics based on real stem work as it's done in Germany. The role... 
    German language
    Remote job
    Hourly pay

    Mercor

    New York, NY
    3 days ago
  • AuraOne, Inc. seeks a remote Evaluation Generalist to review Blender on Windows outputs, apply a multi-page rubric, and provide structured feedback for retraining. The role emphasizes precise labeling of issues, comparisons of model responses, and maintaining calibration... 
    Remote job
    Contract work
    For contractors

    AuraOne Human Data

    New York, NY
    2 days ago
  • AuraOne is seeking a remote Human Data Program Reviewer to evaluate prompts and model outputs using a versioned rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain the modeling team. This independent contractor role is... 
    Remote job
    Hourly pay
    For contractors

    Auraone

    New York, NY
    3 days ago
  •  ...Retrieval Research QA Specialist as a remote contractor to review prompts and model outputs against AuraOne's quality rubric. You will label edge cases, write structured feedback, and help retrain the evaluation system. Responsibilities include comparing paired... 
    For contractors
    Remote work

    AuraOne Human Data

    New York, NY
    2 days ago
  • AuraOne, Inc. is seeking remote Contractors to evaluate computer use agent outputs against our quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain models. Clear written reasoning and reliable weekly availability... 
    Remote job
    For contractors

    AuraOne Human Data

    New York, NY
    1 day ago
  • AuraOne, Inc. seeks an Identity Abuse Security Evaluator for remote evaluation work. You will review model outputs, apply a versioned rubric, label issues, and provide structured feedback to help retrain and improve safety evaluations. The role targets high-precision analysis... 
    Remote job
    For contractors

    AuraOne, Inc.

    New York, NY
    1 day ago
  • AuraOne, Inc. is seeking a Cloud Security Evaluator to remotely assess model outputs against a graded rubric. You will label issues, justify decisions, and help improve the evaluation framework. This contractor role requires careful attention to detail and the ability... 
    Remote job
    For contractors

    AuraOne Human Data

    New York, NY
    1 day ago
  • $70 - $100 per hour

     ...hours/week Role Responsibilities Evaluate and compare AI-generated office artifacts...  .... Grade outputs against structured rubrics and provide feedback to improve model behavior...  ...Date ~ Immediately ; applications reviewed on a rolling basis. Application... 
    Contract work
    Summer work
    Work at office
    Immediate start
    Remote work

    Mercor

    New York, NY
    a month ago
  •  ...scenarios with AI systems Reviewing and labeling conversation transcripts Evaluating AI-generated responses using structured rubrics and providing written...  ...Assessing responses for language quality, customer experience...  ...a high volume of German-speaking coding experts... 
    German language

    Lifted (Upwork)

    New York, NY
    1 day ago
  • AI Trainer Jobs seeks a Music Audio Expert - German for remote evaluation work. You will review German generalist evaluation prompts and responses, assess against a versioned rubric, and write structured feedback to retrain the model. You will judge voice agents and pronunciation... 
    German language
    Remote job
    Contract work
    Part time

    Auraone

    New York, NY
    8 hours ago
  • AuraOne, Inc. is seeking an AI Agent Interaction Specialist to remotely review ai agent interaction evaluation prompts and responses against AuraOne's quality rubric. You will compare paired outputs, label edge cases, and write structured feedback for the modeling team... 
    Remote work
    10 hours per week

    AuraOne Human Data

    New York, NY
    2 days ago
  • $20 - $30 per hour

     ...week Pay: $20–30/hour, based on experience and language coverage Start: Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real...  ...has looked at yet and judge it step by step. • Review — Take an existing annotation, written by our AI... 
    Hourly pay
    Full time
    Contract work
    Immediate start
    Remote work

    Bespoke Labs

    New York, NY
    2 days ago
  • Zekai is seeking experienced finance professionals fluent in German to train and evaluate AI agents on realistic professional tasks. You will create and review realistic work within digital workspaces, drafting tasks in German and defining success criteria grounded in... 
    German language
    Remote job
    Hourly pay
    Part time

    Confidential

    New York, NY
    3 days ago
  • LILT is seeking detail-oriented human reviewers with native fluency to support AI training and evaluation projects. You will work on prompts, AI outputs, text, and...  ...rates, and the chance to contribute to cutting-edge language tech while joining a global community of... 
    Hourly pay
    For contractors
    Local area
    Remote work
    Worldwide
    Flexible hours

    LILT

    New York, NY
    2 days ago
  • LILT is seeking detail-oriented human reviewers to support AI training and evaluation projects. You will assess prompts and outputs, review text, and work...  ...calibrate scoring to ensure high-quality, culturally appropriate results across languages and markets. #J-18808-Ljbffr LILT
    Remote job
    For contractors
    Local area
    Flexible hours

    LILT

    New York, NY
    2 days ago
  • LILT is seeking detail-oriented human reviewers to support AI training and evaluation projects. You will assess prompts, review text and multimedia, and contribute voice recordings where needed. The role emphasizes accuracy, cultural appropriateness, brand alignment, and... 
    For contractors
    Remote work

    LILT

    New York, NY
    2 days ago
  • LILT is seeking detail-oriented human reviewers to support AI training across diverse tasks. You will evaluate prompts and outputs, review text, and contribute voice recordings as needed, applying local cultural context. The role demands accurate judgment, attention to... 
    Hourly pay
    For contractors
    Local area
    Remote work
    Flexible hours

    LILT

    New York, NY
    2 days ago
  • LILT is seeking detail-oriented human reviewers to support AI training and evaluation projects. You will review prompts and AI outputs, annotate content,...  ...schedule, work remotely, and contribute to cutting-edge language technology. Strong attention to detail and ability to... 
    For contractors
    Remote work

    LILT

    New York, NY
    1 day ago
  • LILT seeks detail-oriented human reviewers to support AI training and evaluation projects using local cultural context. You will review prompts, assess outputs...  ..., you choose when to work, how much to take on, and will join a global language community. #J-18808-Ljbffr LILT
    Remote job
    For contractors
    Local area

    LILT

    New York, NY
    1 day ago
  • LILT is seeking detail-oriented human reviewers with strong local cultural context to support a range of AI training and evaluation projects. In this role you will review prompts...  ..., and timely delivery to support cutting-edge language technology. #J-18808-Ljbffr LILT
    For contractors
    Local area
    Flexible hours

    LILT

    New York, NY
    2 days ago
  • LILT is seeking detail-oriented human reviewers with a strong understanding of local cultural context to support AI training and evaluation projects. You'll work across diverse task types, including evaluating prompts and AI-generated outputs, reviewing and correcting text... 
    For contractors
    Local area

    LILT

    New York, NY
    1 day ago
  • AuraOne, Inc. is seeking a remote Human Resources Expert, German (Germany) to review german generalist outputs against a versioned rubric. You will evaluate model outputs, assign severity tags, and provide rationales for comparisons between paired responses. The role requires... 
    German language
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    4 days ago
  • AI Trainer Jobs is seeking a remote Voice Recorder reviewer for German and English evaluation work. You will assess model outputs against rubrics, label issues, and provide structured feedback to retrain and improve prompts. The role requires strong attention to detail... 
    German language
    Remote job
    Hourly pay

    Auraone

    New York, NY
    1 day ago
  • AuraOne is seeking a Human Resources Expert, German (Germany) for a remote evaluation track focused on reviewing german generalist prompts and responses against AuraOne's quality rubric. This is a remote contractor role, US-eligible. You will compare paired outputs, label... 
    German language
    Remote job
    For contractors

    Auraone

    New York, NY
    18 hours ago
  •  ...experienced scientists and engineers who are native or fluent in German to help train and evaluate AI agents on realistic professional tasks. This is a 100...  ...workspaces, creating tasks, grading criteria, and reviewing AI outputs. The work runs as a pilot from Oct 23 to Nov... 
    German language
    Remote job
    Hourly pay
    Contract work
    Part time

    Confidential

    New York, NY
    3 days ago
  • Agency is seeking a German language specialist to help advance AI language models. You will evaluate grammar, syntax, morphology, phonology, semantics and pragmatics, providing rigorous linguistic analysis and error traces. You will work remotely as a contractor, with... 
    German language
    Remote job
    For contractors

    Agency

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to German Language Evaluation Reviewer & Rubric Annotator. Be the first to apply!