Project Zeno | Speech Translation Data Quality Evaluation | Remote

Description

OneForma is looking for detail-oriented bilingual linguists to join Project Zeno , a remote language evaluation project supporting the development of next-generation AI speech translation systems.

Participants will review pre-translated text and pre-labeled named entities, evaluating the quality of both the translations and the entity annotations. Rather than editing the content, contributors will assign quality ratings based on detailed project guidelines, helping build reliable evaluation datasets for speech translation models.

This is a flexible, long-term remote opportunity for professionals with translation or linguistic experience who enjoy analytical language work and maintaining high-quality standards.

Purpose

The purpose of this project is to produce accurate human translation quality assessments and named entity labeling evaluations that meet client quality standards and support the evaluation of advanced AI speech translation models.

Main Requirements

• Native speaker with strong linguistic and cultural knowledge of the target language.
• Fluent in the source language.
• Proficient in English and ability to understand detailed project guidelines.
• Experience in translation, localization, adaptation, or similar linguistic work (formal education is not required).
• Ability to follow complex instructions and apply quality standards consistently.
• Familiarity with banking and medical terminology.
• Excellent attention to detail and analytical skills.
• Background in linguistics, translation, transcreation, subtitling, or content adaptation is a plus.
• Experience with annotation, AI-generated content evaluation, post-editing, or quality assurance tasks is a plus.

What You’ll Do

• Review machine-generated translations and evaluate their quality.
• Review named entity labels and evaluate their accuracy.
• Assign quality ratings (Good, Neutral, or Bad) according to project guidelines.
• Provide rating reasons when required.
• Follow detailed annotation guidelines to ensure consistent, high-quality evaluations.

Available Language Pairs

We are currently recruiting bilingual linguists for the following language pairs (source – target):

• German (Germany) – Spanish (Spain)
• German (Germany) – French (France)
• German (Germany) – Italian (Italy)
• German (Germany) – Japanese (Japan)
• German (Germany) – Korean (Korea)
• German (Germany) – Portuguese (Brazil)
• Spanish (Spain) – German (Germany)
• Spanish (Spain) – French (France)
• Spanish (Spain) – Italian (Italy)
• Spanish (Spain) – Japanese (Japan)
• Spanish (Spain) – Korean (Korea)
• Spanish (Spain) – Portuguese (Brazil)
• French (France) – German (Germany)
• French (France) – Spanish (Spain)
• French (France) – Italian (Italy)
• French (France) – Japanese (Japan)
• French (France) – Korean (Korea)
• French (France) – Portuguese (Brazil)
• Italian (Italy) – German (Germany)
• Italian (Italy) – Spanish (Spain)
• Italian (Italy) – French (France)
• Italian (Italy) – Japanese (Japan)
• Italian (Italy) – Korean (Korea)
• Italian (Italy) – Portuguese (Brazil)
• Japanese (Japan) – German (Germany)
• Japanese (Japan) – Spanish (Spain)
• Japanese (Japan) – Italian (Italy)
• Japanese (Japan) – Korean (Korea)
• Japanese (Japan) – Portuguese (Brazil)
• Korean (Korea) – German (Germany)
• Korean (Korea) – Spanish (Spain)
• Korean (Korea) – French (France)
• Korean (Korea) – Italian (Italy)
• Korean (Korea) – Japanese (Japan)
• Korean (Korea) – Portuguese (Brazil)
• Portuguese (Brazil) – German (Germany)
• Portuguese (Brazil) – Spanish (Spain)
• Portuguese (Portugal) – Spanish (Spain)
• Portuguese (Brazil) – French (France)
• Portuguese (Brazil) – Italian (Italy)
• Portuguese (Brazil) – Japanese (Japan)
• Portuguese (Brazil) – Korean (Korea)

If you have a passion for languages, translation quality, and AI innovation, this is for you. Apply today and help improve the future of multilingual speech translation AI!