Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Bilingual French AI Evaluation Specialist [Remote]

AuraOne Human Data

Remote
  • Remote job

Bilingual French AI Evaluation Specialist is a remote evaluation track for reviewing french generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.

Why this role matters

AI data reviewers help turn french generalist evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.

Responsibilities

  • Evaluate french generalist evaluation model outputs against a versioned rubric and assign severity tags for Bilingual French AI Evaluation Specialist assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
  • Document recurring failure modes so the modeling team can target them in the next training run.

Qualifications

  • Prior evaluation, annotation, or human-rater experience on french generalist evaluation or adjacent content for Bilingual French AI Evaluation Specialist work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Compare two french generalist evaluation model responses to the same prompt and pick the stronger one with rationale.
  • Tag an unsafe response with the correct policy category and severity.
  • Audit a 50-row batch for rubric consistency and report drift to the program lead.
  • Propose a rubric clarification after spotting a recurring failure mode.

Nice to have

  • Background in linguistics, content moderation, or trust & safety review.
  • Experience with inter-rater agreement metrics and calibration cycles.
  • Domain expertise that lets you spot subject-matter errors automated checks miss.

Skills

  • Model output evaluation
  • Rubric-based annotation
  • Severity tagging
  • Inter-rater calibration
  • French generalist evaluation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Bilingual French AI Evaluation Specialist [Remote] in Remote vacancy
  • Crossing Hurdles is seeking a French bilingual expert to evaluate audio samples for nativeness and fluency....  ...and is ideal for linguists or voice specialists. You will assess pronunciation, intonation...  ...clarify requirements and improve AI language understanding. #J-18808-... 
    Bilingual
    French language skills
    Remote job
    Contract work
    Flexible hours

    Crossing Hurdles

    New York, NY
    3 days ago
  •  ...About the role Meridial seeks independent Audio Evaluation Specialists for an AI benchmark evaluation project. You will design evaluation frameworks...  ..., or conversational AI evaluation Native or bilingual proficiency in the target language with strong reading,... 
    Bilingual
    French language skills
    Hourly pay
    For contractors
    Freelance
    Work at office
    Remote work
    Worldwide

    remote work

    New York, NY
    1 day ago
  • We are seeking elite Content Writers & AI Evaluation Specialists with expertise in copywriting, content creation...  ...prompt engineering and evaluating LLM outputs Bilingual capabilities (Chinese, Spanish, Portuguese, Arabic, French, German) Knowledge of NLP concepts and... 
    Bilingual
    French language skills
    Hourly pay
    Contract work
    For contractors
    Remote work
    Flexible hours

    AfterQuery

    New York, NY
    1 day ago
  • $25 - $37 per hour

     ...Bilingual French AI Evaluation Specialist is a remote French specialist track for evaluating french evaluation outputs against native-speaker standards. Reviewers spot fluency, register, and cultural-context errors that automated checks miss, and write structured rationale... 
    Bilingual
    French language skills
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    8 days ago
  • $8 - $65 per hour

     ...human resources fluent in French eager to shape the future of AI? Large‑scale language...  ...AI. We’re looking for HR specialists who live and breathe talent...  ...prompt engineering and evaluation metrics. A master’s...  ...operations in international or bilingual environments signal fit.... 
    Bilingual
    French language skills
    Hourly pay
    Contract work
    For contractors
    Remote work

    Remote

    San Francisco, CA
    1 day ago
  • Aitrainergigs is seeking independent Audio Evaluation Specialists for an AI benchmark project. You will autonomously design evaluation frameworks, conduct role-play-based simulations, and audit AI outputs to generate high-quality audio datasets. Flexibility, attention... 
    French language skills
    Remote job

    Meridial

    New York, NY
    1 day ago
  • AuraOne, Inc. is seeking a French Bilingual Expert to remotely review and evaluate French generalist prompts and responses using AuraOne’s quality rubric. You will compare paired outputs, label edge cases, and generate structured feedback to retrain models. This contractor... 
    Bilingual
    French language skills
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    2 days ago
  • Agency seeks independent Audio Evaluation Specialists for an AI benchmark project evaluating agentic audio models in real-world customer support...  ...clean datasets for model refinement. We require native/bilingual English proficiency and strong communication, plus basic... 
    Bilingual
    French language skills
    Remote job

    Agency

    New York, NY
    2 days ago
  • Prolific is seeking Linguist/Translators to help train and evaluate AI models. You may be invited to join as a Domain Expert participant...  ...complete. Applicants should be fluent in English and Italian/Spanish/French/German/Dutch, pass a skills test, and have a reliable internet... 
    French language skills
    Remote job
    Work from home
    Flexible hours

    Prolific

    New York, NY
    1 day ago
  • Invisible Technologies is seeking independent Audio Evaluation Specialists for an AI benchmark project evaluating agentic audio models. You will...  ...customer support scenarios. Applicants should be native or bilingual in the target language, have basic JSON literacy, strong... 
    Bilingual
    Remote job
    Hourly pay
    Freelance

    Invisible Technologies Inc.

    New York, NY
    2 days ago
  • Unknown company is seeking an HR Specialist fluent in French to help train AI on HR topics, including recruitment, performance, compensation, and employee...  ...mid-senior professionals with strong HR experience, bilingual capabilities, and familiarity with international... 
    Bilingual
    French language skills
    Remote job
    Contract work

    Remote

    San Francisco, CA
    1 day ago
  • Aitrainergigs is seeking a Finance Specialist fluent in French to help train AI models on financial topics. You will discuss complex financial problems in both English and French, verify factual accuracy, and document error traces to improve model reasoning. Ideal candidates... 
    Bilingual
    French language skills
    Remote job
    For contractors
    Flexible hours

    Meridial

    New York, NY
    1 day ago
  • DataAnnotation is seeking a bilingual Hebrew-English professional to train AI models from your language expertise. You will judge AI outputs with a native...  ...scheduling and hourly pay. You will write prompts, evaluate responses, compare outputs, and explain judgments clearly... 
    Bilingual
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  • We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project. Contractors will design evaluation frameworks, execute...  ...expertise includes deep customer support knowledge, bilingual fluency, and basic JSON literacy. Engagement is... 
    Bilingual
    Remote job
    For contractors
    Freelance
    Work from home

    Agency

    New York, NY
    2 days ago
  • Evaluate audio-based conversational AI in realistic customer support scenarios. Contribute to high-quality datasets for advanced AI models. Work remotely...  ..., functions, and simple logic. Requirements: Native or bilingual Portuguese with strong reading, listening, writing, and... 
    Bilingual
    Remote job
    Hourly pay
    For contractors
    Freelance
    Flexible hours

    Jobgether

    New York, NY
    2 days ago
  •  ...customer service role-plays in travel, finance, and tech support. Evaluate AI audio responses using structured criteria for accuracy,...  ...reflect real-world customer expectations. Who you are: Native or bilingual German with strong communication and analytical skills. Experienced... 
    Bilingual
    Remote job
    Hourly pay
    Freelance
    Flexible hours

    Jobgether

    New York, NY
    2 days ago
  • Project Overview We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project assessing advanced agentic audio...  ...troubleshooting, or conversational AI evaluation. Native or bilingual proficiency in the target language, including fluency... 
    Bilingual
    Hourly pay
    For contractors
    Freelance
    Remote work

    Agency

    New York, NY
    2 days ago
  • SME Careers, a subsidiary of SuperAnnotate, seeks a bilingual expert to develop AI training content and assess Arabic-English responses. You will create prompts, evaluate solutions for accuracy and clarity, and help improve model performance through detailed feedback.... 
    Bilingual
    Remote job
    Hourly pay
    For contractors
    Flexible hours

    SME.careers

    New York, NY
    1 day ago
  • $50 per hour

     ...Generalist AI Evaluation Specialist is a remote review track for evaluating AI outputs across generalists specialist operations workflows. Reviewers...  ...AI-assisted workflow tooling and its failure modes. Bilingual experience for cross-region operations. Skills... 
    Bilingual
    Remote job
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  • Aitrainergigs seeks medicine specialists with fluency in French to train AI models for medical accuracy and reasoning. You will engage with models on internal...  ...factual correctness, and trace errors to improve evaluation metrics. A medical degree or health sciences advanced... 
    French language skills
    Remote job
    Contract work

    Meridial

    New York, NY
    1 day ago
  • Invisible Technologies is seeking a Computer Science Specialist fluent in French to train and evaluate next‑gen AI systems. You will engage with large language models on algorithms, ML topics, and software engineering challenges, ensuring factual accuracy and robust reasoning... 
    French language skills
    Remote job
    Contract work

    Invisible Technologies Inc.

    New York, NY
    3 days ago
  • Prolific is shaping the future of AI by building a global pool of skilled participants to train and evaluate models from home. We pay for tasks that test and refine French language capabilities with flexible hours and remote work. Join Prolific as a Domain Expert participant... 
    French language skills
    Remote job
    Worldwide
    Flexible hours

    Prolific

    New York, NY
    1 day ago
  • Logoslabs is seeking an HR Specialist fluent in French to help train and assess AI systems with real-world HR scenarios. You will evaluate compliance, onboarding workflows, and cross-border HR policies, communicating in both English and French to ensure accuracy and depth... 
    French language skills
    Remote job
    Contract work

    Remote

    San Francisco, CA
    2 days ago
  • $38 - $53 per hour

     ...Bilingual French STEM Evaluation Specialist is a remote review track for evaluating AI outputs across french stem review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method... 
    Bilingual
    French language skills
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  • $30 per hour

    Prolific is seeking Advanced French Speakers to help train and evaluate cutting-edge AI models. You’ll receive a quick skills test and, if successful, join as a Domain Expert participant receiving payments for AI tasks. Most tasks pay $30/hr and require about one hour... 
    French language skills
    Remote job

    Prolific

    New York, NY
    17 hours ago
  • Aitrainergigs is seeking a Science Specialist - AI Trainer (Fluent in French) to work remotely. You will challenge language models on physics, chemistry...  ...documenting failures to improve model reasoning and evaluation metrics. Ideal candidates hold a science degree (Bachelor... 
    French language skills
    Remote job

    Meridial

    New York, NY
    1 day ago
  •  ...Evaluation Specialist UN - United Nations Remote | Multiple locations CON level Speaks English, French Application deadline: December 31, 2026 (3 months) The Evaluation Specialist will conduct evaluations of various projects and programs for the UN Secretariat. This... 
    French language skills
    Work at office
    Remote work
    Shift work

    UN - United Nations

    United States
    2 days ago
  • $8 - $65 per hour

     ...Healthcare Specialist (Fluent in French) - Freelance AI Trainer Project Switzerland Are you a master of healthcare fluent in French eager to shape...  ...suggest improvements to our prompt engineering and evaluation metrics. A master's degree in nursing, public health... 
    French language skills
    Hourly pay
    Contract work
    For contractors
    Freelance
    Immediate start
    Remote work

    Meridial

    United States
    1 day ago
  • Aitrainergigs seeks an Insurance Specialist fluent in French to help train and evaluate AI models on underwriting, claims, policy design, and risk management. You will work remotely, analyzing complex insurance scenarios in both English and French and documenting model... 
    French language skills
    Remote job

    Meridial

    New York, NY
    1 day ago
  • Aitrainergigs is seeking a Healthcare Specialist fluent in French to guide AI training for healthcare applications. You will work remotely, evaluating model outputs in English and French, ensuring clinical accuracy, and documenting failure modes for model hardening. The... 
    French language skills
    Remote job

    Meridial

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Bilingual French AI Evaluation Specialist [Remote]. Be the first to apply!