Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Hindi Bilingual Expert — AI Evaluation [Remote]

AuraOne Human Data

Remote
  • Remote job

Hindi Bilingual Expert — AI Evaluation is a remote evaluation track for reviewing hindi generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.

Why this role matters

AI data reviewers help turn hindi generalist evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.

Responsibilities

  • Evaluate hindi generalist evaluation model outputs against a versioned rubric and assign severity tags for Hindi Bilingual Expert — AI Evaluation assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
  • Document recurring failure modes so the modeling team can target them in the next training run.

Qualifications

  • Prior evaluation, annotation, or human-rater experience on hindi generalist evaluation or adjacent content for Hindi Bilingual Expert — AI Evaluation work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Compare two hindi generalist evaluation model responses to the same prompt and pick the stronger one with rationale.
  • Tag an unsafe response with the correct policy category and severity.
  • Audit a 50-row batch for rubric consistency and report drift to the program lead.
  • Propose a rubric clarification after spotting a recurring failure mode.

Nice to have

  • Background in linguistics, content moderation, or trust & safety review.
  • Experience with inter-rater agreement metrics and calibration cycles.
  • Domain expertise that lets you spot subject-matter errors automated checks miss.

Skills

  • Model output evaluation
  • Rubric-based annotation
  • Severity tagging
  • Inter-rater calibration
  • Hindi generalist evaluation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Hindi Bilingual Expert — AI Evaluation [Remote] in Remote vacancy
  • $18 - $22 per hour

    Gridnaut Recruiting is hiring a remote Bilingual Hindi Generalist Expert — AI Safety contractor (pay $18-$22/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Write expert-level prompts in Hindi across a range of sensitive subject areas.; Apply... 
    Bilingual
    Hindi language skills
    Contract work
    For contractors
    Remote work

    Gridnaut Recruiting

    Remote
    17 days ago
  • $30 per hour

    Prolific is seeking fluent Hindi speakers to join its Expert Network and assist in training AI models using legal expertise. Responsibilities include analyzing, editing, and writing in Hindi, judging AI responses, and enhancing AI models. Ideal candidates should have strong... 
    Hindi language skills
    Remote work
    Work from home
    Flexible hours

    Prolific

    Chicago, IL
    5 hours ago
  • $18 - $22 per hour

     ...Bilingual Hindi Generalist Expert — AI Safety is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft...  ...can patch the gap. Why this role matters Adversarial evaluation is how AuraOne hardens AI models before they ship to customers... 
    Bilingual
    Hindi language skills
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    12 days ago
  • $30 per hour

    Prolific is seeking fluent Hindi speakers to join their Expert Network. In this role, you will be completing AI training tasks and judging AI performance regarding Hindi prompts. Candidates must have strong language skills in Hindi and English, a reliable internet connection... 
    Hindi language skills
    Hourly pay
    Remote work
    Work from home
    Flexible hours

    Prolific

    Houston, TX
    5 hours ago
  • $70 - $100 per hour

     ...Drug Discovery & Translational Science Expert — AI Evaluation is a remote clinical-review track for evaluating AI outputs that touch clinical...  ...assisted clinical decision support and its failure modes. Bilingual clinical experience for non-English patient cases.... 
    Bilingual
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    5 days ago
  •  ...Legal Expert (Copyright Law) - AI Evaluation Review is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation...  ...AI-assisted legal-research or compliance tooling. Bilingual experience for cross-jurisdiction matters. Skills... 
    Bilingual
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    1 day ago
  • $40 per hour

     ...Romanian Linguistic Expert - AI Language Evaluation is a remote review track for evaluating AI outputs across romanian linguistic specialist operations...  ...AI-assisted workflow tooling and its failure modes. Bilingual experience for cross-region operations. Skills... 
    Bilingual
    Remote job
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    1 day ago
  •  ...Portfolio Management Expert - AI Finance Evaluation is a remote review track for evaluating AI outputs across finance and risk workflows. Reviewers...  ...close, audit, or risk tooling and its failure modes. Bilingual experience for cross-jurisdiction reviews. Skills... 
    Bilingual
    Remote job
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    1 day ago
  • $30 per hour

    Prolific is seeking fluent Hindi speakers to join our Expert Network, working on AI model training and evaluation. Responsibilities include analyzing, editing, and writing in Hindi, as well as judging AI performance. Ideal candidates must possess strong English skills,... 
    Hindi language skills
    Remote work
    Work from home
    Flexible hours

    Prolific

    Los Angeles, CA
    5 hours ago
  • $30 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ..., and Jack Dorsey . Position: Hindi Linguistic Experts Type: Contract Compensation:...  ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated... 
    Hindi language skills
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    6 days ago
  •  ...Independent Professional & Solopreneur — AI Workflow Review (Domain Expert) is a remote review track for evaluating AI outputs across independent solopreneur specialist...  ...workflow tooling and its failure modes. Bilingual experience for cross-region operations. Skills... 
    Bilingual
    Hourly pay
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    AuraOne Human Data

    Remote
    6 days ago
  • $150 - $180 per hour

     ...Prolific is recruiting Mental Health Professionals to train and evaluate AI models. You’ll complete tasks that may pay $150–$180 per hour,...  ...assess suitability. Successful candidates join as Domain Experts and are paid for AI tasks, many of which require one hour of uninterrupted... 
    Hourly pay
    Remote work
    Work from home

    Prolific

    United States
    1 day ago
  • $8 - $65 per hour

    Prolific is looking for Mental Health Professionals to help train and evaluate AI models in Phoenix, Arizona. As a Domain Expert participant, you'll review AI-generated psychological responses, complete training tasks, and improve models utilizing your expertise. Competitive... 
    Remote work
    Flexible hours

    Prolific

    United States
    3 days ago
  • $8 - $65 per hour

     ...Prolific is seeking Mental Health Professionals to train and evaluate AI models from home. Responsibilities include reviewing AI responses and enhancing model performance using psychological expertise. Ideal candidates will have verified professional status, a solid understanding... 
    Remote work
    Flexible hours

    Prolific

    El Paso, TX
    2 days ago
  •  ...Prolific is seeking Mental Health Professionals in Nashville, TN, to help train and evaluate AI models. Candidates will review AI-generated responses, complete training tasks, and provide insights based on their understanding of psychological theory. Successful participants... 
    Hourly pay
    Remote work
    Work from home
    Flexible hours

    Prolific

    Nashville, TN
    1 day ago
  •  ...Prolific is seeking Mental Health Professionals in Indianapolis, Indiana, to assist in training and evaluating AI models. Ideal candidates will have a verified status as a Mental Health Professional, an understanding of psychological theory, and the ability to focus on... 
    Hourly pay
    Remote work
    Flexible hours

    Prolific

    United States
    3 days ago
  • $8 - $65 per unit

     ...Prolific is seeking Mental Health Professionals to train and evaluate AI models. In this role, you will review AI responses, analyze psychology-related content, and provide feedback to improve models. Applicants must have verified status as a Mental Health Professional... 
    Remote work
    Flexible hours

    Prolific

    United States
    3 days ago
  • $60 - $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    16 days ago
  • $166.4k - $249.6k

     ...days and hours, including weekends. About the Role We are seeking a highly skilled Aerodynamics Expert to contribute to an advanced AI training and evaluation project focused on computational fluid dynamics (CFD), aerodynamic analysis, engineering simulations, and... 
    Hourly pay
    Contract work
    For contractors
    Immediate start
    Remote work
    Flexible hours

    Weekday AI

    Remote
    4 days ago
  •  ...professionals who truly fit their needs. About the Role We are seeking a knowledgeable U. S. Constitutional Law Expert to support a legal data annotation and AI evaluation project. The ideal candidate will have a strong understanding of American constitutional principles,... 
    Contract work
    For contractors
    Remote work

    Gramian Consulting Group

    Remote
    2 days ago
  • $166.4k - $228.8k

     ...About the Role Support the evaluation and improvement of AI systems by reviewing realistic US-law tasks and documents. This expert-review role focuses on legal accuracy, clear feedback, and improving the quality of evaluation data, rather than client-facing legal work... 
    Hourly pay
    Full time
    Remote work
    Flexible hours

    Clera

    Remote
    6 days ago
  •  ...them with professionals who truly fit their needs. About the Role We are seeking a U. S. Copyright Law Expert to contribute to a legal data annotation and AI evaluation project focused on intellectual property law. The ideal candidate will have specialized knowledge of U... 
    Contract work
    For contractors
    Remote work

    Gramian Consulting Group

    Remote
    2 days ago
  • $30 per hour

    Prolific is looking for Fluent Urdu Speakers to join our Expert Network to help train AI models using real legal expertise. The role involves completing tasks that require one hour of uninterrupted work, with pay rates of up to $30/hr. Candidates must possess advanced Urdu... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    New York, NY
    5 hours ago
  • $42 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Position: Music & Lyrics Expert - Hindi Type: Contract Compensation...  ...Role Responsibilities Evaluate AI-generated music across various...  ...resume Complete the Bilingual Competency Interview in Hindi... 
    Bilingual
    Hindi language skills
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    New York, NY
    10 days ago
  • $60 per hour

    Prolific is seeking Biology Experts and Life Science Professionals to evaluate AI-generated science and ensure compliance with scientific standards. Responsibilities include reviewing biological inquiries, validating technical claims from public databases, and critiquing... 
    Hourly pay
    Remote work
    Work from home
    Flexible hours

    Prolific

    San Jose, CA
    2 days ago
  • $60 - $85 per hour

     ...Frontier AI models can draft a contract clause or summarise a judgment in seconds. Whether...  ...into how those models are trained and evaluated. It is about 10 hours a week fully remote...  ...at a glance Openings: 12 legal experts. Time commitment: Approximately 10 hours... 
    Hourly pay
    Full time
    Contract work
    Remote work
    10 hours per week
    Flexible hours

    Wintermeyer Ventures

    San Francisco, CA
    5 days ago
  • $60 - $80 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...solutions grounded in real retail practice. Evaluate AI model outputs against structured...  ...Collaborate with other subject matter experts to ensure consistency and accuracy in training... 
    Contract work
    Summer work
    Remote work
    Weekday work

    Mercor

    New York, NY
    5 days ago
  •  ...behalf of a partner company, which manages all applications and next steps. Our partner is looking for an Aerodynamics Expert - AI Training & Evaluation based in the United States. We are seeking a highly skilled Aerodynamics Expert to contribute to an advanced AI... 
    Full time
    Remote work
    Flexible hours

    Jobgether

    Remote
    2 days ago
  • $30 - $65 per hour

     ...Role Title: Hindi Bilingual Expert Role Type: Contractor Location: Remote micro1 is engaging...  ...to help train next-generation AI systems. Your work will shape how models...  ...Listen to audio clips in Hindi and evaluate the nativeness and fluency of the speaker... 
    Bilingual
    Hindi language skills
    Contract work
    For contractors
    Remote work

    micro1

    United States
    12 days ago
  • $14 - $42 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Position: Music Production Expert - Hindi Type: Contract Compensation...  ...Role Responsibilities Evaluate AI-generated music on...  ...application steps, including the Bilingual Competency Interview in Hindi... 
    Bilingual
    Hindi language skills
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Hindi Bilingual Expert — AI Evaluation [Remote]. Be the first to apply!