Hindi Bilingual Expert — AI Evaluation [Remote]
AuraOne Human Data
- Remote job
Hindi Bilingual Expert — AI Evaluation is a remote evaluation track for reviewing hindi generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.
Why this role matters
AI data reviewers help turn hindi generalist evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.
Responsibilities
- Evaluate hindi generalist evaluation model outputs against a versioned rubric and assign severity tags for Hindi Bilingual Expert — AI Evaluation assignments.
- Compare paired responses and pick the stronger answer with a written rationale.
- Label hallucinations, instruction-following failures, and unsafe content with structured tags.
- Capture ambiguous prompts and route them back to the program team for rubric updates.
- Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
- Document recurring failure modes so the modeling team can target them in the next training run.
Qualifications
- Prior evaluation, annotation, or human-rater experience on hindi generalist evaluation or adjacent content for Hindi Bilingual Expert — AI Evaluation work.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the issue and the rubric clause being applied.
- Strong attention to detail and the ability to flag when a prompt itself is the problem.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Compare two hindi generalist evaluation model responses to the same prompt and pick the stronger one with rationale.
- Tag an unsafe response with the correct policy category and severity.
- Audit a 50-row batch for rubric consistency and report drift to the program lead.
- Propose a rubric clarification after spotting a recurring failure mode.
Nice to have
- Background in linguistics, content moderation, or trust & safety review.
- Experience with inter-rater agreement metrics and calibration cycles.
- Domain expertise that lets you spot subject-matter errors automated checks miss.
Skills
- Model output evaluation
- Rubric-based annotation
- Severity tagging
- Inter-rater calibration
- Hindi generalist evaluation
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
$18 - $22 per hour
Gridnaut Recruiting is hiring a remote Bilingual Hindi Generalist Expert — AI Safety contractor (pay $18-$22/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Write expert-level prompts in Hindi across a range of sensitive subject areas.; Apply...BilingualHindi language skillsContract workFor contractorsRemote work$30 per hour
Prolific is seeking fluent Hindi speakers to join its Expert Network and assist in training AI models using legal expertise. Responsibilities include analyzing, editing, and writing in Hindi, judging AI responses, and enhancing AI models. Ideal candidates should have strong...Hindi language skillsRemote workWork from homeFlexible hours$18 - $22 per hour
...Bilingual Hindi Generalist Expert — AI Safety is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft... ...can patch the gap. Why this role matters Adversarial evaluation is how AuraOne hardens AI models before they ship to customers...BilingualHindi language skillsRemote jobFor contractors10 hours per week$30 per hour
Prolific is seeking fluent Hindi speakers to join their Expert Network. In this role, you will be completing AI training tasks and judging AI performance regarding Hindi prompts. Candidates must have strong language skills in Hindi and English, a reliable internet connection...Hindi language skillsHourly payRemote workWork from homeFlexible hours$70 - $100 per hour
...Drug Discovery & Translational Science Expert — AI Evaluation is a remote clinical-review track for evaluating AI outputs that touch clinical... ...assisted clinical decision support and its failure modes. Bilingual clinical experience for non-English patient cases....BilingualRemote jobFor contractors10 hours per week- ...Legal Expert (Copyright Law) - AI Evaluation Review is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation... ...AI-assisted legal-research or compliance tooling. Bilingual experience for cross-jurisdiction matters. Skills...BilingualRemote jobHourly payFor contractors10 hours per week
$40 per hour
...Romanian Linguistic Expert - AI Language Evaluation is a remote review track for evaluating AI outputs across romanian linguistic specialist operations... ...AI-assisted workflow tooling and its failure modes. Bilingual experience for cross-region operations. Skills...BilingualRemote jobFor contractorsWork experience placement10 hours per week- ...Portfolio Management Expert - AI Finance Evaluation is a remote review track for evaluating AI outputs across finance and risk workflows. Reviewers... ...close, audit, or risk tooling and its failure modes. Bilingual experience for cross-jurisdiction reviews. Skills...BilingualRemote jobHourly payFor contractorsWork experience placement10 hours per week
$30 per hour
Prolific is seeking fluent Hindi speakers to join our Expert Network, working on AI model training and evaluation. Responsibilities include analyzing, editing, and writing in Hindi, as well as judging AI performance. Ideal candidates must possess strong English skills,...Hindi language skillsRemote workWork from homeFlexible hours$30 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ..., and Jack Dorsey . Position: Hindi Linguistic Experts Type: Contract Compensation:... ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated...Hindi language skillsContract workSummer workRemote work- ...Independent Professional & Solopreneur — AI Workflow Review (Domain Expert) is a remote review track for evaluating AI outputs across independent solopreneur specialist... ...workflow tooling and its failure modes. Bilingual experience for cross-region operations. Skills...BilingualHourly payFor contractorsWork experience placementRemote work10 hours per week
$150 - $180 per hour
...Prolific is recruiting Mental Health Professionals to train and evaluate AI models. You’ll complete tasks that may pay $150–$180 per hour,... ...assess suitability. Successful candidates join as Domain Experts and are paid for AI tasks, many of which require one hour of uninterrupted...Hourly payRemote workWork from home$8 - $65 per hour
Prolific is looking for Mental Health Professionals to help train and evaluate AI models in Phoenix, Arizona. As a Domain Expert participant, you'll review AI-generated psychological responses, complete training tasks, and improve models utilizing your expertise. Competitive...Remote workFlexible hours$8 - $65 per hour
...Prolific is seeking Mental Health Professionals to train and evaluate AI models from home. Responsibilities include reviewing AI responses and enhancing model performance using psychological expertise. Ideal candidates will have verified professional status, a solid understanding...Remote workFlexible hours- ...Prolific is seeking Mental Health Professionals in Nashville, TN, to help train and evaluate AI models. Candidates will review AI-generated responses, complete training tasks, and provide insights based on their understanding of psychological theory. Successful participants...Hourly payRemote workWork from homeFlexible hours
- ...Prolific is seeking Mental Health Professionals in Indianapolis, Indiana, to assist in training and evaluating AI models. Ideal candidates will have a verified status as a Mental Health Professional, an understanding of psychological theory, and the ability to focus on...Hourly payRemote workFlexible hours
$8 - $65 per unit
...Prolific is seeking Mental Health Professionals to train and evaluate AI models. In this role, you will review AI responses, analyze psychology-related content, and provide feedback to improve models. Applicants must have verified status as a Mental Health Professional...Remote workFlexible hours$60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance...Contract workSummer workRemote work$166.4k - $249.6k
...days and hours, including weekends. About the Role We are seeking a highly skilled Aerodynamics Expert to contribute to an advanced AI training and evaluation project focused on computational fluid dynamics (CFD), aerodynamic analysis, engineering simulations, and...Hourly payContract workFor contractorsImmediate startRemote workFlexible hours- ...professionals who truly fit their needs. About the Role We are seeking a knowledgeable U. S. Constitutional Law Expert to support a legal data annotation and AI evaluation project. The ideal candidate will have a strong understanding of American constitutional principles,...Contract workFor contractorsRemote work
$166.4k - $228.8k
...About the Role Support the evaluation and improvement of AI systems by reviewing realistic US-law tasks and documents. This expert-review role focuses on legal accuracy, clear feedback, and improving the quality of evaluation data, rather than client-facing legal work...Hourly payFull timeRemote workFlexible hours- ...them with professionals who truly fit their needs. About the Role We are seeking a U. S. Copyright Law Expert to contribute to a legal data annotation and AI evaluation project focused on intellectual property law. The ideal candidate will have specialized knowledge of U...Contract workFor contractorsRemote work
$30 per hour
Prolific is looking for Fluent Urdu Speakers to join our Expert Network to help train AI models using real legal expertise. The role involves completing tasks that require one hour of uninterrupted work, with pay rates of up to $30/hr. Candidates must possess advanced Urdu...Remote workWork from homeFlexible hours$42 per hour
...technical talent with leading AI research labs. Headquartered... ...Position: Music & Lyrics Expert - Hindi Type: Contract Compensation... ...Role Responsibilities Evaluate AI-generated music across various... ...resume Complete the Bilingual Competency Interview in Hindi...BilingualHindi language skillsRemote jobContract workSummer workImmediate start$60 per hour
Prolific is seeking Biology Experts and Life Science Professionals to evaluate AI-generated science and ensure compliance with scientific standards. Responsibilities include reviewing biological inquiries, validating technical claims from public databases, and critiquing...Hourly payRemote workWork from homeFlexible hours$60 - $85 per hour
...Frontier AI models can draft a contract clause or summarise a judgment in seconds. Whether... ...into how those models are trained and evaluated. It is about 10 hours a week fully remote... ...at a glance Openings: 12 legal experts. Time commitment: Approximately 10 hours...Hourly payFull timeContract workRemote work10 hours per weekFlexible hours$60 - $80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...solutions grounded in real retail practice. Evaluate AI model outputs against structured... ...Collaborate with other subject matter experts to ensure consistency and accuracy in training...Contract workSummer workRemote workWeekday work- ...behalf of a partner company, which manages all applications and next steps. Our partner is looking for an Aerodynamics Expert - AI Training & Evaluation based in the United States. We are seeking a highly skilled Aerodynamics Expert to contribute to an advanced AI...Full timeRemote workFlexible hours
$30 - $65 per hour
...Role Title: Hindi Bilingual Expert Role Type: Contractor Location: Remote micro1 is engaging... ...to help train next-generation AI systems. Your work will shape how models... ...Listen to audio clips in Hindi and evaluate the nativeness and fluency of the speaker...BilingualHindi language skillsContract workFor contractorsRemote work$14 - $42 per hour
...technical talent with leading AI research labs. Headquartered... ...Position: Music Production Expert - Hindi Type: Contract Compensation... ...Role Responsibilities Evaluate AI-generated music on... ...application steps, including the Bilingual Competency Interview in Hindi...BilingualHindi language skillsContract workSummer workImmediate startRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Hindi Bilingual Expert — AI Evaluation [Remote]. Be the first to apply!




