Remote Malayalam Evaluation Specialist
AuraOne
New York, NY
- Remote job
AuraOne is seeking a remote Malayalam Language Expert to evaluate model outputs against a structured rubric. You will compare paired responses, label edge cases, and provide detailed rationales to help retrain the model. The role emphasizes maintaining calibration against gold-standard samples, labeling unsafe content, and documenting recurring failure modes for ongoing improvements. Remote contractor engagement with US eligibility is required. #J-18808-Ljbffr AuraOne
Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the Remote Malayalam Evaluation Specialist in New York, NY vacancy
- ...To support program evaluation and advanced analytics, the full-time Program Evaluation Specialist will lead the design and implementation of evaluations, utilizing quantitative and qualitative methodologies to generate actionable insights for health and civilian programs...Remote workFull time
- ...AuraOne is seeking a remote, independent contractor to evaluate cross-border AI outputs using AuraOne's quality rubric. You will compare paired responses, label issues with structured tags, and provide written rationales to support model retraining. The role emphasizes...Remote workHourly payFor contractorsFlexible hours
$70k - $140k
...Program Evaluation SpecialistWe are seeking driven, thoughtful candidates with experience... ...of State (DOS). As a Program Evaluation Specialist with Censeo, you will support quantitative... ...paid vacation and sick leave, flexible and remote work opportunities, and tuition and...Remote workFull timeWork at officeWork from homeFlexible hoursNight shift- ...AuraOne is seeking a Haitian Creole Bilingual Expert for a remote evaluation track. You will review prompts and responses, apply the quality rubric, and provide structured feedback. You’ll label edge cases and contribute to retraining data with clear rationales and severity...Remote workHourly pay10 hours per week
- ...AuraOne seeks a Remote Constitutional AI Reward Model Evaluator to review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain the model. The role is contractor-based and remote...Remote workFor contractors
- ...AuraOne is seeking a Lingala Bilingual Expert for a remote evaluation track. You will review prompts and responses against a quality rubric, label edge cases, and provide structured feedback for retraining the model. This is a contractor role requiring reliable async availability...Remote workFor contractors
- ...AuraOne is seeking a remote Business Document Expert (Chinese Speaker) to review Chinese evaluation prompts and responses against a quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain models. This contractor...Remote workFor contractors
- ...Prompt Robustness Model Evaluation Specialist is a remote evaluation track for reviewing prompt robustness model evaluation evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured...Remote workHourly payFor contractors10 hours per week
- ...Job DescriptionProSidian Seeks a Infrastructure Project Evaluation and Coordination Specialist [DOE0080079] for Program Support on a Exempt W2: No... ...identified Work Site Address (Subject to Change or Working Remotely): 2440 Stevens Center Place, H520 Richland, Washington...Remote workFull timeContract workTemporary workFor contractorsFor subcontractorWork at officeFlexible hours
- AuraOne is seeking a remote Cross-Modal Retrieval Model Evaluator to review prompts and model outputs against our quality rubric. This contractor role focuses on labeling edge cases, writing structured feedback, and contributing to retraining efforts for continued model...Remote jobFor contractors
- AuraOne is seeking a remote Business Document Expert (Korean Speaker) to review and rate Korean generalist evaluation prompts and responses. You will compare paired outputs, label edge cases, and provide structured feedback to retrain models. The role is CONTRACTOR and...Remote jobHourly payFor contractors
$50 per hour
AuraOne is seeking a Korean Audio Evaluation Specialist to remotely review Korean generalist evaluation prompts and responses against AuraOne's quality rubric. You will compare paired outputs, label edge cases, and generate structured feedback for retraining the model....Remote jobContract work- Role Description We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project assessing advanced agentic audio... ...Type ~Freelance / Independent Contractor Workplace Type ~Remote Seniority Level ~Mid-Senior Level...Remote workHourly payContract workFor contractorsFreelance
- AuraOne is seeking a Thai Audio Evaluation Specialist to remotely review generalist outputs against a quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain models. The role emphasizes clear, rationale-driven judgments...Remote jobFor contractors
- AuraOne is seeking a remote Business Document Expert (Portuguese Speaker) to review prompts and responses against our quality rubric. You will evaluate Portuguese generalist outputs, label edge cases, and provide structured feedback to retrain models. This is a contractor...Remote jobFor contractorsFlexible hours
- AuraOne is seeking a remote Video Summarization Evaluator to review and label outputs against our quality rubric. You will compare paired responses, annotate edge cases, and provide structured feedback to help retrain the model. The role emphasizes clear reasoning and...Remote job
- AuraOne is seeking a French Transcription Expert (Canada) to remotely evaluate French generalist prompts and model outputs against AuraOne's quality rubric. You will review paired responses, label edge cases, and provide structured feedback for retraining. This contractor...Remote jobFor contractors
- AuraOne is seeking a Tagalog Language Expert to review generalist evaluation prompts and responses against the company’s quality rubric. This is a remote contractor role focusing on structuring feedback, labeling edge cases, and generating regression data for retraining...Remote jobFor contractors
- AuraOne is seeking an HR Documents Specialist (Japanese) for a remote evaluation track. You will review japanese generalist evaluation prompts and responses against AuraOne's quality rubric, compare paired outputs, label edge cases, and write structured feedback to help...Remote jobFor contractors10 hours per week
- Pearson is seeking a Scoring Assistant for School Administrator and Superintendent credential evaluation. The role is remote and part-time, with sessions typically lasting 2-3 days monthly and scheduled between 8:00 a.m. and 4:00 p.m. PST. Training and review are provided...Remote jobPart timeFlexible hours
- AuraOne seeks a remote contractor to evaluate multi-turn ranking reward model evaluation prompts and responses. You will compare outputs, assign severity tags, and provide structured feedback to retrain the model using AuraOne's rubric. You will identify hallucinations,...Remote jobFor contractors
- AuraOne is seeking a remote Retrieval Relevance Task Evaluator to review prompts and responses against our quality rubric. You will compare outputs, assign severity tags, and provide structured feedback for model retraining. This contractor role requires careful reasoning...Remote jobFor contractors10 hours per week
- AuraOne is seeking a remote News Monitoring Task Evaluator to assess evaluation prompts and responses against our quality rubric. You will compare paired outputs, write rationales, and label edge cases to aid model retraining and quality control. Join as a contractor working...Remote jobFor contractors
- AuraOne is seeking a remote Rubric Calibration Model Evaluation Specialist contractor in the United States. The role focuses on evaluating rubric calibration model outputs, labeling issues, and providing structured feedback to retrain the model. You will compare paired...Remote jobFor contractors
- AuraOne is seeking a Prompt Robustness Model Evaluation Specialist to remotely review prompts and model outputs, applying AuraOne's quality rubric. You will compare paired responses, label edge cases, and provide structured feedback for retraining. This contractor role...Remote jobFor contractors10 hours per week
$20 per hour
...Project Overview We are sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation... ...health insurance and PTO do not apply. Engagement Type: Freelance / Independent Contractor Workplace Type: Remote...Remote workHourly payTemporary workFor contractorsFreelance- AuraOne is seeking a remote Humanoid Task Task Evaluator to review and label humanoid task evaluation prompts and responses. You will compare paired outputs, apply a versioned rubric, and produce structured feedback for retraining the model. This contractor role requires...Remote jobFor contractors
- MIYO Health is seeking a fully remote School Psychologist to partner with a Colorado school district for the 2026-2027 year, focusing on psychoeducational evaluations and eligibility support. The position offers a part-time, evaluation-focused caseload in a flexible remote...Remote jobPart timeFor contractorsFlexible hours
- AuraOne is seeking an Image Evaluation Generalist contractor to remotely review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and draft structured feedback for the modeling team. This role requires precise reasoning...Remote jobFor contractorsFlexible hours
- AuraOne is seeking a remote Pairwise Preference Reward Model Evaluator to review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain the modeling team. This independent contractor...Remote jobHourly payFor contractors10 hours per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Malayalam Evaluation Specialist. Be the first to apply!
Related searches
- skin specialist New York, NY
- senior safety specialist New York, NY
- health specialist New York, NY
- outreach specialist New York, NY
- invoice specialist New York, NY
- information technology specialist New York, NY
- rehabilitation specialist New York, NY
- asset protection specialist New York, NY
- change management specialist New York, NY
- housing program specialist New York, NY



