Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Malayalam Evaluation Specialist

AuraOne

New York, NY
  • Remote job

AuraOne is seeking a remote Malayalam Language Expert to evaluate model outputs against a structured rubric. You will compare paired responses, label edge cases, and provide detailed rationales to help retrain the model. The role emphasizes maintaining calibration against gold-standard samples, labeling unsafe content, and documenting recurring failure modes for ongoing improvements. Remote contractor engagement with US eligibility is required. #J-18808-Ljbffr AuraOne

Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the Remote Malayalam Evaluation Specialist in New York, NY vacancy
  •  ...To support program evaluation and advanced analytics, the full-time Program Evaluation Specialist will lead the design and implementation of evaluations, utilizing quantitative and qualitative methodologies to generate actionable insights for health and civilian programs... 
    Remote work
    Full time

    Virtual Vocations Inc

    United States
    1 day ago
  •  ...AuraOne is seeking a remote, independent contractor to evaluate cross-border AI outputs using AuraOne's quality rubric. You will compare paired responses, label issues with structured tags, and provide written rationales to support model retraining. The role emphasizes... 
    Remote work
    Hourly pay
    For contractors
    Flexible hours

    AuraOne

    New York, NY
    3 days ago
  • $70k - $140k

     ...Program Evaluation SpecialistWe are seeking driven, thoughtful candidates with experience...  ...of State (DOS). As a Program Evaluation Specialist with Censeo, you will support quantitative...  ...paid vacation and sick leave, flexible and remote work opportunities, and tuition and... 
    Remote work
    Full time
    Work at office
    Work from home
    Flexible hours
    Night shift

    Censeo Consulting Group

    Washington DC
    2 days ago
  •  ...AuraOne is seeking a Haitian Creole Bilingual Expert for a remote evaluation track. You will review prompts and responses, apply the quality rubric, and provide structured feedback. You’ll label edge cases and contribute to retraining data with clear rationales and severity... 
    Remote work
    Hourly pay
    10 hours per week

    AuraOne

    New York, NY
    3 days ago
  •  ...AuraOne seeks a Remote Constitutional AI Reward Model Evaluator to review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain the model. The role is contractor-based and remote... 
    Remote work
    For contractors

    AuraOne

    New York, NY
    3 days ago
  •  ...AuraOne is seeking a Lingala Bilingual Expert for a remote evaluation track. You will review prompts and responses against a quality rubric, label edge cases, and provide structured feedback for retraining the model. This is a contractor role requiring reliable async availability... 
    Remote work
    For contractors

    AuraOne

    New York, NY
    3 days ago
  •  ...AuraOne is seeking a remote Business Document Expert (Chinese Speaker) to review Chinese evaluation prompts and responses against a quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain models. This contractor... 
    Remote work
    For contractors

    AuraOne

    New York, NY
    3 days ago
  •  ...Prompt Robustness Model Evaluation Specialist is a remote evaluation track for reviewing prompt robustness model evaluation evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured... 
    Remote work
    Hourly pay
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    2 days ago
  •  ...Job DescriptionProSidian Seeks a Infrastructure Project Evaluation and Coordination Specialist [DOE0080079] for Program Support on a Exempt W2: No...  ...identified Work Site Address (Subject to Change or Working Remotely): 2440 Stevens Center Place, H520 Richland, Washington... 
    Remote work
    Full time
    Contract work
    Temporary work
    For contractors
    For subcontractor
    Work at office
    Flexible hours

    Prosidian Consultng

    Richland, WA
    1 day ago
  • AuraOne is seeking a remote Cross-Modal Retrieval Model Evaluator to review prompts and model outputs against our quality rubric. This contractor role focuses on labeling edge cases, writing structured feedback, and contributing to retraining efforts for continued model... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    2 days ago
  • AuraOne is seeking a remote Business Document Expert (Korean Speaker) to review and rate Korean generalist evaluation prompts and responses. You will compare paired outputs, label edge cases, and provide structured feedback to retrain models. The role is CONTRACTOR and... 
    Remote job
    Hourly pay
    For contractors

    AuraOne

    New York, NY
    4 days ago
  • $50 per hour

    AuraOne is seeking a Korean Audio Evaluation Specialist to remotely review Korean generalist evaluation prompts and responses against AuraOne's quality rubric. You will compare paired outputs, label edge cases, and generate structured feedback for retraining the model.... 
    Remote job
    Contract work

    AuraOne

    New York, NY
    2 days ago
  • Role Description We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project assessing advanced agentic audio...  ...Type ~Freelance / Independent Contractor Workplace Type ~Remote Seniority Level ~Mid-Senior Level... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Freelance

    Meridial

    Remote
    6 days ago
  • AuraOne is seeking a Thai Audio Evaluation Specialist to remotely review generalist outputs against a quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain models. The role emphasizes clear, rationale-driven judgments... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    4 days ago
  • AuraOne is seeking a remote Business Document Expert (Portuguese Speaker) to review prompts and responses against our quality rubric. You will evaluate Portuguese generalist outputs, label edge cases, and provide structured feedback to retrain models. This is a contractor... 
    Remote job
    For contractors
    Flexible hours

    AuraOne

    New York, NY
    16 hours ago
  • AuraOne is seeking a remote Video Summarization Evaluator to review and label outputs against our quality rubric. You will compare paired responses, annotate edge cases, and provide structured feedback to help retrain the model. The role emphasizes clear reasoning and... 
    Remote job

    AuraOne

    New York, NY
    3 days ago
  • AuraOne is seeking a French Transcription Expert (Canada) to remotely evaluate French generalist prompts and model outputs against AuraOne's quality rubric. You will review paired responses, label edge cases, and provide structured feedback for retraining. This contractor... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    16 hours ago
  • AuraOne is seeking a Tagalog Language Expert to review generalist evaluation prompts and responses against the company’s quality rubric. This is a remote contractor role focusing on structuring feedback, labeling edge cases, and generating regression data for retraining... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    16 hours ago
  • AuraOne is seeking an HR Documents Specialist (Japanese) for a remote evaluation track. You will review japanese generalist evaluation prompts and responses against AuraOne's quality rubric, compare paired outputs, label edge cases, and write structured feedback to help... 
    Remote job
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    4 days ago
  • Pearson is seeking a Scoring Assistant for School Administrator and Superintendent credential evaluation. The role is remote and part-time, with sessions typically lasting 2-3 days monthly and scheduled between 8:00 a.m. and 4:00 p.m. PST. Training and review are provided... 
    Remote job
    Part time
    Flexible hours

    Itlearn360

    Sacramento, CA
    3 days ago
  • AuraOne seeks a remote contractor to evaluate multi-turn ranking reward model evaluation prompts and responses. You will compare outputs, assign severity tags, and provide structured feedback to retrain the model using AuraOne's rubric. You will identify hallucinations,... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    17 hours ago
  • AuraOne is seeking a remote Retrieval Relevance Task Evaluator to review prompts and responses against our quality rubric. You will compare outputs, assign severity tags, and provide structured feedback for model retraining. This contractor role requires careful reasoning... 
    Remote job
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    4 days ago
  • AuraOne is seeking a remote News Monitoring Task Evaluator to assess evaluation prompts and responses against our quality rubric. You will compare paired outputs, write rationales, and label edge cases to aid model retraining and quality control. Join as a contractor working... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    2 days ago
  • AuraOne is seeking a remote Rubric Calibration Model Evaluation Specialist contractor in the United States. The role focuses on evaluating rubric calibration model outputs, labeling issues, and providing structured feedback to retrain the model. You will compare paired... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    5 days ago
  • AuraOne is seeking a Prompt Robustness Model Evaluation Specialist to remotely review prompts and model outputs, applying AuraOne's quality rubric. You will compare paired responses, label edge cases, and provide structured feedback for retraining. This contractor role... 
    Remote job
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    2 days ago
  • $20 per hour

     ...Project Overview We are sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation...  ...health insurance and PTO do not apply. Engagement Type: Freelance / Independent Contractor Workplace Type: Remote... 
    Remote work
    Hourly pay
    Temporary work
    For contractors
    Freelance

    Meridial

    Remote
    2 days ago
  • AuraOne is seeking a remote Humanoid Task Task Evaluator to review and label humanoid task evaluation prompts and responses. You will compare paired outputs, apply a versioned rubric, and produce structured feedback for retraining the model. This contractor role requires... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    17 hours ago
  • MIYO Health is seeking a fully remote School Psychologist to partner with a Colorado school district for the 2026-2027 year, focusing on psychoeducational evaluations and eligibility support. The position offers a part-time, evaluation-focused caseload in a flexible remote... 
    Remote job
    Part time
    For contractors
    Flexible hours

    MIYO Health

    Aurora, CO
    3 days ago
  • AuraOne is seeking an Image Evaluation Generalist contractor to remotely review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and draft structured feedback for the modeling team. This role requires precise reasoning... 
    Remote job
    For contractors
    Flexible hours

    AuraOne

    New York, NY
    3 days ago
  • AuraOne is seeking a remote Pairwise Preference Reward Model Evaluator to review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain the modeling team. This independent contractor... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Malayalam Evaluation Specialist. Be the first to apply!