Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Haitian Creole Evaluator & Rubric Specialist

AuraOne

New York, NY
  • Remote job

AI Trainer Jobs is seeking a Haitian Creole Language Expert for a remote evaluation track. You will review language prompts and responses, compare outputs, label edge cases, and provide structured feedback to retrain models. This role emphasizes precise reasoning and rubric alignment. Responsibilities include evaluating model outputs, tagging issues, and maintaining calibration with gold-standard examples. Remote, contractor role with hourly pay after interview. #J-18808-Ljbffr AuraOne

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote Haitian Creole Evaluator & Rubric Specialist in New York, NY vacancy
  • AuraOne seeks an experienced Senior Journalist / Writer for a remote evaluation track. You will review prompts and responses, compare paired outputs, label edge cases, and provide structured feedback for retraining. You’ll help turn outputs into auditable labels, rationales... 
    Remote job
    Hourly pay
    For contractors

    AuraOne

    New York, NY
    4 days ago
  • SME Careers is seeking an experienced Healthcare SME for an hourly remote contractor role. You will create expert healthcare questions, design scoring rubrics, evaluate AI-generated content, and provide precise feedback to improve clinical accuracy and reliability. The... 
    Remote job
    Hourly pay
    For contractors

    Joinkeywork

    New York, NY
    1 day ago
  • AuraOne, Inc. is seeking a Hmong Language Expert for a remote evaluation track to review prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and provide structured feedback for retraining. You will evaluate model... 
    Remote job
    Hourly pay
    For contractors

    AuraOne Human Data

    New York, NY
    1 day ago
  • AuraOne is seeking a Swedish Language Expert (US/Canada Based) for remote evaluation of prompts and responses under AuraOne's quality rubric. You will review paired outputs, label edge cases, and write structured feedback for retraining the model. The role requires prior... 
    Remote job
    Hourly pay
    10 hours per week

    AuraOne

    New York, NY
    1 day ago
  • AuraOne, Inc. is seeking an AI Product Evaluator for a remote contractor role. You will review prompts and model outputs, apply a versioned rubric, and provide structured feedback to retrain the model. The work involves tagging issues, labeling edge cases, and maintaining... 
    Remote job
    For contractors
    10 hours per week

    AuraOne, Inc.

    New York, NY
    2 days ago
  • $80 - $120 per hour

     ...Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-...  ...artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and... 
    Remote work
    Contract work
    Summer work
    Work at office

    Mercor

    New York, NY
    5 days ago
  • AuraOne is seeking a Mandarin Transcription Expert to remotely evaluate mandarin generalist prompts and responses. You will compare outputs,...  ...independent contractor, you will review tasks with guidance from the rubric and provide clear written rationales. Remote work is allowed... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    1 day ago
  •  ...Assessment Rubric AI Evaluator is a remote review track for evaluating AI outputs across assessment rubric ai specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next... 
    Remote job
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  • AuraOne, Inc. is seeking a remote AI Evaluation Rubric Writer reviewer to assess model outputs against a versioned rubric and assign severity tags. You will compare paired responses, label issues, and document recurring failures to help retrain the model. Ideal candidates... 
    Remote job
    For contractors

    AuraOne Human Data

    New York, NY
    1 day ago
  • $90 per hour

     ...Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality and correctness of AI-assisted software-...  ...workflow soundness, and reasoning. Provide clear, rubric-based written feedback to improve AI model outputs .... 
    Remote work
    Contract work
    Summer work

    Mercor

    Abbeville, GA
    22 days ago
  • $80 - $120 per hour

     ...Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-...  ...artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation... 
    Remote work
    Contract work
    Summer work
    Work at office

    Mercor

    Abbeville, GA
    22 days ago
  • $80 - $120 per hour

     ...Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...  ...artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and... 
    Remote work
    Contract work
    Summer work
    Work at office

    Mercor

    Abbeville, GA
    22 days ago
  • $20 - $160 per hour

     ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location: Remote Role Responsibilities Evaluate the relevance...  .... Comfort with applying a detailed rubric consistently. Reliable availability for... 
    Remote work
    Contract work
    Summer work

    Mercor

    Abbeville, GA
    22 days ago
  • $60 - $70 per hour

     ...Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy,...  ...sensitive domains. Apply and refine evaluation rubrics for RLHF , SFT , and AI safety benchmarking .... 
    Remote work
    Contract work
    Summer work

    Mercor

    Abbeville, GA
    22 days ago
  •  ...Pharmacovigilance Safety Evaluator is a remote evaluation track for reviewing pharmacovigilance safety...  ...responses against AuraOne's quality rubric. Reviewers compare paired outputs,...  ...Remote — US-eligible. Remote · Independent specialist contractor. Employment type:... 
    Remote work
    Hourly pay
    For contractors
    10 hours per week

    AuraOne, Inc.

    New York, NY
    4 days ago
  • $14 - $42 per hour

     ...Expert - Hindi Type: Contract Compensation: $14–$42/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate against detailed quality standards... 
    Remote work
    Contract work
    Summer work
    Immediate start

    Mercor

    San Francisco, CA
    2 days ago
  • $80 - $150 per hour

     ...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour Location: Remote Role Responsibilities Review and assess domain-specific documents to ensure quality,... 
    Remote work
    Contract work
    Summer work

    Mercor

    New York, NY
    6 days ago
  • $70 - $120 per hour

    3D Generalist (Remote | $70–$120/hr)] Position: 3D Generalist: Modeling, Rigging & Animation (AI Evaluation)] Type: Full-Time Compensation: $70–$120 per hour] Location...  .... Develop evaluation guidelines, rubrics, and quality checks, including scripted... 
    Remote work
    Hourly pay
    Full time
    Weekday work

    Synthires

    United States
    1 day ago
  • $16 per hour

     ...Job Description Job Description   Intake Specialist Bilingual (Haitian Creole) Hourly Compensation: $16.00 + Up to $14,00.00 Bonus + Benefits...  ...preferred Ability to work independently in a remote setting Compliance Requirements: Successfully pass... 
    Remote job
    Haitian creole
    Hourly pay

    Chrysalis Health

    Fort Lauderdale, FL
    27 days ago
  • AI Trainer Jobs is seeking a Mongolian Bilingual Expert for a remote evaluation track. You will review prompts and model outputs against a versioned rubric, label edge cases, and provide structured feedback for retraining. The role emphasizes accuracy, clear reasoning,... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    2 days ago
  •  ...Dataset Ontology QA Reviewer role is a remote contractor position focused on auditing...  ...You will compare responses to a versioned rubric, assign severity tags, and provide reasoning...  .... Ideal candidates bring experience in evaluation/annotation, clear written reasoning, and... 
    Remote job
    For contractors
    Flexible hours

    AuraOne, Inc.

    New York, NY
    2 hours ago
  • AuraOne, Inc. is seeking a Korean Formality Cultural Context Reviewer for a remote contractor role based in the United States. You will assess Korean generalist outputs against a fixed rubric, tag edge cases, and provide structured feedback to help retrain models. Responsibilities... 
    Remote job
    For contractors

    AuraOne, Inc.

    New York, NY
    1 day ago
  • Modern MedEd LLC is conducting a remote study for radiology residents to evaluate diagnostic imaging using a structured rubric. Participants will review de-identified images and provide expert reads on each case, contributing to reference evaluations for benchmarking purposes... 
    Remote job
    Weekly pay
    For contractors
    Flexible hours

    Modern MedEd LLC

    New York, NY
    1 day ago
  • AuraOne, Inc. is seeking a Kannada Audio transcription Expert to work remotely as an independent contractor. You will review and rate audio annotation outputs against a defined rubric, assign severity tags, and provide structured feedback to support model retraining. Responsibilities... 
    Remote job
    For contractors

    AuraOne, Inc.

    New York, NY
    1 day ago
  • $30 - $40 per hour

    OpenTrain AI, Inc. is seeking a Passport Application AI Evaluation Expert for a remote, short-term contract. You will review passport questions for realism, create rubrics for accurate answers, and define evaluation standards for identity documents, renewals, and minors... 
    Remote job
    Hourly pay
    Temporary work

    OpenTrain AI, Inc.

    Brooklyn, NY
    2 days ago
  • $100 per hour

     ...$100/hour In this hourly, remote contractor role, you will work...  ...expert-level healthcare questions, evaluate AI-generated clinical content, and design high-quality rubrics defining what an accurate,...  ...clinical experience; senior and specialist-level professionals are... 
    Remote work
    Hourly pay
    Contract work
    For contractors

    SuperAnnotate

    San Francisco, CA
    a month ago
  • AuraOne, Inc. is seeking a remote evaluator to review food delivery AI response evaluations. You will compare paired outputs, label issues,...  ...structured feedback to help retrain the model according to AuraOne's rubric. Ideal candidates have prior annotation experience, strong... 
    Remote job
    For contractors

    AuraOne Human Data

    New York, NY
    3 days ago
  • AI Trainer Jobs is seeking a Hebrew Bilingual Expert for remote evaluation work. You will review Hebrew prompts and responses, compare outputs...  ...and provide structured feedback to support AuraOne’s quality rubric. Responsibilities include labeling edge cases, tracking... 
    Remote job
    Hourly pay
    Contract work
    For contractors
    Flexible hours

    AuraOne

    New York, NY
    4 days ago
  • AI Trainer Jobs is seeking a remote contractor to evaluate application users premiere on Windows generalist evaluation outputs. You will apply a versioned rubric, label issues, and provide structured feedback for retraining efforts. Responsibilities include comparing responses... 
    Remote job
    Hourly pay
    Part time
    For contractors

    AuraOne

    New York, NY
    1 day ago
  • $30 per hour

    Type: Hourly contract Compensation: $20-$30/hour Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent systems using defined rubrics and quality standards. Review multi-step agent workflows,... 
    Remote job
    Hourly pay
    Contract work

    Crossing Hurdles

    New York, NY
    12 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Haitian Creole Evaluator & Rubric Specialist. Be the first to apply!