Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Entity Resolution Quality Evaluator & Rubric Expert

AuraOne, Inc.

New York, NY
  • Remote job

AuraOne, Inc. seeks an Entity Resolution Data Specialist for a remote evaluation track to review prompts and responses against AuraOne's quality rubric. You will label edge cases, write structured feedback, and help retrain models. You will compare paired outputs, assign severity tags, and document recurring failure modes to improve data quality for AuraOne Human Data projects. This contractor role requires strong attention to detail and reliable async availability. #J-18808-Ljbffr AuraOne, Inc.

Vacancy posted 18 hours ago
Similar jobs that could be interesting for youBased on the Remote Entity Resolution Quality Evaluator & Rubric Expert in New York, NY vacancy
  •  ...accredited Veterans Service Officers to help evaluate and improve AI systems on veterans benefits...  ...knowledge matters. As a contractor working remotely in the United States, you will review questions, write comprehensive rubrics for service-connected disability claims,... 
    Remote job
    Quality
    For contractors

    micro1

    New York, NY
    2 days ago
  •  ...seeking a Biology / environmental science Evaluator for a remote contract role. You will assess AI-generated artifacts using domain-specific rubrics, identify errors, and provide structured feedback to improve content quality. Candidates should have 5+ years in biology... 
    Remote job
    Quality
    Contract work
    Work at office

    Mercor

    San Francisco, CA
    4 days ago
  • $80 - $120 per hour

     ...Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-...  ...artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation... 
    Remote work
    Quality
    Contract work
    Summer work
    Work at office

    Mercor

    New York, NY
    28 days ago
  • $80 - $120 per hour

     ...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80-$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation errors... 
    Remote work
    Quality
    Contract work
    Summer work
    Work at office

    Mercor

    San Francisco, CA
    4 days ago
  • $80 - $120 per hour

     ...Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...  ...artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation... 
    Remote work
    Quality
    Contract work
    Summer work
    Work at office

    Mercor

    New York, NY
    11 days ago
  • $80 - $120 per hour

     ...Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...  ...artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation... 
    Remote work
    Quality
    Contract work
    Summer work
    Work at office

    Mercor

    New York, NY
    4 days ago
  • AuraOne, Inc. is seeking a remote Rubric Ontology Data Specialist to evaluate prompts and responses against our quality rubric. Reviewers label edge cases, assign severity, and generate structured feedback to retrain our models. Your work ensures auditable labels, robust... 
    Remote job
    Quality
    For contractors
    Flexible hours

    AuraOne, Inc.

    New York, NY
    5 days ago
  • AuraOne, Inc. is seeking a diligent remote contractor to evaluate at-work video recorder outputs against a versioned rubric. You will assign severity tags, write rationales, and help identify edge cases for quality control. Responsibilities include comparing responses,... 
    Remote job
    Quality
    For contractors

    AuraOne, Inc.

    New York, NY
    3 days ago
  • AuraOne is seeking an AI Agent Evaluator to remotely review and label ai agent evaluation prompts and responses against AuraOne's quality rubric. You will compare outputs, identify edge cases, and provide structured feedback to support retraining. The role focuses on auditing... 
    Remote job
    Quality

    Auraone

    New York, NY
    2 days ago
  • AuraOne, Inc. is seeking a Hmong Language Expert for a remote evaluation track to review prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and provide structured feedback for retraining. You will evaluate model outputs... 
    Remote job
    Quality
    Hourly pay
    For contractors

    AuraOne, Inc.

    New York, NY
    18 hours ago
  • AuraOne is seeking a Swedish Language Expert (US/Canada Based) for remote evaluation of prompts and responses under AuraOne's quality rubric. You will review paired outputs, label edge cases, and write structured feedback for retraining the model. The role requires prior... 
    Remote job
    Quality
    Hourly pay
    10 hours per week

    Auraone

    New York, NY
    1 day ago
  • AI Trainer Jobs is seeking a Cantonese Language Evaluator for a remote contractor role. You will review cantonese generalist evaluation prompts and responses, apply AuraOne's quality rubric, and label edge cases with structured feedback to retrain the model. You will compare... 
    Remote job
    Quality
    For contractors
    10 hours per week

    Auraone

    New York, NY
    2 days ago
  •  ...to generate high-quality data, evaluations, and...  ...the structured resolution of disagreements...  ...refine evaluation rubrics, review guidelines...  ...standards. Provide expert advisory support...  ...Other commercial entities relevant to assigned...  ...and flexible remote work. Learn how... 
    Remote work
    Quality
    Contract work
    Temporary work
    For contractors
    Freelance
    Flexible hours

    Turing

    United States
    23 days ago
  •  ...You will also fact-check claims, flag unsafe content, and craft prompts and reasoning examples that demonstrate high-quality outputs. This role is remote, hourly, and part-time with flexible hours. You should be a native Polish speaker with professional English,... 
    Remote job
    Quality
    Hourly pay
    Part time
    Flexible hours

    Vettedlance

    New York, NY
    3 days ago
  •  ...experienced Photography and Cinematography Expert to evaluate professional photo and video content for a specialized project. This remote, worldwide role requires expertise in...  ...and briefs, assess technical and creative quality, and provide clear written explanations for... 
    Remote job
    Quality
    Worldwide

    YO AI Labs

    New York, NY
    5 days ago
  • AuraOne, Inc. is seeking a remote Computer Vision Data Annotation Specialist contractor to evaluate model outputs against a versioned rubric, tag edge cases, and provide structured feedback...  ...gold standards to maintain reviewer-quality scores. Strong attention to detail and... 
    Remote job
    Quality
    For contractors

    AuraOne, Inc.

    New York, NY
    18 hours ago
  •  ...Entity Resolution Ontology QA Reviewer is a remote evaluation track for reviewing entity resolution ontology qa evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback... 
    Remote job
    Quality
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  • $18 - $45 per hour

     ...China & Spain Market Expertise | Remote Freelance Opportunity Company: Volga...  ...- Fixed Income Subject Matter Experts (SMEs) to support a specialized AI evaluation pilot focused on the financial markets...  ...the accuracy, reliability, and quality of AI-generated financial outputs... 
    Remote work
    Quality
    Extra income
    Temporary work
    For contractors
    Freelance
    Flexible hours

    Volga Partners

    New York, NY
    18 hours ago
  • $20 - $65 per hour

     ...Python Expert Evaluator is a remote engineering review track for evaluating Python code, debugging traces...  ...this role matters Python model quality lives or dies on whether the generated...  ...with a written rationale tied to the rubric. Tag failure modes (compile error,... 
    Remote job
    Quality
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  • $50 per hour

     ...Bengali Generalist Evaluator Expert is a remote Bengali specialist track for evaluating bengali evaluation...  ...role matters Multilingual model quality depends on reviewers who can read...  ...Calibrate against the AuraOne Bengali rubric in weekly reviewer-quality cycles.... 
    Remote job
    Quality
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    29 days ago
  • $70 - $110 per hour

     ...–$110/hour Location: Remote Duration: 4–6 weeks...  ...Role Responsibilities Evaluate AI-generated sales strategies...  ...and training materials for quality and accuracy. Compare AI...  ...setting, and customer complaint resolution. Provide expert feedback on sales-... 
    Remote work
    Quality
    Hourly pay
    Contract work
    Summer work
    Immediate start

    Mercor

    New York, NY
    24 days ago
  • $90 per hour

     ...Contract Compensation: $90/hour Location: Remote Role Responsibilities Render a reference page and...  ...replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid .... 
    Remote work
    Quality
    Contract work
    Summer work
    Local area

    Mercor

    San Francisco, CA
    a month ago
  • $125k - $147k

     ...despite delivering high-quality care. While...  ...Independent Dispute Resolution) were designed to...  ...Clinical Subject Matter Expert to own the...  ...into annotations, evaluation criteria, and clear...  ...drafts against a rubric The ability to...  ...outside those regions. Remote and hybrid... 
    Remote work
    Quality
    Full time
    Flexible hours

    Pivotal Health

    Remote
    10 days ago
  • $60 - $70 per hour

     ...Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety...  ..., policy compliance, and overall quality. Review content involving...  .... Apply and refine evaluation rubrics for RLHF , SFT , and AI safety... 
    Remote work
    Quality
    Contract work
    Summer work

    Mercor

    New York, NY
    a month ago
  • $104k - $312k

     ...influential research in AI evaluation like FinanceBench ,...  ...Independent contractor, fully remote, asynchronous Pay:...  ...pages and closings, entity records and cap tables, and...  ...scenarios are fictional. Quality is judged on accuracy, rubric validity, difficulty and... 
    Remote work
    Quality
    Contract work
    For contractors
    Local area
    10 hours per week

    Patronus AI, Inc.

    Remote
    11 days ago
  • AuraOne is seeking a Tamang Language Expert to work remotely as part of its evaluation track. You will review tamang...  ...retrain the model. This role focuses on quality and reproducibility across...  ...reasoning, and the ability to apply rubrics consistently. #J-18808-Ljbffr Auraone
    Remote work
    Quality

    Auraone

    New York, NY
    1 day ago
  • $120 - $175 per hour

     .... Position: CNC Machining Expert Type: Contract Compensation...  ...120–$175/hour Location: Remote Role Responsibilities...  ...text-only, objective, verifiable rubrics for grading CNC machining...  ...deadlines and improve rubric quality. Qualifications Must-Have... 
    Remote work
    Quality
    Contract work
    Summer work

    Mercor

    Detroit, MI
    7 days ago
  • $800 per month

     ...: $800/hour Location: Remote Commitment: 20–40 hours/week...  ...court bonds, and bond-default resolution. Create work products such...  ...surety-professional quality. Grade AI-generated responses against structured rubrics for credit judgment, capacity... 
    Remote work
    Quality
    Contract work
    For contractors
    Summer work
    Work at office
    Immediate start

    Mercor

    New York, NY
    9 days ago
  • $70 - $95 per hour

     ...Position: Accounting Experts Type: Contract...  ...5/hour Location: Remote Commitment: 20+ hours...  ...controllership, including multi-entity and multi-currency...  ...functions; write rubrics that distinguish senior...  ...calibrates contributors to the quality bar before live work.... 
    Remote work
    Quality
    Hourly pay
    Contract work
    For contractors
    Summer work

    Mercor

    New York, NY
    a month ago
  • $28 per hour

     ...participants and AI models, evaluate whether sufficient...  ...helps improve the quality, reasoning, and...  ...Time (PST) Fully remote 4-week contractor...  ...subject matter experts with one of the...  ..., Conflict Resolution, Qualitative Research...  ...Developing evaluation rubrics, annotation... 
    Remote work
    Quality
    Weekly pay
    Contract work
    Temporary work
    For contractors
    Immediate start

    Verita Ai

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Entity Resolution Quality Evaluator & Rubric Expert. Be the first to apply!