Remote Entity Resolution Quality Evaluator & Rubric Expert
AuraOne, Inc.
- Remote job
AuraOne, Inc. seeks an Entity Resolution Data Specialist for a remote evaluation track to review prompts and responses against AuraOne's quality rubric. You will label edge cases, write structured feedback, and help retrain models. You will compare paired outputs, assign severity tags, and document recurring failure modes to improve data quality for AuraOne Human Data projects. This contractor role requires strong attention to detail and reliable async availability. #J-18808-Ljbffr AuraOne, Inc.
- ...accredited Veterans Service Officers to help evaluate and improve AI systems on veterans benefits... ...knowledge matters. As a contractor working remotely in the United States, you will review questions, write comprehensive rubrics for service-connected disability claims,...Remote jobQualityFor contractors
- ...seeking a Biology / environmental science Evaluator for a remote contract role. You will assess AI-generated artifacts using domain-specific rubrics, identify errors, and provide structured feedback to improve content quality. Candidates should have 5+ years in biology...Remote jobQualityContract workWork at office
$80 - $120 per hour
...Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-... ...artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation...Remote workQualityContract workSummer workWork at office$80 - $120 per hour
...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80-$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation errors...Remote workQualityContract workSummer workWork at office$80 - $120 per hour
...Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... ...artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation...Remote workQualityContract workSummer workWork at office$80 - $120 per hour
...Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... ...artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation...Remote workQualityContract workSummer workWork at office- AuraOne, Inc. is seeking a remote Rubric Ontology Data Specialist to evaluate prompts and responses against our quality rubric. Reviewers label edge cases, assign severity, and generate structured feedback to retrain our models. Your work ensures auditable labels, robust...Remote jobQualityFor contractorsFlexible hours
- AuraOne, Inc. is seeking a diligent remote contractor to evaluate at-work video recorder outputs against a versioned rubric. You will assign severity tags, write rationales, and help identify edge cases for quality control. Responsibilities include comparing responses,...Remote jobQualityFor contractors
- AuraOne is seeking an AI Agent Evaluator to remotely review and label ai agent evaluation prompts and responses against AuraOne's quality rubric. You will compare outputs, identify edge cases, and provide structured feedback to support retraining. The role focuses on auditing...Remote jobQuality
- AuraOne, Inc. is seeking a Hmong Language Expert for a remote evaluation track to review prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and provide structured feedback for retraining. You will evaluate model outputs...Remote jobQualityHourly payFor contractors
- AuraOne is seeking a Swedish Language Expert (US/Canada Based) for remote evaluation of prompts and responses under AuraOne's quality rubric. You will review paired outputs, label edge cases, and write structured feedback for retraining the model. The role requires prior...Remote jobQualityHourly pay10 hours per week
- AI Trainer Jobs is seeking a Cantonese Language Evaluator for a remote contractor role. You will review cantonese generalist evaluation prompts and responses, apply AuraOne's quality rubric, and label edge cases with structured feedback to retrain the model. You will compare...Remote jobQualityFor contractors10 hours per week
- ...to generate high-quality data, evaluations, and... ...the structured resolution of disagreements... ...refine evaluation rubrics, review guidelines... ...standards. Provide expert advisory support... ...Other commercial entities relevant to assigned... ...and flexible remote work. Learn how...Remote workQualityContract workTemporary workFor contractorsFreelanceFlexible hours
- ...You will also fact-check claims, flag unsafe content, and craft prompts and reasoning examples that demonstrate high-quality outputs. This role is remote, hourly, and part-time with flexible hours. You should be a native Polish speaker with professional English,...Remote jobQualityHourly payPart timeFlexible hours
- ...experienced Photography and Cinematography Expert to evaluate professional photo and video content for a specialized project. This remote, worldwide role requires expertise in... ...and briefs, assess technical and creative quality, and provide clear written explanations for...Remote jobQualityWorldwide
- AuraOne, Inc. is seeking a remote Computer Vision Data Annotation Specialist contractor to evaluate model outputs against a versioned rubric, tag edge cases, and provide structured feedback... ...gold standards to maintain reviewer-quality scores. Strong attention to detail and...Remote jobQualityFor contractors
- ...Entity Resolution Ontology QA Reviewer is a remote evaluation track for reviewing entity resolution ontology qa evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback...Remote jobQualityHourly payFor contractors10 hours per week
$18 - $45 per hour
...China & Spain Market Expertise | Remote Freelance Opportunity Company: Volga... ...- Fixed Income Subject Matter Experts (SMEs) to support a specialized AI evaluation pilot focused on the financial markets... ...the accuracy, reliability, and quality of AI-generated financial outputs...Remote workQualityExtra incomeTemporary workFor contractorsFreelanceFlexible hours$20 - $65 per hour
...Python Expert Evaluator is a remote engineering review track for evaluating Python code, debugging traces... ...this role matters Python model quality lives or dies on whether the generated... ...with a written rationale tied to the rubric. Tag failure modes (compile error,...Remote jobQualityFor contractors10 hours per week$50 per hour
...Bengali Generalist Evaluator Expert is a remote Bengali specialist track for evaluating bengali evaluation... ...role matters Multilingual model quality depends on reviewers who can read... ...Calibrate against the AuraOne Bengali rubric in weekly reviewer-quality cycles....Remote jobQualityFor contractors10 hours per week$70 - $110 per hour
...–$110/hour Location: Remote Duration: 4–6 weeks... ...Role Responsibilities Evaluate AI-generated sales strategies... ...and training materials for quality and accuracy. Compare AI... ...setting, and customer complaint resolution. Provide expert feedback on sales-...Remote workQualityHourly payContract workSummer workImmediate start$90 per hour
...Contract Compensation: $90/hour Location: Remote Role Responsibilities Render a reference page and... ...replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid ....Remote workQualityContract workSummer workLocal area$125k - $147k
...despite delivering high-quality care. While... ...Independent Dispute Resolution) were designed to... ...Clinical Subject Matter Expert to own the... ...into annotations, evaluation criteria, and clear... ...drafts against a rubric The ability to... ...outside those regions. Remote and hybrid...Remote workQualityFull timeFlexible hours$60 - $70 per hour
...Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety... ..., policy compliance, and overall quality. Review content involving... .... Apply and refine evaluation rubrics for RLHF , SFT , and AI safety...Remote workQualityContract workSummer work$104k - $312k
...influential research in AI evaluation like FinanceBench ,... ...Independent contractor, fully remote, asynchronous Pay:... ...pages and closings, entity records and cap tables, and... ...scenarios are fictional. Quality is judged on accuracy, rubric validity, difficulty and...Remote workQualityContract workFor contractorsLocal area10 hours per week- AuraOne is seeking a Tamang Language Expert to work remotely as part of its evaluation track. You will review tamang... ...retrain the model. This role focuses on quality and reproducibility across... ...reasoning, and the ability to apply rubrics consistently. #J-18808-Ljbffr AuraoneRemote workQuality
$120 - $175 per hour
.... Position: CNC Machining Expert Type: Contract Compensation... ...120–$175/hour Location: Remote Role Responsibilities... ...text-only, objective, verifiable rubrics for grading CNC machining... ...deadlines and improve rubric quality. Qualifications Must-Have...Remote workQualityContract workSummer work$800 per month
...: $800/hour Location: Remote Commitment: 20–40 hours/week... ...court bonds, and bond-default resolution. Create work products such... ...surety-professional quality. Grade AI-generated responses against structured rubrics for credit judgment, capacity...Remote workQualityContract workFor contractorsSummer workWork at officeImmediate start$70 - $95 per hour
...Position: Accounting Experts Type: Contract... ...5/hour Location: Remote Commitment: 20+ hours... ...controllership, including multi-entity and multi-currency... ...functions; write rubrics that distinguish senior... ...calibrates contributors to the quality bar before live work....Remote workQualityHourly payContract workFor contractorsSummer work$28 per hour
...participants and AI models, evaluate whether sufficient... ...helps improve the quality, reasoning, and... ...Time (PST) Fully remote 4-week contractor... ...subject matter experts with one of the... ..., Conflict Resolution, Qualitative Research... ...Developing evaluation rubrics, annotation...Remote workQualityWeekly payContract workTemporary workFor contractorsImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Entity Resolution Quality Evaluator & Rubric Expert. Be the first to apply!
- evaluator New York, NY
- work from home web search evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- work from home social media evaluator New York, NY
- ai evaluator New York, NY
- ads evaluator New York, NY
- education evaluator New York, NY
- quality evaluator New York, NY
- social media evaluator New York, NY


