UI Design Quality Evaluator [Remote]
AuraOne Human Data
- Remote job
UI Design Quality Evaluator is a remote review track for evaluating AI outputs across ui / ux design workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach so the modeling team can train on it.
Why this role matters
UI / UX design AI is only useful if a working professional would actually ship the output. AuraOne uses portfolio-credentialed reviewers to grade outputs the way a senior creative would — with craft, constraints, and tooling all in scope.
Responsibilities
- Review AI outputs against current ui / ux design craft and tooling standards for UI Design Quality Evaluator assignments.
- Grade composition, constraint adherence, and production-readiness on a structured rubric.
- Flag tooling-specific failures (file format, scale, naming, layer hygiene) with severity tags.
- Capture the corrected approach or reference so the modeling team can train on it.
- Adjudicate disputed creative judgments against published references or firm style guides.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Portfolio or production experience in ui / ux design or an adjacent creative discipline for UI Design Quality Evaluator work.
- Hands-on familiarity with the standard tooling for the discipline.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the craft issue and the standard being applied.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Grade a model's ui / ux design output against the brief and rate craft, constraints, and production-readiness.
- Flag a tooling-specific failure (incorrect file format, unsupported feature, naming convention) with severity.
- Adjudicate a disputed creative judgment between two reviewers using a firm style guide.
- Audit a 25-asset batch for rubric consistency and report drift to the program lead.
Nice to have
- Studio, agency, or in-house team experience shipping production work.
- Prior experience reviewing AI-assisted creative tooling and its failure modes.
- Familiarity with AAA or feature-grade pipelines and asset standards.
Skills
- Creative review
- Production-grade craft
- Tooling fluency
- Asset evaluation
- UI / UX design
- Production quality
- Design critique
- Design
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
- ...Alignerr is seeking Search Quality Evaluators (AI Training) to assess search results, AI-generated answers, and recommendations. This remote, hourly contract offers flexible 10–40 hours per week and the opportunity to contribute to reliable AI information delivery. You...QualityHourly payContract workRemote work10 hours per weekFlexible hours
- ...The Mental Health Evaluator (MHE) is a critical role dedicated to delivering comprehensive, clinically appropriate, culturally competent... ...essential member of the interdisciplinary team to maintain high-quality patient care. The MHE reports to the Regional Program Manager...Quality
- ...high volume of English-speaking freelancers based in the United States to support an AI evaluation project focused on assessing the relevance, usefulness, reliability, and overall quality of online search results. Freelancers will review webpages presented in response to...QualityContract workFreelanceImmediate start
- ...Pharmacovigilance Safety Evaluator is a remote evaluation track for reviewing pharmacovigilance safety evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the...QualityHourly payFor contractorsRemote work10 hours per week
- ...Overview Role Summary: Seeking experienced Qualified Medical Evaluators (QMEs) and California-licensed physicians interested in... ...and administrative preparation Historian Services Report quality assurance support Report submission assistance Tracking...QualityContract workFor contractorsRemote workFlexible hours
- ...aMaryland Licensed Psychologistto join our growing behavioral health evaluation team. This flexible opportunity allows you toconduct... ...psychological testing results. Prepare comprehensive, court-quality evaluation reports with diagnoses and treatment recommendations...QualityReliefPrivate practiceRemote workFlexible hours
- ...Professional Qualification Evaluator (PQE) Location: Onsite/Remote - Martinsburg, WV Schedule: Full-Time Salary Range: To be determined... ...with applicable Government procedures. Meet established quality and production standards for application evaluations....QualityFull timeContract workLocal areaRemote work
$14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data...QualityHourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hours- ...Eligible No Major Duties As a Program Evaluator you will be responsible for the... ...logistics and program shortfalls, and ensures quality control and compliance across... ...Essential (EE) position. The incumbent will be designated Non-Combat Essential (NCE). In the event...QualityFull timeContract workTemporary workFor contractorsRemote work
$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...QualityHourly payPart timeRemote workFlexible hours$30 - $45 per hour
...Job Description: Web Browsing Evaluator remote $30 - $45/hour pay Required Skills Attention to Detail Data Annotation... ...micro1 is engaging Web Browsing Evaluators to contribute high-quality web interaction data for a valued customer project. In this...QualityFor contractorsRemote work$14.5 per hour
...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years of experience in...QualityBi-weekly payHourly payPart timeImmediate startRemote workWork from homeFlexible hours$14 per hour
TELUS Digital is seeking individuals for a remote, freelance Content Reviewer role focused on evaluating online content for search quality. You will rate text, images, and webpages to improve AI-powered search results. No prior experience required beyond meeting basic...QualityRemote jobHourly payFor contractorsFreelanceFlexible hours- ...DecisionPoint is seeking a Planning Evaluator to join our team in Atlanta, GA, to provide... ...on mixed-methods tools. Design evaluation to meet agency responses and... ...outcomes. Monitor and assess data quality, integrity, and completeness. Collaborate...QualityFor contractorsWork at officeLocal areaRemote work
$70 - $120 per hour
...Generalist: Modeling, Rigging & Animation (AI Evaluation)] Type: Full-Time Compensation... ...realistic production tasks, and develop quality standards that improve generative AI... ..., and product visualization. Design real-world 3D tasks based on studio and...QualityHourly payFull timeRemote workWeekday work$80 - $120 per hour
...Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation...QualityContract workSummer workWork at officeRemote work$80k - $130k
...DoAs a Project - Program Analytics & Insights Evaluator II on the project, you will be responsible for:Supporting the design and implementation of large, multi-site... ...evaluation design, data collection methods, data quality, data management, analysis, and reportingManaging...QualityLocal area- ...Luxury Brand Evaluator Turn your passion for luxury into a career opportunity. Explore the world of premium brands and make a lasting... ...your home. 3. Observe carefully - check the ambiance, service quality, and overall customer experience. 4. Provide honest feedback...QualityWorldwideFlexible hours
- AI Trainer Jobs seeks a Hindi Language Expert for a remote evaluation track. Review Hindi prompts and responses, compare paired outputs... ...Data, and calibrate against gold standards to maintain reviewer quality. This contractor role offers flexible hours and program-driven...QualityRemote jobFor contractorsFlexible hours
- ...explain in writing what looked off, working remotely on your own schedule. Contributors review outputs for realism, adherence, and quality, and earn compensation per hour with flexible hours and weekly payments. Access to leading LLMs is included, making this a compelling...QualityHourly payWeekly payRemote workFlexible hours
$30 - $40 per hour
OpenTrain AI, Inc. is seeking a Passport Application AI Evaluation Expert for a remote, short-term contract. You will review passport questions for realism, create rubrics for accurate answers, and define evaluation standards for identity documents, renewals, and minors...QualityRemote jobHourly payTemporary work- ...compare image and video pairs, and explain what’s off, all remotely and on your own schedule. You will rate outputs on adherence, quality, and realism, write concise explanations in English, and contribute to improving AI that powers real-world applications. Ideal candidates...QualityRemote job
- ...practicing physicians (MD/DO) with an active, unrestricted US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. You will review vignettes, score reasoning quality, and write concise rationales to improve AI tools used in healthcare....QualityRemote job10 hours per week
$20 - $30 per hour
...focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI... ..., and providing actionable feedback to enhance product quality. Ideal candidates will have strong analytical skills, attention...QualityRemote jobHourly pay- Meridial is seeking independent contractor experts to evaluate AI-generated outputs focusing on JSON structure, formatting accuracy, and response quality. You will review responses for clarity, accuracy, and technical soundness, ensuring alignment with project guidelines...QualityContract workFor contractorsRemote work
$40 per hour
Talantir is seeking a remote contractor to work on evaluating AI chatbots. You will be given coding challenges for AI chatbots and assess... ...hourly starting at $40+ USD per hour, with bonuses for high-quality and high-volume work. This independent contract role lets you...QualityRemote jobHourly payContract workFor contractors- CXG is seeking a luxury brand evaluator in Florida to discreetly assess customer experiences across boutiques or online channels. You will... ...visit stores or evaluate online, observe ambiance and service quality, and share honest feedback to help brands refine their...QualityWorldwideFlexible hours
- ...veterans. This non-treating role reviews medical records, conducts evaluations, and completes VA DBQs through a secure online portal to... ...documentation and timely submission of findings while maintaining high quality and objectivity for veteran clients. #J-18808-Ljbffr MRG...QualityPart time1 day per week
- US Remote About the role Web Browsing Evaluator is a remote evaluation track for reviewing web browsing evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the...QualityRemote work10 hours per week
- CXG is seeking evaluators in the United States to visit luxury stores or assess online experiences. You will observe ambiance and service quality, then provide honest feedback via our mobile platform. Assignments are flexible, with potential reimbursement for approved...QualityFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to UI Design Quality Evaluator [Remote]. Be the first to apply!





