UI Design Quality Evaluator [Remote]
AuraOne Human Data
Remote
- Remote job
UI Design Quality Evaluator is a remote review track for evaluating AI outputs across ui / ux design workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach so the modeling team can train on it.
Why this role matters
UI / UX design AI is only useful if a working professional would actually ship the output. AuraOne uses portfolio-credentialed reviewers to grade outputs the way a senior creative would — with craft, constraints, and tooling all in scope.
Responsibilities
- Review AI outputs against current ui / ux design craft and tooling standards for UI Design Quality Evaluator assignments.
- Grade composition, constraint adherence, and production-readiness on a structured rubric.
- Flag tooling-specific failures (file format, scale, naming, layer hygiene) with severity tags.
- Capture the corrected approach or reference so the modeling team can train on it.
- Adjudicate disputed creative judgments against published references or firm style guides.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Portfolio or production experience in ui / ux design or an adjacent creative discipline for UI Design Quality Evaluator work.
- Hands-on familiarity with the standard tooling for the discipline.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the craft issue and the standard being applied.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Grade a model's ui / ux design output against the brief and rate craft, constraints, and production-readiness.
- Flag a tooling-specific failure (incorrect file format, unsupported feature, naming convention) with severity.
- Adjudicate a disputed creative judgment between two reviewers using a firm style guide.
- Audit a 25-asset batch for rubric consistency and report drift to the program lead.
Nice to have
- Studio, agency, or in-house team experience shipping production work.
- Prior experience reviewing AI-assisted creative tooling and its failure modes.
- Familiarity with AAA or feature-grade pipelines and asset standards.
Skills
- Creative review
- Production-grade craft
- Tooling fluency
- Asset evaluation
- UI / UX design
- Production quality
- Design critique
- Design
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the UI Design Quality Evaluator [Remote] in Remote vacancy
- ...TechnicalPer DiemAll ShiftsAs neededJob Summary: The Mental Health Evaluator (MHE) is a critical role dedicated to delivering comprehensive,... ...member of the interdisciplinary team to maintain high-quality patient care. The MHE reports to the Regional Program Manager for...Quality
HealthAlliance of the Hudson Valley
Valhalla, NY4 days ago - ...preferred.Experience: Minimum of two years’ experience in the designated field of license, preferably with rehabilitation/LTACH and marketing... ..., in 17 states. PAM Health is committed to providing high-quality patient care and outstanding customer service, coupled with...QualityFull timeLocal area
PAM Health
Humble, TX1 day ago $14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...QualityHourly payPart timeRemote workFlexible hoursWelo Data
United States1 day ago- ...Weekday 1 is seeking expert Evaluators to review AI-generated real estate, hospitality and events outputs for accuracy, rigor and domain quality. You will apply deep expertise to grade documents, spreadsheets and slide decks. Requirements include 5+ years in Real estate...QualityHourly payWeekly payContract workWork at officeRemote workWeekday work
Weekday 1
United States3 days ago $80 - $120 per hour
...Compensation: $80 - $120 per hour We are hiring expert Evaluators in Special education / IEP to review and assess AI-generated... ...spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs...QualityHourly payContract workFor contractorsWork at officeRemote workWeekday 1
New York, NY2 days ago$11.5 per hour
...offering a part-time remote position as an Online Task Contributor. In this role, you will evaluate and provide feedback on content to enhance search engine results and quality. No prior experience is needed, but proficiency in English and residency in the U.S. for the...QualityHourly payPart timeRemote workUniversity of Delaware
United States1 day ago$80 - $120 per hour
...Special Education Iep Evaluator This role is for one of our clients. Compensation: $80 - $120 per hour. We are hiring expert Evaluators... ...spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs....QualityHourly payRemote workWeekday
United States2 days ago- ...aMaryland Licensed Psychologistto join our growing behavioral health evaluation team. This flexible opportunity allows you toconduct... ...psychological testing results. Prepare comprehensive, court-quality evaluation reports with diagnoses and treatment recommendations...QualityReliefPrivate practiceRemote workFlexible hours
Shore Staffing Inc
Lexington Park, MD5 days ago - AuraOne is seeking an Odia Audio transcription Expert for a remote evaluation track to review audio annotation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write structured feedback for retraining the modeling...QualityRemote jobFor contractors
- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...QualityContract workTemporary workImmediate startRemote work
MERIT Beauty
New York, NY5 days ago - ...Luxury Brand Evaluator Turn your passion for luxury into a career opportunity. Explore the world of premium brands and make a lasting... ...your home. 3. Observe carefully - check the ambiance, service quality, and overall customer experience. 4. Provide honest feedback...QualityRemote workWorldwideFlexible hours
CXG
United States1 day ago - ...About the role Swahili Evaluation AI Evaluator is a remote evaluation track for reviewing swahili generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback...QualityHourly payFor contractorsRemote work10 hours per week
AI Trainer Jobs
New York, NY1 day ago - ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...QualityWork at officeRemote work
Obsidian
New York, NY3 days ago - ...Obsidian is hiring expert Evaluators in Real estate, hospitality, and events to review AI-generated work for accuracy, rigor, and domain quality. This remote position requires deep expertise and involves grading outputs like documents and presentations. Applicants...QualityWork at officeRemote work
Obsidian
San Francisco, CA2 days ago $14.5 per hour
...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years of experience in...QualityBi-weekly payHourly payPart timeImmediate startRemote workWork from homeFlexible hoursWelo Data
United States4 days ago- Rex.zone is seeking a Senior AI data annotator to perform data labeling and evaluation for NLP tasks, RLHF assessments, and prompt QA to improve training data quality and model performance. This is a US-based remote, full-time role aligned with Miami talent demand. You...QualityRemote jobFull time
$14.5 per hour
...companies to provide datasets that are high-quality, ethically sourced, relevant, diverse,... ...! Job Description As a Web Search Evaluator, you will play a key role in improving... ...modules and a required quality test designed by our client before starting work. *Please...QualityPart timeCurrently hiringImmediate startRemote workWork from home10 hours per weekFlexible hoursJobs for Humanity
United States2 days ago- AuraOne is seeking a remote Preference Dataset QA Reward Model Evaluator to review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and write structured feedback for the modeling team to retrain. As a contractor, you work...QualityRemote jobHourly payFor contractors
$52k - $57k
...POSITION TITLE: Program Evaluator REPORTS TO: Director of Quality BROAD FUNCTION: Collects, analyzes, and reports on data to evaluate effectiveness of program services. I. CORE VALUES: # CULTURAL PROFICIENCY: Articulates and applies historical context...QualityFull timeSummer workLocal areaFamily Connections
East Orange, NJ3 days ago$50 - $70 per hour
...Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for quality and correctness. Provide clear, well-reasoned written feedback and ratings. Compare and...QualityContract workSummer workRemote workFlexible hoursMercor
San Francisco, CA25 days ago- ...experts in Spreadsheet QA and workbook maintenance to review AI-generated documents, spreadsheets, and slide decks for accuracy and quality. This is a remote, hourly engagement. Ideal candidates have 5+ years in Spreadsheet QA, fluent English, and strong mastery of...QualityRemote jobHourly payWork at office
$20 per hour
...tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance... .... An ideal candidate will have a strong background in UI/UX design and excellent English skills. The position offers...Remote workFlexible hoursDataAnnotation
United States1 day ago- ...About the role We are hiring expert Evaluators in Data analysis / quantitative readouts to review and assess AI-generated work products... ..., and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs...QualityHourly payWork at officeRemote work
Mercor Inc
New York, NY2 days ago $20 per hour
...individuals for remote opportunities in training AI chatbots. Responsibilities include developing prompts, writing high-quality responses, and evaluating AI outputs. The ideal candidates are fluent in English with excellent writing skills. With a flexible schedule, pay...QualityHourly payRemote workFlexible hoursSupportFinity
United States1 day ago- Remolity, Inc. is seeking contributors for a paid study on image quality assessment and brand alignment. You will calibrate by judging... ...desktop. Ideal candidates are professional photographers or visual designers with 2+ years of experience, Photoshop proficiency, a portfolio...QualityRemote job
- ...leading customer experience firm is looking for luxury brand evaluators to assess customer experiences and provide feedback for various... ...allow you to engage both in-store and online, influencing the quality of service in luxury markets. Duties include visiting boutiques...QualityFlexible hours
- Obsidian is seeking expert Evaluators in Humanities / arts / culture to review AI-generated work products for accuracy, rigor, and domain quality. You will apply subject-matter expertise to grade outputs and provide structured feedback. This is a remote, hourly engagement...QualityRemote jobHourly payWork at office
$80 - $120 per hour
Incident management / reliability / SRE Evaluator is a remote engineering review track for evaluating production code, debugging traces,... ...fix so the modeling team can target the gap. Engineering model quality lives or dies on whether the generated code actually compiles,...QualityFor contractorsRemote work10 hours per week- ...Luxury Brand Evaluator CXG is a global Customer Experience consulting firm specializing exclusively in serving premium and luxury brands... ...home. 3. Observe carefully - check the ambiance, service quality, and overall customer experience. 4. Provide honest feedback...QualityWorldwideFlexible hours
- About the role Hindi Localization AI Evaluator is a remote evaluation track for reviewing hindi generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the...QualityHourly payFor contractorsRemote work10 hours per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to UI Design Quality Evaluator [Remote]. Be the first to apply!
