UI Design Quality Evaluator [Remote]
AuraOne Human Data
- Remote job
UI Design Quality Evaluator is a remote review track for evaluating AI outputs across ui / ux design workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach so the modeling team can train on it.
Why this role matters
UI / UX design AI is only useful if a working professional would actually ship the output. AuraOne uses portfolio-credentialed reviewers to grade outputs the way a senior creative would — with craft, constraints, and tooling all in scope.
Responsibilities
- Review AI outputs against current ui / ux design craft and tooling standards for UI Design Quality Evaluator assignments.
- Grade composition, constraint adherence, and production-readiness on a structured rubric.
- Flag tooling-specific failures (file format, scale, naming, layer hygiene) with severity tags.
- Capture the corrected approach or reference so the modeling team can train on it.
- Adjudicate disputed creative judgments against published references or firm style guides.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Portfolio or production experience in ui / ux design or an adjacent creative discipline for UI Design Quality Evaluator work.
- Hands-on familiarity with the standard tooling for the discipline.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the craft issue and the standard being applied.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Grade a model's ui / ux design output against the brief and rate craft, constraints, and production-readiness.
- Flag a tooling-specific failure (incorrect file format, unsupported feature, naming convention) with severity.
- Adjudicate a disputed creative judgment between two reviewers using a firm style guide.
- Audit a 25-asset batch for rubric consistency and report drift to the program lead.
Nice to have
- Studio, agency, or in-house team experience shipping production work.
- Prior experience reviewing AI-assisted creative tooling and its failure modes.
- Familiarity with AAA or feature-grade pipelines and asset standards.
Skills
- Creative review
- Production-grade craft
- Tooling fluency
- Asset evaluation
- UI / UX design
- Production quality
- Design critique
- Design
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
- ...preferred.Experience: Minimum of two years’ experience in the designated field of license, preferably with rehabilitation/LTACH and marketing... ..., in 17 states. PAM Health is committed to providing high-quality patient care and outstanding customer service, coupled with...QualityFull timeLocal area
- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...QualityContract workTemporary workImmediate startRemote work
- ...Dutch Bilingual Expert for a remote, contractor role. You will evaluate AI-generated Dutch speech, assess nativeness and accuracy, and... ...detail. This independent, remote position offers flexible scheduling and focus on language quality assessment. #J-18808-Ljbffr YO AI LabsQualityRemote jobFor contractorsFlexible hours
$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...QualityHourly payPart timeRemote workFlexible hours- Dorado is seeking expert Evaluators in market research / competitive intelligence to review AI-generated work products for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs. This is a remote, hourly engagement. Requirements...QualityRemote jobHourly payWork at office
- ...Hebrew Bilingual Expert to contribute to a language and AI training project focused on Hebrew audio evaluation. You will assess nativeness, fluency, and linguistic quality, and provide feedback to help improve model understanding and generation. The role is remote and...QualityRemote jobContract work
- YO AI Labs seeks Hebrew bilingual experts to contribute to an AI training project by evaluating Hebrew audio content and assessing linguistic quality. You will provide detailed feedback on nativeness, fluency, pronunciation, and authenticity, with clear explanations in...QualityRemote jobFor contractorsFlexible hours
- YO AI Labs is seeking a Thai Bilingual Expert to evaluate Thai audio content for quality and authenticity on a remote basis. You will assess nativeness, fluency, pronunciation, and linguistic accuracy, while documenting feedback in English. No AI experience is required;...QualityRemote jobFor contractorsFlexible hours
- ...Labs is seeking Polish Bilingual Experts to contribute to an AI training project by evaluating Polish audio content and providing feedback on nativeness, fluency, and linguistic quality. You will document assessments in English, follow guidelines, and collaborate with project...QualityRemote job
- Dorado is seeking an AI Language Quality Evaluator fluent in Greek and English for an ongoing, task-based project. This remote freelance role involves reviewing translated and AI-flagged content to judge accuracy, classify issues, and suggest corrected translations. You...QualityRemote jobFor contractorsFreelanceFlexible hours
- ...experts to contribute to an AI training project focused on Tamil language understanding and generation. You will evaluate Tamil audio content, assess linguistic quality, and provide detailed feedback based on established guidelines. No prior AI experience is required; strong...QualityRemote job
- Unknown is seeking a Polish Bilingual Expert (contractor) to evaluate Polish audio content for AI training. The role emphasizes nativeness, fluency, and linguistic quality, with feedback delivered in English. Strong Polish language skills and clear written and verbal English...QualityRemote jobFor contractors
- ...language and AI training project focused on improving Italian-language understanding and generation. You will evaluate Italian audio content, assess linguistic quality, and provide detailed feedback based on guidelines. No prior AI experience is required. Strong Italian...QualityRemote jobFor contractors
- ...experts in Spreadsheet QA and workbook maintenance to review AI-generated documents, spreadsheets, and slide decks for accuracy and quality. This is a remote, hourly engagement. Ideal candidates have 5+ years in Spreadsheet QA, fluent English, and strong mastery of...QualityRemote jobHourly payWork at office
- ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...QualityWork at officeRemote work
- Mercor is seeking expert Evaluators in Legal/compliance to review AI-generated documents, spreadsheets, and slide decks for accuracy and quality. This is a remote, hourly engagement requiring deep subject-matter expertise and careful judgment. You will assess artifacts...QualityRemote jobHourly payWork at office
- YO AI Labs is seeking Tamil bilingual experts to contribute to language and AI training projects focused on evaluating Tamil audio quality and linguistic authenticity. You will assess nativeness, fluency, pronunciation, and overall accuracy, providing clear feedback in...QualityRemote job
- ...bilingual experts for a remote, contract-based role focused on evaluating Polish audio content and providing detailed feedback to... ...communication skills, and meticulous attention to linguistic quality, with the ability to follow established guidelines and deliver...QualityRemote jobContract work
- ...Mental Health Evaluator The Mental Health Evaluator is a critical role dedicated to delivering comprehensive, clinically appropriate... ...essential member of the interdisciplinary team to maintain high-quality patient care. The MHE reports to the Regional Program Manager for...Quality
- ...Web Browsing Evaluator Contractor Remote Micro1 is engaging Web Browsing Evaluators to contribute high-quality web interaction data for a valued customer project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will...QualityFor contractorsRemote work
$20 per hour
...tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance... .... An ideal candidate will have a strong background in UI/UX design and excellent English skills. The position offers...Remote workFlexible hours$80 - $120 per hour
...Special Education Iep Evaluator This role is for one of our clients. Compensation: $80 - $120 per hour. We are hiring expert Evaluators... ...spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs....QualityHourly payRemote work$80 - $120 per hour
...Compensation: $80 - $120 per hour We are hiring expert Evaluators in Special education / IEP to review and assess AI-generated... ...spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs...QualityHourly payContract workFor contractorsWork at officeRemote work- ...Luxury Brand Evaluator CXG is a global Customer Experience consulting firm specializing exclusively in serving premium and luxury brands... ...home. 3. Observe carefully - check the ambiance, service quality, and overall customer experience. 4. Provide honest feedback...QualityWorldwideFlexible hours
- ...seeking Dutch bilingual experts to contribute to a global language and AI training project. You will evaluate AI-generated Dutch speech, assess nativeness and quality, and provide detailed feedback to help improve language models. This remote contractor role requires native...QualityRemote jobFor contractors
- ...Luxury Brand Evaluator Turn your passion for luxury into a career opportunity. Explore the world of premium brands and make a lasting... ...your home. 3. Observe carefully - check the ambiance, service quality, and overall customer experience. 4. Provide honest feedback...QualityWorldwideFlexible hours
- Obsidian is seeking expert Evaluators in Biology/environmental science to review and assess AI-generated work products for accuracy and quality. In this remote, hourly role, you will leverage your expertise to provide feedback on documents and presentations, ensuring they...QualityRemote jobHourly pay
- Mercor is seeking expert Evaluators in Humanities / arts / culture to review AI-generated work products for accuracy, rigor, and domain quality. This remote hourly engagement requires deep subject-matter expertise to grade outputs and provide actionable feedback. Candidates...QualityRemote jobHourly payWork at office
- ...oriented AI Analysts based in the United States for a Google Wallet evaluation project. This role allows you to engage with advanced AI tools... ...of AI. You will evaluate model responses, review output quality, and provide structured feedback. The position is a full-time...QualityRemote jobFull timeContract work
$20 - $30 per hour
...focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI... ..., and providing actionable feedback to enhance product quality. Ideal candidates will have strong analytical skills, attention...QualityRemote jobHourly pay
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to UI Design Quality Evaluator [Remote]. Be the first to apply!

