Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

UI Design Quality Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

UI Design Quality Evaluator is a remote review track for evaluating AI outputs across ui / ux design workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach so the modeling team can train on it.

Why this role matters

UI / UX design AI is only useful if a working professional would actually ship the output. AuraOne uses portfolio-credentialed reviewers to grade outputs the way a senior creative would — with craft, constraints, and tooling all in scope.

Responsibilities

  • Review AI outputs against current ui / ux design craft and tooling standards for UI Design Quality Evaluator assignments.
  • Grade composition, constraint adherence, and production-readiness on a structured rubric.
  • Flag tooling-specific failures (file format, scale, naming, layer hygiene) with severity tags.
  • Capture the corrected approach or reference so the modeling team can train on it.
  • Adjudicate disputed creative judgments against published references or firm style guides.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Portfolio or production experience in ui / ux design or an adjacent creative discipline for UI Design Quality Evaluator work.
  • Hands-on familiarity with the standard tooling for the discipline.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the craft issue and the standard being applied.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a model's ui / ux design output against the brief and rate craft, constraints, and production-readiness.
  • Flag a tooling-specific failure (incorrect file format, unsupported feature, naming convention) with severity.
  • Adjudicate a disputed creative judgment between two reviewers using a firm style guide.
  • Audit a 25-asset batch for rubric consistency and report drift to the program lead.

Nice to have

  • Studio, agency, or in-house team experience shipping production work.
  • Prior experience reviewing AI-assisted creative tooling and its failure modes.
  • Familiarity with AAA or feature-grade pipelines and asset standards.

Skills

  • Creative review
  • Production-grade craft
  • Tooling fluency
  • Asset evaluation
  • UI / UX design
  • Production quality
  • Design critique
  • Design

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the UI Design Quality Evaluator [Remote] in Remote vacancy
  •  ...preferred.Experience: Minimum of two years’ experience in the designated field of license, preferably with rehabilitation/LTACH and marketing...  ..., in 17 states. PAM Health is committed to providing high-quality patient care and outstanding customer service, coupled with... 
    Quality
    Full time
    Local area

    PAM Health

    Humble, TX
    2 days ago
  •  ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers... 
    Quality
    Contract work
    Temporary work
    Immediate start
    Remote work

    MERIT Beauty

    New York, NY
    1 day ago
  •  ...Dutch Bilingual Expert for a remote, contractor role. You will evaluate AI-generated Dutch speech, assess nativeness and accuracy, and...  ...detail. This independent, remote position offers flexible scheduling and focus on language quality assessment. #J-18808-Ljbffr YO AI Labs
    Quality
    Remote job
    For contractors
    Flexible hours

    YO AI Labs

    San Francisco, CA
    2 days ago
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical... 
    Quality
    Hourly pay
    Part time
    Remote work
    Flexible hours

    Welo Data

    United States
    1 day ago
  • Dorado is seeking expert Evaluators in market research / competitive intelligence to review AI-generated work products for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs. This is a remote, hourly engagement. Requirements... 
    Quality
    Remote job
    Hourly pay
    Work at office

    Dorado

    New York, NY
    2 days ago
  •  ...Hebrew Bilingual Expert to contribute to a language and AI training project focused on Hebrew audio evaluation. You will assess nativeness, fluency, and linguistic quality, and provide feedback to help improve model understanding and generation. The role is remote and... 
    Quality
    Remote job
    Contract work

    YO AI Labs

    San Francisco, CA
    2 days ago
  • YO AI Labs seeks Hebrew bilingual experts to contribute to an AI training project by evaluating Hebrew audio content and assessing linguistic quality. You will provide detailed feedback on nativeness, fluency, pronunciation, and authenticity, with clear explanations in... 
    Quality
    Remote job
    For contractors
    Flexible hours

    YO AI Labs

    Los Angeles, CA
    2 days ago
  • YO AI Labs is seeking a Thai Bilingual Expert to evaluate Thai audio content for quality and authenticity on a remote basis. You will assess nativeness, fluency, pronunciation, and linguistic accuracy, while documenting feedback in English. No AI experience is required;... 
    Quality
    Remote job
    For contractors
    Flexible hours

    YO AI Labs

    Boston, MA
    2 days ago
  •  ...Labs is seeking Polish Bilingual Experts to contribute to an AI training project by evaluating Polish audio content and providing feedback on nativeness, fluency, and linguistic quality. You will document assessments in English, follow guidelines, and collaborate with project... 
    Quality
    Remote job

    YO AI Labs

    Austin, TX
    2 days ago
  • Dorado is seeking an AI Language Quality Evaluator fluent in Greek and English for an ongoing, task-based project. This remote freelance role involves reviewing translated and AI-flagged content to judge accuracy, classify issues, and suggest corrected translations. You... 
    Quality
    Remote job
    For contractors
    Freelance
    Flexible hours

    Dorado

    Brooklyn, NY
    2 days ago
  •  ...experts to contribute to an AI training project focused on Tamil language understanding and generation. You will evaluate Tamil audio content, assess linguistic quality, and provide detailed feedback based on established guidelines. No prior AI experience is required; strong... 
    Quality
    Remote job

    YO AI Labs

    Dallas, TX
    2 days ago
  • Unknown is seeking a Polish Bilingual Expert (contractor) to evaluate Polish audio content for AI training. The role emphasizes nativeness, fluency, and linguistic quality, with feedback delivered in English. Strong Polish language skills and clear written and verbal English... 
    Quality
    Remote job
    For contractors

    YO AI Labs

    Annapolis, MD
    2 days ago
  •  ...language and AI training project focused on improving Italian-language understanding and generation. You will evaluate Italian audio content, assess linguistic quality, and provide detailed feedback based on guidelines. No prior AI experience is required. Strong Italian... 
    Quality
    Remote job
    For contractors

    YO AI Labs

    New York, NY
    2 days ago
  •  ...experts in Spreadsheet QA and workbook maintenance to review AI-generated documents, spreadsheets, and slide decks for accuracy and quality. This is a remote, hourly engagement. Ideal candidates have 5+ years in Spreadsheet QA, fluent English, and strong mastery of... 
    Quality
    Remote job
    Hourly pay
    Work at office

    Mercor

    Miami, FL
    1 day ago
  •  ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional... 
    Quality
    Work at office
    Remote work

    Obsidian

    New York, NY
    3 days ago
  • Mercor is seeking expert Evaluators in Legal/compliance to review AI-generated documents, spreadsheets, and slide decks for accuracy and quality. This is a remote, hourly engagement requiring deep subject-matter expertise and careful judgment. You will assess artifacts... 
    Quality
    Remote job
    Hourly pay
    Work at office

    Mercor

    San Francisco, CA
    16 hours ago
  • YO AI Labs is seeking Tamil bilingual experts to contribute to language and AI training projects focused on evaluating Tamil audio quality and linguistic authenticity. You will assess nativeness, fluency, pronunciation, and overall accuracy, providing clear feedback in... 
    Quality
    Remote job

    YO AI Labs

    Washington DC
    2 days ago
  •  ...bilingual experts for a remote, contract-based role focused on evaluating Polish audio content and providing detailed feedback to...  ...communication skills, and meticulous attention to linguistic quality, with the ability to follow established guidelines and deliver... 
    Quality
    Remote job
    Contract work

    YO AI Labs

    Miami, FL
    2 days ago
  •  ...Mental Health Evaluator The Mental Health Evaluator is a critical role dedicated to delivering comprehensive, clinically appropriate...  ...essential member of the interdisciplinary team to maintain high-quality patient care. The MHE reports to the Regional Program Manager for... 
    Quality

    Maria Fareri Children's Hospital, a member of the WMCHealth ...

    Poughkeepsie, NY
    1 day ago
  •  ...Web Browsing Evaluator Contractor Remote Micro1 is engaging Web Browsing Evaluators to contribute high-quality web interaction data for a valued customer project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will... 
    Quality
    For contractors
    Remote work

    ESR Healthcare

    New York, NY
    1 day ago
  • $20 per hour

     ...tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance...  .... An ideal candidate will have a strong background in UI/UX design and excellent English skills. The position offers... 
    Remote work
    Flexible hours

    DataAnnotation

    United States
    4 days ago
  • $80 - $120 per hour

     ...Special Education Iep Evaluator This role is for one of our clients. Compensation: $80 - $120 per hour. We are hiring expert Evaluators...  ...spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs.... 
    Quality
    Hourly pay
    Remote work

    Weekday

    United States
    2 days ago
  • $80 - $120 per hour

     ...Compensation: $80 - $120 per hour We are hiring expert Evaluators in  Special education / IEP  to review and assess AI-generated...  ...spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs... 
    Quality
    Hourly pay
    Contract work
    For contractors
    Work at office
    Remote work

    Weekday AI

    United States
    1 day ago
  •  ...Luxury Brand Evaluator CXG is a global Customer Experience consulting firm specializing exclusively in serving premium and luxury brands...  ...home. 3. Observe carefully - check the ambiance, service quality, and overall customer experience. 4. Provide honest feedback... 
    Quality
    Worldwide
    Flexible hours

    CXG

    Atlanta, GA
    3 days ago
  •  ...seeking Dutch bilingual experts to contribute to a global language and AI training project. You will evaluate AI-generated Dutch speech, assess nativeness and quality, and provide detailed feedback to help improve language models. This remote contractor role requires native... 
    Quality
    Remote job
    For contractors

    YO AI Labs

    Atlanta, GA
    2 days ago
  •  ...Luxury Brand Evaluator Turn your passion for luxury into a career opportunity. Explore the world of premium brands and make a lasting...  ...your home. 3. Observe carefully - check the ambiance, service quality, and overall customer experience. 4. Provide honest feedback... 
    Quality
    Worldwide
    Flexible hours

    CXG

    Los Angeles, CA
    1 day ago
  • Obsidian is seeking expert Evaluators in Biology/environmental science to review and assess AI-generated work products for accuracy and quality. In this remote, hourly role, you will leverage your expertise to provide feedback on documents and presentations, ensuring they... 
    Quality
    Remote job
    Hourly pay

    Obsidian

    San Francisco, CA
    3 days ago
  • Mercor is seeking expert Evaluators in Humanities / arts / culture to review AI-generated work products for accuracy, rigor, and domain quality. This remote hourly engagement requires deep subject-matter expertise to grade outputs and provide actionable feedback. Candidates... 
    Quality
    Remote job
    Hourly pay
    Work at office

    Mercor Inc

    San Francisco, CA
    4 days ago
  •  ...oriented AI Analysts based in the United States for a Google Wallet evaluation project. This role allows you to engage with advanced AI tools...  ...of AI. You will evaluate model responses, review output quality, and provide structured feedback. The position is a full-time... 
    Quality
    Remote job
    Full time
    Contract work

    Turing

    Seattle, WA
    3 days ago
  • $20 - $30 per hour

     ...focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI...  ..., and providing actionable feedback to enhance product quality. Ideal candidates will have strong analytical skills, attention... 
    Quality
    Remote job
    Hourly pay

    Crossing Hurdles

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to UI Design Quality Evaluator [Remote]. Be the first to apply!