Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

UI Design Quality Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

UI Design Quality Evaluator is a remote review track for evaluating AI outputs across ui / ux design workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach so the modeling team can train on it.

Why this role matters

UI / UX design AI is only useful if a working professional would actually ship the output. AuraOne uses portfolio-credentialed reviewers to grade outputs the way a senior creative would — with craft, constraints, and tooling all in scope.

Responsibilities

  • Review AI outputs against current ui / ux design craft and tooling standards for UI Design Quality Evaluator assignments.
  • Grade composition, constraint adherence, and production-readiness on a structured rubric.
  • Flag tooling-specific failures (file format, scale, naming, layer hygiene) with severity tags.
  • Capture the corrected approach or reference so the modeling team can train on it.
  • Adjudicate disputed creative judgments against published references or firm style guides.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Portfolio or production experience in ui / ux design or an adjacent creative discipline for UI Design Quality Evaluator work.
  • Hands-on familiarity with the standard tooling for the discipline.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the craft issue and the standard being applied.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a model's ui / ux design output against the brief and rate craft, constraints, and production-readiness.
  • Flag a tooling-specific failure (incorrect file format, unsupported feature, naming convention) with severity.
  • Adjudicate a disputed creative judgment between two reviewers using a firm style guide.
  • Audit a 25-asset batch for rubric consistency and report drift to the program lead.

Nice to have

  • Studio, agency, or in-house team experience shipping production work.
  • Prior experience reviewing AI-assisted creative tooling and its failure modes.
  • Familiarity with AAA or feature-grade pipelines and asset standards.

Skills

  • Creative review
  • Production-grade craft
  • Tooling fluency
  • Asset evaluation
  • UI / UX design
  • Production quality
  • Design critique
  • Design

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 13 days ago
Similar jobs that could be interesting for youBased on the UI Design Quality Evaluator [Remote] in Remote vacancy
  • $40 per hour

    A cutting-edge AI design firm is seeking a Digital Designer to evaluate and enhance AI-generated designs. This role involves critiquing UI/UX visuals, assessing aesthetic quality, and contributing to various design-focused projects. Candidates should have a strong background... 
    Quality
    Remote work

    DataAnnotation

    Providence, RI
    2 days ago
  • $20 per hour

    A leading design technology firm is seeking an Experience Designer to enhance AI systems in understanding and generating...  ...and critique AI outputs and help refine design quality. Applicants should have a background in UI/UX and be fluent in English. This is a remote... 
    Quality
    Remote job

    DataAnnotation

    Nevada, IA
    4 days ago
  •  ...The Mental Health Evaluator (MHE) is a critical role dedicated to delivering comprehensive, clinically appropriate, culturally competent...  ...essential member of the interdisciplinary team to maintain high-quality patient care. The MHE reports to the Regional Program Manager... 
    Quality

    WMCHealth

    Kingston, NY
    10 hours ago
  •  ...preferred.Experience: Minimum of two years’ experience in the designated field of license, preferably with rehabilitation/LTACH and marketing...  ..., in 17 states. PAM Health is committed to providing high-quality patient care and outstanding customer service, coupled with... 
    Quality
    Full time
    Local area

    PAM Health

    Humble, TX
    2 days ago
  • $20 per hour

    A tech company is seeking a Receptionist to assist in training AI models. This role involves evaluating the logic of AI chatbots and ensuring quality in their outputs. Applicants should be fluent in English, detail-oriented, and possess strong writing skills. This position... 
    Quality
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  •  ...to increased self-sufficiency. We're currently looking for an Evaluator & Inspector for our WCCA Weatherization Program.The Evaluator /...  ...compared to original plans and inspects for both quantity and quality of work performed. The Evaluator and Inspector must conduct on-... 
    Quality
    Contract work
    For contractors
    Work experience placement
    Work at office
    Work from home

    Iowa Community Action Association - West Central Community A...

    Harlan, IA
    27 days ago
  •  ...Blueprint Technologies is looking for a Labeler/Annotator to evaluate AI-generated responses in French. The ideal candidate will have...  ...evaluating outputs for accuracy and relevance, and maintaining high-quality evaluations. This remote role offers competitive compensation... 
    Quality
    Local area
    Remote work

    BluePrint Technologies

    New York, NY
    1 day ago
  •  ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional... 
    Quality
    Work at office
    Remote work

    Obsidian

    New York, NY
    2 days ago
  •  ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers... 
    Quality
    Contract work
    Temporary work
    Immediate start
    Remote work

    MERIT Beauty

    New York, NY
    4 days ago
  • $45 - $85 per hour

     ...Ixolabs is seeking an Animation Quality Evaluator to refine AI-generated animations. The ideal candidate will evaluate motion fluidity and naturalness, ensuring animations convey believable narratives. The role is part-time (15-25 hours/week) and offers competitive compensation... 
    Quality
    Part time
    Remote work

    Ixolabs

    Washington DC
    1 day ago
  • $40 per hour

     ...data annotation service is seeking a Biology Expert to train AI models. The role involves measuring AI progress, evaluating chatbot outputs, and ensuring quality improvement. Ideal candidates will have a strong background in biology or biochemistry. This independent... 
    Quality
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    DataAnnotation

    Iowa, LA
    3 days ago
  • $14.5 per hour

     ...AI Web Search Evaluator Unlock the Power of the Internet! Are you curious, tech-savvy, and passionate about improving online search...  ...home. ~ Career Growth: Develop your analytical, research, and quality assessment skills. ~ Exclusive Perks: ~ Medical, Dental,... 
    Quality
    Bi-weekly pay
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Jobs for Humanity

    United States
    16 hours ago
  •  ...Prada, Versace, and more. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess...  ...your home. # Observe carefully - check the ambiance, service quality, and overall customer experience. # Provide honest feedback -... 
    Quality
    Contract work
    Worldwide
    Flexible hours

    CXG Group

    Atlanta, GA
    2 days ago
  • $40 per hour

     ...Physics Graduate Assistant to join their team in a remote position. The role involves training AI models by evaluating their outputs and improving their quality through complex physics problems. Candidates should have a strong grasp of classical mechanics, electromagnetism... 
    Quality
    Hourly pay
    Contract work
    Remote work

    DataAnnotation

    Indiana, PA
    3 days ago
  • $40 per hour

     ...Graduate Assistant to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert understanding of physics. Other related... 
    Quality
    Hourly pay
    Full time
    Contract work
    Part time
    Remote work

    DataAnnotation

    Charleston, WV
    3 days ago
  • $14.5 per hour

     ...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge...  ...learning modules and a required quality test designed by our client before starting work. *... 
    Quality
    Hourly pay
    Part time
    Currently hiring
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Jobs for Humanity

    United States
    1 day ago
  • $60 per hour

     ...state-of-the-art AI models on tasks like evaluating AI-generated security content, solving...  ...to $60 USD/hour, with bonuses for high-quality and high-volume work. Impact: help shape...  ...real-world accuracy and validity. Design and solve security-focused technical problems... 
    Quality
    Hourly pay
    Full time
    Remote work
    Flexible hours

    DataAnnotation

    Nevada, IA
    3 days ago
  • $20 per hour

    A leading data annotation firm is seeking a Web Designer to evaluate AI-generated designs and enhance their understanding of design principles....  ...schedule. Ideal candidates will have a strong background in UI/UX or web design and be fluent in English. Compensation starts... 
    Remote work

    DataAnnotation

    Wyoming, OH
    16 hours ago
  • $80 - $120 per hour

     .... Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location...  ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation... 
    Quality
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  •  ...leading tech company in Alabama is seeking a Marketing Designer to train and improve AI models by evaluating AI-generated designs. The role offers flexibility and...  ...project levels. Ideal candidates will possess strong UI/UX design skills and a good command of English,... 
    Remote work

    DataAnnotation

    El Paso, TX
    16 hours ago
  • $20 per hour

     ...technology firm in the United States is seeking a Digital Web Designer to evaluate AI-generated designs and enhance the model's understanding of...  ...starting at $20/hr. Candidates should have a background in UI/UX, fluency in English, and strong design principles understanding... 
    Remote work

    DataAnnotation

    Montgomery, AL
    3 days ago
  • $20 per hour

     ...leading AI training company is looking for an Experience Designer to improve AI model outputs by evaluating design work, including interfaces and visuals. This...  ...Applicants must be fluent in English with a background in UI/UX design. This independent contract opportunity is... 
    Contract work
    Remote work
    Flexible hours

    DataAnnotation

    Lincoln, NE
    3 days ago
  • $20 per hour

     ...tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance...  .... An ideal candidate will have a strong background in UI/UX design and excellent English skills. The position offers... 
    Remote work
    Flexible hours

    DataAnnotation

    Columbia, SC
    3 days ago
  • $20 per hour

    A leading technology company is seeking a Digital Designer to assess and improve AI-generated designs while working remotely. The role involves reviewing UI/UX outputs, providing critical feedback, and training AI models to enhance aesthetics and usability. Candidates... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Florida, NY
    3 days ago
  • $25 - $30 per hour

    DataAnnotation is seeking contractors to assist in training AI chatbots. This flexible role allows you to choose projects based on your schedule while working from home. Ideal candidates will manage business communications and possess excellent writing and research skills...
    Quality
    Hourly pay
    For contractors
    Remote work
    Work from home
    Flexible hours

    DataAnnotation

    Indiana, PA
    4 days ago
  •  ...freelancers to contract as independent contractors. In this role, you will develop prompts to train AI chatbots, write quality responses, and evaluate AI model outputs. This position, ideal for business professionals, permits flexible hours between 5-40 per week and pays... 
    Quality
    Hourly pay
    Contract work
    For contractors
    Freelance
    Remote work
    Flexible hours

    DataAnnotation

    Wausau, WI
    4 days ago
  • $25 - $30 per hour

     ...independent contractor role. As a key contributor, you will help train AI chatbots by developing complex prompts, writing high-quality responses, and evaluating AI outputs. Ideal candidates will manage their own schedules, with pay starting at $25-$30+ per hour. This... 
    Quality
    Hourly pay
    For contractors
    Freelance
    Remote work
    Work from home
    Flexible hours

    DataAnnotation

    Florida, NY
    4 days ago
  • $25 - $30 per hour

     ...contractor role allows you to work from home and choose your own projects. Candidates will develop prompts, write responses, and evaluate AI models. Ideal for those experienced in business communication, this position requires strong writing and research skills, along... 
    Quality
    Hourly pay
    For contractors
    Remote work
    Work from home

    DataAnnotation

    Louisiana, MO
    3 days ago
  •  ...DataAnnotation is seeking independent contractors to help train AI chatbots, developing prompts and evaluating model outputs. This role allows for flexible hours between 5-40 per week, ideally suited for detail-oriented professionals experienced in business communications... 
    Quality
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  • $25 - $30 per hour

     ...pay starting at $25 to $30+ per hour and bonuses on select projects. The role involves developing prompts, writing high-quality responses, and evaluating AI outputs. Applicants must be fluent in English and preferably have a bachelor’s degree or be in progress. #J-18808-... 
    Quality
    Hourly pay
    For contractors
    Remote work
    Work from home

    DataAnnotation

    Virginia, MN
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to UI Design Quality Evaluator [Remote]. Be the first to apply!