Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

UI Design Quality Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

UI Design Quality Evaluator is a remote review track for evaluating AI outputs across ui / ux design workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach so the modeling team can train on it.

Why this role matters

UI / UX design AI is only useful if a working professional would actually ship the output. AuraOne uses portfolio-credentialed reviewers to grade outputs the way a senior creative would — with craft, constraints, and tooling all in scope.

Responsibilities

  • Review AI outputs against current ui / ux design craft and tooling standards for UI Design Quality Evaluator assignments.
  • Grade composition, constraint adherence, and production-readiness on a structured rubric.
  • Flag tooling-specific failures (file format, scale, naming, layer hygiene) with severity tags.
  • Capture the corrected approach or reference so the modeling team can train on it.
  • Adjudicate disputed creative judgments against published references or firm style guides.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Portfolio or production experience in ui / ux design or an adjacent creative discipline for UI Design Quality Evaluator work.
  • Hands-on familiarity with the standard tooling for the discipline.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the craft issue and the standard being applied.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a model's ui / ux design output against the brief and rate craft, constraints, and production-readiness.
  • Flag a tooling-specific failure (incorrect file format, unsupported feature, naming convention) with severity.
  • Adjudicate a disputed creative judgment between two reviewers using a firm style guide.
  • Audit a 25-asset batch for rubric consistency and report drift to the program lead.

Nice to have

  • Studio, agency, or in-house team experience shipping production work.
  • Prior experience reviewing AI-assisted creative tooling and its failure modes.
  • Familiarity with AAA or feature-grade pipelines and asset standards.

Skills

  • Creative review
  • Production-grade craft
  • Tooling fluency
  • Asset evaluation
  • UI / UX design
  • Production quality
  • Design critique
  • Design

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the UI Design Quality Evaluator [Remote] in Remote vacancy
  •  ...Alignerr is seeking Search Quality Evaluators (AI Training) to assess search results, AI-generated answers, and recommendations. This remote, hourly contract offers flexible 10–40 hours per week and the opportunity to contribute to reliable AI information delivery. You... 
    Quality
    Hourly pay
    Contract work
    Remote work
    10 hours per week
    Flexible hours

    Alignerr Corp.

    United States
    4 days ago
  •  ...The Mental Health Evaluator (MHE) is a critical role dedicated to delivering comprehensive, clinically appropriate, culturally competent...  ...essential member of the interdisciplinary team to maintain high-quality patient care. The MHE reports to the Regional Program Manager... 
    Quality

    Westchester Medical Center Health Network

    Kingston, OK
    4 days ago
  •  ...high volume of English-speaking freelancers based in the United States to support an AI evaluation project focused on assessing the relevance, usefulness, reliability, and overall quality of online search results. Freelancers will review webpages presented in response to... 
    Quality
    Contract work
    Freelance
    Immediate start

    Lifted, an Upwork Company™

    Remote
    7 days ago
  •  ...Pharmacovigilance Safety Evaluator is a remote evaluation track for reviewing pharmacovigilance safety evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the... 
    Quality
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne, Inc.

    New York, NY
    4 days ago
  •  ...Overview Role Summary: Seeking experienced Qualified Medical Evaluators (QMEs) and California-licensed physicians interested in...  ...and administrative preparation Historian Services Report quality assurance support Report submission assistance Tracking... 
    Quality
    Contract work
    For contractors
    Remote work
    Flexible hours

    Dane Street, LLC

    California
    21 days ago
  •  ...aMaryland Licensed Psychologistto join our growing behavioral health evaluation team. This flexible opportunity allows you toconduct...  ...psychological testing results. Prepare comprehensive, court-quality evaluation reports with diagnoses and treatment recommendations... 
    Quality
    Relief
    Private practice
    Remote work
    Flexible hours

    Shore Staffing Inc

    Lexington Park, MD
    3 days ago
  •  ...Professional Qualification Evaluator (PQE) Location: Onsite/Remote - Martinsburg, WV Schedule: Full-Time Salary Range: To be determined...  ...with applicable Government procedures. Meet established quality and production standards for application evaluations.... 
    Quality
    Full time
    Contract work
    Local area
    Remote work

    Akhiok-Kaguyak, Inc. / Sugpiat Family of Companies

    Remote
    15 days ago
  • $14.5 per hour

     ...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data... 
    Quality
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Welo Data

    New York, NY
    2 days ago
  •  ...Eligible No Major Duties As a Program Evaluator you will be responsible for the...  ...logistics and program shortfalls, and ensures quality control and compliance across...  ...Essential (EE) position. The incumbent will be designated Non-Combat Essential (NCE). In the event... 
    Quality
    Full time
    Contract work
    Temporary work
    For contractors
    Remote work

    Defense Logistics Agency

    Arlington, VA
    2 days ago
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical... 
    Quality
    Hourly pay
    Part time
    Remote work
    Flexible hours

    Welo Data

    United States
    4 days ago
  • $30 - $45 per hour

     ...Job Description: Web Browsing Evaluator remote $30 - $45/hour pay Required Skills Attention to Detail Data Annotation...  ...micro1 is engaging Web Browsing Evaluators to contribute high-quality web interaction data for a valued customer project. In this... 
    Quality
    For contractors
    Remote work

    ESR Healthcare

    United States
    4 days ago
  • $14.5 per hour

     ...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years of experience in... 
    Quality
    Bi-weekly pay
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Welo Data

    United States
    2 days ago
  • $14 per hour

    TELUS Digital is seeking individuals for a remote, freelance Content Reviewer role focused on evaluating online content for search quality. You will rate text, images, and webpages to improve AI-powered search results. No prior experience required beyond meeting basic... 
    Quality
    Remote job
    Hourly pay
    For contractors
    Freelance
    Flexible hours

    TELUS Digital

    New York, NY
    3 days ago
  •  ...DecisionPoint is seeking a Planning Evaluator to join our team in Atlanta, GA, to provide...  ...on mixed-methods tools. Design evaluation to meet agency responses and...  ...outcomes. Monitor and assess data quality, integrity, and completeness. Collaborate... 
    Quality
    For contractors
    Work at office
    Local area
    Remote work

    Decisionpoint Corporation

    Atlanta, GA
    4 days ago
  • $70 - $120 per hour

     ...Generalist: Modeling, Rigging & Animation (AI Evaluation)] Type: Full-Time Compensation...  ...realistic production tasks, and develop quality standards that improve generative AI...  ..., and product visualization. Design real-world 3D tasks based on studio and... 
    Quality
    Hourly pay
    Full time
    Remote work
    Weekday work

    Synthires

    United States
    1 day ago
  • $80 - $120 per hour

     ...Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour...  ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation... 
    Quality
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    19 days ago
  • $80k - $130k

     ...DoAs a Project - Program Analytics & Insights Evaluator II on the project, you will be responsible for:Supporting the design and implementation of large, multi-site...  ...evaluation design, data collection methods, data quality, data management, analysis, and reportingManaging... 
    Quality
    Local area

    Deloitte

    Atlanta, GA
    1 day ago
  •  ...Luxury Brand Evaluator Turn your passion for luxury into a career opportunity. Explore the world of premium brands and make a lasting...  ...your home. 3. Observe carefully - check the ambiance, service quality, and overall customer experience. 4. Provide honest feedback... 
    Quality
    Worldwide
    Flexible hours

    CXG

    Washington DC
    2 days ago
  • AI Trainer Jobs seeks a Hindi Language Expert for a remote evaluation track. Review Hindi prompts and responses, compare paired outputs...  ...Data, and calibrate against gold standards to maintain reviewer quality. This contractor role offers flexible hours and program-driven... 
    Quality
    Remote job
    For contractors
    Flexible hours

    AuraOne

    New York, NY
    1 day ago
  •  ...explain in writing what looked off, working remotely on your own schedule. Contributors review outputs for realism, adherence, and quality, and earn compensation per hour with flexible hours and weekly payments. Access to leading LLMs is included, making this a compelling... 
    Quality
    Hourly pay
    Weekly pay
    Remote work
    Flexible hours

    Outlier

    Oklahoma City, OK
    21 hours ago
  • $30 - $40 per hour

    OpenTrain AI, Inc. is seeking a Passport Application AI Evaluation Expert for a remote, short-term contract. You will review passport questions for realism, create rubrics for accurate answers, and define evaluation standards for identity documents, renewals, and minors... 
    Quality
    Remote job
    Hourly pay
    Temporary work

    OpenTrain AI, Inc.

    Brooklyn, NY
    2 days ago
  •  ...compare image and video pairs, and explain what’s off, all remotely and on your own schedule. You will rate outputs on adherence, quality, and realism, write concise explanations in English, and contribute to improving AI that powers real-world applications. Ideal candidates... 
    Quality
    Remote job

    Outlier

    Naperville, IL
    21 hours ago
  •  ...practicing physicians (MD/DO) with an active, unrestricted US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. You will review vignettes, score reasoning quality, and write concise rationales to improve AI tools used in healthcare.... 
    Quality
    Remote job
    10 hours per week

    Mindrift

    New York, NY
    1 day ago
  • $20 - $30 per hour

     ...focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI...  ..., and providing actionable feedback to enhance product quality. Ideal candidates will have strong analytical skills, attention... 
    Quality
    Remote job
    Hourly pay

    Crossing Hurdles

    New York, NY
    21 hours ago
  • Meridial is seeking independent contractor experts to evaluate AI-generated outputs focusing on JSON structure, formatting accuracy, and response quality. You will review responses for clarity, accuracy, and technical soundness, ensuring alignment with project guidelines... 
    Quality
    Contract work
    For contractors
    Remote work

    Meridial

    New York, NY
    1 day ago
  • $40 per hour

    Talantir is seeking a remote contractor to work on evaluating AI chatbots. You will be given coding challenges for AI chatbots and assess...  ...hourly starting at $40+ USD per hour, with bonuses for high-quality and high-volume work. This independent contract role lets you... 
    Quality
    Remote job
    Hourly pay
    Contract work
    For contractors

    DataAnnotation

    Sacramento, CA
    21 hours ago
  • CXG is seeking a luxury brand evaluator in Florida to discreetly assess customer experiences across boutiques or online channels. You will...  ...visit stores or evaluate online, observe ambiance and service quality, and share honest feedback to help brands refine their... 
    Quality
    Worldwide
    Flexible hours

    CXG

    West Palm Beach, FL
    1 day ago
  •  ...veterans. This non-treating role reviews medical records, conducts evaluations, and completes VA DBQs through a secure online portal to...  ...documentation and timely submission of findings while maintaining high quality and objectivity for veteran clients. #J-18808-Ljbffr MRG... 
    Quality
    Part time
    1 day per week

    MRG Exams

    Los Angeles, CA
    3 days ago
  • US Remote About the role Web Browsing Evaluator is a remote evaluation track for reviewing web browsing evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the... 
    Quality
    Remote work
    10 hours per week

    AuraOne Human Data

    New York, NY
    4 days ago
  • CXG is seeking evaluators in the United States to visit luxury stores or assess online experiences. You will observe ambiance and service quality, then provide honest feedback via our mobile platform. Assignments are flexible, with potential reimbursement for approved... 
    Quality
    Flexible hours

    CXG

    Marietta, GA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to UI Design Quality Evaluator [Remote]. Be the first to apply!