UI Design Quality Evaluator [Remote]
AuraOne Human Data
- Remote job
UI Design Quality Evaluator is a remote review track for evaluating AI outputs across ui / ux design workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach so the modeling team can train on it.
Why this role matters
UI / UX design AI is only useful if a working professional would actually ship the output. AuraOne uses portfolio-credentialed reviewers to grade outputs the way a senior creative would — with craft, constraints, and tooling all in scope.
Responsibilities
- Review AI outputs against current ui / ux design craft and tooling standards for UI Design Quality Evaluator assignments.
- Grade composition, constraint adherence, and production-readiness on a structured rubric.
- Flag tooling-specific failures (file format, scale, naming, layer hygiene) with severity tags.
- Capture the corrected approach or reference so the modeling team can train on it.
- Adjudicate disputed creative judgments against published references or firm style guides.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Portfolio or production experience in ui / ux design or an adjacent creative discipline for UI Design Quality Evaluator work.
- Hands-on familiarity with the standard tooling for the discipline.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the craft issue and the standard being applied.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Grade a model's ui / ux design output against the brief and rate craft, constraints, and production-readiness.
- Flag a tooling-specific failure (incorrect file format, unsupported feature, naming convention) with severity.
- Adjudicate a disputed creative judgment between two reviewers using a firm style guide.
- Audit a 25-asset batch for rubric consistency and report drift to the program lead.
Nice to have
- Studio, agency, or in-house team experience shipping production work.
- Prior experience reviewing AI-assisted creative tooling and its failure modes.
- Familiarity with AAA or feature-grade pipelines and asset standards.
Skills
- Creative review
- Production-grade craft
- Tooling fluency
- Asset evaluation
- UI / UX design
- Production quality
- Design critique
- Design
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
$40 per hour
A cutting-edge AI design firm is seeking a Digital Designer to evaluate and enhance AI-generated designs. This role involves critiquing UI/UX visuals, assessing aesthetic quality, and contributing to various design-focused projects. Candidates should have a strong background...QualityRemote work$20 per hour
A leading design technology firm is seeking an Experience Designer to enhance AI systems in understanding and generating... ...and critique AI outputs and help refine design quality. Applicants should have a background in UI/UX and be fluent in English. This is a remote...QualityRemote job- ...The Mental Health Evaluator (MHE) is a critical role dedicated to delivering comprehensive, clinically appropriate, culturally competent... ...essential member of the interdisciplinary team to maintain high-quality patient care. The MHE reports to the Regional Program Manager...Quality
- ...preferred.Experience: Minimum of two years’ experience in the designated field of license, preferably with rehabilitation/LTACH and marketing... ..., in 17 states. PAM Health is committed to providing high-quality patient care and outstanding customer service, coupled with...QualityFull timeLocal area
$20 per hour
A tech company is seeking a Receptionist to assist in training AI models. This role involves evaluating the logic of AI chatbots and ensuring quality in their outputs. Applicants should be fluent in English, detail-oriented, and possess strong writing skills. This position...QualityHourly payRemote workFlexible hours- ...to increased self-sufficiency. We're currently looking for an Evaluator & Inspector for our WCCA Weatherization Program.The Evaluator /... ...compared to original plans and inspects for both quantity and quality of work performed. The Evaluator and Inspector must conduct on-...QualityContract workFor contractorsWork experience placementWork at officeWork from home
- ...Blueprint Technologies is looking for a Labeler/Annotator to evaluate AI-generated responses in French. The ideal candidate will have... ...evaluating outputs for accuracy and relevance, and maintaining high-quality evaluations. This remote role offers competitive compensation...QualityLocal areaRemote work
- ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...QualityWork at officeRemote work
- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...QualityContract workTemporary workImmediate startRemote work
$45 - $85 per hour
...Ixolabs is seeking an Animation Quality Evaluator to refine AI-generated animations. The ideal candidate will evaluate motion fluidity and naturalness, ensuring animations convey believable narratives. The role is part-time (15-25 hours/week) and offers competitive compensation...QualityPart timeRemote work$40 per hour
...data annotation service is seeking a Biology Expert to train AI models. The role involves measuring AI progress, evaluating chatbot outputs, and ensuring quality improvement. Ideal candidates will have a strong background in biology or biochemistry. This independent...QualityHourly payContract workRemote workFlexible hours$14.5 per hour
...AI Web Search Evaluator Unlock the Power of the Internet! Are you curious, tech-savvy, and passionate about improving online search... ...home. ~ Career Growth: Develop your analytical, research, and quality assessment skills. ~ Exclusive Perks: ~ Medical, Dental,...QualityBi-weekly payHourly payPart timeImmediate startRemote workWork from homeFlexible hours- ...Prada, Versace, and more. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess... ...your home. # Observe carefully - check the ambiance, service quality, and overall customer experience. # Provide honest feedback -...QualityContract workWorldwideFlexible hours
$40 per hour
...Physics Graduate Assistant to join their team in a remote position. The role involves training AI models by evaluating their outputs and improving their quality through complex physics problems. Candidates should have a strong grasp of classical mechanics, electromagnetism...QualityHourly payContract workRemote work$40 per hour
...Graduate Assistant to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert understanding of physics. Other related...QualityHourly payFull timeContract workPart timeRemote work$14.5 per hour
...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge... ...learning modules and a required quality test designed by our client before starting work. *...QualityHourly payPart timeCurrently hiringImmediate startRemote workWork from home10 hours per weekFlexible hours$60 per hour
...state-of-the-art AI models on tasks like evaluating AI-generated security content, solving... ...to $60 USD/hour, with bonuses for high-quality and high-volume work. Impact: help shape... ...real-world accuracy and validity. Design and solve security-focused technical problems...QualityHourly payFull timeRemote workFlexible hours$20 per hour
A leading data annotation firm is seeking a Web Designer to evaluate AI-generated designs and enhance their understanding of design principles.... ...schedule. Ideal candidates will have a strong background in UI/UX or web design and be fluent in English. Compensation starts...Remote work$80 - $120 per hour
.... Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation...QualityContract workSummer workWork at officeRemote work- ...leading tech company in Alabama is seeking a Marketing Designer to train and improve AI models by evaluating AI-generated designs. The role offers flexibility and... ...project levels. Ideal candidates will possess strong UI/UX design skills and a good command of English,...Remote work
$20 per hour
...technology firm in the United States is seeking a Digital Web Designer to evaluate AI-generated designs and enhance the model's understanding of... ...starting at $20/hr. Candidates should have a background in UI/UX, fluency in English, and strong design principles understanding...Remote work$20 per hour
...leading AI training company is looking for an Experience Designer to improve AI model outputs by evaluating design work, including interfaces and visuals. This... ...Applicants must be fluent in English with a background in UI/UX design. This independent contract opportunity is...Contract workRemote workFlexible hours$20 per hour
...tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance... .... An ideal candidate will have a strong background in UI/UX design and excellent English skills. The position offers...Remote workFlexible hours$20 per hour
A leading technology company is seeking a Digital Designer to assess and improve AI-generated designs while working remotely. The role involves reviewing UI/UX outputs, providing critical feedback, and training AI models to enhance aesthetics and usability. Candidates...Hourly payRemote workFlexible hours$25 - $30 per hour
DataAnnotation is seeking contractors to assist in training AI chatbots. This flexible role allows you to choose projects based on your schedule while working from home. Ideal candidates will manage business communications and possess excellent writing and research skills...QualityHourly payFor contractorsRemote workWork from homeFlexible hours- ...freelancers to contract as independent contractors. In this role, you will develop prompts to train AI chatbots, write quality responses, and evaluate AI model outputs. This position, ideal for business professionals, permits flexible hours between 5-40 per week and pays...QualityHourly payContract workFor contractorsFreelanceRemote workFlexible hours
$25 - $30 per hour
...independent contractor role. As a key contributor, you will help train AI chatbots by developing complex prompts, writing high-quality responses, and evaluating AI outputs. Ideal candidates will manage their own schedules, with pay starting at $25-$30+ per hour. This...QualityHourly payFor contractorsFreelanceRemote workWork from homeFlexible hours$25 - $30 per hour
...contractor role allows you to work from home and choose your own projects. Candidates will develop prompts, write responses, and evaluate AI models. Ideal for those experienced in business communication, this position requires strong writing and research skills, along...QualityHourly payFor contractorsRemote workWork from home- ...DataAnnotation is seeking independent contractors to help train AI chatbots, developing prompts and evaluating model outputs. This role allows for flexible hours between 5-40 per week, ideally suited for detail-oriented professionals experienced in business communications...QualityFor contractorsRemote workFlexible hours
$25 - $30 per hour
...pay starting at $25 to $30+ per hour and bonuses on select projects. The role involves developing prompts, writing high-quality responses, and evaluating AI outputs. Applicants must be fluent in English and preferably have a bachelor’s degree or be in progress. #J-18808-...QualityHourly payFor contractorsRemote workWork from home
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to UI Design Quality Evaluator [Remote]. Be the first to apply!



