UI/UX Designer for AI Evaluation

Evaluate real-world digital product design work by defining clear quality standards and scoring completed samples with rigorous written reasoning. This hourly remote role focuses on assessing work rather than creating design deliverables. Key Responsibilities

• Create precise, task-specific evaluation criteria for digital product and UX work, including design systems and component libraries, responsive interfaces and dashboards, onboarding, checkout and booking flows, authenticated customer portals, UX writing, product content, and design-to-engineering handoff.
• Assess AI-generated and human work samples against established criteria and provide detailed written justification for every score.
• Apply consistent, evidence-based judgment so evaluations are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and iterate quickly.

• At least 5 years of professional product design, UI/UX, or design systems experience for real digital products, rather than brand or marketing websites.
• Experience at digital-product or UX studios, in-house product design teams at product-led companies, or e-commerce and marketplace organizations with sophisticated customer portals and dashboards.
• Experience in one or more relevant areas: product, UI, or design systems design; UX leadership; UX writing or content design; or digital product or business analysis.
• Strong command of interaction and visual design, design systems, responsive layouts, end-to-end product flows, Figma prototyping and production handoff, and design-review critique.
• Exceptional written communication and the ability to explain why work does or does not meet the needs of a real product and its users.
• Detail-oriented, consistent, and comfortable having judgments reviewed and calibrated with peers.
• Experience with AI training, evaluation, or human-data projects is a plus.

• Remote hourly engagement.

• $80 to $150 per hour.

• Submit a resume, portfolio, or relevant professional background.
• Qualified applicants may be asked to complete a brief assessment or provide additional information.