UI/UX Designer for AI Model Evaluation

Help define what excellent digital-product design work looks like by creating precise, task-specific evaluation criteria and scoring completed design work. This engagement focuses on assessing how well AI systems and people perform real-world product design tasks, you will not produce product deliverables yourself, you will produce reproducible, well-justified evaluations and written rationale for each score.

• Design task-specific grading criteria for real-world digital product and UX deliverables, including design systems and component libraries, responsive UI layouts and dashboards, end-to-end product flows such as onboarding, checkout, and booking, logged-in customer portals, UX writing and product content, and design-to-engineering or production handoff.
• Score AI-generated and human work samples against those criteria, providing detailed written justifications for every score.
• Apply consistent, evidence-based judgment so scores are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and iterate quickly on grading criteria and scoring approach.

• At least 5 years of professional experience in product design, UI/UX, or design systems for real digital products, not brand or marketing sites.
• Experience at leading digital-product or UX studios, in-house product-design teams at major product-led companies, or at e-commerce or marketplace companies with sophisticated customer portals and dashboards.
• Relevant background in one or more of these tracks: Product or UI Designer, Design Systems Designer, UX Lead, UX Writer or Content Designer, or digital Product or Business Analyst.
• Deep fluency in interaction and visual design, design systems, responsive layouts, end-to-end product flows, prototyping, and production handoff in Figma.
• Ability to articulate critique and evaluation the way a design or UX lead would in a review.
• Exceptionally strong written communication, able to explain exactly why a piece of work does or does not meet the bar for a real product and its users.
• Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.
• Prior experience with AI training, evaluation, or human-data projects is a strong plus.

• Location: Remote.
• Employment type: hourly engagement.

• Pay rate: 80 - 150 hourly.

To apply, submit your resume and portfolio or other materials that demonstrate relevant professional experience. Qualified applicants may be asked to complete a brief assessment or provide additional information for evaluation. Submitted materials will be reviewed and selected candidates will be invited to the next step.