Agency Brand Designer for AI Evaluation

Role Overview

Help evaluate real-world brand and design work by defining clear standards for quality and applying them to completed samples. This role focuses on creating task-specific grading criteria and scoring AI-generated and human work with rigorous written rationale, rather than producing design deliverables directly.

Key Responsibilities

• Create precise grading criteria for brand identity systems and guidelines, logos and visual identities, campaign and marketing visuals, packaging concepts, presentation and layout design, digital and social assets, and brand messaging and positioning.
• Score completed AI-generated and human work samples against established criteria, providing detailed written justification for each score.
• Use consistent, evidence-based judgment so evaluations are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and rapidly refine your work.

Qualifications

• At least 5 years of professional experience in brand, visual, or graphic design.
• Experience at a leading independent brand and design agency, such as Pentagram, Wolff Olins, Landor, Collins, or IDEO. Agency experience is required; in-house or enterprise design-team experience alone does not meet this requirement.
• Experience as a Creative Director, Brand Designer focused on logos, visual identity, and supporting graphics, Web Designer focused on UI/UX and web architecture, or Graphic Designer.
• Strong command of typography, layout, visual hierarchy, color, composition, logo development, brand identity systems, and creative-director-style critique.
• Exceptional written communication and the ability to clearly explain why work meets or falls short of the required standard.
• Detail-oriented, consistent, and comfortable having judgment reviewed and calibrated with peers.
• Experience with copywriting and brand messaging, including audience research, competitor research, and positioning, is a plus.
• Prior AI training, evaluation, or human-data project experience is a plus.

Work Terms

• Remote, hourly engagement.

Compensation

• $80 to $150 per hour.

Application Process

• Submit your resume, portfolio, and background information to begin the application process.
• Qualified applicants may be asked to complete an assessment or provide additional information.