Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Design Evaluation Expert - Graphic - AI Trainer

Mercor

1. Role Overview Mercor is partnering with a leading AI research organization to engage experienced brand designers for a project focused on evaluating how well AI systems perform real-world brand and design work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications. 2. Key Responsibilities Design precise, task-specific grading criteria for real-world brand design deliverables (brand identity systems and guidelines, logos and visual identity, campaign and marketing visuals, packaging concepts, presentation and layout design, digital and social assets, and brand messaging and positioning) Score AI-generated and human work samples against those criteria, with detailed written justifications for every score Apply consistent, evidence-based judgment so that scores are reproducible and defensible Incorporate structured feedback from senior reviewers and iterate quickly on your work 3. Ideal Qualifications 5+ years of professional experience in brand, visual, or graphic design Background specifically at world-class independent brand and design agencies (e.g., Pentagram, Wolff Olins, Landor, Collins, IDEO) — agency experience, not in-house or enterprise design teams Experience in one of the core brand disciplines: Creative Director, Brand Designer (logo, visual identity, supporting graphics), Web Designer (UI/UX, web architecture), or Graphic Designer Deep fluency in the day-to-day craft: typography, layout and visual hierarchy, color, composition, logo and brand identity systems, and articulating critique the way a creative director would in a review Exceptionally strong written communication, with the ability to explain exactly why a piece of work does or does not meet the bar Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers Experience with copywriting and brand messaging — including audience research, competitor research, and positioning — is a strong plus Prior experience with AI training, evaluation, or human-data projects is a strong plus #J-18808-Ljbffr Mercor

Vacancy posted 21 hours ago
Similar jobs that could be interesting for youBased on the Design Evaluation Expert - Graphic - AI Trainer in Boston, MA vacancy
  • $80 - $150 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Jack Dorsey . Position: Design Expert Type: Contract Compensation...  ...professional experience in graphic, brand, or visual design. ~...  ...with AI training , evaluation, or human-data projects.... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    Boston, MA
    18 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ..., and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Boston, MA
    12 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Boston, MA
    12 days ago
  • A government services company is looking for a skilled Litigation Graphics Consultant to support a Federal agency's customer initiative. This role involves designing and maintaining graphics for litigation, video editing, and providing IT support during trials. Candidates... 
    Suggested
    Remote job
    Flexible hours

    CGS Federal (Contact Government Services)

    Boston, MA
    4 days ago
  • DataAnnotation is seeking an Illustrator to help train AI models by evaluating UI/UX outputs and providing detailed feedback. Your design expertise will guide improvements in aesthetics, usability, and creative quality for next‑gen AI tools used by designers. As an independent... 
    Suggested
    Remote job
    For contractors
    Work from home
    Flexible hours

    DataAnnotation

    Boston, MA
    2 days ago
  •  ...collaborating with a leading AI lab to engage experienced educators...  ...development and instructional design, assessment and psychometrics,...  ...Work spans task design, evaluation, and structured feedback on AI...  ...into reviewer, lead, and domain‑expert roles #J-18808-Ljbffr Obsidian

    Obsidian

    Boston, MA
    4 days ago
  • Overview In this role, you will evaluate AI-generated responses and provide structured written feedback. This is a great opportunity for sharp, analytical thinkers to contribute to high-impact AI research projects. Basic Qualifications Bachelor's degree from a top-500 globally... 

    Obsidian

    Boston, MA
    5 days ago
  • Mercor is seeking senior social work professionals to design evaluation tasks for AI systems operating in large human services and clinical social work settings. The role focuses on creating realistic scenarios and reference outputs that guide how senior clinicians think... 

    Mercor

    Boston, MA
    2 days ago
  • $50 - $125 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: Product Design/UX Expert Type: Contract Compensation:...  ...hours/week Role Responsibilities Evaluate product design decisions using professional... 
    Contract work
    Summer work
    Remote work

    Mercor

    Boston, MA
    8 days ago
  •  ...Job Title- Graphic Designer 3 Location- Boston, MA, United States, 02114 Reporting Type- Onsite Duration: 8 month...  ...execution. ~ Market Visits: As needed, conduct market visits to evaluate execution of marketing initiatives, and competitive insights.... 
    Seasonal work

    campus4tech

    Boston, MA
    3 days ago
  • $70 - $100 per hour

     ...and technical talent with leading AI research labs. Headquartered in San...  ...Particle & Nuclear Physics Expert Type: Contract Compensation...  .../week Role Responsibilities Design challenging computational problems to evaluate AI capabilities in Particle & Nuclear... 
    Contract work
    Summer work
    Remote work

    Mercor

    Boston, MA
    9 days ago
  •  ...Job Description Job Description Design Expert Job Type: Contractor Location: Remote Schedule: Flexible...  ...We are seeking senior Product Design and AI-Assisted Development Experts to create evaluation tasks for AI systems working across rapid prototyping... 
    Remote job
    Weekly pay
    Contract work
    For contractors
    Flexible hours

    YO AI Labs

    Boston, MA
    3 days ago
  •  ...become more resilient. Underpinned by technology, data, analytics, AI, change management, talent and sustainability capabilities, our...  ...distribution) and define digital supply chain strategies enabled by AI/ML.Design and implement AI-powered planning solutions (demand forecasting,... 
    Full time
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    5 days ago
  •  ...candidates at this time. About Mercor Mercor partners with leading AI labs and enterprises to train frontier models using human...  ...systems in your area of expertise. One interview, real results AI experts share how Mercor made hiring faster, fairer, and easier — with just... 
    Contract work
    For contractors
    Remote work

    Mercor

    Boston, MA
    5 days ago
  • $112.5k - $150k

     ...User Experience DesignerRole OverviewWe’re seeking a Senior UX Designer to join our User Experience team. This role offers a unique opportunity...  ...for team members.Participate in usability testing sessions to evaluate design effectiveness and identify areas for improvement.... 
    Freelance
    Internship

    Plymouth Rock Assurance

    Boston, MA
    2 days ago
  • $142.7k - $264.9k

     ...engine and connective tissue for Design, Data and Data Science...  ...role in building and deploying AI/ML-powered digital solutions that...  ...initiativesYou act as the subject matter expert to inform software products...  ...studies and comparative evaluations of analytical approaches for... 
    Full time
    Temporary work
    Local area

    Genentech

    Boston, MA
    1 day ago
  • $169.1k - $314k

     ...engine and connective tissue for Design, Data and Data Science...  ...role in building and deploying AI/ML-powered digital solutions that...  ...execution of simulation studies to evaluate innovative trial designs and...  ..., collaborating with domain experts to productize the validation of... 
    Full time
    Temporary work
    Local area

    Genentech

    Boston, MA
    1 day ago
  • $150k - $215k

     ...hiring a Senior Data Engineer to lead the design, development, and evolution of the data...  ...of the Data Engineering organization by evaluating new technologies, improving engineering standards...  ..., and scale our data ecosystem.Leverage AI tools and automation to accelerate... 
    Full time

    WHOOP

    Boston, MA
    4 days ago
  • $100k - $157k

     ...beyond. As a Senior UX Designer on our UX team, you'll...  ...finance, and beyond. As AI becomes an increasingly...  ...product managers, domain experts, and fellow UX...  ...of AI: Explore and evaluate emerging AI capabilities...  ...Interaction Design, Psychology, Graphic Design, Computer... 
    Temporary work
    Worldwide

    InterSystems

    Boston, MA
    4 days ago
  •  ...UX Designer Mid-Level | 3-5 Years | Boston, MA | In-Office | Full-Time...  ..., hardware, software, AI, product, and design. We are growing...  ...product managers and engineers to evaluate tradeoffs and move toward...  ...systems without needing to become experts in the machinery underneath.... 
    Full time
    Work at office
    Immediate start
    Remote work
    Visa sponsorship

    Neurable

    Boston, MA
    5 days ago
  • $70 - $80 per hour

     ...Senior UX Researcher role, you will play a critical part in ensuring our products and services are designed with the user in mind. You will lead research initiatives, evaluate design options and prototypes, and analyze data to provide actionable insights that will guide... 

    KForce

    Boston, MA
    5 days ago
  • $90k - $130k

     ...decisions. Working closely with Product Design, Product Management, Clinical, Regulatory...  ...environments.Expertise in both generative and evaluative research methods, with demonstrated...  ...Strong commitment to embracing and leveraging AI tools in day-to-day tasks, ensuring AI-... 
    Full time
    Work at office
    Relocation

    WHOOP

    Boston, MA
    1 day ago
  •  ...is partnering with a leading AI lab to hire experienced new business...  ...The role emphasizes creating, evaluating, and refining AI-generated...  ..., and data-driven exhibit design. We seek 3+ years in high-growth...  ...enterprise B2B settings, with expert PowerPoint skills and precise... 
    Remote job

    Ethos

    Boston, MA
    5 days ago
  • $100k - $160k

     ...and Data Engineering practice. You will design, build, and maintain scalable data pipelines...  ...that enable advanced analytics, AI, and intelligent automation. Key Responsibilities...  ..., and reliability of data feeds. Evaluate and implement streaming and real‑time data... 
    For contractors
    Immediate start
    Remote work
    Home office
    Flexible hours
    Shift work

    Kearney

    Boston, MA
    3 days ago
  • $117.6k - $161.7k

     ...Become a part of our caring community The Senior Data Engineer designs, builds, and maintains data processing solutions that enable...  ...quality, reliability, and performance. The successful candidate will evaluate and select appropriate technologies, implement and monitor data... 
    Bi-weekly pay
    Full time
    Temporary work
    Apprenticeship
    Work at office
    Immediate start
    Remote work
    Work from home
    Home office

    Humana

    Boston, MA
    2 days ago
  • $145.9k - $234.2k

     ...RoleModerna is seeking a Senior AI Engineer in Cambridge, MA/...  ...technical leadership for the design, implementation, and operation...  ...model and prompt versioning, evaluation, monitoring, incident response...  ...automation, or data-intensive systems.Expert proficiency with Python and... 
    Permanent employment
    Full time
    Work at office
    Work from home

    Moderna Therapeutics

    Cambridge, MA
    2 days ago
  • $90.16k - $167.44k

    AI EngineerJob Posting DescriptionThe AI Engineer will join the AI team supporting the...  .../John Hancock. This role will help design, build, deploy, and scale production-grade...  ...processing, feature engineering, model training, evaluation, deployment, and monitoring.... 
    Full time
    Temporary work
    Local area

    John Hancock

    Boston, MA
    3 days ago
  •  ...Experience Design And Research LeadWe are seeking a highly motivated, organized, and strategic...  ...roadmap; and guide the iterative design, evaluation, and refinement of user experience...  ...with delivery plan.Experience in working in AI enablement solution design and... 
    Full time
    Contract work
    Remote work
    Monday to Friday
    Flexible hours

    Mindlance

    Boston, MA
    4 days ago
  •  ...help create user-friendly solutions as new AI-powered applications are built. Hybrid...  ...Title: UI/UX & Spatial Experience Designer Location East Boston, MA I....  ...and executive presentations. 2. Evaluate design, prototyping, spatial computing, visualization... 
    Local area

    3B Staffing LLC

    Boston, MA
    2 days ago
  •  ...Senior UI/UX Designer IIEmployment Type: Full-Time, ExperiencedCGS is seeking a Senior UI/UX Designer to join our team supporting a...  ...scale UX design efforts to include research, blueprinting, and evaluating existing systems.Manage the planning, design, and implementation... 
    Full time
    Work at office

    Contact Government Services LLC

    Boston, MA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Design Evaluation Expert - Graphic - AI Trainer. Be the first to apply!