Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Design Evaluation Expert - Graphic - AI Trainer

$80 - $150 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote

Role Responsibilities

  • Design precise, task-specific grading criteria for real-world design deliverables such as brand identity systems and guidelines, campaign visuals, and packaging concepts.
  • Score AI-generated and human work samples against established criteria, providing detailed written justifications for each score.
  • Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
  • Incorporate structured feedback from senior reviewers and iterate quickly on your work.
  • Collaborate asynchronously and work independently to meet deadlines and improve AI model performance .

Qualifications

Must-Have

  • 5+ years of professional experience in graphic, brand, or visual design.
  • Background at world-class design studios or creative agencies, or in senior design roles at leading consumer or technology brands.
  • Deep fluency in typography, layout, visual hierarchy, color, composition, and brand systems.
  • Exceptionally strong written communication skills.
  • Detail-oriented and consistent, with comfort in having your judgment reviewed.

Preferred

  • Prior experience with AI training , evaluation, or human-data projects.

Application Process (Takes 20–30 mins to complete)

  • Submit your resume, portfolio, or relevant professional background to get started.
  • Qualified applicants may be asked to complete a brief assessment or submit additional information.

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#hiringmercor

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Design Evaluation Expert - Graphic - AI Trainer in Boston, MA vacancy
  • $80 - $180 per hour

     ...technical talent with leading AI research labs. Headquartered...  .... Position: Professional Design Experts Type: Contract Compensation...  ...Role Responsibilities Evaluate product design decisions to...  ...preferences. Develop graphics, documents, and other files using... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    Boston, MA
    19 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Boston, MA
    5 days ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $...  .... Collaborate with subject matter experts to ensure consistency and quality.... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Boston, MA
    a month ago
  • $45k - $60k

    Visual hierarchy Visual hierarchy Written Communication AI Design Evaluator / Design Quality Specialist About The Role We are seeking a detail...  ...candidates with experience in UI/UX design, product design, graphic design, web design, or related creative fields who are... 
    Suggested
    Permanent employment
    For contractors
    Remote work

    Aston Carter

    Boston, MA
    4 days ago
  •  ...collection platform in Boston is seeking an AI Trainer fluent in Korean. The role involves...  ...connection. You will complete tasks like evaluating AI performance and contributing to model...  ...Candidates must pass a skills verification test to join the Domain Expert pool. #J-18808-Ljbffr
    Suggested
    Remote work
    Flexible hours

    Prolific

    Boston, MA
    16 hours ago
  • $24 per hour

     ...Use your accounting and QuickBooks experience to help improve AI responses to real small-business and financial questions. In this remote freelance project, you'll evaluate accuracy, identify gaps and help build reliable standards for accounting-related AI tasks. A part... 
    Part time
    Freelance
    Remote work

    Braintrust

    Boston, MA
    1 day ago
  • $85 - $100 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: Corporate Designer — Aesthetics Projects Type: Contract...  ...untimed). Preference labelling (≈45 min) : Evaluate three client deliverables and score them.... 
    Contract work
    Summer work
    Remote work

    Mercor

    Boston, MA
    5 days ago
  • $50 - $125 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: Product Design/UX Expert Type: Contract Compensation:...  ...hours/week Role Responsibilities Evaluate product design decisions using professional... 
    Contract work
    Summer work
    Remote work

    Mercor

    Boston, MA
    1 day ago
  • $70 - $100 per hour

     ...and technical talent with leading AI research labs. Headquartered in San...  ...Particle & Nuclear Physics Expert Type: Contract Compensation...  ...week Role Responsibilities Design challenging computational problems to evaluate AI capabilities in Particle & Nuclear... 
    Contract work
    Summer work
    Remote work

    Mercor

    Boston, MA
    2 days ago
  •  ...focused role centered on ownership, quality, and creative impact. Creative Tracks Applicants may focus on one primary area: Graphic Design & Branding Event materials, social assets, sponsor decks, brand consistency Apparel Design Merchandise concepts, wearable... 
    Remote job
    Internship

    Childhood Cancer Society

    Cambridge, MA
    4 days ago
  • $170.6k

     ...Job Details: Job Description: The Graphics Research Organization at Intel is seeking a highly motivated Research Scientist Intern to...  ...industry-leading researchers to develop innovative graphics and AI techniques. Your work may contribute directly to Intel's graphics... 
    Remote job
    Internship
    Local area
    Immediate start
    Work from home
    Worldwide
    Shift work

    Intel

    Cambridge, MA
    3 days ago
  • $86.6k - $144.4k

    Data ScientistBuild AI That Accelerates Scientific DiscoveryDo...  ...Scientist at Elsevier, you will design, develop, and deploy AI and...  ...scientific ontologies.Fine-tune, evaluate, and integrate large language...  ...product, UX, analytics, and domain experts to transform ambiguous... 
    Local area

    Elsevier

    Boston, MA
    4 days ago
  • $155k - $410k

     ...Description & SummaryThe OpportunityAs an AI & GenAI Data Scientist-Director, you will...  ...advanced technologies and techniques to design and develop robust data solutions for clients...  ...closely with team members. We evaluate these factors thoughtfully to establish a... 
    Full time
    H1b

    PwC

    Boston, MA
    4 days ago
  • $153k - $259k

     ...decisions alongside product, design, and engineering partners. This...  ...ll also be the team’s resident expert on behavioral data, helping...  ...product and design decisions.Apply AI tools responsibly to improve...  ...design recommendations and evaluate whether experience changes achieve... 
    Full time
    Temporary work
    Work at office
    Shift work

    athenahealth

    Boston, MA
    4 days ago
  •  ...reliability, and trustworthiness of our clinical AI outputs. You'll build the systems that...  ...knows what it doesn't know" — developing evaluation frameworks, calibrated confidence scoring...  ...actually trust. What You'll Do Design and implement automated evaluation... 
    Full time

    Bioscope%20AI

    Boston, MA
    5 days ago
  • $45 - $60 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: Education Expert - Sourcing Funnel (Private) Type: Contract...  ...: Remote Role Responsibilities Design realistic educational scenarios and tasks... 
    Contract work
    Summer work
    Remote work

    Mercor

    Boston, MA
    6 days ago
  • $153k - $259k

     ...should.athenahealth is looking for designers who can dive into complex...  ...success criteria and metrics to evaluate design outcomes. Additional...  ...with or exposure to emerging AI tools, with the ability to explore...  .... We offer IT solutions and expert services that eliminate the daily... 
    Full time
    Temporary work
    Work at office

    athenahealth

    Boston, MA
    1 day ago
  • $142.7k - $264.9k

     ...engine and connective tissue for Design, Data and Data Science...  ...role in building and deploying AI/ML-powered digital solutions that...  ...initiativesYou act as the subject matter expert to inform software products...  ...studies and comparative evaluations of analytical approaches for... 
    Temporary work
    Local area

    Genentech

    Boston, MA
    2 days ago
  •  ...backgrounds and industries to create a safer, sustainable and more connected world. Job OverviewExecutes standard simulations to support design and manufacturing.Your main tasksExecution of structural-mechanical simulations in Ansys/LS-Dyna, as well as injection molding... 
    Work at office
    Local area

    TE connectivity

    Boston, MA
    4 days ago
  • $75 - $85 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Angelo , Larry Summers , and Jack Dorsey . Position: Figma Designer Type: Contract Compensation: $75–$85/hour Location... 
    Contract work
    Summer work
    Remote work

    Mercor

    Boston, MA
    5 days ago
  • $107k - $181k

     ...healthcare for all.Position Summary:Design experiences that help...  ...research and heuristic reviews to evaluate usefulness, usability, and...  ...engineering stakeholders.Use AI tools as part of the design process...  .... We offer IT solutions and expert services that eliminate the daily... 
    Full time
    Temporary work
    Work at office

    athenahealth

    Boston, MA
    1 day ago
  •  ...sustainable healthcare for all.Design meaningful experiences that...  ...strengthen consistency and quality.Use AI tools to accelerate design...  ...to work through ambiguity, evaluate tradeoffs, and make timely decisions...  .... We offer IT solutions and expert services that eliminate the... 
    Full time
    Temporary work
    Work at office

    athenahealth

    Boston, MA
    1 day ago
  •  ...Scientist I, you are a technical leader and lead data scientist who design, build, and oversee bioinformatics platforms and data systems...  ...developers and bioinformaticians. Set priorities, guide and evaluate performance, and accountable for the team’s output and quality.... 
    Local area

    AbbVie

    Cambridge, MA
    2 days ago
  • $88k - $101.4k

     ...The Learning Experience Designer (LXD) partners with teams across...  ...development, implementation, evaluation, and continuous improvement....  ...stakeholders and subject matter experts, the LXD seeks to understand...  ...responsible use of approved AI and emerging learning technologies... 

    Dana-Farber Cancer Institute

    Brookline, MA
    1 day ago
  • $80 - $100 per hour

     ...role will focus on leading the design of analytics data architecture...  ..., data engineering, and AI to build scalable, trusted data...  ...making data architecture decisions.Expert-level SQL and Python skills....  ...applications.Experience developing evaluation frameworks to measure the... 
    Full time
    Contract work
    Temporary work
    Flexible hours

    Motion Recruitment

    Boston, MA
    3 days ago
  • $126k - $234k

     ...inference, and gene prioritization.Support the identification, evaluation, and validation of novel therapeutic targets using human genetic...  ...$126,000.00 - $234,000.00Skills DesiredArtificial Intelligence (AI), Biostatistics, Change Management, Curious Mindset, Data Governance... 
    Full time
    Remote work

    Novartis

    Cambridge, MA
    1 day ago
  •  ...NH   We are seeking a User Experience Designer for a high-visibility transformation...  ...Group utilizes artificial intelligence (AI) tools as part of its initial application...  ...requirements of the position. All AI-assisted evaluations and responses are reviewed by human recruiters... 
    Hourly pay
    Local area

    Eliassen Group

    Boston, MA
    5 days ago
  •  ...Navy. Travel the world, document military operations and develop high-profile media campaigns. From photography and journalism to graphic design and videography, Navy MCs can do it all. We’re looking for Sailors with talent and originality, who aren’t afraid to think... 
    Full time
    Local area
    Overseas

    U.S. Navy

    Cambridge, MA
    16 hours ago
  • $134k - $348.5k

     ...Description & SummaryThe OpportunityAs part of the AI Engineering team within the Digital...  ...& Technology team, you will lead the design and delivery of AI and machine learning solutions...  ...and quality expectations for testing and evaluation of AI-enabled systems, technical evidence... 
    Full time
    H1b

    PwC

    Boston, MA
    3 days ago
  •  ...future of brand experience.At Jack Morton, we design and build head-turning, smile-inducing,...  ...**Jack Morton is hiring a  Senior Graphic Designer to join our Creative team. At Jack...  ...Must have expert-level knowledge of Adobe Creative Suite:... 
    Work at office

    Jack Morton Worldwide

    Boston, MA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Design Evaluation Expert - Graphic - AI Trainer. Be the first to apply!