Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Design Evaluation Expert - Graphic - AI Trainer

$80 - $150 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote

Role Responsibilities

  • Design precise, task-specific grading criteria for real-world design deliverables such as brand identity systems and guidelines, campaign visuals, and packaging concepts.
  • Score AI-generated and human work samples against established criteria, providing detailed written justifications for each score.
  • Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
  • Incorporate structured feedback from senior reviewers and iterate quickly on your work.
  • Collaborate asynchronously and work independently to meet deadlines and improve AI model performance .

Qualifications

Must-Have

  • 5+ years of professional experience in graphic, brand, or visual design.
  • Background at world-class design studios or creative agencies, or in senior design roles at leading consumer or technology brands.
  • Deep fluency in typography, layout, visual hierarchy, color, composition, and brand systems.
  • Exceptionally strong written communication skills.
  • Detail-oriented and consistent, with comfort in having your judgment reviewed.

Preferred

  • Prior experience with AI training , evaluation, or human-data projects.

Application Process (Takes 20–30 mins to complete)

  • Submit your resume, portfolio, or relevant professional background to get started.
  • Qualified applicants may be asked to complete a brief assessment or submit additional information.

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#hiringmercor
Vacancy posted 10 days ago
Similar jobs that could be interesting for youBased on the Design Evaluation Expert - Graphic - AI Trainer in Boston, MA vacancy
  • $80 - $180 per hour

     ...technical talent with leading AI research labs. Headquartered...  .... Position: Professional Design Experts Type: Contract Compensation...  ...Role Responsibilities Evaluate product design decisions to...  ...preferences. Develop graphics, documents, and other files using... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    Boston, MA
    18 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Boston, MA
    4 days ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $...  .... Collaborate with subject matter experts to ensure consistency and quality.... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Boston, MA
    29 days ago
  • $45k - $60k

    Visual hierarchy Visual hierarchy Written Communication AI Design Evaluator / Design Quality Specialist About The Role We are seeking a detail...  ...candidates with experience in UI/UX design, product design, graphic design, web design, or related creative fields who are... 
    Suggested
    Permanent employment
    For contractors
    Remote work

    Aston Carter

    Boston, MA
    3 days ago
  • $24 per hour

     ...Use your accounting and QuickBooks experience to help improve AI responses to real small-business and financial questions. In this remote freelance project, you'll evaluate accuracy, identify gaps and help build reliable standards for accounting-related AI tasks. A part... 
    Suggested
    Part time
    Freelance
    Remote work

    Braintrust

    Boston, MA
    4 hours ago
  •  ...collection platform in Boston is seeking an AI Trainer fluent in Korean. The role involves...  ...connection. You will complete tasks like evaluating AI performance and contributing to model...  ...Candidates must pass a skills verification test to join the Domain Expert pool. #J-18808-Ljbffr
    Remote work
    Flexible hours

    Prolific

    Boston, MA
    4 hours ago
  • $85 - $100 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: Corporate Designer — Aesthetics Projects Type: Contract...  ...untimed). Preference labelling (≈45 min) : Evaluate three client deliverables and score them.... 
    Contract work
    Summer work
    Remote work

    Mercor

    Boston, MA
    4 days ago
  • $50 - $125 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: Product Design/UX Expert Type: Contract Compensation:...  ...hours/week Role Responsibilities Evaluate product design decisions using professional... 
    Contract work
    Summer work
    Remote work

    Mercor

    Boston, MA
    a month ago
  • $66 - $84 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...question's difficulty as Medium, Hard, or Expert. Provide 1 correct answer and 9 plausible...  ...graduate-level CS theory, algorithms, systems design, and/or machine learning.Excellent written... 
    Contract work
    Summer work
    Remote work

    Mercor Inc

    Boston, MA
    3 days ago
  •  ...focused role centered on ownership, quality, and creative impact. Creative Tracks Applicants may focus on one primary area: Graphic Design & Branding Event materials, social assets, sponsor decks, brand consistency Apparel Design Merchandise concepts, wearable... 
    Remote job
    Internship

    Childhood Cancer Society

    Cambridge, MA
    3 days ago
  • $100 per hour

    Ethos is seeking a deal team associate to help train an AI language model on professional presentation tasks. You will create, evaluate, and refine AI-generated slide decks for investment memos, LBO outputs, and portfolio reviews. This remote, flexible role offers $100... 
    Remote job
    Hourly pay
    Immediate start
    Flexible hours

    Ethos

    Boston, MA
    5 days ago
  • $170.6k

     ...Job Details: Job Description: The Graphics Research Organization at Intel is seeking a highly motivated Research Scientist Intern to...  ...industry-leading researchers to develop innovative graphics and AI techniques. Your work may contribute directly to Intel's graphics... 
    Remote job
    Internship
    Local area
    Immediate start
    Work from home
    Worldwide
    Shift work

    Intel

    Cambridge, MA
    2 days ago
  •  ...reliability, and trustworthiness of our clinical AI outputs. You'll build the systems that...  ...knows what it doesn't know" — developing evaluation frameworks, calibrated confidence scoring...  ...actually trust. What You'll Do Design and implement automated evaluation... 
    Full time

    Bioscope%20AI

    Boston, MA
    4 days ago
  • $45 - $60 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: Education Expert - Sourcing Funnel (Private) Type: Contract...  ...: Remote Role Responsibilities Design realistic educational scenarios and tasks... 
    Contract work
    Summer work
    Remote work

    Mercor

    Boston, MA
    5 days ago
  • $153k - $259k

     ..., MA, and it reports to the UX Design Senior Manager within Clinicals...  ...experiences for ambient and several AI- or voice-based experiences, as...  ...or mixed-method approaches to evaluate opportunities and experiences. Navigate ambiguity with expert problem framing and thoughtful... 
    Full time
    Temporary work
    Work at office

    Archer

    Boston, MA
    4 days ago
  • $75 - $85 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Angelo , Larry Summers , and Jack Dorsey . Position: Figma Designer Type: Contract Compensation: $75–$85/hour Location... 
    Contract work
    Summer work
    Remote work

    Mercor

    Boston, MA
    4 days ago
  • $155.8k - $185k

     ...lifestyle brand with 200+ stores nationwide, we design thoughtful, inspired apparel and...  ...ways. Overview J.Jill is seeking an AI Enablement Engineer to accelerate the practical...  ..., and other enterprise functions. Evaluate emerging AI capabilities and measure... 

    J. Jill

    Quincy, MA
    3 days ago
  •  ...Navy. Travel the world, document military operations and develop high-profile media campaigns. From photography and journalism to graphic design and videography, Navy MCs can do it all. We’re looking for Sailors with talent and originality, who aren’t afraid to think... 
    Full time
    Local area
    Overseas

    U.S. Navy

    Cambridge, MA
    4 days ago
  • $88k - $101.4k

     ...The Learning Experience Designer (LXD) partners with teams across...  ...development, implementation, evaluation, and continuous improvement....  ...stakeholders and subject matter experts, the LXD seeks to understand...  ...responsible use of approved AI and emerging learning technologies... 
    Remote work

    Dana-Farber Cancer Institute

    Brookline, MA
    5 days ago
  •  ...NH   We are seeking a User Experience Designer for a high-visibility transformation...  ...Group utilizes artificial intelligence (AI) tools as part of its initial application...  ...requirements of the position. All AI-assisted evaluations and responses are reviewed by human recruiters... 
    Hourly pay
    Local area

    Eliassen Group

    Boston, MA
    4 days ago
  • $48k - $65.42k

    Linden Central, a growing finance company based in Boston, MA, seeks a talented Graphic Designer for a full-time position. This role offers competitive compensation and benefits. As a Graphic Designer, you'll create visual content for marketing and communications. Your... 
    Full time
    Work at office

    Linden Central

    Boston, MA
    5 days ago
  • Graphic Designer (corporate branding systems) Business group: Creative Team - supporting insurance product and marketing. Candidate Value Proposition The successful candidate will have the opportunity to impact communicating our mission of helping our customers live a... 
    Contract work

    Compunnel Inc.

    Boston, MA
    5 days ago
  • $45 per hour

    The Boch Center is seeking a reliable, detail-oriented Freelance Graphic Designer to support our Marketing team on an as-needed basis. This role will provide creative and production design support during staff vacations, planned absences, and periods of increased project... 
    Hourly pay
    For contractors
    Freelance
    Remote work
    Flexible hours

    Montserrat

    Boston, MA
    3 days ago
  •  ...Ruby Wines, Inc. located in Avon, MA is seeking an experienced Graphic Designer and Print Production Specialist. The primary responsibility...  ...and distributors, and product ratings from industry evaluators. Cross-check product entry details using the Ruby Journal Software... 
    Work experience placement

    Ruby Wines

    Avon, MA
    2 days ago
  • Linden Central, a Boston-based finance company, is seeking a full-time Graphic Designer to create visual content for marketing and communications. You will design graphics for social media, email campaigns, and print materials, collaborating with the marketing team to... 
    Full time

    Linden Central

    Boston, MA
    5 days ago
  •  ...Graphics Summer Work Study The Graphics Summer Work Study student will be responsible for projects for all schools, city, residential...  ...as needed throughout the school year. Tasks can include designing clear, engaging graphics for print, social media campaigns, marketing... 
    Summer work

    Newton North High School

    Newton, MA
    3 days ago
  • $21.9 - $27.37 per hour

     ...We are looking for a talented ambitious designer to join our Marketing & Communications team...  ...to learn and incorporate motion graphics and production for broadcast a plus....  ...Software usage relevant to job duties will be evaluated. Software applications: High level... 
    Hourly pay
    Full time
    Seasonal work
    Work at office

    Trans Dist Comm of Hampton Rds

    Norfolk, MA
    2 days ago
  •  ...staff, integrate technology and drive efficiencies. As architects, designers, workplace strategists and environmental specialists in the...  ...We are currently seeking a full‑time Intermediate Experiential Graphic Designer for our Boston studio. Under the supervision of EGD design... 
    Full time
    Work experience placement
    Worldwide
    Flexible hours
    3 days per week

    IA Interior Architects

    Boston, MA
    18 hours ago
  • $25.2 - $54 per hour

    Graphic Design & Technical Communications Intern STR is seeking a creative, detail-oriented Graphic Design & Technical Communications Intern...  ..., and comfortable working with technical subject matter experts to understand their work and translate complex information into... 
    Hourly pay
    Summer work
    Internship
    Work at office
    Local area
    Flexible hours
    Night shift

    STR

    Boston, MA
    5 days ago
  • ContractStaffingRecruiters.com is seeking a Sr. Telecom BIM Designer in Boston, Massachusetts. This role involves managing Revit BIM models and collaborating with discipline leads on telecommunications projects. Candidates should have extensive experience in Revit BIM... 

    ContractStaffingRecruiters.com

    Boston, MA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Design Evaluation Expert - Graphic - AI Trainer. Be the first to apply!