Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Design Evaluation Expert - Graphic

$80 - $150 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote

Role Responsibilities

  • Design precise, task-specific grading criteria for real-world design deliverables such as brand identity systems and guidelines, campaign visuals, and packaging concepts.
  • Score AI-generated and human work samples against established criteria, providing detailed written justifications for each score.
  • Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
  • Incorporate structured feedback from senior reviewers and iterate quickly on your work.
  • Collaborate asynchronously and work independently to meet deadlines and improve AI model performance .

Qualifications

Must-Have

  • 5+ years of professional experience in graphic, brand, or visual design.
  • Background at world-class design studios or creative agencies, or in senior design roles at leading consumer or technology brands.
  • Deep fluency in typography, layout, visual hierarchy, color, composition, and brand systems.
  • Exceptionally strong written communication skills.
  • Detail-oriented and consistent, with comfort in having your judgment reviewed.

Preferred

  • Prior experience with AI training , evaluation, or human-data projects.

Application Process (Takes 20–30 mins to complete)

  • Submit your resume, portfolio, or relevant professional background to get started.
  • Qualified applicants may be asked to complete a brief assessment or submit additional information.

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 9 days ago
Similar jobs that could be interesting for youBased on the Design Evaluation Expert - Graphic in New York, NY vacancy
  • $70 per hour

     ...this role $70/hr for Presentation Specialist / Visual Graphics Designer (Consulting) Expert work puts your Creative expertise on the same footing as...  ...Consulting) Expert, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert... 
    Suggested
    Hourly pay
    Remote work
    Weekend work

    Ethos

    New York, NY
    2 days ago
  • $50 - $90 per hour

     ...military operations and international humanitarian law expertise to evaluate AI systems, build conflict-risk frameworks, and assess defense...  ...law and convert those boundaries into AI evaluation guidance. Design conflict-risk rubrics and scenario-based tools for operational... 
    Suggested
    Hourly pay
    Contract work
    Part time
    Remote work
    Worldwide

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  • $2,200 per month

    Design real-world database engineering tasks for AI agents. Build reference solutions, tests, and grading rubrics. Assess correctness...  ...Partner Company The hiring company advances AI capabilities by evaluating complex database engineering problems. It partners with Jobgether... 
    Suggested
    Remote job
    For contractors
    Flexible hours

    Partner Company

    New York, NY
    4 days ago
  • RemoteJobsOne is seeking a Financial Expert contractor to help train AI systems by developing realistic finance prompts and structured evaluation rubrics. You will review AI outputs against defined criteria and provide actionable feedback, using Excel and other Microsoft... 
    Suggested
    Remote job
    For contractors

    RemoteJobsOne

    New York, NY
    1 day ago
  • $21 - $65 per hour

    Review AI-generated images as a remote Graphic Designer in the United States, comparing outputs, spotting visual artifacts, and writing clear...  ...Open to applicants in United States The work You will evaluate AI-generated images against original digital images, photographs... 
    Suggested
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  •  ...reliability across multilingual and domain-specific testing. You will design test plans, build rubrics, and document failure modes to raise...  ...hours, collaborating with researchers and engineers to evaluate LLM outputs, identify edge cases, and propose improvements to prompts... 
    Remote job
    For contractors
    Flexible hours

    Invisible Technologies Inc.

    New York, NY
    12 hours ago
  • Zohorecruit is seeking a talented Graphic Designer for remote work to create visuals for digital media and print that align with client briefs and brand identity. You will collaborate with clients and team members to deliver compelling designs, develop layouts, illustrations... 
    Remote job

    Slash Staffing LLC

    New York, NY
    3 days ago
  • Perseus Group is seeking a senior graphic designer to partner with our marketing team and management on ongoing brand and design work. This remote, long-term contract role suits someone who can operate independently, respect established brand systems, and thoughtfully... 
    Remote job
    Long term contract
    Part time
    Seasonal work

    Perseus Group, Constellation Software

    New York, NY
    4 days ago
  • CoreTrust is seeking a creative Graphic Designer to join the marketing team on a contract basis. You will design a wide range of marketing materials—presentations, brochures, case studies—and build and maintain templates and a centralized library of design assets across... 
    Contract work
    Remote work

    Feedinkoo: Remote Jobs

    New York, NY
    1 day ago
  • Prolific Academic Ltd. is seeking a skilled product and UX designer to work on tasks that train and evaluate AI models. Roles are flexible paid assignments following a brief skills assessment, with some tasks requiring up to an hour of focused work and others shorter. You... 
    Remote job
    Flexible hours

    prolificacademicltd

    New York, NY
    2 days ago
  • Partner Company is seeking a contractor to design real-world database engineering tasks for AI agents, build reference solutions with tests and rubrics, and assess correctness, concurrency, and performance. The role requires deep expertise in storage, query execution,... 
    Remote job
    For contractors
    Flexible hours

    Partner Company

    New York, NY
    4 days ago
  • $70 per hour

    Ethos is seeking a Presentation Specialist / Visual Graphics Designer (Consulting) Expert for remote projects in Creative AI training. You’ll evaluate outputs, correct errors, and provide expert reasoning within strict style guides, often on neutral or technical-manual... 
    Remote job

    Ethos

    New York, NY
    4 days ago
  •  ...HumanSignal is a remote-friendly platform pairing graphic design professionals with AI training projects. We’re seeking designers to rate and edit design samples, helping AI models learn what makes visuals effective. You’ll rate typography, color, layout, and hierarchy... 
    Freelance
    Remote work

    HumanSignal

    New York, NY
    5 days ago
  • $24 per hour

     ...experience to help improve AI responses to real small-business and financial questions. In this remote freelance project, you'll evaluate accuracy, identify gaps and help build reliable standards for accounting-related AI tasks. A part-time commitment of 20 hours per... 
    Part time
    Freelance
    Remote work

    Braintrust

    New York, NY
    4 days ago
  • $1,350 per unit

     ...Help evaluate how AI systems approach scientific and clinical work. Use your subject expertise to design realistic problems, define verifiable outcomes and evaluate proposed solutions for scientific accuracy and quality of reasoning. What you’ll work on Develop Linux... 

    Braintrust

    New York, NY
    1 day ago
  • micro1 Inc. is seeking a Digital Artist contractor to evaluate and enhance AI-generated images. You will use your artistic and technical expertise to train AI systems with high-quality real-world inputs, contributing to model learning and behavior evaluation. The ideal... 
    Remote job
    For contractors

    micro1 Inc.

    New York, NY
    4 days ago
  • Digital Designer (AI Output Evaluation) is a remote review track for evaluating AI outputs across digital designer creative review workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach... 
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne Human Data

    New York, NY
    12 hours ago
  • $8 - $65 per hour

     ...Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates... 
    Hourly pay
    Remote work
    Work from home
    Flexible hours

    Prolific

    New York, NY
    1 day ago
  • Remotebridge is seeking a Digital Artist contractor based in the United States to participate in a project evaluating AI-generated images. You will apply your visual expertise to assess, annotate, and provide precise feedback on artwork, helping to train next-generation... 
    Remote job
    For contractors

    Remotebridge

    New York, NY
    2 days ago
  • Remotebridge is seeking a Digital Artist contractor in the United States to evaluate and enhance AI-generated images. You will apply your artistic and technical expertise to provide high-quality feedback that informs how models learn and perform. Responsibilities include... 
    Remote job
    For contractors

    Remotebridge

    New York, NY
    4 days ago
  • $21 - $65 per hour

     ...Posted Open to applicants in United States The work You will evaluate AI-generated images by comparing them with original digital...  ...in digital art, retouching, compositing, 3D rendering, graphic design, color grading, or photography. A portfolio showing original... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  • AuraOne, Inc. is seeking a Digital Designer (AI Output Evaluation) contractor to remotely review AI-generated design outputs within established creative-review workflows. You will assess craft, constraints, and tooling adherence, and document corrected approaches for model... 
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    12 hours ago
  •  ...Senior Humanitarian Evaluation Expert/ Evaluation of risk-taking, risk-sharing and risk management in humanitarian action, New York, United States of America, home based with travel to countries for data collection, as relevant 5 months and 29 days *************... 
    Work experience placement
    Work at office
    Work from home

    UNICEF

    New York, NY
    15 days ago
  • NDT Subject Matter Expert - Laser Shearography (Level II / III) - AI Evaluation is a remote review track for evaluating AI outputs across ndt subject matter laser shearography specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and... 
    Hourly pay
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    AuraOne Human Data

    New York, NY
    1 day ago
  • $30 - $65 per hour

     ...naturally and clearly the speech is delivered. Your feedback will support AI systems that understand and generate Tamil. You will use evaluation guidelines consistently, explain your decisions in English, and point out unclear language content when requirements need... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Work at office
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    12 hours ago
  • Location: United States Arts, Media & Design Expert - PowerPoint Review & Reconstruction Role Type: Contractor Location: Remote Engagement...  ...behind presentation and design decisions. AI training or evaluation experience is a plus, but not required . Project Details Work... 
    Remote job
    For contractors
    Flexible hours

    YO AI Labs

    New York, NY
    2 days ago
  • Lifted is seeking German-speaking coding experts to support a high-volume AI evaluation project in an audio-enabled, real-time setting. You will review transcripts, validate JSON structures, and provide written justifications on language quality, technical accuracy, and... 
    Remote work
    Flexible hours

    Lifted (Upwork)

    New York, NY
    4 days ago
  • $41.6 - $48.93 per hour

    As a Human Centered Design Expert, you will help the Department of Health and Human Services (HHS) Office of Minority Health (OMH) to meet...  ...and recommend design solutions and improvements, and evaluate correspondence designs according to LEP community requirements... 
    Full time
    Contract work
    Temporary work
    Work at office
    Remote work
    Monday to Friday

    Service Design Show

    New York, NY
    2 hours ago
  • About the opportunity We are sourcing independent contractor experts to review AI-generated coding and technical customer service outputs...  ...to identify basic logic, syntax, or functionality issues. Evaluate outputs for technical accuracy, clarity, natural language, and... 
    For contractors
    Live in

    Meridial

    New York, NY
    12 hours ago
  • OpenTrain AI is seeking a Computer Science Expert in Python Validation for project-based, contract work. You will design challenging CS problems, validate AI-generated solutions, and evaluate multi-step reasoning using Python tools. The role is 100% remote worldwide with... 
    Remote job
    Hourly pay
    Contract work
    Worldwide
    10 hours per week

    OpenTrain AI, Inc.

    New York, NY
    12 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Design Evaluation Expert - Graphic. Be the first to apply!