Design Evaluation Expert - Graphic
$80 - $150 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world design deliverables such as brand identity systems and guidelines, campaign visuals, and packaging concepts.
- Score AI-generated and human work samples against established criteria, providing detailed written justifications for each score.
- Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on your work.
- Collaborate asynchronously and work independently to meet deadlines and improve AI model performance .
Qualifications
Must-Have
- 5+ years of professional experience in graphic, brand, or visual design.
- Background at world-class design studios or creative agencies, or in senior design roles at leading consumer or technology brands.
- Deep fluency in typography, layout, visual hierarchy, color, composition, and brand systems.
- Exceptionally strong written communication skills.
- Detail-oriented and consistent, with comfort in having your judgment reviewed.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume, portfolio, or relevant professional background to get started.
- Qualified applicants may be asked to complete a brief assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$70 per hour
...this role $70/hr for Presentation Specialist / Visual Graphics Designer (Consulting) Expert work puts your Creative expertise on the same footing as... ...Consulting) Expert, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert...SuggestedHourly payRemote workWeekend work$50 - $90 per hour
...military operations and international humanitarian law expertise to evaluate AI systems, build conflict-risk frameworks, and assess defense... ...law and convert those boundaries into AI evaluation guidance. Design conflict-risk rubrics and scenario-based tools for operational...SuggestedHourly payContract workPart timeRemote workWorldwide$2,200 per month
Design real-world database engineering tasks for AI agents. Build reference solutions, tests, and grading rubrics. Assess correctness... ...Partner Company The hiring company advances AI capabilities by evaluating complex database engineering problems. It partners with Jobgether...SuggestedRemote jobFor contractorsFlexible hours- RemoteJobsOne is seeking a Financial Expert contractor to help train AI systems by developing realistic finance prompts and structured evaluation rubrics. You will review AI outputs against defined criteria and provide actionable feedback, using Excel and other Microsoft...SuggestedRemote jobFor contractors
$21 - $65 per hour
Review AI-generated images as a remote Graphic Designer in the United States, comparing outputs, spotting visual artifacts, and writing clear... ...Open to applicants in United States The work You will evaluate AI-generated images against original digital images, photographs...SuggestedHourly payContract workPart timeFor contractorsRemote work- ...reliability across multilingual and domain-specific testing. You will design test plans, build rubrics, and document failure modes to raise... ...hours, collaborating with researchers and engineers to evaluate LLM outputs, identify edge cases, and propose improvements to prompts...Remote jobFor contractorsFlexible hours
- Zohorecruit is seeking a talented Graphic Designer for remote work to create visuals for digital media and print that align with client briefs and brand identity. You will collaborate with clients and team members to deliver compelling designs, develop layouts, illustrations...Remote job
- Perseus Group is seeking a senior graphic designer to partner with our marketing team and management on ongoing brand and design work. This remote, long-term contract role suits someone who can operate independently, respect established brand systems, and thoughtfully...Remote jobLong term contractPart timeSeasonal work
- CoreTrust is seeking a creative Graphic Designer to join the marketing team on a contract basis. You will design a wide range of marketing materials—presentations, brochures, case studies—and build and maintain templates and a centralized library of design assets across...Contract workRemote work
- Prolific Academic Ltd. is seeking a skilled product and UX designer to work on tasks that train and evaluate AI models. Roles are flexible paid assignments following a brief skills assessment, with some tasks requiring up to an hour of focused work and others shorter. You...Remote jobFlexible hours
- Partner Company is seeking a contractor to design real-world database engineering tasks for AI agents, build reference solutions with tests and rubrics, and assess correctness, concurrency, and performance. The role requires deep expertise in storage, query execution,...Remote jobFor contractorsFlexible hours
$70 per hour
Ethos is seeking a Presentation Specialist / Visual Graphics Designer (Consulting) Expert for remote projects in Creative AI training. You’ll evaluate outputs, correct errors, and provide expert reasoning within strict style guides, often on neutral or technical-manual...Remote job- ...HumanSignal is a remote-friendly platform pairing graphic design professionals with AI training projects. We’re seeking designers to rate and edit design samples, helping AI models learn what makes visuals effective. You’ll rate typography, color, layout, and hierarchy...FreelanceRemote work
$24 per hour
...experience to help improve AI responses to real small-business and financial questions. In this remote freelance project, you'll evaluate accuracy, identify gaps and help build reliable standards for accounting-related AI tasks. A part-time commitment of 20 hours per...Part timeFreelanceRemote work$1,350 per unit
...Help evaluate how AI systems approach scientific and clinical work. Use your subject expertise to design realistic problems, define verifiable outcomes and evaluate proposed solutions for scientific accuracy and quality of reasoning. What you’ll work on Develop Linux...- micro1 Inc. is seeking a Digital Artist contractor to evaluate and enhance AI-generated images. You will use your artistic and technical expertise to train AI systems with high-quality real-world inputs, contributing to model learning and behavior evaluation. The ideal...Remote jobFor contractors
- Digital Designer (AI Output Evaluation) is a remote review track for evaluating AI outputs across digital designer creative review workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach...Hourly payFor contractorsRemote work10 hours per week
$8 - $65 per hour
...Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates...Hourly payRemote workWork from homeFlexible hours- Remotebridge is seeking a Digital Artist contractor based in the United States to participate in a project evaluating AI-generated images. You will apply your visual expertise to assess, annotate, and provide precise feedback on artwork, helping to train next-generation...Remote jobFor contractors
- Remotebridge is seeking a Digital Artist contractor in the United States to evaluate and enhance AI-generated images. You will apply your artistic and technical expertise to provide high-quality feedback that informs how models learn and perform. Responsibilities include...Remote jobFor contractors
$21 - $65 per hour
...Posted Open to applicants in United States The work You will evaluate AI-generated images by comparing them with original digital... ...in digital art, retouching, compositing, 3D rendering, graphic design, color grading, or photography. A portfolio showing original...Hourly payContract workPart timeFor contractorsRemote work- AuraOne, Inc. is seeking a Digital Designer (AI Output Evaluation) contractor to remotely review AI-generated design outputs within established creative-review workflows. You will assess craft, constraints, and tooling adherence, and document corrected approaches for model...Remote jobFor contractors10 hours per week
- ...Senior Humanitarian Evaluation Expert/ Evaluation of risk-taking, risk-sharing and risk management in humanitarian action, New York, United States of America, home based with travel to countries for data collection, as relevant 5 months and 29 days *************...Work experience placementWork at officeWork from home
- NDT Subject Matter Expert - Laser Shearography (Level II / III) - AI Evaluation is a remote review track for evaluating AI outputs across ndt subject matter laser shearography specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and...Hourly payFor contractorsWork experience placementRemote work10 hours per week
$30 - $65 per hour
...naturally and clearly the speech is delivered. Your feedback will support AI systems that understand and generate Tamil. You will use evaluation guidelines consistently, explain your decisions in English, and point out unclear language content when requirements need...Hourly payContract workPart timeFor contractorsWork at officeRemote work- Location: United States Arts, Media & Design Expert - PowerPoint Review & Reconstruction Role Type: Contractor Location: Remote Engagement... ...behind presentation and design decisions. AI training or evaluation experience is a plus, but not required . Project Details Work...Remote jobFor contractorsFlexible hours
- Lifted is seeking German-speaking coding experts to support a high-volume AI evaluation project in an audio-enabled, real-time setting. You will review transcripts, validate JSON structures, and provide written justifications on language quality, technical accuracy, and...Remote workFlexible hours
$41.6 - $48.93 per hour
As a Human Centered Design Expert, you will help the Department of Health and Human Services (HHS) Office of Minority Health (OMH) to meet... ...and recommend design solutions and improvements, and evaluate correspondence designs according to LEP community requirements...Full timeContract workTemporary workWork at officeRemote workMonday to Friday- About the opportunity We are sourcing independent contractor experts to review AI-generated coding and technical customer service outputs... ...to identify basic logic, syntax, or functionality issues. Evaluate outputs for technical accuracy, clarity, natural language, and...For contractorsLive in
- OpenTrain AI is seeking a Computer Science Expert in Python Validation for project-based, contract work. You will design challenging CS problems, validate AI-generated solutions, and evaluate multi-step reasoning using Python tools. The role is 100% remote worldwide with...Remote jobHourly payContract workWorldwide10 hours per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Design Evaluation Expert - Graphic. Be the first to apply!
- technology expert New York, NY
- subject matter expert New York, NY
- guest service support expert New York, NY
- sql expert New York, NY
- fulfillment expert New York, NY
- graphic design remote New York, NY
- graphic intern New York, NY
- graphic design internship no experience New York, NY
- contract graphic designer New York, NY
- lead graphic designer New York, NY



