Design Evaluation Expert - Graphic
$80 - $150 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world design deliverables such as brand identity systems and guidelines, campaign visuals, and packaging concepts.
- Score AI-generated and human work samples against established criteria, providing detailed written justifications for each score.
- Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on your work.
- Collaborate asynchronously and work independently to meet deadlines and improve AI model performance .
Qualifications
Must-Have
- 5+ years of professional experience in graphic, brand, or visual design.
- Background at world-class design studios or creative agencies, or in senior design roles at leading consumer or technology brands.
- Deep fluency in typography, layout, visual hierarchy, color, composition, and brand systems.
- Exceptionally strong written communication skills.
- Detail-oriented and consistent, with comfort in having your judgment reviewed.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume, portfolio, or relevant professional background to get started.
- Qualified applicants may be asked to complete a brief assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Design Evaluation Expert - Graphic in New York, NY vacancy
$30 per hour
...a wide variety of experiences, knowledge, and skills. The role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now tackle complex design...SuggestedRemote workWork from homeFlexible hoursProlific
New York, NY2 days ago- Softechub is seeking a remote Graphic Designer contractor to evaluate AI-generated images and contribute to improving visual outputs. You will apply your eye for detail, assess image quality, and provide constructive feedback to help train next-generation AI systems. The...SuggestedRemote jobFor contractors
- TechDSF is seeking a highly creative and forward-thinking Graphic Designer to craft impactful visuals across digital, print, and product platforms. You’ll collaborate with our marketing, branding, and development teams to design engaging assets that align with our brand...SuggestedRemote job
- Zohorecruit is seeking a talented Graphic Designer for remote work to create visuals for digital media and print that align with client briefs and brand identity. You will collaborate with clients and team members to deliver compelling designs, develop layouts, illustrations...SuggestedRemote job
- Actalent is hiring a remote Visual Designer to evaluate frontier AI models on real design tasks such as interfaces, layouts, typography, and... ...creative deliverables. The ideal candidate brings UI/UX or graphic design experience, a strong sense of visual hierarchy, and the...SuggestedRemote job
$1,350 per unit
...Help evaluate how AI systems approach scientific and clinical work. Use your subject expertise to design realistic problems, define verifiable outcomes and evaluate proposed solutions for scientific accuracy and quality of reasoning. What you’ll work on Develop Linux...Braintrust
New York, NY2 days ago$24 per hour
...experience to help improve AI responses to real small-business and financial questions. In this remote freelance project, you'll evaluate accuracy, identify gaps and help build reliable standards for accounting-related AI tasks. A part-time commitment of 20 hours per...Part timeFreelanceRemote workBraintrust
New York, NY14 hours ago$8 - $65 per hour
...Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates...Hourly payRemote workWork from homeFlexible hoursProlific
New York, NY2 days ago- ...seeking a Digital Artist for a remote contractor role within the United States. You will contribute creative and technical expertise to evaluate and enhance AI-generated images for a cutting-edge project. Responsibilities include evaluating visuals, providing constructive...Remote jobHourly payFor contractors
$174k - $252k
...-energy-density dual-use regimes.Create evaluation datasets of complex physics and nuclear... ...the domain.Collaborate with engineers to design mitigations that block harmful outputs without... ...position of Radiological Subject Matter Expert (SME) in the CBRNE team within the...Google
New York, NY4 days ago- Remotebridge is seeking a Digital Artist contractor in the United States to evaluate and enhance AI-generated images. You will apply your artistic and technical expertise to provide high-quality feedback that informs how models learn and perform. Responsibilities include...Remote jobFor contractors
$21 - $65 per hour
...Posted Open to applicants in United States The work You will evaluate AI-generated images by comparing them with original digital... ...in digital art, retouching, compositing, 3D rendering, graphic design, color grading, or photography. A portfolio showing original...Hourly payContract workPart timeFor contractorsRemote work- ...Senior Humanitarian Learning Expert/ Evaluation of risk-taking, risk-sharing and risk management in humanitarian action Contract Duration... ...visualization of evaluation key message; Experience designing and conducting interviews with local and national NGOs and with...Contract workWork experience placementWork at officeLocal areaRemote workWork from home
UNICEF
New York, NY14 days ago $50 - $150 per hour
...experienced healthcare professionals to contribute to AI training and evaluation projects. You’ll apply your domain knowledge and professional... ...based on project feedback and quality standards. Selected experts will receive detailed project instructions and examples during...Hourly payFor contractorsRemote work$110 - $140 per hour
Alpheva is seeking a senior terminology expert to support AI evaluation projects focused on term bases, controlled vocabulary, consistency, and subject-matter usage. You will review model responses and worked examples for terminology issues and assess alignment with professional...Remote jobHourly payContract work- Prolific in New York, NY, is seeking Chemistry Experts and Chemical Engineers to join its Expert Network. In this role, you will help train and evaluate AI models using your chemical expertise. Duties include evaluating AI-generated responses for accuracy and validating...Remote jobWork from homeFlexible hours
- Alpheva is seeking a senior clinical research expert to support AI evaluation projects centered on study protocols, endpoints, bias, safety reporting, and trial interpretation. This is remote, project-based contract work with scope, hours, and assignments determined by...Remote jobContract work
$100 - $130 per hour
Bring senior learning science expertise to AI evaluation projects focused on learning mechanisms, evidence-based pedagogy, and study design. Review model responses and worked... ...evidence. Pay $100-$130/hr Alpheva is a new expert network (launched September 2026); payout...Hourly payContract workRemote work$62.5 per hour
HVAC Expert for AI Diagnostics and System Design Build HVAC diagnostic and system-design scenarios, write reference answers, and rate AI responses for accuracy... ...with no fixed schedule. Pay is up to $30 per hour. Evaluate and rank AI-generated responses in Bahasa Indonesian,...Hourly payContract workPart timeFor contractorsRemote workFlexible hours- ...Trainer Project United States of America Are you an insurance expert eager to shape the future of AI? Large‑scale language models are... ...traces, and suggest improvements to our prompt engineering and evaluation metrics. A bachelor’s or master’s in insurance, finance, risk management...Remote jobHourly payContract workFor contractorsFreelanceImmediate start
$90 - $120 per hour
Alpheva is a remote, project-based expert network hiring senior higher education experts to evaluate AI-driven college instruction, policy, and student support tasks. Experts review model outputs, craft reference answers, and set scoring criteria grounded in established...Remote jobHourly payFlexible hours- Alpheva seeks a senior educator to support AI evaluation projects focused on lesson delivery, learner needs, classroom assessment, and feedback. This is remote, project-based contract work; scope and hours depend on project matching. You will review model responses for...Remote jobContract work
- ...alternative application process. Instructional Design and Accessibility Specialist Active -... ...as audio, video, animations, websites, graphics, etc. Design and deliver professional... ..., federal and WCAG 2.0 AA standards. Evaluate and report accessibility of instructional...Part timeWork at officeRemote workMonday to Friday
- Alpheva is seeking a senior crop protection expert for AI evaluation projects focusing on pest diagnosis, resistance, integrated pest management, and pesticide safety. This remote, project-based role emphasizes high-level technical judgment and evidence-based corrections...Remote job
- Alpheva is seeking a senior film expert to evaluate AI-driven screenwriting, editing, continuity, and production decisions on a remote, project-based contract basis. Review responses, develop reference answers, and justify corrections with traceable evidence. Scope, hours...Remote jobHourly payContract work
$30 per hour
Prolific is seeking fluent Hindi speakers to join their Expert Network, helping to train and evaluate AI models with real legal expertise. Responsibilities include analyzing and writing tasks in Hindi, judging AI’s performance, and aiding in the improvement of AI models...Remote jobHourly payFlexible hours- Zekai is seeking experienced HR professionals fluent in Spanish to train and evaluate AI agents on realistic professional tasks. The role involves working in digital workspaces to craft and assess HR-related tasks, with emphasis on local regulations and terminology. You...Remote jobContract workLocal area
- AuraOne, Inc. is seeking a remote contractor to review voice actors evaluation prompts and responses, applying a versioned rubric to assign severity tags and provide structured feedback for retraining. You will compare paired outputs, label edge cases, and document recurring...Remote jobFor contractors10 hours per week
- Alignerr is seeking a Chemistry Subject Matter Expert to help evaluate and improve AI systems that reason through advanced chemical problems.... ...can articulate clear, precise reasoning in writing. You'll design challenging chemistry problems, develop step-by-step solutions...Remote jobHourly payContract work
$30 per hour
Prolific is seeking Fluent Hindi Speakers to join our Expert Network to train and evaluate AI models using real legal expertise. You will complete paid tasks that require focused, uninterrupted work and may earn up to $30 per hour. A quick skills verification test is required...Remote jobHourly payWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Design Evaluation Expert - Graphic. Be the first to apply!
Related searches
- technology expert New York, NY
- subject matter expert New York, NY
- guest service support expert New York, NY
- sql expert New York, NY
- fulfillment expert New York, NY
- graphic design remote New York, NY
- graphic intern New York, NY
- graphic design internship no experience New York, NY
- contract graphic designer New York, NY
- lead graphic designer New York, NY