Design Evaluation Expert - Graphic
$80 - $150 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world design deliverables such as brand identity systems and guidelines, campaign visuals, and packaging concepts.
- Score AI-generated and human work samples against established criteria, providing detailed written justifications for each score.
- Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on your work.
- Collaborate asynchronously and work independently to meet deadlines and improve AI model performance .
Qualifications
Must-Have
- 5+ years of professional experience in graphic, brand, or visual design.
- Background at world-class design studios or creative agencies, or in senior design roles at leading consumer or technology brands.
- Deep fluency in typography, layout, visual hierarchy, color, composition, and brand systems.
- Exceptionally strong written communication skills.
- Detail-oriented and consistent, with comfort in having your judgment reviewed.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume, portfolio, or relevant professional background to get started.
- Qualified applicants may be asked to complete a brief assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Design Evaluation Expert - Graphic in New York, NY vacancy
$30 per hour
...wide variety of experiences, knowledge, and skills. The role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now tackle complex design...SuggestedRemote jobWork from homeFlexible hours- A leading AI research firm is seeking Expert Prompt Curators to design challenging prompts for evaluating advanced AI models. The role requires advanced knowledge in diverse fields and offers flexible hours, remote work, and a competitive hourly wage. Ideal candidates will...SuggestedRemote jobHourly payTemporary workFlexible hours
$196k - $230k
...seeking an experienced UX Researcher to define and scale how we evaluate Notion’s AI-powered experiences—focusing on what “good” looks... ...reusable rubrics, workflows, and measurement approaches that product, design, engineering, and data science can apply consistently.This role...SuggestedLocal areaShift work- Independent Evaluations for Neurology• 1099 Position working minimum of 8 hours per month• Can work up to 3 full days per week • Very flexible- Design your own schedule• Determine level of patient disability for insurance companies, mostly worker's compensation casesQualifications...SuggestedFlexible hours3 days per week
- Independent Evaluations for Orthopedic Surgery • 1099 Position working minimum of 8 hours per month• Work up to 3 full days per week @ earning potential up to 1 Mill annually• Very flexible- Design your own schedule• Determine level of patient disability for insurance companies...SuggestedRemote workFlexible hours3 days per week
- A visual design consultancy is seeking an Illustrator to enhance AI models' understanding of design. This role involves reviewing AI-... ...and usability. Candidates should have a background in UI/UX or graphic design, with fluency in English. This is a flexible remote position...Hourly payRemote workFlexible hours
DataAnnotation
New York, NY4 days ago - ...Raspberry AI Raspberry AI is a generative AI design platform built for fashion brands and... ...Raspberry AI is looking for a Product Expert who bridges deep technical fluency with... ...cutting‑edge generative tools, run structured evaluations, deeply work in our product, translate...Immediate start
$30 per hour
Prolific is seeking fluent Hindi speakers to join their Expert Network, helping to train and evaluate AI models with real legal expertise. Responsibilities include analyzing and writing tasks in Hindi, judging AI’s performance, and aiding in the improvement of AI models...Remote jobHourly payFlexible hours$80k - $95k
...people, and business development happening around the world. The Graphic Designer reports to the Regional Marketing Director and works in close... ...opportunities to all applicants and employees, and we evaluate qualified applicants without regard to ancestry, age, color,...Work at officeLocal areaShift workFranklin Templeton
New York, NY2 days ago- ...About you: You are a designer at heart. You specialize either in motion graphics or you are a strong visual designer with some experience with motion design... ...resume with the requirements of the role. This tool evaluates information based on contextual relevance and is...Work at office
Within
New York, NY2 days ago $70k - $80k
...The Graphic Designer will execute high-quality creative assets across all brand touchpoints, working... ...generation, and workflow optimization. Evaluate emerging design technologies and... ...campaign creative, and visual storytelling. Expert proficiency in Adobe Creative Suite....Seasonal workRetrofête
New York, NY1 day ago$47.17 - $52.41 per hour
...experiences through innovative design and compelling visual... ...expertise across web, packaging, graphic, and digital design to create... ...impeccable production skills. Expert proficiency in the Adobe... ...equal-opportunity employer. We evaluate qualified applicants without...Hourly payTemporary workWorldwideSkill Corp
New York, NY1 day ago- ...Visual/Graphic Designer Job at Civil Science (Remote, USA) Civil Science, a leading engineering and design firm, is hiring a Visual/Graphic... ...background check and driving record review Civil Science may evaluate sponsorship for temporary or permanent work visas (e.g., E-3,...Permanent employmentFull timeTemporary workH1bRemote workWork visa
Icanstudent
New York, NY2 days ago $80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...Contract workSummer workWork at officeRemote workMercor
New York, NY3 days ago$60 - $75 per hour
A leading information services firm is seeking a Remote Archivist to design questions and evaluate AI responses related to archival management. This position requires strong experience as an archivist and the ability to work independently in a fully remote environment....Remote jobHourly pay- ...research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least 3 years of experience with...Remote jobContract workFlexible hours
$50 per hour
...accelerator is looking for remote PhD candidates in Chemistry, Chemical Engineering, or related fields. You will design advanced chemistry problems to evaluate AI performance and collaborate with researchers on benchmarks. This role offers flexible hours and a pay rate...Remote jobHourly payFlexible hours- Sr Graphic Designer Georgia, United States What you’ll do The Sr. Graphic Designer is a high performing contributor that works to facilitate... ...share lessons learned. Collaborate cross-functionally to evaluate technical, system, and process improvements. Perform other duties...Work at officeFlexible hours
- ...structured communication and slide craftsmanship. This fully remote, flexible engagement pays $100/hour and offers 5–20 hours per week (more if desired). Start date is ASAP; work includes creating, evaluating, and polishing client-ready decks and executive #J-18808-LjbffrImmediate startRemote workFlexible hours
Ethos
New York, NY3 days ago $20 per hour
...We are looking for a Graphic Designer to help train and improve cutting-edge AI models. You’ll assess and enhance how AI systems understand, generate, and evaluate design work — including interfaces, layouts, visuals, and user experiences. In this role, you’ll use...Full timeContract workPart timeRemote workDataAnnotation
New York, NY4 days ago- Graphic Designer (Photoshop and Adobe Illustrator Experience Required) We are a fast-growing promotional products company looking for a Graphic Designer to create professional, sales‑driven marketing materials. This role focuses on designing flyers, product sell sheets...
- ...Publicis Groupe ANZ is seeking a versatile Digital Designer in New York. In this role, you will create eye-catching digital graphics and animations, supporting various digital design projects. The ideal candidate will have a Bachelor's degree in graphic design and experience...
Publicis Groupe ANZ
New York, NY18 hours ago $30 - $60 per hour
...and data-driven Senior Experimentation Designer to lead the design of digital experiments... ...Digital Design, or related disciplines.Expert-level proficiency with Figma, including... ...process, including sourcing, screening, and evaluating candidates. AI helps assess applications...Contract workTemporary workRemote work$180.3k - $244k
...delightful robots for everyday life. We are hiring a Principal UX Designer to define what it feels like to live with a Fauna robot: how it... ...launch. Our process is iterative and demo-led: build fast, evaluate honestly, and let each round of feedback sharpen the next. The...Flexible hours- Feedinkoo is seeking an experienced Graphic Designer for an immediate opening. This role involves creating visually appealing designs for a variety of customers. The ideal candidate should have a background in graphic design, knowledge of Adobe Creative Suite, and experience...Immediate start
$60 - $70 per hour
...: AI Safety Practitioner Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality. Review content involving misinformation...Contract workSummer workRemote workMercor
New York, NY2 days ago$78.4k - $117.6k
...working toward MSF’s social mission. ROLE OVERVIEW The Multimedia Graphic Designer will produce visual content and develop creative strategies... ...to inform and engage audiences, and provide others with expert advice while working within established communications systems...Work at officeImmediate startShift workMsfcareers
New York, NY18 hours ago- ...View a typical day working as an Experiential Designer. We are hungry for fresh design talent—from graphic communications to interior, environmental, and experiential... ...team of programmers, engineers, wayfinding experts, and other specialists. Draft conceptual...Work at officeRemote work2 days per week
Takeform
New York, NY5 hours ago - ...DescriptionResponsibilities:Supporting the UX department in NY as a UX Designer. His/Her role will be in support of the Smart Internet project.... ...new products and makes improvements to existing products. Evaluate products, parts, or processes for cost efficiency and...Immediate start
$90k - $115k
...About the job Multimedia Graphic Designer QVV683VR Make the Case with Stunning Visuals. If you thrive under pressure and love turning complex... ...motion design, or a related field, or equivalent experience. Expert-level skills in Adobe Creative Suite (Photoshop, Illustrator,...Full timeImmediate startRemote workIcreatives
New York, NY18 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Design Evaluation Expert - Graphic. Be the first to apply!
Related searches
- technology expert New York, NY
- subject matter expert New York, NY
- guest service support expert New York, NY
- fulfillment expert New York, NY
- graphic intern New York, NY
- environmental graphic designer New York, NY
- graphic designer New York, NY
- motion graphics New York, NY
- contract graphic designer New York, NY
- graphic designer marketing New York, NY