Design Evaluation Expert - Graphic
$80 - $150 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world design deliverables such as brand identity systems and guidelines, campaign visuals, and packaging concepts.
- Score AI-generated and human work samples against established criteria, providing detailed written justifications for each score.
- Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on your work.
- Collaborate asynchronously and work independently to meet deadlines and improve AI model performance .
Qualifications
Must-Have
- 5+ years of professional experience in graphic, brand, or visual design.
- Background at world-class design studios or creative agencies, or in senior design roles at leading consumer or technology brands.
- Deep fluency in typography, layout, visual hierarchy, color, composition, and brand systems.
- Exceptionally strong written communication skills.
- Detail-oriented and consistent, with comfort in having your judgment reviewed.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume, portfolio, or relevant professional background to get started.
- Qualified applicants may be asked to complete a brief assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 14 days ago
Similar jobs that could be interesting for youBased on the Design Evaluation Expert - Graphic in New York, NY vacancy
$30 per hour
...a wide variety of experiences, knowledge, and skills. The role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now tackle complex design...SuggestedRemote workWork from homeFlexible hoursProlific
New York, NY1 day ago- ...Job Description Job Description Graphic Designer – Editorial, Poster & Marketing Layout Role Type: Contractor Location: Remote... ...& Template Systems Adobe/Figma Production Flow Design Evaluation Strong written English and visual communication skills...SuggestedRemote jobFor contractors
YO AI Labs
New York, NY8 days ago - ...Obsidian is seeking a Medical Expert to help train AI models with high-quality healthcare reasoning data. You will design clinical scenarios, evaluate model outputs, and provide essential feedback to improve AI-driven patient care. This remote, asynchronous role defaults...SuggestedRemote workFlexible hours
Obsidian
New York, NY21 hours ago $174k - $252k
...-energy-density dual-use regimes.Create evaluation datasets of complex physics and nuclear... ...the domain.Collaborate with engineers to design mitigations that block harmful outputs without... ...position of Radiological Subject Matter Expert (SME) in the CBRNE team within the...SuggestedGoogle
New York, NY2 days ago- ...Job Description Job Description Arts, Media & Design Expert — PowerPoint Review & Reconstruction Role Type: Contractor Location... ...behind presentation and design decisions. ~ AI training or evaluation experience is a plus, but not required . Project Details...SuggestedRemote jobFor contractorsFlexible hours
YO AI Labs
New York, NY8 days ago $150 - $180 per hour
...Prolific is recruiting Mental Health Professionals to help train and evaluate AI models. After a quick test, you may join as a Domain Expert participant and get paid to complete AI tasks. Tasks may pay up to $150–$180 per hour and require about one hour of uninterrupted...Hourly payRemote workProlific
New York, NY21 hours ago$80 - $180 per hour
...Jack Dorsey . Position: Professional Design Experts Type: Contract Compensation:... ...hours/week Role Responsibilities Evaluate product design decisions to align with... ...standards and taste preferences. Develop graphics, documents, and other files using...Contract workSummer workRemote workMercor
New York, NY4 days ago- ...Description Job Description Creative & Design Specialist Role Type: Contractor... ...to support a customer project focused on graphic design, multimedia production, UI/UX, motion... ...use your professional design expertise to evaluate and improve AI-generated creative outputs...Remote jobFor contractorsWorldwideFlexible hours
YO AI Labs
New York, NY8 days ago $80 - $150 per hour
...Jack Dorsey . Position: Agency Brand Design Expert Type: Contract Compensation:... ...experience in brand, visual, or graphic design. ~ Background at world-class independent... ...Prior experience with AI training , evaluation, or human-data projects. Application...Contract workSummer workRemote workMercor
New York, NY3 days ago- ...What You'll Do Apply your subject-matter expertise to advanced AI training and evaluation work Develop or evaluate challenging problems within your area of expertise Assess AI-generated reasoning for technical accuracy and identify subtle errors or failure modes...Contract workTemporary workImmediate startRemote workFlexible hours
Rise Data Labs
New York, NY7 days ago - ...What You'll Do Apply your subject-matter expertise to advanced AI training and evaluation work Develop or evaluate challenging problems within your area of expertise Assess AI-generated reasoning for technical accuracy and identify subtle errors or failure modes...Contract workTemporary workImmediate startRemote workFlexible hours
Rise Data Labs
New York, NY7 days ago $60 - $80 per hour
...management , and operations reasoning . Design challenging, domain-relevant retail tasks... ...grounded in real retail practice. Evaluate AI model outputs against structured... ...Collaborate with other subject matter experts to ensure consistency and accuracy in training...Contract workSummer workRemote workWeekday workMercor
New York, NY22 days ago$50 - $60 per hour
...modeling, texturing, animation, editing, color grading, or motion graphics. Currently pursuing or recently completed Master's studies... ...skills. Complete a brief paid assessment to further evaluate your fit for the role. Resources & Support For details about...Contract workSummer workImmediate startRemote workMercor
New York, NY4 days ago- ...Job Description Job Description Tzumi is looking for a Digital E-commerce/Marketing Graphic Designer Our digital marketing department is expanding and looking for a talented, on-site Graphic Designer who specializes in Amazon listings, website and social media...Work at office
Tzumi Electronics
New York, NY9 days ago $61.8k - $74.16k
...Conducting original research to evaluate what works—and what doesn’t; and # Providing expert assistance and policy guidance... ...Initiatives, a project of the Center, co-designs models for community-driven... ...Initiatives, is seeking a graphic designer who is committed to...Full timeTemporary workWork at officeLocal areaWork visaMonday to FridayFlexible hoursWeekend workAfternoon shiftCenter for Justice Innovation
New York, NY7 days ago$15 - $80 per hour
...Create high-quality training data for AI systems by evaluating robotics and human-activity videos. This remote contract role uses your visual analysis skills to assess actions, improve annotations, and apply detailed quality standards. No prior AI experience is required...Hourly payContract workFor contractorsRemote workSaidGig
New York, NY21 hours ago- ...Job Description Job Description Role Title: Graphic Designer Role Type: Contractor Location: Remote We are seeking skilled Graphic... ...use their design expertise to produce high-quality graphics, evaluate creative outputs, and provide actionable feedback. No prior...Remote jobFor contractors
YO AI Labs
New York, NY8 days ago $50 - $60 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Graphic Designers (Must own MacBook) Type: Contract Compensation: $5... ...reasoning skills. Complete a brief paid assessment to evaluate your fit for the role. Resources & Support For details...Contract workSummer workFreelanceImmediate startRemote workMercor
New York, NY4 days ago$30 - $40 per hour
...Illustrator on Windows for vector illustration, logo, and layout design. Capture high-resolution screenshots with more than 2.5... ...Work independently with Adobe Illustrator to create and refine graphic designs. Collaborate asynchronously with teams to ensure...Contract workSummer workRemote workFlexible hoursMercor
New York, NY7 days ago$55 - $65 per hour
...Windows - Code Type: Contract Compensation: $55–$65/hour Location: Remote Role Responsibilities Evaluate FPGA and digital hardware designs using Quartus II on Windows . Develop and review FPGA design projects to ensure alignment with industry...Contract workSummer workRemote workFlexible hoursMercor
New York, NY2 days ago- ...the visual language of A1's product. In AI applications, visual design must do more than look polished. It must help users understand... ...rounds of interviews and a design assessment. Applications are evaluated by our team members. Interviews will be conducted via virtual...Full time
Bjak
New York, NY15 days ago $2,000 per unit
...and Jack Dorsey . Position: STEM Expert Task Pilot Type: Contract... ...agents on expert-level technical work. Design open-ended tasks with no single right answer... ...AI capabilities. Ensure tasks are evaluated automatically from 0 to 1 with partial credit...Full timeContract workSummer workRemote workMercor
New York, NY9 days ago$100 - $120 per unit
...Jack Dorsey . Position: Baseball Fan Live MLB Game AI Evaluator (US) Type: Contract Compensation: $100$120 per... ...team stats rules challenges schedules broadcasts highlights and expert-style analysis. Run the same question on two AI products side...Full timeContract workWork experience placementSummer workRemote workMercor
New York, NY9 days ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Procurement / vendor management Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote workMercor
New York, NY22 days ago$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote workMercor
New York, NY22 days ago$100k - $115k
...The Graphic Design Manager will lead the day-to-day execution of graphic design across all brand... ..., and workflow optimization. Evaluate emerging design technologies and identify... ...creative, and visual storytelling. ~ Expert proficiency in Adobe Creative Suite....Seasonal workRetrofête
New York, NY3 days ago- ...POSITION TITLE: Designer – OFFLINE Graphics (Apparel/Active/Accessories) REPORTS TO: Design Director SUPERVISES: Assistant Designer... ...compensation, assignment, training, promotion, performance evaluation, discipline and discharge. AEO also provides reasonable accommodation...Full timePart timeSummer workCasual workSeasonal workWork at officeLocal areaRemote workHome officeWeekend work
$75k - $100k
...stakes healthcare communications. Acting as both strategist and designer, you will distill complex medical content into sharp,... ...Advanced proficiency in InDesign, Illustrator, and Photoshop ~ Expert layout skills, with a strong willingness and enthusiasm to master...Full timeLocal areaFlywheel Partners
New York, NYa month ago$106k - $189.97k
...WD101447Position OverviewAutodesk is changing how the world is designed and made. From the buildings we live in to the products we use... ...better world for all. Our customers rely on Autodesk to discover, evaluate, and purchase the right products to support their education,...Full timeLive inRemote workWorldwideAutodesk
New York, NY2 days ago$24 - $28 per hour
...content reflecting our world. Job Description The Graphics Coordinator at TODAY with Jenna & Sheinelle is the primary graphics... ...to enhance segments. The Coordinator serves as the final evaluator of prepared graphics, ensuring elements are accurate, error-...Full timeWork at officeLocal areaWeekend workNBCUniversal
New York, NY23 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Design Evaluation Expert - Graphic. Be the first to apply!
Related searches
- subject matter expert New York, NY
- technology expert New York, NY
- fulfillment expert New York, NY
- guest service support expert New York, NY
- sql expert New York, NY
- remote graphic New York, NY
- graphic intern New York, NY
- entry level graphic designer New York, NY
- graphic designer full time New York, NY
- graphic production artist New York, NY