Design Evaluation Expert - Graphic - AI Trainer
$80 - $150 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world design deliverables such as brand identity systems and guidelines, campaign visuals, and packaging concepts.
- Score AI-generated and human work samples against established criteria, providing detailed written justifications for each score.
- Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on your work.
- Collaborate asynchronously and work independently to meet deadlines and improve AI model performance .
Qualifications
Must-Have
- 5+ years of professional experience in graphic, brand, or visual design.
- Background at world-class design studios or creative agencies, or in senior design roles at leading consumer or technology brands.
- Deep fluency in typography, layout, visual hierarchy, color, composition, and brand systems.
- Exceptionally strong written communication skills.
- Detail-oriented and consistent, with comfort in having your judgment reviewed.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume, portfolio, or relevant professional background to get started.
- Qualified applicants may be asked to complete a brief assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Design Evaluation Expert - Graphic - AI Trainer in Boston, MA vacancy
$40 per hour
...We are looking for a Physics Expert to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert level of physics...SuggestedHourly payFull timeContract workPart timeRemote workDataAnnotation
Boston, MA2 days ago$20 per hour
A leading AI company is seeking a UX/UI Designer to enhance AI models through design evaluation and feedback. You'll review AI-generated outputs, refining the models' aesthetics and usability. The position is flexible and remote, with compensation starting at $20/hr for...SuggestedContract workRemote workFlexible hoursDataAnnotation
Boston, MA3 days ago- A government services company is looking for a skilled Litigation Graphics Consultant to support a Federal agency's customer initiative. This role involves designing and maintaining graphics for litigation, video editing, and providing IT support during trials. Candidates...SuggestedRemote jobFlexible hours
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Position: Brand / creative direction / marketing collateral Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote workMercor
Boston, MA4 days ago$70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Generalist Expert Type: Contract Compensation: $... ...Location: Remote Role Responsibilities Evaluate AI-generated responses to ensure...SuggestedContract workSummer workRemote workMercor
Boston, MAmore than 2 months ago$20 per hour
...We are looking for a Mobile UI Designer to help train and improve cutting‑edge AI models. You’ll assess and enhance... ...systems understand, generate, and evaluate design work — including interfaces... ..., web design, product design, or graphic design Strong understanding of...Full timeContract workPart timeRemote workDataAnnotation
Boston, MA2 days ago- Overview In this role, you will evaluate AI-generated responses and provide structured written feedback. This is a great opportunity for sharp, analytical thinkers to contribute to high-impact AI research projects. Basic Qualifications Bachelor's degree from a top-500 globally...
- ...Handshake is looking for skilled KiCad and LibrePCB users to support AI research through flexible, hourly contract work. This is not a... ...with schematic capture, PCB layout, or embedded hardware design to evaluate AI-generated content and provide feedback that helps AI better...Hourly payFull timeContract workFor contractorsFreelanceRemote workFlexible hours
GrabJobs
Boston, MA5 days ago $50 - $125 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Product Design/UX Expert Type: Contract Compensation:... ...hours/week Role Responsibilities Evaluate product design decisions using professional...Contract workSummer workRemote workMercor
Boston, MAa month ago$42 - $48 per hour
...significant impact? We are looking for a creative and meticulous designer to join the Marketing team. In this role, you will be... ...awesome benefits! Aquent is an equal-opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex...Hourly payContract workTemporary workMonday to FridaySkill Corp
Boston, MA4 days ago- ...become more resilient. Underpinned by technology, data, analytics, AI, change management, talent and sustainability capabilities, our... ...distribution) and define digital supply chain strategies enabled by AI/ML.Design and implement AI-powered planning solutions (demand forecasting,...Full timeLive inWork at officeLocal area
$45 - $60 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Education Expert - Sourcing Funnel (Private) Type: Contract... ...: Remote Role Responsibilities Design realistic educational scenarios and tasks...Contract workSummer workRemote workMercor
Boston, MA2 days ago- ...Aristocrat Interactive is seeking a senior Graphic Designer to join our iLottery team in a fast-paced digital marketing environment, crafting compelling assets across web, email, social, and apps. You will collaborate with UX/UI designers and developers to adapt visuals...
Aristocrat Interactive
Boston, MA5 days ago $145k - $165k
...relationships, trusted intelligence, and expert guidance, Later removes fear... ....Built on a native, AI-powered platform and more than... ...We are looking for a Senior UX Designer to join our team and lead the... ...geographic location, and scope. We evaluate compensation bi-annually,...Permanent employmentTemporary workLocal areaImmediate startRemote workShift work$112.5k - $150k
...User Experience DesignerRole OverviewWe’re seeking a Senior UX Designer to join our User Experience team. This role offers a unique opportunity... ...for team members.Participate in usability testing sessions to evaluate design effectiveness and identify areas for improvement....FreelanceInternship$150k - $215k
...hiring a Senior Data Engineer to lead the design, development, and evolution of the data... ...of the Data Engineering organization by evaluating new technologies, improving engineering standards... ..., and scale our data ecosystem.Leverage AI tools and automation to accelerate...Full time$142.7k - $264.9k
...engine and connective tissue for Design, Data and Data Science... ...role in building and deploying AI/ML-powered digital solutions that... ...initiativesYou act as the subject matter expert to inform software products... ...studies and comparative evaluations of analytical approaches for...Full timeTemporary workLocal area$169.1k - $314k
...engine and connective tissue for Design, Data and Data Science... ...role in building and deploying AI/ML-powered digital solutions that... ...execution of simulation studies to evaluate innovative trial designs and... ..., collaborating with domain experts to productize the validation of...Full timeTemporary workLocal area$91.3k - $228.2k
...The Technology team drives the design, development, and operation of... ..., data infrastructure, and AI-enabled technologies that power... ...healthcare and ad tech domain experts. Essential Functions ~ Analyze... ...hypotheses, success metrics, evaluation frameworks, and business-...Full timePart timeFor contractorsImmediate startWorldwideIQVIA
Boston, MA2 days ago- ...project scoping, project/sample design, reception and processing of... ...Utilizing advanced statistical and AI/ML techniques to create high-... ...and functional business experts and business leaders. You... ...including safe automation design and evaluation systems. ~ Experience in...Full time
InterSources
Boston, MA4 days ago $40 per hour
...and contribute to developing cutting-edge AI systems, while enjoying the flexibility... ...state-of-the-art AI models on tasks like evaluating AI-generated quantitative analysis, solving... ...accuracy and real-world validity. Design and solve quantitative problems used to train...Hourly payFull timeRemote workFlexible hoursDataAnnotation
Boston, MA3 days ago$40 per hour
An innovative AI company in the United States is seeking experienced quantitative professionals for remote roles that involve evaluating AI-generated quantitative work, solving complex problems, and contributing to the development of cutting-edge AI systems. Ideal candidates...Hourly payRemote workDataAnnotation
Boston, MA2 days ago$90k - $130k
...decisions. Working closely with Product Design, Product Management, Clinical, Regulatory... ...environments.Expertise in both generative and evaluative research methods, with demonstrated... ...Strong commitment to embracing and leveraging AI tools in day-to-day tasks, ensuring AI-...Full timeWork at officeRelocation$70 - $80 per hour
...Senior UX Researcher role, you will play a critical part in ensuring our products and services are designed with the user in mind. You will lead research initiatives, evaluate design options and prototypes, and analyze data to provide actionable insights that will guide...- ...future of brand experience.At Jack Morton, we design and build head-turning, smile-inducing,... ...a US Jack office**Jack Morton is hiring a Graphic Designer to join our Creative team. You're... ...Slides and PowerPointGenerate conceptual AI imagery for decks, activations, and early-...Work at officeFlexible hours
$145.9k - $234.2k
...RoleModerna is seeking a Senior AI Engineer in Cambridge, MA/... ...technical leadership for the design, implementation, and operation... ...model and prompt versioning, evaluation, monitoring, incident response... ...automation, or data-intensive systems.Expert proficiency with Python and...Permanent employmentFull timeWork at officeWork from home$124k - $280k
...engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a... ...stakeholders to translate data requirements into solutions- Evaluating and recommending new data technologies and tools- Leading data...Full timeH1b$143.69k - $229.9k
...Hybrid) Reports to: Manager, User Experience Design A quick snapshot… As a Staff UX... ...work Deep command of both generative and evaluative research methods and clear judgment about... ...enterprise SaaS software environment Researching AI-powered product features, agentic...Full timeImmediate startWorldwideFlexible hours- Crain Communications is seeking a Multimedia Designer in Boston, MA, to create engaging storytelling experiences across multiple platforms. This role collaborates closely with editorial and creative teams to develop compelling multimedia content that strengthens audience...Remote job
$73.5k - $212.28k
...advanced technologies and techniques to design and develop robust data solutions for clients... ...cross-functional teams to incorporate AI into various applications- Drive initiatives... ...closely with team members. We evaluate these factors thoughtfully to establish a...Full timeH1b
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Design Evaluation Expert - Graphic - AI Trainer. Be the first to apply!
Related searches
- subject matter expert Boston, MA
- guest service support expert Boston, MA
- technology expert Boston, MA
- fulfillment expert Boston, MA
- graphic designer marketing Boston, MA
- remote graphic Boston, MA
- graphic designer Boston, MA
- graphic programmer Boston, MA
- graphic design remote Boston, MA
- visual designer Boston, MA