Design Evaluation Expert - Graphic - AI Trainer
Mercor
1. Role Overview Mercor is partnering with a leading AI research organization to engage experienced brand designers for a project focused on evaluating how well AI systems perform real-world brand and design work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications. 2. Key Responsibilities Design precise, task-specific grading criteria for real-world brand design deliverables (brand identity systems and guidelines, logos and visual identity, campaign and marketing visuals, packaging concepts, presentation and layout design, digital and social assets, and brand messaging and positioning) Score AI-generated and human work samples against those criteria, with detailed written justifications for every score Apply consistent, evidence-based judgment so that scores are reproducible and defensible Incorporate structured feedback from senior reviewers and iterate quickly on your work 3. Ideal Qualifications 5+ years of professional experience in brand, visual, or graphic design Background specifically at world-class independent brand and design agencies (e.g., Pentagram, Wolff Olins, Landor, Collins, IDEO) — agency experience, not in-house or enterprise design teams Experience in one of the core brand disciplines: Creative Director, Brand Designer (logo, visual identity, supporting graphics), Web Designer (UI/UX, web architecture), or Graphic Designer Deep fluency in the day-to-day craft: typography, layout and visual hierarchy, color, composition, logo and brand identity systems, and articulating critique the way a creative director would in a review Exceptionally strong written communication, with the ability to explain exactly why a piece of work does or does not meet the bar Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers Experience with copywriting and brand messaging — including audience research, competitor research, and positioning — is a strong plus Prior experience with AI training, evaluation, or human-data projects is a strong plus #J-18808-Ljbffr Mercor
$80 - $150 per hour
...technical talent with leading AI research labs. Headquartered... ...Jack Dorsey . Position: Design Expert Type: Contract Compensation... ...professional experience in graphic, brand, or visual design. ~... ...with AI training , evaluation, or human-data projects....SuggestedContract workSummer workRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote work- A government services company is looking for a skilled Litigation Graphics Consultant to support a Federal agency's customer initiative. This role involves designing and maintaining graphics for litigation, video editing, and providing IT support during trials. Candidates...SuggestedRemote jobFlexible hours
- DataAnnotation is seeking an Illustrator to help train AI models by evaluating UI/UX outputs and providing detailed feedback. Your design expertise will guide improvements in aesthetics, usability, and creative quality for next‑gen AI tools used by designers. As an independent...SuggestedRemote jobFor contractorsWork from homeFlexible hours
- ...collaborating with a leading AI lab to engage experienced educators... ...development and instructional design, assessment and psychometrics,... ...Work spans task design, evaluation, and structured feedback on AI... ...into reviewer, lead, and domain‑expert roles #J-18808-Ljbffr Obsidian
- Overview In this role, you will evaluate AI-generated responses and provide structured written feedback. This is a great opportunity for sharp, analytical thinkers to contribute to high-impact AI research projects. Basic Qualifications Bachelor's degree from a top-500 globally...
- Mercor is seeking senior social work professionals to design evaluation tasks for AI systems operating in large human services and clinical social work settings. The role focuses on creating realistic scenarios and reference outputs that guide how senior clinicians think...
$50 - $125 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Product Design/UX Expert Type: Contract Compensation:... ...hours/week Role Responsibilities Evaluate product design decisions using professional...Contract workSummer workRemote work- ...Job Title- Graphic Designer 3 Location- Boston, MA, United States, 02114 Reporting Type- Onsite Duration: 8 month... ...execution. ~ Market Visits: As needed, conduct market visits to evaluate execution of marketing initiatives, and competitive insights....Seasonal work
$70 - $100 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Particle & Nuclear Physics Expert Type: Contract Compensation... .../week Role Responsibilities Design challenging computational problems to evaluate AI capabilities in Particle & Nuclear...Contract workSummer workRemote work- ...Job Description Job Description Design Expert Job Type: Contractor Location: Remote Schedule: Flexible... ...We are seeking senior Product Design and AI-Assisted Development Experts to create evaluation tasks for AI systems working across rapid prototyping...Remote jobWeekly payContract workFor contractorsFlexible hours
- ...become more resilient. Underpinned by technology, data, analytics, AI, change management, talent and sustainability capabilities, our... ...distribution) and define digital supply chain strategies enabled by AI/ML.Design and implement AI-powered planning solutions (demand forecasting,...Full timeLive inWork at officeLocal area
- ...candidates at this time. About Mercor Mercor partners with leading AI labs and enterprises to train frontier models using human... ...systems in your area of expertise. One interview, real results AI experts share how Mercor made hiring faster, fairer, and easier — with just...Contract workFor contractorsRemote work
$112.5k - $150k
...User Experience DesignerRole OverviewWe’re seeking a Senior UX Designer to join our User Experience team. This role offers a unique opportunity... ...for team members.Participate in usability testing sessions to evaluate design effectiveness and identify areas for improvement....FreelanceInternship$142.7k - $264.9k
...engine and connective tissue for Design, Data and Data Science... ...role in building and deploying AI/ML-powered digital solutions that... ...initiativesYou act as the subject matter expert to inform software products... ...studies and comparative evaluations of analytical approaches for...Full timeTemporary workLocal area$169.1k - $314k
...engine and connective tissue for Design, Data and Data Science... ...role in building and deploying AI/ML-powered digital solutions that... ...execution of simulation studies to evaluate innovative trial designs and... ..., collaborating with domain experts to productize the validation of...Full timeTemporary workLocal area$150k - $215k
...hiring a Senior Data Engineer to lead the design, development, and evolution of the data... ...of the Data Engineering organization by evaluating new technologies, improving engineering standards... ..., and scale our data ecosystem.Leverage AI tools and automation to accelerate...Full time$100k - $157k
...beyond. As a Senior UX Designer on our UX team, you'll... ...finance, and beyond. As AI becomes an increasingly... ...product managers, domain experts, and fellow UX... ...of AI: Explore and evaluate emerging AI capabilities... ...Interaction Design, Psychology, Graphic Design, Computer...Temporary workWorldwide- ...UX Designer Mid-Level | 3-5 Years | Boston, MA | In-Office | Full-Time... ..., hardware, software, AI, product, and design. We are growing... ...product managers and engineers to evaluate tradeoffs and move toward... ...systems without needing to become experts in the machinery underneath....Full timeWork at officeImmediate startRemote workVisa sponsorship
$70 - $80 per hour
...Senior UX Researcher role, you will play a critical part in ensuring our products and services are designed with the user in mind. You will lead research initiatives, evaluate design options and prototypes, and analyze data to provide actionable insights that will guide...$90k - $130k
...decisions. Working closely with Product Design, Product Management, Clinical, Regulatory... ...environments.Expertise in both generative and evaluative research methods, with demonstrated... ...Strong commitment to embracing and leveraging AI tools in day-to-day tasks, ensuring AI-...Full timeWork at officeRelocation- ...is partnering with a leading AI lab to hire experienced new business... ...The role emphasizes creating, evaluating, and refining AI-generated... ..., and data-driven exhibit design. We seek 3+ years in high-growth... ...enterprise B2B settings, with expert PowerPoint skills and precise...Remote job
$100k - $160k
...and Data Engineering practice. You will design, build, and maintain scalable data pipelines... ...that enable advanced analytics, AI, and intelligent automation. Key Responsibilities... ..., and reliability of data feeds. Evaluate and implement streaming and real‑time data...For contractorsImmediate startRemote workHome officeFlexible hoursShift work$117.6k - $161.7k
...Become a part of our caring community The Senior Data Engineer designs, builds, and maintains data processing solutions that enable... ...quality, reliability, and performance. The successful candidate will evaluate and select appropriate technologies, implement and monitor data...Bi-weekly payFull timeTemporary workApprenticeshipWork at officeImmediate startRemote workWork from homeHome office$145.9k - $234.2k
...RoleModerna is seeking a Senior AI Engineer in Cambridge, MA/... ...technical leadership for the design, implementation, and operation... ...model and prompt versioning, evaluation, monitoring, incident response... ...automation, or data-intensive systems.Expert proficiency with Python and...Permanent employmentFull timeWork at officeWork from home$90.16k - $167.44k
AI EngineerJob Posting DescriptionThe AI Engineer will join the AI team supporting the... .../John Hancock. This role will help design, build, deploy, and scale production-grade... ...processing, feature engineering, model training, evaluation, deployment, and monitoring....Full timeTemporary workLocal area- ...Experience Design And Research LeadWe are seeking a highly motivated, organized, and strategic... ...roadmap; and guide the iterative design, evaluation, and refinement of user experience... ...with delivery plan.Experience in working in AI enablement solution design and...Full timeContract workRemote workMonday to FridayFlexible hours
- ...help create user-friendly solutions as new AI-powered applications are built. Hybrid... ...Title: UI/UX & Spatial Experience Designer Location East Boston, MA I.... ...and executive presentations. 2. Evaluate design, prototyping, spatial computing, visualization...Local area
- ...Senior UI/UX Designer IIEmployment Type: Full-Time, ExperiencedCGS is seeking a Senior UI/UX Designer to join our team supporting a... ...scale UX design efforts to include research, blueprinting, and evaluating existing systems.Manage the planning, design, and implementation...Full timeWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Design Evaluation Expert - Graphic - AI Trainer. Be the first to apply!
- sql expert Boston, MA
- subject matter expert Boston, MA
- fulfillment expert Boston, MA
- guest service support expert Boston, MA
- technology expert Boston, MA
- remote graphic Boston, MA
- graphic Boston, MA
- visual designer Boston, MA
- full-time, temporary graphic designer Boston, MA
- graphic designer full time Boston, MA


