Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Product Design Expert — AI Evaluation (Remote)

$75 - $85 per hour

AuraOne Human Data

Remote
  • Remote job

Product Design Expert — AI Evaluation (Remote) is a remote review track for evaluating AI outputs across product design creative review workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach so the modeling team can train on it.

Why this role matters

Product Design creative review AI is only useful if a working professional would actually ship the output. AuraOne uses portfolio-credentialed reviewers to grade outputs the way a senior creative would — with craft, constraints, and tooling all in scope.

Responsibilities

  • Review AI outputs against current product design creative review craft and tooling standards for Product Design Expert — AI Evaluation (Remote) assignments.
  • Grade composition, constraint adherence, and production-readiness on a structured rubric.
  • Flag tooling-specific failures (file format, scale, naming, layer hygiene) with severity tags.
  • Capture the corrected approach or reference so the modeling team can train on it.
  • Adjudicate disputed creative judgments against published references or firm style guides.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Portfolio or production experience in product design creative review or an adjacent creative discipline for Product Design Expert — AI Evaluation (Remote) work.
  • Hands-on familiarity with the standard tooling for the discipline.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the craft issue and the standard being applied.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a model's product design creative review output against the brief and rate craft, constraints, and production-readiness.
  • Flag a tooling-specific failure (incorrect file format, unsupported feature, naming convention) with severity.
  • Adjudicate a disputed creative judgment between two reviewers using a firm style guide.
  • Audit a 25-asset batch for rubric consistency and report drift to the program lead.

Nice to have

  • Studio, agency, or in-house team experience shipping production work.
  • Prior experience reviewing AI-assisted creative tooling and its failure modes.
  • Familiarity with AAA or feature-grade pipelines and asset standards.

Skills

  • Creative review
  • Production-grade craft
  • Tooling fluency
  • Asset evaluation
  • Product Design creative review

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$75–$85 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Product Design Expert — AI Evaluation (Remote) in Remote vacancy
  • $87.19k - $119.91k

     ...factories to augmented reality and remote healthcare.ADI fosters a...  ...combines analog, digital, AI, and software technologies into...  ...more at and on LinkedIn and X.Product EngineerAnalog Devices Inc....  ...intelligent new graduate as Product (Design Evaluation) Engineer to join our... 
    Remote work
    Permanent employment
    Full time
    Work at office

    Analog Devices

    Wilmington, MA
    4 days ago
  • $50 per hour

    Prolific in Portland, Oregon is seeking Product Designers and UX Specialists to join their Expert Network for training AI models. Ideal candidates should hold a degree in...  ...relevant experience. Responsibilities include evaluating AI-generated designs, auditing accessibility... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Portland, OR
    1 day ago
  • $146.3k - $274.3k

     ...learn.We're looking for a design engineer who lives at...  ....Work directly with product and engineering to prototype...  ...already build with AI-native workflows, and we...  ...prototyping loops, rapid evaluation, continuous refinement...  ...Jose; San Francisco; Remote CaliforniaType: Full time
    Remote work
    Full time
    Temporary work
    For contractors
    Local area
    Immediate start
    Worldwide

    Adobe Systems

    San Jose, CA
    6 days ago
  • $50 per hour

    Prolific is seeking Product Designers and UX Specialists to join their Expert Network. The role involves training and evaluating AI models using real design expertise, with opportunities...  ...communication skills. Flexible hours and remote work are offered for this role. #J-1... 
    Remote job
    Hourly pay
    Flexible hours

    Prolific

    Jacksonville, FL
    4 days ago
  • $129.3k - $159k

     ...The Studio Technology Design team partners with filmmakers, artists, production teams, and technologists...  ...technologies, including AI, to improve both the...  ...site 3-4 days per week. Remote candidates are not eligible...  ...will not influence our evaluation process. We evaluate... 
    Remote work
    Work at office
    3 days per week

    Disney Interactive

    Glendale, CA
    1 day ago
  • $150 - $180 per hour

     ...Virginia Beach is seeking Mental Health Professionals to train and evaluate AI models. The role involves reviewing AI responses to...  ...attention to detail, and a reliable internet connection. Join our Expert Network to influence future AI innovations and work flexibly from... 
    Remote work
    Work from home

    Prolific

    Virginia Beach, VA
    1 day ago
  • $80 - $120 per hour

     ...Role Overview Review AI-generated documents, spreadsheets, and...  ...customer research expertise. This remote, hourly role focuses on...  ...quality, then delivering actionable evaluations. Key Responsibilities Evaluate AI-generated work products against domain-specific... 
    Remote work
    Hourly pay
    Work at office

    SaidGig

    United States
    a month ago
  •  ...Prolific is seeking Mental Health Professionals in Nashville, TN, to help train and evaluate AI models. Candidates will review AI-generated responses, complete training tasks, and provide insights based on their understanding of psychological theory. Successful participants... 
    Remote work
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Nashville, TN
    19 hours ago
  • $50 per hour

    Prolific is seeking Product Designers and UX Specialists to join their Expert Network in Columbus, Ohio. This role involves training AI models using real design expertise, evaluating, and refining AI-generated designs...  ...with hours and remote work options. #J-18808-Ljbffr... 
    Remote job
    Hourly pay

    Prolific

    Columbus, OH
    2 days ago
  • $30 per hour

    Prolific is seeking Advanced Dutch Speakers in Chicago, IL to train AI models. You will complete AI tasks and assess AI performance in...  ...competitive rates and direct payment through PayPal. Pass the evaluation, and you can start within 15 minutes. #J-18808-Ljbffr Prolific
    Remote job
    Work from home

    Prolific

    Chicago, IL
    4 days ago
  • $80 - $150 per hour

    Prolific is seeking Medical Doctors to join as Domain Expert participants in training AI models. Responsibilities include evaluating AI responses for accuracy and writing feedback for improvement. A competitive pay of $80-$150 per hour based on skills is offered. Candidates... 
    Remote job
    Hourly pay
    Work from home

    Prolific

    Denver, CO
    1 day ago
  • $157k - $267k

     ...Details We’re looking for a Product/UX Designer to own the design of Hubble’...  ...in Seattle, but West Coast Remote could be okay. Responsibilities...  ...without follow-up. Use AI tools to move faster and explore...  ...understand how developers evaluate tools, what earns their... 
    Remote work

    Jobot

    Seattle, WA
    2 days ago
  • $22 - $41 per hour

     ...ADI combines analog, digital, AI, and software technologies...  ...projects alongside a team of experts. Collaborating with colleagues...  ...possible. About the Role As a Design Evaluation Engineer Intern, you will...  ...validation of semiconductor products throughout the development... 
    Permanent employment
    Full time
    Internship
    Work at office

    Analog Devices

    Wilmington, MA
    8 hours ago
  • $89 per hour

     ...THE OPPORTUNITY: Senior Product UX Designer REPORTS TO: Senior...  ...Product LOCATION: US - Remote Headquartered in Los...  ...experiment results. Continue evaluating experiences after...  ...on small screens Expert-level Figma: component...  ...measurable outcomes. AI-native workflow: actively... 
    Remote work
    Full time
    Summer work
    Work at office
    Flexible hours

    Birdy Grey

    Los Angeles, CA
    1 day ago
  • $8 - $65 per hour

    Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    New York, NY
    1 day ago
  • $80 - $150 per hour

    Prolific is seeking Medical Doctors to train and evaluate AI models. As a Domain Expert participant, you will receive $80-$150/hr for tasks requiring your expertise. Responsibilities include reviewing AI responses for accuracy and quality, and providing structured feedback... 
    Remote job
    Work from home

    Prolific

    Seattle, WA
    5 days ago
  • Prolific is seeking HR and Talent Professionals in Austin, Texas, to join their Expert Network. Your role will involve evaluating AI outputs, developing HR scenarios, and providing feedback on HR policies. Ideal candidates will have professional experience in HR, knowledge... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    Austin, TX
    4 days ago
  • $80 - $150 per hour

    Prolific is seeking Medical Doctors to train and evaluate AI models. You'll review AI-generated clinical responses and evaluate their accuracy and appropriateness, earning competitive pay of $80-$150 per hour depending on your skills and experience. Ideal candidates must... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Portland, OR
    4 days ago
  • Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    Tucson, AZ
    3 days ago
  • $110.39k - $151.81k

     ...Intelligent Edge. ADI combines analog, digital, AI, and software technologies into solutions that combat...  .... Learn more at and on LinkedIn and X.Senior Design Evaluation EngineerAbout the RoleJoin our industry‑leading product engineering team advancing next‑generation... 
    Permanent employment
    Full time
    Work at office
    Day shift

    Analog Devices

    Wilmington, MA
    11 hours ago
  • $60 per hour

    Prolific is seeking Biology Experts and Life Science Professionals to evaluate AI-generated science and ensure compliance with scientific standards. Responsibilities...  ...from public databases, and critiquing experimental designs. Successful candidates will earn competitive pay... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    San Jose, CA
    5 days ago
  • $80 - $150 per hour

    Prolific in New York, NY, is seeking Medical Doctors to join our Expert Network for training and evaluating AI models. As a Domain Expert participant, you will review and rate AI-generated clinical responses, providing crucial feedback for AI development. You must hold... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    New York, NY
    2 days ago
  • Prolific in New York, NY, is seeking Chemistry Experts and Chemical Engineers to join its Expert Network. In this role, you will help train and evaluate AI models using your chemical expertise. Duties include evaluating AI-generated responses for accuracy and validating... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    New York, NY
    1 day ago
  • $60 per hour

    Prolific is seeking Biology Experts and Life Science Professionals to join their Expert Network to evaluate AI-generated science. This role allows you to work from home with...  ...claims, and critiquing experimental designs. Successful candidates should have a strong... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Dallas, TX
    4 days ago
  • Prolific is seeking talented Product Designers and UX Specialists to join our Expert Network for training and evaluation of cutting-edge AI models. Candidates should have a relevant educational background and at least one year of experience in design-related fields. Responsibilities... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    Arizona City, AZ
    3 days ago
  • $60 per hour

    Prolific is looking for Biology Experts and Life Science Professionals in Las Vegas, NV to evaluate AI-generated science. Successful candidates will work flexibly from home, earning up to $60 per hour for paid tasks. Responsibilities include reviewing scientific data accuracy... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Las Vegas, NV
    4 days ago
  • $65 per hour

     ...Registered Nurses - AI Training Prolific is not just another player in the AI space...  ...for Registered Nurses to help train and evaluate cutting‑edge AI models. If you have the necessary...  ...be invited to join Prolific as a Domain Expert participant, where you’ll get paid to... 
    Remote work
    Self employment
    Work from home
    Flexible hours

    Prolific

    Omaha, NE
    19 hours ago
  • $90 - $140 per hour

     ...Role Overview Contribute expert written analysis that helps train next-generation AI systems across product design, UX research, visual design...  ...frontend engineering. This remote contract role focuses on explaining...  ...for diverse audiences. Evaluate design systems,... 
    Remote work
    Hourly pay
    Contract work

    SaidGig

    United States
    14 days ago
  • $50 per hour

    Prolific seeks Product Designers and UX Specialists to help train AI models using your expertise. You'll evaluate AI-generated designs and ensure usability and accessibility while working from home. Ideal candidates hold a BS, MS, or PhD in a relevant field and have at... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    Sacramento, CA
    5 days ago
  • $60 per hour

    Prolific in Seattle, WA is searching for Chemistry Experts and Chemical Engineers to join our Expert Network to train AI models with your expertise. The role involves evaluating AI-generated chemistry, fact-checking chemical reactions, and auditing technical documentation... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Seattle, WA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Product Design Expert — AI Evaluation (Remote). Be the first to apply!