Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Content Designer for AI Output Evaluation (Remote)

$75 per hour

AuraOne, Inc.

Content Designer for AI Output Evaluation (Remote) is a remote review track for evaluating AI outputs across content designer creative review workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach so the modeling team can train on it.

Why this role matters

Content Designer creative review AI is only useful if a working professional would actually ship the output. AuraOne uses portfolio-credentialed reviewers to grade outputs the way a senior creative would - with craft, constraints, and tooling all in scope.

Responsibilities
  • Review AI outputs against current content designer creative review craft and tooling standards for Content Designer for AI Output Evaluation (Remote) assignments.
  • Grade composition, constraint adherence, and production-readiness on a structured rubric.
  • Flag tooling-specific failures (file format, scale, naming, layer hygiene) with severity tags.
  • Capture the corrected approach or reference so the modeling team can train on it.
  • Adjudicate disputed creative judgments against published references or firm style guides.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
  • Portfolio or production experience in content designer creative review or an adjacent creative discipline for Content Designer for AI Output Evaluation (Remote) work.
  • Hands-on familiarity with the standard tooling for the discipline.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the craft issue and the standard being applied.
  • Reliable async availability for at least 10 hours per week.
Example tasks
  • Grade a model's content designer creative review output against the brief and rate craft, constraints, and production-readiness.
  • Flag a tooling-specific failure (incorrect file format, unsupported feature, naming convention) with severity.
  • Adjudicate a disputed creative judgment between two reviewers using a firm style guide.
  • Audit a 25-asset batch for rubric consistency and report drift to the program lead.
Nice to have
  • Studio, agency, or in-house team experience shipping production work.
  • Prior experience reviewing AI-assisted creative tooling and its failure modes.
  • Familiarity with AAA or feature-grade pipelines and asset standards.
Skills
  • Creative review
  • Production-grade craft
  • Tooling fluency
  • Asset evaluation
  • Content Designer creative review
Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$75 / hr

Portfolio or production experience in content designer creative review or an adjacent creative discipline for Content Designer for AI Output Evaluation (Remote) work. Hands-on familiarity with the standard tooling for the discipline. Comfort applying multi-page rubrics consistently across long batches. Clear written reasoning that names the craft issue and the standard being applied. Reliable async availability for at least 10 hours per week.

#J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Content Designer for AI Output Evaluation (Remote) in United States vacancy
  •  ...AuraOne, Inc. is seeking a Content Designer for AI Output Evaluation (Remote) to review AI outputs against craft, constraints, and tooling standards. This independent contractor role emphasizes producing documented corrected approaches so the modeling team can train on... 
    Remote work
    For contractors
    10 hours per week

    AuraOne, Inc.

    United States
    3 days ago
  •  ...AuraOne is seeking a remote Game Designer / Gameplay Developer contractor to evaluate AI outputs across game art workflows. You will grade craft, constraints, and tooling adherence, flag production issues, and document corrected approaches for training the modeling team... 
    Remote work
    For contractors
    10 hours per week

    AuraOne

    United States
    4 days ago
  •  ...AI Trainer Jobs seeks a Senior Presentation Designer to participate in a remote review track evaluating AI outputs across senior presentation designer workflows. You will assess craft, constraints, and tooling adherence, flag production-readiness issues, and document... 
    Remote work
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    4 days ago
  •  ...AuraOne is seeking a remote VFX Artist / 3D Animator reviewer to evaluate AI outputs for 3D design workflows. You will assess craft, constraints, and tooling adherence, flag production-readiness issues, and document corrections to train the modeling team. This is a contractor... 
    Remote work
    For contractors
    10 hours per week

    AuraOne

    United States
    4 days ago
  • YO AI Labs seeks an AI Evaluation Specialist to assess enterprise AI outputs on a contractual, remote basis across the US, Canada, UK, Ireland, Australia, and New Zealand. You will apply rubrics, identify weaknesses, and provide concrete feedback to improve systems. The... 
    Remote job

    YO AI Labs

    San Francisco, CA
    4 days ago
  •  ...A Frontier AI Company is seeking a Senior Digital Designer for a remote, part-time independent contract role. The work focuses on reviewing, grading, and providing...  ...improvements, with an emphasis on consistent evaluation and growth-design judgment rather than creating original... 
    Remote work
    Contract work
    Part time

    A Frontier AI Company

    United States
    2 days ago
  •  ...s the role?As a Staff Content Designer within UX Platform, you...  ...experience.With UX AI Enablement, you'll make...  ...documentation, and quality evaluations that let AI-assisted...  ...determines if the output meets the quality bar....  ...once or twice per week. Remote candidates outside commutable... 
    Remote work
    Full time
    Work at office
    Local area
    Visa sponsorship
    Flexible hours

    Etsy

    Brooklyn, NY
    4 days ago
  • $80 - $120 per hour

     ...Weekday AI is seeking experienced Evaluators to review AI-generated artifacts for data quality and CRM operations. This is a fully remote, hourly engagement. You will apply deep subject-matter...  ...structured feedback, and help improve output accuracy. Compensation is $80–... 
    Remote work
    Hourly pay
    Weekly pay
    For contractors
    Weekday work

    Weekday AI

    United States
    9 hours ago
  •  ...Obsidian is seeking expert Evaluators in Software Engineering to review AI-generated slides, spreadsheets, and documents...  ...subject-matter expertise to grade outputs and provide actionable feedback in a clear, structured format. This remote, hourly engagement requires 5+... 
    Remote work
    Hourly pay
    Work at office

    Mercor Inc

    San Francisco, CA
    4 days ago
  • $50 per hour

     ...Prolific in Portland, Oregon is seeking Product Designers and UX Specialists to join their Expert Network for training AI models. Ideal candidates should hold a degree...  ...relevant experience. Responsibilities include evaluating AI-generated designs, auditing accessibility,... 
    Remote work
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Portland, OR
    5 days ago
  •  ...is hiring a contract Customer success / support operations Evaluator to assess AI-generated artifacts against domain-specific quality rubrics...  ...slide decks, and provide structured feedback to improve AI outputs. You will work independently and asynchronously with global... 
    Remote job
    Contract work

    mercor

    San Francisco, CA
    5 days ago
  • $100 per hour

     ...Key Responsibilities Evaluate and refine AI-generated responses for accuracy,...  ...and analytical rigor. Conduct content reviews, quality assurance,...  ...rubric-based assessments of AI outputs. Annotate data, interpret...  ...program is preferred. Work Terms Remote, part-time independent... 
    Remote work
    Hourly pay
    Part time
    For contractors

    SaidGig

    New York, NY
    2 days ago
  •  ...AI Trainer Jobs seeks a Visual Designer (Motion & 3D) for a remote reviewer track evaluating AI outputs across 3D design workflows. You will assess craft, constraints, and tooling adherence, flag production-readiness issues, and document the corrected approach for training... 
    Remote work

    AuraOne

    New York, NY
    4 days ago
  •  ...SaidGig is seeking a remote contract designer to apply creative and multimedia expertise to AI systems through structured design, media, evaluation, and feedback workflows. Experience with professional...  ...Behance; evaluate AI-generated outputs for accuracy; and #J-18808-... 
    Remote work
    Contract work

    SaidGig

    United States
    3 days ago
  •  ...Partner Company, a remote-first AI research initiative, seeks a senior animator-evaluator to assess AI-generated performances and establish rigorous evaluation standards for realism. You will define benchmarks and rubrics, then apply them to character animation, facial... 
    Remote work

    Partner Engineering and Science

    United States
    4 days ago
  •  ...Location: Philippines (Remote) Schedule: US...  ..., IT IS INVESTING IN AI-POWERED TECHNOLOGIES...  ...RESEARCH, PERSUASIVE CONTENT STRATEGY, AND AI-POWERED...  ...Senior E-commerce Content Designer & AI Visual Content...  ...polished final assets. Evaluate AI-generated outputs for visual quality,... 
    Remote work
    Full time

    OpenKrill

    New York, NY
    3 days ago
  •  ...Weekday AI is seeking experienced UI/UX and product design professionals to contribute to an AI research initiative evaluating how AI systems perform real-world digital product design work....  ...production-grade design judgment, with fully remote, contract-based engagement and... 
    Remote work
    Weekly pay
    Contract work
    Weekday work

    Weekday AI

    United States
    10 hours ago
  • $30 per hour

     ...another player in the AI space – we are building...  ...Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are...  ...integrity of design outputs. This is a flexible, ad...  ...and "enterprise-ready" content, ensuring outputs are... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    New York, NY
    8 hours ago
  • $50 per hour

    Prolific is seeking Product Designers and UX Specialists to join their Expert Network. The role involves training and evaluating AI models using real design expertise, with opportunities...  ...skills. Flexible hours and remote work are offered for this role. #J-188... 
    Remote job
    Hourly pay
    Flexible hours

    Prolific

    Jacksonville, FL
    3 days ago
  • $50 per hour

     ...Prolific in the United States is seeking Product Designers and UX Specialists to join our Expert Network to help train and evaluate cutting-edge AI models using real design expertise. If you have the necessary experience, we’ll send you a quick test to assess your skills... 
    Remote work
    Hourly pay

    Prolific

    United States
    2 days ago
  • $38.78 per hour

    Content Specialist & Visual Designer We are seeking a Content Specialist & Visual...  ...take operational outputs, progress narratives...  ...generative AI and prompt engineering...  ...: In-Office T/W/Th; Remote M/F Role Type: Full-...  ...opportunity employer. We evaluate qualified applicants... 
    Remote work
    Hourly pay
    Weekly pay
    Full time
    Contract work
    Work at office

    Aquent (United States)

    Cupertino, CA
    21 hours ago
  • $50 - $60 per hour

     ...Presentation Design Evaluation Specialist is a remote review track for evaluating AI outputs across presentation design evaluation specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document... 
    Remote job
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    18 days ago
  • DataAnnotation seeks an experienced UI/UX Product Designer - AI Trainer to shape evaluation briefs for frontier AI models on real visual design tasks. This...  ...what works and where approaches break down. Remote work from Evanston, IL with pay per hour. #J-18808-Ljbffr... 
    Remote job
    Hourly pay
    Contract work

    DataAnnotation

    Evanston, IL
    4 days ago
  •  ...Prolific is seeking HR and Talent Professionals in Austin, Texas, to join their Expert Network. Your role will involve evaluating AI outputs, developing HR scenarios, and providing feedback on HR policies. Ideal candidates will have professional experience in HR, knowledge... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    Austin, TX
    2 days ago
  • $60 - $90 per hour

     ...About the role Acting and Animation Evaluation Specialist is a remote review track for evaluating AI outputs across animation review workflows. Reviewers grade craft...  ...tooling all in scope. Judge creative and design output against professional standards. Craft counts... 
    Remote work
    Contract work
    For contractors
    10 hours per week

    AuraOne

    San Jose, CA
    23 days ago
  •  ...are uniting human teams with AI agents. By orchestrating the...  ...we show up for every day.As a Content Designer II at Smartsheet, you’ll collaborate...  .... This role is eligible for remote work within Costa Rica. You...  ..., and AI-generated outputs. You will ensure AI responses... 
    Remote work
    Full time
    Work at office
    Flexible hours

    Smartsheet

    San Jose, CA
    3 days ago
  •  ...Science Specialists to join its Expert Network to help train and evaluate AI models. You’ll take a brief skills test and, if successful,...  ...home to support high‑quality data collection. You will rank AI outputs, review CS research papers and AI summaries, and perform fact... 
    Remote work
    Work from home

    Prolific

    New York, NY
    11 hours ago
  •  ...Specialists to join our Expert Network for training and evaluating AI models. After a quick test, you may join...  ...Researchers hire your CS expertise to grade AI outputs, review papers, and verify code logic. You’ll work remotely with competitive pay, flexible hours, and the... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    New York, NY
    2 days ago
  •  ...Feedinkoo is seeking a remote contractor to review AI-generated content and create high-quality prompts that guide AI learning. As part of a fast-growing...  ...Services company, you will enhance AI performance by evaluating responses and ensuring model integrity. The ideal... 
    Remote work
    For contractors

    Feedinkoo

    United States
    2 days ago
  • $50 per hour

     ...Talent Professionals to join their Expert Network, helping train AI models using real HR expertise. This role offers competitive...  ...the opportunity to work from home. Responsibilities include evaluating AI outputs, creating HR scenarios, and doing data validation. Candidates... 
    Remote work
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Oklahoma City, OK
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Content Designer for AI Output Evaluation (Remote). Be the first to apply!