Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

General Creative - AI Creative Evaluation (Contra Labs)

Temporary

Contra Labs

About Contra Labs

Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying the patterns behind what gets created, what gets chosen, and what resonates. We believe human input will always be at the center of net new creation, and our mission is to help shape technology so human creativity can be amplified to create what today is unimaginable.

By joining the Contra Labs network you gain access to paid projects with some of the most innovative companies building the next generation of creative and AI-powered tools.

How It Works

This is an application to join the network and be eligible for roles as they arise. Projects are staffed on an as-needed basis, typically 5 to 10 hours at a time, though some may extend into longer engagements. In unique cases, we may have full-time roles available as well. When a project matches your skill set, we'll reach out with details and timeline.

To Join the Network

  1. Portfolio review - We'll assess your Contra profile and portfolio for strength in product design, specifically across desktop and mobile applications.
  2. Record a 30 second intro video - Share a quick 30 second introduction so we can get to know you.
  3. Complete profile - Once you’ve applied, we recommend completing your profile for better job matches and setting up your wallet so you can get paid when a job comes through.

What You May Work On

  • Evaluate AI-generated visual outputs across a wide range of styles, subjects, and creative formats
  • Provide clear, structured feedback on composition, color usage, styling, visual hierarchy, cohesion, mood, and overall aesthetic quality
  • Help define creative benchmarks and taste standards for what visually compelling, emotionally resonant, and culturally relevant creative work looks like in the next generation of AI-powered tools
  • Contribute to research on how convergence (shared best practices) and divergence (individual taste and creative direction) shape visual quality and creative preference

What We're Looking For

  • Strong portfolio showcasing high-quality creative work with a clear point of view, visual taste, and aesthetic consistency, shared via your Contra profile
  • Strong understanding of visual composition, styling, color, hierarchy, mood, and overall creative direction
  • Ability to articulate visual and aesthetic feedback clearly and constructively
  • Strong creative instincts and awareness of contemporary visual culture, trends, and design aesthetics
  • Comfort working in fast-paced, experimental environments (experience with AI or creative tools is a plus)
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the General Creative - AI Creative Evaluation (Contra Labs) in San Francisco, CA vacancy
  •  ...About Contra Labs Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across...  ...comes through. What You May Work On Evaluate AI-generated advertisements and marketing creative... 
    Creative
    Full time
    Contract work

    Contra Labs

    San Francisco, CA
    1 day ago
  •  ...About Contra Labs Contra Labs sits at the intersection of human creativity and technology. We partner with leading product companies to improve the creative tools...  ...a range of subjects and styles. # Skills evaluation - You’ll complete a structured videography submission... 
    Creative
    Full time
    Contract work

    Contra Labs

    San Francisco, CA
    1 day ago
  •  ...About Contra Labs Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across...  ...comes through. What You May Work On Evaluate AI-generated graphic design outputs across formats... 
    Creative
    Contract work
    Immediate start

    Contra Labs

    San Francisco, CA
    1 day ago
  • $70 per hour

    About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...investors include Benchmark , General Catalyst , Peter Thiel , Adam D'...  ...: Remote Role Responsibilities Evaluate AI-generated responses to ensure... 
    Creative
    Contract work
    Summer work
    Remote work

    mercor

    San Francisco, CA
    2 days ago
  • $105 - $140 per unit

    About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...investors include Benchmark, General Catalyst, Peter Thiel, Adam D'...  ...Football (Soccer) Fan - Live Match AI Evaluator (UK & Spain) Type: Contract... 
    Creative
    Contract work
    Summer work
    Remote work
    Flexible hours

    Mercor Inc

    San Francisco, CA
    2 days ago
  • $60 - $70 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...include Benchmark , General Catalyst , Peter Thiel , Adam...  ...Remote Role Responsibilities Evaluate AI-generated responses for safety... 
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    15 days ago
  • $50 - $90 per hour

     ...job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...investors include Benchmark , General Catalyst , Peter Thiel ,...  ...Domain Expert — AI Training & Evaluation Type: Contract Compensation... 
    Creative
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    23 days ago
  • Mercor connects elite creative and technical talent with leading AI research labs. The remote contract role evaluates AI-generated artifacts against domain-specific quality rubrics and provides clear, structured feedback to ensure accuracy and high presentation standards... 
    Creative
    Remote job
    Contract work

    mercor

    San Francisco, CA
    1 day ago
  • Mercor connects elite creative and technical talent with leading AI research labs, and seeks a Music & Lyrics Expert to evaluate AI-generated content remotely. You will assess music quality, compare lyrics to published songs, and rate for creativity, prompt adherence,... 
    Creative
    Remote job
    Contract work

    mercor

    San Francisco, CA
    1 day ago
  • $80 - $120 per hour

    Mercor connects elite creative and technical talent with leading AI research labs. This contract role evaluates AI-generated artifacts in humanities/arts/culture, delivering clear feedback to improve model outputs. Remote work, English fluency required, 5+ years of domain... 
    Creative
    Remote job
    Contract work
    Work at office

    mercor

    San Francisco, CA
    1 day ago
  • Mercor connects elite creative and technical talent with leading AI research labs. A remote contract role as Customer success / support operations evaluator seeks a highly experienced professional to assess AI outputs against quality rubrics. The candidate will identify... 
    Creative
    Remote job
    Contract work

    mercor

    San Francisco, CA
    2 days ago
  • Mercor connects elite creative and technical talent with leading AI research labs. A remote contract role focuses on evaluating AI-generated artifacts against quality rubrics, identifying errors, and delivering structured feedback to support AI model improvements. Applicants... 
    Creative
    Remote job
    Contract work
    Work at office

    Mercor Inc

    San Francisco, CA
    2 days ago
  • Mercor connects elite creative and technical talent with leading AI research labs. We are hiring a Music Audio Expert - Punjabi for a remote contract up to 6 months. Responsibilities include evaluating AI model outputs for lyrics and voice, scoring training data quality... 
    Creative
    Remote job
    Contract work

    mercor

    San Francisco, CA
    1 day ago
  • YO AI Labs is seeking a Creative & Design Specialist to evaluate AI-generated outputs, provide high-quality human feedback, and improve creative workflows. You will work remotely, collaborating on graphic design, UI/UX, motion graphics, and multimedia tasks across a range... 
    Creative
    Remote job
    Flexible hours

    YO AI Labs

    San Francisco, CA
    1 day ago
  • $100 - $150 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...include Benchmark , General Catalyst , Peter Thiel , Adam...  ...pipelines , and technical reports. Evaluate AI-generated or human-created... 
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $100 - $150 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...include Benchmark , General Catalyst , Peter Thiel , Adam...  ..., and A/B test write-ups . Evaluate AI-generated or human-created... 
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    12 days ago
  • $150 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...include Benchmark , General Catalyst , Peter Thiel , Adam...  ...consistent model response grading. Evaluate clinical dialogues for accuracy... 
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    15 days ago
  • $20 - $160 per hour

     ...job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...investors include Benchmark , General Catalyst , Peter Thiel ,...  ...Health AI Conversation Quality Evaluation Type: Contract Compensation... 
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    4 days ago
  • $100 - $150 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...include Benchmark , General Catalyst , Peter Thiel , Adam...  ...Remote Role Responsibilities Evaluate AI-generated artifacts for usability... 
    Creative
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    12 days ago
  • $80 - $120 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...include Benchmark , General Catalyst , Peter Thiel , Adam...  ...analysis / quantitative readouts Evaluator Type: Contract Compensation... 
    Creative
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    14 days ago
  •  ...Evaluate AI model safety by designing adversarial test prompts and classifications...  ...accelerator for frontier AI labs and a trusted partner for...  .... The work calls for creativity, analytical rigor, and...  ...be egregious and contractors generally will not view generated imagery... 
    Creative
    Part time
    For contractors

    Turing

    San Francisco, CA
    14 days ago
  • $90 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...include Benchmark , General Catalyst , Peter Thiel , Adam...  ...those that merely look correct. Evaluate responsive behavior and semantic... 
    Creative
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    9 days ago
  • $100 - $150 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...include Benchmark , General Catalyst , Peter Thiel , Adam...  ...Remote Role Responsibilities Evaluate AI-generated artifacts for usability... 
    Creative
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    1 day ago
  • $85 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...include Benchmark , General Catalyst , Peter Thiel , Adam...  ...coding agents to complete and evaluate complex infrastructure engineering... 
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    15 days ago
  • $170 - $190 per hour

     ...job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...investors include Benchmark , General Catalyst , Peter Thiel ,...  ...- Clinical Documentation & AI Evaluation Type: Contract Compensation... 
    Creative
    Contract work
    Work experience placement
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    13 days ago
  • $90 per hour

     ...job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...investors include Benchmark , General Catalyst , Peter Thiel ,...  ..., preference-labeling, model-evaluation, or structured code-review work... 
    Creative
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $170 - $190 per hour

     ...job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...investors include Benchmark , General Catalyst , Peter Thiel ,...  ...Outpatient Clinical Documentation & AI Evaluation Type: Contract... 
    Creative
    Contract work
    Work experience placement
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    21 days ago
  • $60 - $90 per hour

     ...job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...investors include Benchmark , General Catalyst , Peter Thiel ,...  ...Machine Learning Engineer — Model Evaluation & Experimentation Type: Contract... 
    Creative
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    12 days ago
  • $43 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...include Benchmark , General Catalyst , Peter Thiel , Adam...  ...week Role Responsibilities Evaluate AI model output lyrics , voice... 
    Creative
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $60 - $100 per hour

     ...job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...investors include Benchmark , General Catalyst , Peter Thiel ,...  ...PCB / 3D Design Engineer — AI Evaluation Type: Contract Compensation... 
    Creative
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    11 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to General Creative - AI Creative Evaluation (Contra Labs). Be the first to apply!