Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Content Designer - AI Creative Evaluation (Contra Labs)

Temporary

Contra Labs

About Contra Labs

Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying the patterns behind what gets created, what gets chosen, and what resonates. We believe human input will always be at the center of net new creation, and our mission is to help shape technology so human creativity can be amplified to create what today is unimaginable.

By joining the Contra Labs network you gain access to paid projects with some of the most innovative companies building the next generation of creative and AI-powered tools.

How It Works

This is an application to join the network and be eligible for roles as they arise. Projects are staffed on an as-needed basis, typically 5 to 10 hours at a time, though some may extend into longer engagements. In unique cases, we may have full-time roles available as well. When a project matches your skill set, we'll reach out with details and timeline.

To Join the Network

  1. Portfolio review - We'll assess your Contra profile and portfolio for strength in content design, with a focus on ad creative and performance-driven visual content.
  2. Record a 30 second intro video - Share a quick 30 second introduction so we can get to know you.
  3. Complete profile - Once you’ve applied, we recommend completing your profile for better job matches and setting up your wallet so you can get paid when a job comes through.

What You May Work On

  • Evaluate AI-generated content design outputs with a focus on ad creatives, social media assets, and performance-driven visual content
  • Provide clear, structured feedback on visual impact, messaging clarity, brand consistency, and scroll-stopping effectiveness
  • Help define creative benchmarks and taste standards for what great ad design looks like in the next generation of AI-powered tools
  • Contribute to research on how convergence (shared best practices) and divergence (individual taste and creative direction) shape content design quality

What We're Looking For

  • Strong portfolio showcasing high-quality content and ad design work across platforms (social, display, paid media), shared via your Contra profile
  • Deep understanding of what makes ad creative effective, visually compelling, and on-brand across formats and channels
  • Ability to articulate creative and strategic feedback on content design clearly and constructively
  • Comfort working in fast-paced, experimental environments (experience with AI or design tools is a plus)
Vacancy posted 24 days ago
Similar jobs that could be interesting for youBased on the Content Designer - AI Creative Evaluation (Contra Labs) in San Francisco, CA vacancy
  •  ...About Contra Labs Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies...  ...improve their tools across design, video, development, and...  ...mobile applications. Skills evaluation: You'll rate AI-generated... 
    Creative
    Full time
    Contract work

    Contra Labs

    San Francisco, CA
    6 days ago
  •  ...About Contra Labs Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies...  ...improve their tools across design, video, development, and beyond...  ...What You May Work On Evaluate AI-generated graphic design outputs... 
    Creative
    Contract work
    Immediate start

    Contra Labs

    San Francisco, CA
    24 days ago
  •  ...About Contra Labs Contra Labs sits at the intersection of human creativity and technology. We partner with leading...  ...as the real-world content they're built to understand...  ...quality. # Skills evaluation - You’ll complete a...  ...submission designed to evaluate attention... 
    Creative
    Full time
    Contract work

    Contra Labs

    San Francisco, CA
    24 days ago
  •  ...About Contra Labs Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies...  ...improve their tools across design, video, development, and beyond...  ...What You May Work On Evaluate AI-generated advertisements and... 
    Creative
    Full time
    Contract work

    Contra Labs

    San Francisco, CA
    24 days ago
  • $70 - $120 per hour

     ...week Open to: USA Join a leading AI lab's cutting-edge GenAI team to be at the...  ...'re seeking a talented Senior Motion Designer and Creative Technologist with deep, hands-on...  ...Remotion, Canvas, SVG or Three.js. Evaluate AI-generated motion graphics and video... 
    Creative
    Full time
    Contract work
    Weekday work

    Mercor

    San Francisco, CA
    11 days ago
  • $85 per hour

     ...Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review... 
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    9 days ago
  • $80 - $120 per hour

     ...Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour... 
    Creative
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    28 days ago
  • $90 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...that merely look correct. Evaluate responsive behavior and semantic...  ...assessment background. Pixel-perfect design-to-code experience. Web... 
    Creative
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • $70 - $120 per hour

     ...Open to: USA Join a leading AI lab's cutting-edge GenAI team to...  ...Art Director or Senior Brand Designer with deep, hands-on agency or...  ...in editable source files. Evaluate AI-generated design work and...  ...or senior designer at a creative agency, brand consultancy, packaging... 
    Creative
    Full time
    Contract work
    Weekday work

    Mercor

    San Francisco, CA
    11 days ago
  • $189k - $274k

     ...within the AIUX repertoire.Design targeted experiments...  ...concepts based on your creative ideas.Help drive...  ...launches. Contribute to the lab's creation of intellectual...  ..., and designing human-AI collaboration workflows...  ...leaders.Experience in evaluating complex spaces to surface... 
    Creative

    Google

    San Francisco, CA
    1 day ago
  • $65 per hour

     ...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...: Remote Role Responsibilities Evaluate FPGA and digital hardware designs using Quartus II on Windows .... 
    Creative
    Remote job
    Contract work
    Summer work
    Flexible hours

    Mercor

    San Francisco, CA
    18 days ago
  • $40 per hour

     ...job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Remote Role Responsibilities Evaluate the use of Photoshop for...  ...photographers, retouchers, and graphic designers. Capture high-resolution... 
    Creative
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    28 days ago
  • $150 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...model response grading. Evaluate clinical dialogues for accuracy...  ...medical education Grading-criteria design or clinical guideline... 
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    9 days ago
  • $125 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Dorsey . Position: Product Design/UX Expert Type: Contract...  ...week Role Responsibilities Evaluate product design decisions using... 
    Creative
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    27 days ago
  • $20 - $160 per hour

     ...job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Health AI Conversation Quality Evaluation Type: Contract Compensation...  ...human-feedback, evaluation, or content review. Background in... 
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    28 days ago
  • $40 per hour

     ...Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Location: Remote Role Responsibilities Evaluate the functionality and performance of Blender on... 
    Creative
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    4 days ago
  • $100 - $150 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Role Responsibilities Design precise, task-specific grading criteria...  ..., and technical reports. Evaluate AI-generated or human-created... 
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • $70 per hour

     ...Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and... 
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    26 days ago
  • $100 - $150 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Role Responsibilities Design precise, task-specific grading criteria...  ..., and A/B test write-ups . Evaluate AI-generated or human-created... 
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $30 per hour

     ...Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...it, answering questions, and correcting errors. Evaluate the experience and deliverables, providing concise... 
    Creative
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    17 days ago
  • $80 - $120 per hour

     ...Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Position: Data analysis / quantitative readouts Evaluator Type: Contract Compensation: $80–$120/hour... 
    Creative
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    8 days ago
  • $70 - $110 per hour

     ...Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated operational plans , staff schedules... 
    Creative
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    26 days ago
  • $50 - $90 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Domain Expert — AI Training & Evaluation Type: Contract Compensation...  ...reflecting practical work. Design challenging finance tasks and... 
    Creative
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    6 days ago
  • $100 - $150 per hour

     ...Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software... 
    Creative
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    25 days ago
  • $60 - $90 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Learning Engineer — Model Evaluation & Experimentation Type: Contract...  ...Role Responsibilities Design tasks by transforming real ML research... 
    Creative
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $60 - $70 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Role Responsibilities Evaluate AI-generated responses for safety...  ...and overall quality. Review content involving misinformation, political... 
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    10 days ago
  • $70 - $110 per hour

     ...Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , emails,... 
    Creative
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    21 days ago
  • $90 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-to-code experience. Accessibility... 
    Creative
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • $70 - $120 per hour

     ...Open to: USA Join a leading AI lab's cutting-edge GenAI team to...  ...audio post-production. Design challenging, real-world music...  ...editable session formats. Evaluate AI-generated music, voice-over...  ...skills and the ability to explain creative decisions clearly. About... 
    Creative
    Full time
    Contract work
    Weekday work

    Mercor

    San Francisco, CA
    11 days ago
  • $70 - $120 per hour

     ...Open to: USA Join a leading AI lab's cutting-edge GenAI team to...  ...Editorial, Deck & Document Designer with deep, hands-on presentation...  ...editable source formats. Evaluate AI-generated presentations,...  ...skills and the ability to explain creative decisions clearly. About... 
    Creative
    Full time
    Contract work
    Weekday work

    Mercor

    San Francisco, CA
    11 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Content Designer - AI Creative Evaluation (Contra Labs). Be the first to apply!