Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Producer (Remote) — AI Evaluation & Benchmark Creator

Temporary

YO AI Labs

YO AI Labs is seeking an experienced Producer (Film/TV/Digital/Live) for a remote contractor role to design and evaluate realistic production benchmarks. You will craft evaluation tasks, call sheets, budgets, and schedules, advancing multi-constraint scenarios while ensuring industry relevance and high-quality outputs.

This position emphasizes independent remote work with quick onboarding and output-based compensation, requiring strong documentation and analytical judgment from seasoned

#J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Producer (Remote) — AI Evaluation & Benchmark Creator in Chicago, IL vacancy
  • Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models in partnership with a leading AI lab. You will assess AI-generated...  ...~20 hours per week, flexible commitment, and a remote setup for qualified applicants. #J-18808-Ljbffr... 
    Remote work
    Immediate start
    Flexible hours

    Obsidian

    New York, NY
    4 days ago
  • $20 - $36 per hour

     ...Role Overview Evaluate AI-generated music in Slovak and English by listening across genres...  ...years of professional experience as a music producer, audio engineer, or mixing engineer...  ...and artists Work Terms Location: Remote Engagement type: hourly Start date... 
    Remote work
    Hourly pay
    Immediate start
    Flexible hours

    SaidGig

    United States
    a month ago
  • Capital Virtues, the visual artist creator agency within The Jacky Winter Group, seeks a Talent Agent & Producer for our North American team. This remote-first role focuses on agenting, talent management and production across campaigns, partnerships and social content.... 
    Remote job

    Critical Playground LLC

    Los Angeles, CA
    5 days ago
  •  ...Role Overview Evaluate and benchmark the coding abilities of frontier AI models by reviewing AI-generated solutions, validating them against real-world software...  ...expected start date is next week. Work location: Remote, United States only. Perks: fully remote work... 
    Remote work
    Contract work
    For contractors

    SaidGig

    United States
    a month ago
  •  ...Join a pioneering AI initiative focused on building the next generation of evaluation benchmarks for frontier AI models. We are seeking experienced QA and Test Engineers...  ...ensure benchmark integrity. This is a fully remote, full-time engagement requiring approximately... 
    Remote work
    Full time
    Contract work
    For contractors
    Flexible hours

    Weekday

    Remote
    a month ago
  • $80 - $100 per hour

     ...the client who is a leading AI platform that enables organizations...  ...-quality human feedback, AI evaluation, and model alignment. The...  ...by designing programming benchmarks, evaluating AI-generated code...  ...Additional Information Fully remote contract opportunity.... 
    Remote work
    Hourly pay
    Weekly pay
    Contract work
    10 hours per week

    Lifted, an Upwork Company™

    Texas City, TX
    19 days ago
  • Part Time Producer & Digital Content Creator - KBUL *This position requires you to work in-office and on-site as needed. * Be the Voice, Face, and Digital...  ...during on‑air segments Coordinate guests, interviews, remote broadcasts, and station events Connect with listeners... 
    Remote work
    Part time
    Work at office
    Local area
    Monday to Friday

    RadioJobs

    Brooklyn, NY
    1 day ago
  •  ...Senior Producer Join CI Games and be part of shaping the future...  ...unified vision. Continuously evaluate and refine production...  .... Your role will be fully remote, which may present communication...  ...player expectations and quality benchmarks. ~ The ability to critically... 
    Remote work
    Worldwide
    Flexible hours
    Shift work

    CI Games

    United States
    4 days ago
  •  ...the world’s fastest-growing AI companies, accelerating the advancement...  ...high-quality human feedback, evaluation, and training data. Role...  ...Engineers to help evaluate, benchmark, and improve the coding...  ...Turing Work in a fully remote environment. Opportunity... 
    Remote work
    Contract work
    Temporary work
    For contractors
    Freelance

    Turing

    Remote
    6 days ago
  • $63k - $85k

     ...award winning podcasts, where it produces original content for and with...  ...collaborating with content creators, hosts, and the wider...  ...and audience demographics, to evaluate performance, identify trends,...  ...through basic tech setups for remote recording ● Strong interpersonal... 
    Remote work
    Temporary work
    Work experience placement
    Local area

    Adswizz

    New York, NY
    21 hours ago
  •  ...Description Job Description Producer (Film/TV/Digital/Live) Job...  ...: Contractor Location: Remote Job Overview We are...  ...or live events to support an AI evaluation project. You will use your production...  ...high-quality production benchmarks. No prior AI experience... 
    Remote job
    For contractors

    YO AI Labs

    Dallas, TX
    25 days ago
  • Informa TechTarget is hiring a detail-oriented Multimedia Producer to support our multimedia operations. You will work at the intersection of editorial strategy, production and workflow optimization to ensure our journalism reaches audiences seamlessly across platforms... 
    Remote job

    Informa Connect Limited

    Brooklyn, NY
    1 day ago
  • Farsyt is seeking a high-output Commercial Lines Producer in Massachusetts to manage a sophisticated book of business. This role emphasizes...  ...package includes a base salary and commission structure. Remote and hybrid work options are available for the right candidate.... 
    Remote job

    Farsyt

    Cambridge, MA
    1 day ago
  •  ...of experience in multimedia production, expertise in Generative AI platforms, and is comfortable managing projects and stakeholders....  ...follows a hybrid work schedule with three days in the office and two remote. Strong storytelling and collaboration skills are essential,... 
    Remote work
    Work at office

    Utah SHRM

    Alexandria, VA
    5 days ago
  •  ...About this role Role Title: Producer (Film/TV/Digital/Live)...  ...Type: Contractor Location: Remote micro1 is engaging Producers...  ...project focused on advancing AI evaluation. In this role, you'll apply...  ...written English, suitable for AI benchmarking and technical review.... 
    Remote work
    Temporary work
    For contractors

    micro1

    Remote
    6 days ago
  • $45 - $85 per hour

     ...on production expertise to create realistic evaluation materials that help advance next-generation AI systems. This remote contract role focuses on translating real-world...  ...in clear, precise written English for benchmarking and technical review. Collaborate with the... 
    Remote work
    Hourly pay
    Contract work

    SaidGig

    United States
    a month ago
  • $11 - $30.65 per hour

    Meridial is seeking contractors to evaluate advanced agentic audio models by simulating realistic customer service interactions across multiple domains. You will contribute to developing diverse datasets and assess model performance using various metrics. The role requires... 
    Remote job
    Hourly pay
    For contractors

    Meridial

    New York, NY
    1 day ago
  • YO AI Labs seeks Medical Evaluation Specialists, including medical students, residents, physicians, and biomedical professionals, to contribute clinical...  ..., and document rationales with citations. This is a remote contractor role emphasizing high-quality medical content.... 
    Remote job
    For contractors

    YO AI Labs

    Dallas, TX
    4 days ago
  • $150 - $180 per hour

     ...Prolific in Virginia Beach is seeking Mental Health Professionals to train and evaluate AI models. The role involves reviewing AI responses to psychological scenarios and completing related tasks, offering competitive pay up to $150-180/hr. You must have a valid mental... 
    Remote work
    Work from home

    Prolific

    Virginia Beach, VA
    1 day ago
  • $50 - $90 per hour

    Senior Social Content Creator / Video Producer (Contract) San Jose, California or Remote Nex is on a mission to help families rediscover the joy of movement. Created by parents for parents, Nex combines technology and play to deliver fun, social, and interactive experiences... 
    Remote job
    Hourly pay
    Contract work
    Part time
    For contractors
    Seasonal work
    Immediate start
    Flexible hours

    Nex

    Brooklyn, NY
    5 days ago
  •  ...Prolific is seeking Mental Health Professionals in Nashville, TN, to help train and evaluate AI models. Candidates will review AI-generated responses, complete training tasks, and provide insights based on their understanding of psychological theory. Successful participants... 
    Remote work
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Nashville, TN
    14 hours ago
  • $30 per hour

    Prolific is seeking Advanced Dutch Speakers in Chicago, IL to train AI models. You will complete AI tasks and assess AI performance in...  ...competitive rates and direct payment through PayPal. Pass the evaluation, and you can start within 15 minutes. #J-18808-Ljbffr Prolific
    Remote job
    Work from home

    Prolific

    Chicago, IL
    4 days ago
  •  ...Job Description Job Description AI Story Producer / AI Filmmaker (Full-Time, Remote)About Us We're building the future of AI-powered entertainment. Our studio creates premium vertical short-form series for a streaming platform, with stories told through cinematic... 
    Remote work
    Full time

    Plutus LLC

    Los Angeles, CA
    14 days ago
  • $80 - $150 per hour

    Prolific is seeking Medical Doctors to train and evaluate AI models. You'll review AI-generated clinical responses and evaluate their accuracy and appropriateness, earning competitive pay of $80-$150 per hour depending on your skills and experience. Ideal candidates must... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Portland, OR
    4 days ago
  • Video Producer job at Huckberry. Austin, TX. Huckberry...  ...will be provided to a remote hire Responsibilities:...  ...video production trends, evaluating how new technologies...  ...personalities and content creators Requirements 3-5...  ...strong understanding of how AI is impacting the video... 
    Remote work
    Summer work
    Freelance
    Work from home
    Relocation package

    Huckberry

    Austin, TX
    5 days ago
  • $8 - $65 per hour

    Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    New York, NY
    1 day ago
  • Prolific is seeking HR and Talent Professionals in Austin, Texas, to join their Expert Network. Your role will involve evaluating AI outputs, developing HR scenarios, and providing feedback on HR policies. Ideal candidates will have professional experience in HR, knowledge... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    Austin, TX
    4 days ago
  • $80 - $150 per hour

    Prolific is seeking Medical Doctors to train and evaluate AI models. As a Domain Expert participant, you will receive $80-$150/hr for tasks requiring your expertise. Responsibilities include reviewing AI responses for accuracy and quality, and providing structured feedback... 
    Remote job
    Work from home

    Prolific

    Seattle, WA
    5 days ago
  • $60 per hour

    Prolific is seeking Biology Experts and Life Science Professionals to join their Expert Network to evaluate AI-generated science. This role allows you to work from home with flexible hours and offers a competitive pay rate of up to $60 per hour for reviewing model responses... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Dallas, TX
    4 days ago
  • Prolific is seeking talented Product Designers and UX Specialists to join our Expert Network for training and evaluation of cutting-edge AI models. Candidates should have a relevant educational background and at least one year of experience in design-related fields. Responsibilities... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    Arizona City, AZ
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Producer (Remote) — AI Evaluation & Benchmark Creator. Be the first to apply!