Music Producer for AI Model Evaluation

Evaluate and rate music generated by state of the art generative AI systems across many genres, working in both Italian and English. You will perform critical listening, compare outputs against reference material, and provide detailed labels and quality ratings that guide model development.

• Compare AI-generated songs head-to-head, judging musicality, creativity, adherence to prompts, vocal performance, and production and mix quality
• Label recordings for genre, song structure, instrumentation, presence and type of vocals, and other musical characteristics
• Review AI-generated lyrics and vocal performances against reference material for quality, accuracy, and naturalness

• Native or near-native proficiency in Italian, with the ability to follow detailed written instructions in English
• At least 2 years of professional experience as a music producer, audio engineer, or mixing engineer
• Access to headphones or studio monitors suitable for critical listening
• Nice to have: formal training in music performance, theory, or composition
• Nice to have: credited or commercially released production, engineering, or mixing work
• Nice to have: broad familiarity with contemporary Italian genres, sub-genres, and artists

• Location: Remote
• Employment type: hourly
• Start date: immediate
• Duration: up to 6 months
• Commitment: flexible. Most experts work around 20 hours per week, there is no cap on hours

• Hourly rate: 20 to 36 per hour

• Language requirement: native or near-native Italian, and the ability to read and follow instructions in English
• Equipment requirement: headphones or studio monitors suitable for critical listening
• Reasonable accommodations are available upon request
• All qualified applicants will be considered without regard to legally protected characteristics

• Submit your resume as part of the application
• Complete the application steps, including a Bilingual Competency Interview conducted in Italian
• After submission, expect to receive next steps and onboarding details within a few days