Malayalam Musician for AI Model Evaluation

Evaluate and annotate outputs from generative music AI models in Malayalam and English, providing detailed ratings and audio-engineering informed feedback on lyrics, vocal generation, musicality, and production quality. This role supports model development by scoring training data, performing head-to-head sample comparisons, and producing structured song annotations across genres and song structures.

• Listen to and evaluate AI-generated music for lyrical quality, vocal synthesis, and overall musical standards.
• Rate AI-generated samples head-to-head on musicality, creativity, adherence to the prompt, vocal quality, and production or mix quality, using audio-engineering terminology.
• Score the quality of musical training data used by models.
• Annotate songs in detail via a structured taxonomy, including genre and sub-genre classification, song structure, and vocal and instrumental characteristics.
• Write and assess music in the domain language listed in the title, and understand directions given in English.

• At least 3 years of professional experience as a music producer, audio engineer, and/or sound mixer.
• Demonstrable understanding of musical performance, music theory, and lyrics.
• College degree in music that includes performance, theory, and lyrical study.
• Prior experience writing lyrical music in Malayalam.
• Native or near-native proficiency in Malayalam and strong proficiency in English, sufficient to understand instructions and provide written annotations.

• Location: Remote.
• Employment type: Hourly, part-time.
• Expected commitment: 10 or more hours per week.
• Start date: Immediate.
• Project duration: Up to 6 months.

Hourly rate between 10.8 and 19.44 per hour.

• Must be able to read, write, and produce lyrical music in Malayalam.
• Must be able to follow directions given in English and communicate findings in English.

• Submit your resume and the required application form.
• Complete a 25-minute conversational interview covering your background, experience, and motivations.
• Receive next steps and onboarding information within a few days after the interview.

Reasonable accommodations are available upon request. All qualified applicants will be considered without regard to legally protected characteristics.