Music Annotator or Evaluator
Innodata India
Job Title: Music Annotator (Music Theory / Composition) AI Project Employment Type: Contract / Project-based Work Mode: Remote About the Role We are hiring trained musicians to annotate music audio for an AI training project. You will listen closely to tracks and write detailed, musician-to-musician descriptions of form, harmony, rhythm, arrangement, and production. General music interest or genre familiarity is not enough. This role needs formal training in theory or composition, plus hands-on production experience. Required Qualifications Master’s or PhD in Music, with a focus on composition or music theory Certification or diploma in the music industry (mandatory) At least 1 year of hands-on music production experience Strong music theory knowledge and the ability to write fine-grained descriptions Must pass resume screening and project quality checks Key Skills (Verified During Screening) Form: Identify musical form and section function by ear, including song sections and neutral forms Instrumentation and arrangement: Identify instruments, playing techniques, and arrangement roles (groove, bass line, pad, lead, counter-melody, fills), plus instrumental and vocal entries and exits Harmony: Analyze harmony by ear, including chord progressions, chord names, pedal points, cadences, key changes, and modulations Harmonic roles: Analyze the role of each instrument (e.g., violin carrying the main motif in rapid staccato) Rhythm and tempo: Identify groove, meter or feel, drum patterns, syncopation, half-time/double-time relationships, tempo changes, and the natural tapping tempo Melody and dynamics: Describe melody, hooks, contour, repetition, call and response, vocal style, dynamics, texture, builds, drops, crescendos, layering, and density changes Production techniques: Recognize reverb, delay, distortion, filtering, sidechain effects, stereo image, and lo-fi vs. polished treatment Transitions: Recognize fills, risers, stops, cuts, fades, hard edits, starts, endings, and movement into the next section Communication: Write clear, precise descriptions of what is happening in an arrangement #J-18808-Ljbffr Innodata India
- Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards, working in Hindi...Suggested
- ...Data annotation: labeling, classifying, and structuring documents, tables, and other content to support AI training datasets. LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness. Content...SuggestedHourly payFor contractorsRemote workFlexible hours
- ...Hindi localization specialist for a fully remote, hourly contractor role. You will apply localization judgment to data annotation, evaluation, and content generation tasks, ensuring tone, terminology, and cultural nuance are accurate across prompts and outputs. You will...SuggestedRemote jobHourly payFor contractors
$17 per hour
...'Angelo , Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Thai Type: Contract Compensation: $17... ...months Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other...SuggestedRemote jobContract workSummer workImmediate start$19 per hour
...'Angelo , Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Bengali Type: Contract Compensation:... ...months Commitment: 20 hours/week Role Responsibilities Evaluate AI-generated music across diverse genres and rate against...SuggestedRemote jobContract workSummer workImmediate start$39 per hour
...'Angelo , Larry Summers , and Jack Dorsey . Position: Music Audio Expert - English (US) Type: Contract Compensation... ...months Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output for lyrics, voice generation, and other...Contract workSummer workImmediate startRemote work- ...is seeking a professional Maltese voice actor and linguistic annotator for a data-training project. You will record scripted Maltese... ...samples. You will collaborate with the team to refine prompts, evaluation methods, and voice design guidelines, and provide expert feedback...
- ...A leading research accelerator is seeking a contractor to evaluate North American teen humor. The role involves reviewing short-form content, rating based on cultural relevance, and explaining humor dynamics clearly. Ideal candidates are 18 to 19 years old, familiar with...Contract workFor contractorsFreelanceRemote workFlexible hours
- ...Pharmacovigilance Safety Evaluator is a remote evaluation track for reviewing pharmacovigilance safety evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling...Hourly payFor contractorsRemote work10 hours per week
$14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data...Hourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hours$25 - $35 per hour
Ad Ref: FAR-00681 Earning Potential: While pay is per-inspection, efficient contractors typically earn the equivalent of $25–$35 per hour. FAR Inspections is actively seeking a reliable independent contractor to perform residential mortgage inspections in Idaho County,...Hourly payPrice workExtra incomeFull timeFor contractorsLive inFlexible hours$80 - $120 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work- ...Join a 16-week research study evaluating AI assistants from the perspective of everyday users. We’re looking for people who already use Gemini, Instinct, or Muse and can assess prompts and responses in English. A part-time commitment of 20 hours per week is available...Full timePart timeImmediate start
$30 - $50 per hour
A leading AI training company is seeking a Remote Annotator to support human-in-the-loop AI training workflows for large language models. This role involves reviewing labeled datasets, performing evaluations for helpfulness and safety, and ensuring quality in training data...Remote jobHourly pay$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Remote jobHourly payPart timeFlexible hours- A leading AI research accelerator is hiring a position focused on contributing to projects that evaluate and enhance AI systems. You will design community service scenarios, write structured explanations, and evaluate AI accuracy. The ideal candidate will have 4+ years...Remote jobFull timeFor contractors
- RWS Group is seeking a remote evaluator to help improve AI search results by providing detailed feedback on text, audio, images, and videos. You’ll work from home, simulating everyday searches to influence how major search engines respond to real users. Ideal candidates...Remote jobWork from home
- ...identity verification. Content can be sensitive, upsetting or offensive. Languages English Listing facts Arrangement Remote Category AI Evaluation & Training Compensation stated by the source Task-based compensation varies with project availability, task volume, quality and...FreelanceRemote work
- Meridial is seeking independent contractor experts to evaluate AI-generated outputs across technical and customer-facing content. The role merges language fluency, customer service judgment, and coding knowledge to ensure JSON structure, formatting accuracy, and response...For contractors
- RWS is seeking a web-savvy evaluator to test and rate how search engines respond to everyday queries. This flexible, part-time role can be done remotely from Argentina, with an emphasis on accuracy and quick feedback to improve AI data used by major platforms. You will...Remote jobPart timeFlexible hours
- Feedinkoo is seeking a Graphic Designer to help train and improve AI models focused on UI/UX design, visuals, and user experiences. You will critique AI outputs, provide feedback, and guide model improvements to better reflect aesthetics and usability for designers. The...Remote work
- About the Role We’re looking for contract, remote Italian-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll assess whether outputs make sense, are consistent, and reflect real-world expectations in Italian. What...Contract workTemporary workFreelanceImmediate startRemote work
- AuraOne, Inc. is seeking a remote Healthcare Operations Evaluator to review AI-driven clinical outputs. This contractor role requires licensed clinicians to assess reasoning, dosing logic, and guideline adherence, flag safety issues, and document corrections for model improvements...Remote jobFor contractors10 hours per week
- Alignerr Corp. is seeking AI Chatbot Testers for a fully remote, hourly-contract role. You will engage with cutting-edge AI systems, evaluate responses, and provide actionable feedback to shape safer and smarter tools. No technical background required, and you can work 10...Remote jobHourly payContract workFlexible hours
- Signify Health, part of CVS Health®, is seeking a Part-time Clinician (NP or PA) to perform in-home health evaluations in Livingston, Rochester and surrounding areas. Hours approx. 29.5 per week with travel to member homes and occasional virtual visits. Licensure and board...Part time
$129k
...salesSales call evaluationObjection handlingSales complianceCall quality reviewVirtual detailingCRM### Key responsibilities* Listen to and evaluate AI-led sales calls with healthcare professionals.* Score sales effectiveness, messaging, professionalism, and compliance using...Contract workPart timeFor contractorsRemote work10 hours per weekFlexible hours$20.3 per hour
...a Maps Personalization Relevance Rater for English (United States). This freelance role involves reviewing queries and results, evaluating places, and rating relevance to improve map recommendations. Ideal candidates are located in the United States with the right to...Hourly payWeekly payFreelance$30 per hour
RWS Group is seeking a part-time, remote evaluator to test and refine how search engines respond to everyday queries. You will contribute by assessing text, audio, images and videos to improve AI data used by major search engines and platforms. Ideal for freelancers or...Remote jobHourly payPart timeFreelanceWork from homeFlexible hours- RWS is seeking a part-time Search Quality Rater to help improve AI-driven search results from everyday queries. You will evaluate how client search engines respond, providing feedback on content across text, audio, images, and video to refine AI data used by major platforms...Remote jobPart timeWork from home
- Globik AI is seeking economists and economic analysts to evaluate AI-generated economic reasoning, explanations, and analysis. The role involves reviewing AI outputs, checking concepts, assumptions, and causal reasoning for accuracy and reliability. Candidates will document...Flexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Music Annotator or Evaluator. Be the first to apply!
- evaluator New York, NY
- work from home web search evaluator New York, NY
- web search evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- work from home social media evaluator New York, NY
- ai evaluator New York, NY
- education evaluator New York, NY
- quality evaluator New York, NY
- social media evaluator New York, NY



