Music AI Evaluation Specialist
Mercor
Mercor is seeking experienced musicians to evaluate generative musical AI models in collaboration with a leading AI lab. You will judge outputs across genres, assess lyrics and voice generation, and score training data quality. Strong English comprehension and music production background are required. The role emphasizes careful analysis, consistency, and bilingual proficiency to ensure high-quality evaluation of creative AI systems. #J-18808-Ljbffr Mercor
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Music AI Evaluation Specialist in New York, NY vacancy
- Mercor is seeking experienced music producers and audio engineers to evaluate generative music AI models. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Japanese and English. Key responsibilities include comparing...Suggested
- Muse Group создает музыкальные приложения для проигрывания, записи и композиции, а также обучающие инструменты и свободное ПО. В составе Muse Group — Hal Leonard, публикующий нотные издания и образовательные материалы по всему миру. Задачи включают работу по QA моделей ...Suggested
- ...Position Title: Senior Computer Programmer – AI Evaluation Specialist Location: Remote (Continental U.S.) Company: JR Software Solutions Inc. (JRSS) Employment Type: Full-time About JR Software Solutions Inc. JRSS is a certified Women-Owned Small Business...SuggestedPermanent employmentFull timeRemote work
JRSS Corporation
New York, NY1 day ago - ...A leading AI organization in Australia is seeking individuals with strong writing and analytical skills to evaluate and improve AI outputs. The ideal candidate must possess the ability to assess emotional nuances and detail while adhering to structured guidelines. Responsibilities...SuggestedImmediate start
Crossing Hurdles
New York, NY5 days ago - ...people who can complete detailed reviews and keep their own judgments accurate. You will finish evaluation workflows and verify consistency across your judgments while assessing AI-generated voice, image and video content. The role is remote with flexible hours and project...SuggestedRemote jobFreelanceFlexible hours
- Anyone AI is seeking remote independent contractors to help create and evaluate data for frontier AI models. You will interact with AI models and compare responses to ensure quality and reliability. Responsibilities include assessing accuracy, helpfulness, and instruction...Remote jobFor contractors
$30 per hour
BANGLA AI EVALUATION SPECIALIST Up to $30/hr Depending on the project Bachelor's Remote Part-time Flexible hours Opportunity Overview Handshake is looking for Bangla speakers as it’s spoken in Singapore to help make AI responses more personalized. This is not a traditional...Part timeLocal areaRemote workFlexible hours- AI Trainer Jobs seeks a Generalist (Macbook User) to remotely evaluate prompts and responses against AuraOne's rubric. You will compare paired outputs, label edge cases, and draft structured feedback for retraining. Role involves reviewing frontier model outputs, judging...Remote job
$60 per hour
Prolific is seeking Computer Science Specialists to join its Expert Network to help train and evaluate AI models. If you have a CS research or technical analysis background, you’ll complete a brief 10-15 minute test; successful candidates will be invited to join Prolific...Remote jobWork from homeFlexible hours- OpenTrain AI, Inc. is seeking infectious disease expertise to evaluate AI-generated responses. You will create clinical tasks, review answers, and judge accuracy, safety, and alignment with current infectious disease practice in a remote, asynchronous setting. The role...Hourly payContract workPart timeRemote work
- ...audio issues, flag concerns, and apply processing with defensible choices Coordinate with technical teams on editing scenarios and evaluation metrics Maintain consistent quality control and meet project deadlines in a fast paced environment Communicate technical...Hourly payFor contractorsFreelanceRemote workWorldwide
remote work
New York, NY3 days ago $15 - $30 per hour
...suggesting improvements to our prompt engineering and evaluation metrics. A bachelor’s or master’s degree in Audio Engineering, Music Production, Acoustics, or a closely related... ...Dialogue / Audio Post-Production - Freelance AI Trainer Project Employment type: Freelance /...Hourly payContract workFor contractorsFreelanceRemote workAgency.com
New York, NY3 days ago- AI Trainer Jobs is seeking contributors for remote language evaluation work. You will assess Slovak translations and localization, rate model outputs, and provide corrected answers to improve AI training. The role offers flexible hours, remote collaboration, and weekly...Remote jobFor contractorsFlexible hours
$50 per hour
OpenTrain AI, Inc. is seeking a remote, part-time reviewer for nursing prompt evaluation. You will assess prompts and AI responses, write improvements, and clearly explain reasoning to guide model behavior. The role requires current undergraduate nursing students, fluent...Remote jobHourly payPart time- ...Job DescriptionJob Description Job Title AI Evaluation Engineer Location Hybrid / Remote Employment Type Full-time Job Summary We are seeking an AI Evaluation Engineer to design, implement, and maintain evaluation frameworks for AI and machine learning systems, with a...Full timeRemote work
Ova Technologies
New York, NY1 day ago $40 per hour
DataAnnotation is seeking contributors to evaluate AI translations in Slovak, focusing on localization and cultural nuance across real projects. You’ll review model outputs, identify errors, and provide clear, training-quality feedback from a linguistic perspective. Remote...Remote jobFlexible hours$25 per hour
Prolific is seeking AI Training Experts to help train and evaluate cutting‑edge AI models. You’ll complete paid tasks and may be invited to join as a participant after a quick skills test. Tasks include analyzing, editing, and writing annotations, with pay up to $25 per...Remote jobHourly payWork from homeFlexible hours- ...seeking a contract expert in specialty medication access to review AI-assisted recommendations, assess medical necessity, and ensure... ...guide safer, more reliable AI workflows. The role focuses on evaluating prior authorization decisions, formularies, step therapy, and documentation...Contract work
- OpenTrain AI, Inc. is seeking a Materials Science Expert for a fully remote, part-time contractor role. You will create and review challenging materials science problems used to train and evaluate AI systems, combining deep materials science knowledge with careful scientific...Remote jobPart timeFor contractors
$50 per hour
Prolific Academic Ltd is seeking Product Designers and UX Specialists to join our Expert Network to train and evaluate AI models using real design expertise. If selected, you’ll complete a brief test and, upon success, join Prolific as a paid participant to work on AI training...Remote jobHourly payWork from homeFlexible hours- Zekai is seeking a Research Evaluation Specialist (PhD or Masters) for a remote, world-wide contractor role (~15 hours per week). You will craft high-difficulty QA pairs to rigorously evaluate AI models, source primary references, and document reasoning with citations....Remote jobContract workFor contractors
- Category: Frontier Model Evaluation Pay: Hourly rate confirmed after the interview process... ...Location: Remote US-eligible Contractor AI Trainer & Evaluator is a remote evaluation... ...Remote US-eligible. Remote Independent specialist contractor. Employment type: CONTRACTOR....Hourly payFor contractorsRemote work10 hours per week
$229.9k - $262.4k
...AI Engineer 5 (AI Foundations: Evaluations and Agentic Workflows) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized...Full timePart timeWork at officeLocal areaCapital One
New York, NY3 days ago$197.3k - $225.1k
AI Engineer 4 (AI Foundations: Benchmarking, Evaluation, and Explainability) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time,...Full timePart timeLocal areaCapital One
New York, NY3 days ago$15 - $35 per hour
...Development Expert for a remote contract role. The position offers 10-40 hours per week and compensation of $15-$35 per hour. You will evaluate AI interview models by responding to scenario-based questions in sales and business development, and provide structured feedback on...Remote jobHourly payContract work10 hours per week$30 - $60 per hour
Jobgether SRL in the United States seeks a remote, contract-based role to design realistic medical tasks for evaluating AI in healthcare. This part-time position offers about 20 hours per week and remote work flexibility. You will create tasks involving clinical analysis...Remote jobHourly payContract workPart time- ...Develop and maintain the voice of Adventure Ted using cutting-edge technology and AI tools to ensure consistent character portrayal across animations, virtual events, and multimedia projects. Collaborate with Childhood Cancer Society’s creative and production teams...Remote job
Childhood Cancer Society
New York, NY5 days ago - Alpheva is a remote, project-based contract network launched September 2026. We seek a senior HR expert to support AI evaluation projects focused on people policy, hiring, performance, and workplace decision-making. You will review model responses and worked examples for...Remote jobContract work
- Outlier Ai is seeking detail-oriented, fluent English speakers to review AI-generated media on a flexible schedule. You will roleplay live conversations with an AI voice model, score exchanges, and compare AI-generated images and videos to determine which follows prompts...Remote jobFlexible hours
- Dscout is building a human-grounded layer to teach AI to work in the real world and stay aligned there. We seek a research-focused expert to design rubrics, benchmarks, and evaluation methods using real-world data from diverse contexts. You will lead long-horizon studies...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Music AI Evaluation Specialist. Be the first to apply!
