Domain Expert- Music

• Create advanced prompts covering music theory, genres, composers, artists, production instruments.
• Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
• Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
• Develop benchmark datasets and adversarial test cases.
• Provide evidence-based feedback with reliable references.
• Collaborate with AI researchers to improve model performance.
• Maintain high annotation quality and documentation

• Master's degree or higher in any field
• Strong knowledge of music, including music theory, composition, genres, composers, artists, instruments, music history, production techniques, notation, and contemporary music trends.
• 3+ years of relevant professional experience, preferably in music education, performance, composition, music production, journalism, research, content creation, audio engineering, or a related field.
• Excellent written English, research, and analytical skills.
• Strong attention to detail and ability to evaluate music-related information accurately, identify factual inconsistencies, and assess reasoning across diverse musical topics.

• Experience with LLMs, Generative AI, prompt engineering, or AI evaluation.
• Published research, industry recognition, or teaching experience is a plus.
• Ability to work independently and provide objective, evidence-backed reviews.
• Degrees in Music, Music Theory, Musicology, Ethnomusicology, Music Education, Music Production, Audio Engineering, Performing Arts, or other music-related disciplines

RequiredAlso useful

Also listed: analytical skills, attention to detail.

Project and contracting process: Turing. Applications continue on the provider's website.