Benchmark RadarMuseBench
MuseBench evaluates multimodal large language models on intent-level understanding of audiovisual arts, covering cinematic arts, static visual arts, stage performing arts, and game arts with 4,016 questions in single- and multi-select formats.
- Released
- 2026-06-29
- Readiness
- Runnable
- Primary field
- General AI
Why it matters
Existing video and multimodal benchmarks mostly test perceptual recognition, leaving artistic intent and creative reasoning unevaluated. MuseBench measures a distinct capability gap, providing a reference for progress in creative-domain expertise.
Motivation
Audiovisual arts encompass diverse creative disciplines, including cinema, visual arts, stage performance, and game design, where artistic meaning arises from deliberate combinations of visual, auditory, and narrative elements (e.g., fear amplified through claustrophobic framing, or grief conveyed through silence and lingering close-ups).
Primary resources
Benchmark Radar records only publicly supported details and links back to primary sources for verification.