Benchmark RadarINSPIRE
INSPIRE evaluates instruction-aware speech retrieval, where natural-language instructions specify relevance criteria including semantic content, speaker identity, speaking style, environmental sounds, and combinations. The benchmark includes a fixed dataset and protocol for evaluating retrieval systems.
- Released
- 2026-08-17
- Readiness
- Paper only
- Primary field
- General AI
Why it matters
Speech retrieval systems currently rely on fixed similarity matching and cannot adapt to diverse user intents. INSPIRE provides a standardized evaluation to compare methods across different retrieval intents, highlighting gaps in handling both semantic and paralinguistic attributes.
Motivation
Existing speech retrieval systems rely on fixed similarity matching and cannot adapt to diverse user intents.
Primary resources
Benchmark Radar records only publicly supported details and links back to primary sources for verification.