Benchmark RadarAI BENCHMARK PROFILE
AmchiBias
AmchiBias is a benchmark for measuring socio-cultural stereotypical bias for Goan identity groups, with 313 minimal pairs across eight sociodemographic dimensions in English and Devanagari Konkani.
- Released
- 2026-06-13
- Readiness
- Paper only
- Primary field
- General AI
Why it matters
Stereotypical bias is often considered only at the national level. This benchmark addresses hyperlocal subnational identities in a low-resource language, highlighting gaps in multilingual model evaluation.
Motivation
Socio-cultural stereotypical bias is an important consideration in the development and deployment of NLP systems.
Primary resources
Benchmark Radar records only publicly supported details and links back to primary sources for verification.