Benchmark RadarRadar
GitHub

Build with us on GitHub

Explore both repositories.

benchmark-radar.com☆ View & star ↗ benchmark-radar.org☆ View & star ↗

A little star goes a long way. ♡

Benchmark Radar tracks emerging AI benchmarks.

Discover new public evaluations, search the benchmark library, and see which benchmarks are gaining attention or appearing in leading model reports.

14latest releases
Time window
Sort by
How Attention is calculated

What the score means. Attention is a relative 0–100 estimate of how much public interest a benchmark is receiving—or, for a brand-new release, may receive. It does not measure benchmark quality or model performance.

  • Latest: 45% Hugging Face paper votes + 25% GitHub stars + 5% dataset downloads, with up to 25 bonus points from the experimental LLM 7-day forecast.
  • 30 days: 20% paper votes + 62.86% GitHub stars + 17.14% dataset downloads. No LLM forecast.
  • 90 days: 5% paper votes + 61.47% GitHub stars + 33.53% dataset downloads. No LLM forecast.

How the forecast works. The LLM considers only the supplied benchmark scope, artifact readiness, topical breadth, and verified publisher evidence. It does not invent stars, votes, downloads, or adoption.

Normalization and missing data. Latest uses within-batch percentiles; 30- and 90-day counts use log normalization against the window maximum. A missing signal receives a neutral value of 0.5—not zero—and lowers confidence. Scores use the last known observations; the page update date does not mean every signal was freshly collected.

Rising benchmarks

14 results
New-release coverage through 2026-11-10 · Some sources unavailable · Editorial review pending · Attention observed 2026-11-11

Paper v110 Nov
Chat, Writing & PreferenceAcceptance claimed · ACM Multimedia 2025 (Brave New Ideas track)

SPY-Bench

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities but raise significant privacy concerns due to their abilities to infer sensitive personal information from images with high precision.

RunnableAttention 38 · #1 · latest0 HF votes6 GitHub stars
Paper v110 Nov
Science

Chem World

Molecular property prediction is fundamental to computational chemistry and drug formulation research, yet existing benchmarks remain fragmented across datasets, properties, and evaluation protocols, limiting systematic evaluation of model…

Paper onlyAttention not measured yet
Paper v110 Nov
Deep Research & Search

ARE-bench

Research agents achieve increasingly strong benchmark scores, yet these scores do not necessarily translate into reliable delivery in ongoing research projects.

Paper onlyAttention not measured yet
Paper v109 Nov

VIGOR

Multimodal large language models (MLLMs) are typically evaluated by whether they produce correct answers, but correctness alone does not reveal whether their outputs are supported by the right visual evidence.

RunnableAttention #1 · 09 Nov0 GitHub stars
Paper v109 Nov
Multi-Agent & Games

WorkflowArena

Large language model agents are increasingly deployed as multi-agent systems rather than as a standalone model operating within a single context.

Paper onlyAttention #2 · 09 Nov
Paper v109 Nov
Deep Research & Search

TRIAD

Multimodal retrieval increasingly supports agentic systems, where user requests can involve cross-level relations, combine multiple constraints, and evolve across dialogue turns.

Paper onlyAttention #3 · 09 Nov
Paper v109 Nov
Agentic Coding & SWE

SWE-Time

Repository-level code-understanding benchmarks have progressively expanded the spatial scope of reasoning, from local code to entire repositories, while largely treating each repository as a static snapshot.

Paper onlyAttention #4 · 09 Nov
Paper v109 Nov
Tool Use & Function Calling

ShadowBench-MCP

LLM agents increasingly act as routers for tools, APIs, and software-supply-chain workflows, making an execution path - rather than generated text alone - a security-relevant model output.

Paper onlyAttention #5 · 09 Nov
Paper v109 Nov

Infrathon

In this work, we study whether frontier agent can continually improve real-world AI infrastructure over long horizons.

Paper onlyAttention #6 · 09 Nov
Paper v109 Nov
Robotics & Embodied AI

GeoMind

Robotic manipulation has advanced rapidly in mapping visual observations and language instructions to actions.

RunnableAttention #7 · 09 Nov
Paper v109 Nov
Professional & Enterprise Work

DEPUTYBENCH

Enterprise agents must determine whether ordinary requests are permitted by organizational records and policies while continuing legitimate work.

Paper onlyAttention #8 · 09 Nov
Paper v109 Nov
Science

ChemInsight

We introduce ChemInsight, a benchmark designed to evaluate large language models (LLMs) on chemistry tasks that require multi-step reasoning and structured chemical understanding.

Paper onlyAttention #9 · 09 Nov
Paper v109 Nov

AutoBuddy-Bench

As LLM agents become more autonomous, they are increasingly expected to run as always-on assistants on a user's behalf, identifying work to be done and completing it without being asked.

Paper onlyAttention #10 · 09 Nov
Paper v109 Nov
Professional & Enterprise WorkAcceptance claimed · 40th Conference on Neural Information Processing Systems (NeurIPS 2026)

AgentScript-Eval

Domain-specific languages (DSLs) are widely used in enterprise software, giving a compact interface to complex tasks, from data access to infrastructure automation.

Paper onlyAttention #11 · 09 Nov