Benchmark Radar
AI BENCHMARK PROFILE

WaveformQA

General AICoding & Software EngineeringWaveformQA Team

WaveformQA is a QA benchmark for LLM temporal reasoning over digital waveforms, comprising 360 questions with programmatically generated ground truths across eight categories, including multi-signal correlation and event ordering, with waveforms generated from open-source designs.

Released
2026-07-22
Readiness
Paper only
Primary field
General AI

Why it matters

Temporal reasoning over waveforms is critical for hardware verification; existing benchmarks focus on HDL generation, leaving this capability untested. WaveformQA provides a reproducible way to evaluate LLMs on this task.

Motivation

Large Language Models (LLMs) have demonstrated strong capabilities in code generation and reasoning, yet their ability to perform temporal reasoning over digital waveform data remains largely unexplored.

Primary resources

Benchmark Radar records only publicly supported details and links back to primary sources for verification.