Benchmark RadarJETO-Bench
JETO-Bench is a benchmark of 660 execution time improvement patches (ETIPs) in Java, with 91 manually verified. It is built using JETO-Mine, a configurable tool that mines ETIPs from GitHub repositories and statistically validates improvements.
- Released
- 2026-06-30
- Readiness
- Runnable
- Primary field
- General AI
Why it matters
Provides a reproducible benchmark for performance bug fixing in Java, an area lacking benchmarks. Enables evaluation of patch generation and test generation tools.
Motivation
Automated fixing of performance issues is gaining attention, but existing benchmarks of execution time improvement patches (ETIPs) target Python, C++, or .NET and are fixed datasets that cannot be extended under user-defined configurations.
Primary resources
Benchmark Radar records only publicly supported details and links back to primary sources for verification.