ZeroBench
“We track progress on ZeroBench over the subsequent year, observing SotA reaching 6% pass^5 and 19% pass@5, indicating the potential longevity of the benchmark.”
The authors, in the abstract
An Impossible Visual Benchmark for Contemporary Large Multimodal Models