VSI-Bench
A visual-spatial benchmark testing whether multimodal models can understand and recall spaces from video.
Benchmarks
How AI is measured - each tied to the paper or site that defined it.
104 entries, all primary-sourced
MASK Benchmark (Honesty)
A benchmark that separates honesty from accuracy, measuring whether language models lie under pressure rather than just whether they are correct.
ARC-AGI-2
The 2025 successor to ARC-AGI, a harder reasoning benchmark that frontier AI systems initially scored in the single digits on.
BrowseComp
OpenAI benchmark of 1,266 questions that force a web agent to dig persistently for hard-to-find facts.
HalluLens
A Meta hallucination benchmark built on a clear taxonomy, with tasks that regenerate to resist leakage.
GDPval
OpenAI benchmark scoring AI on real economically valuable work across 44 occupations in nine GDP sectors.
Long-Horizon-Terminal-Bench
A 46-task terminal benchmark with dense partial-credit grading where the best agent scores just 15.2 percent.
CryptanalysisBench
A 191-task benchmark where five frontier models break 65 to 86 percent of already-broken cryptographic schemes.