Rolling record / ARQ 63 Concerning · ▲ +2 7-day 3595 events in window / as of 02 Oct 2026
ARQAI Risk Quotient
capability 48.6 Mixed

What Do We Expect from LLMs? Mapping the Design of LLM Benchmarks

A survey of how LLM benchmarks are designed, highlighting gaps between what benchmarks measure and what the field claims about model capabilities.

A survey of how LLM benchmarks are designed, highlighting gaps between what benchmarks measure and what the field claims about model capabilities.

Auto-scored: Academic analysis of benchmark design; minor framing contribution with no direct risk or mitigation impact.