Rolling record / ARQ 63 Concerning · ▲ +2 7-day 3595 events in window / as of 02 Oct 2026
ARQAI Risk Quotient
capability 80.2 Danger

Reproducibility is not construct validity: LLM measurement of institutionally situated communication

The paper argues that reproducible LLM-based measurements of institutionally situated communication may still lack construct validity, highlighting a methodological risk in AI evaluation.

The paper argues that reproducible LLM-based measurements of institutionally situated communication may still lack construct validity, highlighting a methodological risk in AI evaluation.

Auto-scored: A methodological critique that raises awareness of validity limits in LLM measurement, a minor framing risk.