Benchmarking LLM Judges for Voice-Agent Evaluation: Reliability, Calibration, and Human Oversight

This paper benchmarks LLM judges for voice-agent evaluation, highlighting reliability and calibration issues that could affect AI oversight.

Auto-scored: It provides a real but partial step toward better evaluation of voice agents, while noting reliability concerns that pose minor risk.