Exploring a Layer-Wise Design Space for KV Cache Eviction

A technical paper on memory-efficient inference for large language models, with no direct safety or governance implications.

Auto-scored: An incremental efficiency improvement for LLM inference that neither raises nor lowers AI risk under the rubric.