A Zeroth-Order Paradigm for LLM Preference Alignment

Proposes a zeroth-order optimization method for aligning LLM preferences without gradient access, potentially improving alignment efficiency.

Auto-scored: A technical alignment method paper with no direct risk or mitigation impact.