Keep up with reinforcement learning research. Without the noise.

2025 · 453 cites · Policy Gradient, RLHF & Alignment

This paper introduces Group Sequence Policy Optimization (GSPO), our stable, efficient, and performant reinforcement learning algorithm for training large language models. Unlike previous algorithms that adopt token-leve…