Key papers

• TREK: Distill to Explore, Reinforce to Refine (2026)
  Yuanda Xu et al.
  2.00
• Privileged Information Distillation for Language Models (2026)
  Emiliano Penaloza et al.
  1.94
• On-Policy Self-Distillation for Reasoning Compression (2026)
  Hejian Sang et al.
  1.94
• Self-Distillation Zero: Self-Revision Turns Binary Rewards into Dense Supervision (2026)
  Yinghui He et al.
  1.94
• Unmasking On-Policy Distillation: Where It Helps, Where It Hurts, and Why (2026)
  Mohammadreza Armandpour et al.
  1.94
• CollectionLoRA: Collecting 50 Effects in 1 LoRA via Multi-Teacher On-Policy Distillation (2026)
  Fangtai Wu et al.
  1.94
• Not All Disagreement Is Learnable: Token Teachability in On-Policy Distillation (2026)
  Yuanyi Wang et al.
  1.94
• Efficient Agentic Reinforcement Learning with On-Policy Intrinsic Knowledge Boundary Enhancement (2026)
  Dingwei Chen et al.
  1.94
• OPRD: On-Policy Representation Distillation (2026)
  Shenzhi Yang et al.
  1.94
• OPD-Evolver: Cultivating Holistic Agent Evolver via On-Policy Distillation (2026)
  Guibin Zhang et al.
  1.94
• Trust the Right Teacher: Quality-Aware Self-Distillation for GUI Grounding (2026)
  Jingyuan Huang et al.
  1.94
• Seeing Before Reasoning: Decoupling Perception and Reasoning for Shortcut-Resilient Multimodal On-Policy Self-Distillation (2026)
  Sihan Wang et al.
  1.94
• Synthetic Sandbox for Training Machine Learning Engineering Agents (2026)
  Yuhang Zhou et al.
  1.83
• TIP: Token Importance in On-Policy Distillation (2026)
  Yuanda Xu et al.
  1.83
• Beyond SFT-to-RL: Pre-alignment via Black-Box On-Policy Distillation for Multimodal RL (2026)
  Sudong Wang et al.
  1.83
• Reasoning over mathematical objects: on-policy reward modeling and test time aggregation (2026)
  Pranjal Aggarwal et al.
  1.78
• Nemotron-Cascade 2: Post-Training LLMs with Cascade RL and Multi-Domain On-Policy Distillation (2026)
  Zhuolin Yang et al.
  1.78
• Learning to Detect Language Model Training Data via Active Reconstruction (2026)
  Junjie Oscar Yin et al.
  1.72
• OVD: On-policy Verbal Distillation (2026)
  Jing Xiong et al.
  1.67
• DRAGON: Distributional Rewards Optimize Diffusion Generative Models (2025)
  Yatong Bai et al.
  1.28
• AceReason-Nemotron: Advancing Math and Code Reasoning through Reinforcement Learning (2025)
  Yang Chen et al.
  1.28
• On-Policy RL Meets Off-Policy Experts: Harmonizing Supervised Fine-Tuning and Reinforcement Learning via Dynamic Weighting (2025)
  Wenhao Zhang et al.
  1.28
• ExGRPO: Learning to Reason from Experience (2025)
  Runzhe Zhan et al.
  1.28
• The Best of N Worlds: Aligning Reinforcement Learning with Best-of-N Sampling via max@k Optimisation (2025)
  Farid Bagirov et al.
  1.28
• SePPO: Semi-Policy Preference Optimization for Diffusion Alignment (2024)
  Daoan Zhang et al.
  —