Diffusion Model-based Reinforcement Learning For Version Age Of Information Scheduling: Average And Tail-risk-sensitive Control
2026 · Haoyuan Pan, Sizhao Chen, Zhaorui Wang, et al.
Abstract
Ensuring timely and semantically accurate information delivery is critical in real-time wireless systems. While Age of Information (AoI) quantifies temporal freshness, Version Age of Information (VAoI) captures semantic staleness by accounting for version evolution between transmitters and receivers. Existing VAoI scheduling approaches primarily focus on minimizing average VAoI, overlooking rare but severe staleness events that can compromise reliability under stochastic packet arrivals and unreliable channels. This paper investigates both average-oriented and tail-risk-sensitive VAoI scheduling in a multi-user status update system with long-term transmission cost constraints. We first formulate the average VAoI minimization problem as a constrained Markov decision process and introduce a deep diffusion-based Soft Actor-Critic (D2SAC) algorithm. By generating actions through a diffusion-based denoising process, D2SAC enhances policy expressiveness and establishes a strong baseline for
Authors
(none)
Tags
Stats
Related papers
- Age Of Semantics In Cooperative Communications: To Expedite Simulation Towards Real Via Offline Reinforcement Learning (2022)0.00
- Offline Critic-guided Diffusion Policy For Multi-user Delay-constrained Scheduling (2025)0.00
- A Survey Of Freshness-aware Wireless Networking With Reinforcement Learning (2025)0.00
- Diffusion Policies With Value-conditional Optimization For Offline Reinforcement Learning (2025)0.00
- Beyond Freshness And Semantics: A Coupon-collector Framework For Effective Status Updates (2026)0.00
- Distributional Soft Actor-critic With Diffusion Policy (2025)0.00
- Optimizing The Long-term Average Reward For Continuing Mdps: A Technical Report (2021)0.00
- Multi-agent Conditional Diffusion Model With Mean Field Communication As Wireless Resource Allocation Planner (2025)0.00