Structure-enhanced Deep Reinforcement Learning For Optimal Transmission Scheduling

Abstract

Remote state estimation of large-scale distributed dynamic processes plays an important role in Industry 4.0 applications. In this paper, by leveraging the theoretical results of structural properties of optimal scheduling policies, we develop a structure-enhanced deep reinforcement learning (DRL) framework for optimal scheduling of a multi-sensor remote estimation system to achieve the minimum overall estimation mean-square error (MSE). In particular, we propose a structure-enhanced action selection method, which tends to select actions that obey the policy structure. This explores the action space more effectively and enhances the learning efficiency of DRL agents. Furthermore, we introduce a structure-enhanced loss function to add penalty to actions that do not follow the policy structure. The new loss function guides the DRL to converge to the optimal policy structure quickly. Our numerical results show that the proposed structure-enhanced DRL algorithms can save the training time

Stats

• citations2
• S2 citations—
• github stars0
• HF likes0
• heat score3.58
• arxiv keychen2022structure

Related papers

• Effective Multi-user Delay-constrained Scheduling With Deep Recurrent Reinforcement Learning (2022)7.16
• Decentralized Task Scheduling In Distributed Systems: A Deep Reinforcement Learning Approach (2026)0.00
• Control-optimized Deep Reinforcement Learning For Artificially Intelligent Autonomous Systems (2025)0.00
• Resource Management In Wireless Networks Via Multi-agent Deep Reinforcement Learning (2020)16.43
• Offline Reinforcement Learning For Wireless Network Optimization With Mixture Datasets (2023)9.59
• The Cost Of Learning: Efficiency Vs. Efficacy Of Learning-based RRM For 6G (2022)0.00
• UDQL: Bridging The Gap Between MSE Loss And The Optimal Value Function In Offline Reinforcement Learning (2024)0.00
• Digital Twin-assisted Efficient Reinforcement Learning For Edge Task Scheduling (2022)9.23