A Deep Actor-critic Reinforcement Learning Framework For Dynamic Multichannel Access

Abstract

To make efficient use of limited spectral resources, we in this work propose a deep actor-critic reinforcement learning based framework for dynamic multichannel access. We consider both a single-user case and a scenario in which multiple users attempt to access channels simultaneously. We employ the proposed framework as a single agent in the single-user case, and extend it to a decentralized multi-agent framework in the multi-user scenario. In both cases, we develop algorithms for the actor-critic deep reinforcement learning and evaluate the proposed learning policies via experiments and numerical results. In the single-user model, in order to evaluate the performance of the proposed channel access policy and the framework's tolerance against uncertainty, we explore different channel switching patterns and different switching probabilities. In the case of multiple users, we analyze the probabilities of each user accessing channels with favorable channel conditions and the probability

Stats

• citations106
• S2 citations—
• github stars0
• HF likes0
• heat score15.22
• arxiv keyzhong2019a

Related papers

• Dynamic Channel Access Via Meta-reinforcement Learning (2021)5.84
• Multi-agent Actor-critic For Mixed Cooperative-competitive Environments (2017)0.00
• Actor-attention-critic For Multi-agent Reinforcement Learning (2018)0.00
• A Reinforcement Learning Approach For The Multichannel Rendezvous Problem (2019)7.16
• Resource Management In Wireless Networks Via Multi-agent Deep Reinforcement Learning (2020)16.43
• A Multi-task Approach To Robust Deep Reinforcement Learning For Resource Allocation (2023)0.00
• Deep Reinforcement Learning For Distributed Uncoordinated Cognitive Radios Resource Allocation (2019)0.00
• Learning Implicit Credit Assignment For Cooperative Multi-agent Reinforcement Learning (2020)0.00