Distributed-training-and-execution Multi-agent Reinforcement Learning For Power Control In Hetnet
2022 · Kaidi Xu, Nguyen van Huynh, Geoffrey Ye Li
Abstract
In heterogeneous networks (HetNets), the overlap of small cells and the macro cell causes severe cross-tier interference. Although there exist some approaches to address this problem, they usually require global channel state information, which is hard to obtain in practice, and get the sub-optimal power allocation policy with high computational complexity. To overcome these limitations, we propose a multi-agent deep reinforcement learning (MADRL) based power control scheme for the HetNet, where each access point makes power control decisions independently based on local information. To promote cooperation among agents, we develop a penalty-based Q learning (PQL) algorithm for MADRL systems. By introducing regularization terms in the loss function, each agent tends to choose an experienced action with high reward when revisiting a state, and thus the policy updating speed slows down. In this way, an agent's policy can be learned by other agents more easily, resulting in a more efficien
Authors
(none)
Tags
Stats
Related papers
- Multi-agent Reinforcement Learning For Power Control In Wireless Networks Via Adaptive Graphs (2023)7.16
- Multi-agent Deep Reinforcement Learning (MADRL) Meets Multi-user MIMO Systems (2021)7.50
- Resource Management In Wireless Networks Via Multi-agent Deep Reinforcement Learning (2020)16.43
- A Multi-agent Multi-environment Mixed Q-learning For Partially Decentralized Wireless Network Optimization (2024)0.00
- Decentralized Task Scheduling In Distributed Systems: A Deep Reinforcement Learning Approach (2026)0.00
- Deep Reinforcement Learning For Distributed And Uncoordinated Cognitive Radios Resource Allocation (2022)0.00
- Distributed Transmission Control For Wireless Networks Using Multi-agent Reinforcement Learning (2022)0.00
- Mean-field Multi-agent Reinforcement Learning: A Decentralized Network Approach (2021)0.00