Faded-experience Trust Region Policy Optimization For Model-free Power Allocation In Interference Channel

Abstract

Policy gradient reinforcement learning techniques enable an agent to directly learn an optimal action policy through the interactions with the environment. Nevertheless, despite its advantages, it sometimes suffers from slow convergence speed. Inspired by human decision making approach, we work toward enhancing its convergence speed by augmenting the agent to memorize and use the recently learned policies. We apply our method to the trust-region policy optimization (TRPO), primarily developed for locomotion tasks, and propose faded-experience (FE) TRPO. To substantiate its effectiveness, we adopt it to learn continuous power control in an interference channel when only noisy location information of devices is available. Results indicate that with FE-TRPO it is possible to almost double the learning speed compared to TRPO. Importantly, our method neither increases the learning complexity nor imposes performance loss.

Stats

• citations7
• S2 citations—
• github stars0
• HF likes0
• heat score6.77
• arxiv keykhoshkholgh2020faded

Related papers

• Adaptive Trust Region Policy Optimization: Global Convergence And Faster Rates For Regularized Mdps (2019)12.10
• Simple Policy Optimization (2024)0.00
• Entrpo: Trust Region Policy Optimization Method With Entropy Regularization (2021)0.00
• Multi-agent Trust Region Policy Optimization (2020)12.61
• Neural Proximal/trust Region Policy Optimization Attains Globally Optimal Policy (2019)0.00
• Hindsight Trust Region Policy Optimization (2019)0.00
• Embedding Safety Into RL: A New Take On Trust Region Methods (2024)0.00
• Trust-pcl: An Off-policy Trust Region Method For Continuous Control (2017)0.00