NROWAN-DQN: A Stable Noisy Network With Noise Reduction And Online Weight Adjustment For Exploration

Abstract

Deep reinforcement learning has been applied more and more widely nowadays, especially in various complex control tasks. Effective exploration for noisy networks is one of the most important issues in deep reinforcement learning. Noisy networks tend to produce stable outputs for agents. However, this tendency is not always enough to find a stable policy for an agent, which decreases efficiency and stability during the learning process. Based on NoisyNets, this paper proposes an algorithm called NROWAN-DQN, i.e., Noise Reduction and Online Weight Adjustment NoisyNet-DQN. Firstly, we develop a novel noise reduction method for NoisyNet-DQN to make the agent perform stable actions. Secondly, we design an online weight adjustment strategy for noise reduction, which improves stable performance and gets higher scores for the agent. Finally, we evaluate this algorithm in four standard domains and analyze properties of hyper-parameters. Our results show that NROWAN-DQN outperforms prior algorit

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyhan2020nrowan

Related papers

• Noisy Networks For Exploration (2017)0.00
• Weighted Double Deep Multiagent Reinforcement Learning In Stochastic Cooperative Environments (2018)0.00
• Noisy Spiking Actor Network For Exploration (2024)0.00
• Exploring More When It Needs In Deep Reinforcement Learning (2021)0.00
• Action Noise In Off-policy Deep Reinforcement Learning: Impact On Exploration And Performance (2022)0.00
• An Integrated Approach To Neural Architecture Search For Deep Q-networks (2025)0.00
• Adaptive Symmetric Reward Noising For Reinforcement Learning (2019)0.00
• An Adaptive Synchronization Approach For Weights Of Deep Reinforcement Learning (2020)0.00