Learning Sparse Representations Incrementally In Deep Reinforcement Learning

Abstract

Sparse representations have been shown to be useful in deep reinforcement learning for mitigating catastrophic interference and improving the performance of agents in terms of cumulative reward. Previous results were based on a two step process were the representation was learned offline and the action-value function was learned online afterwards. In this paper, we investigate if it is possible to learn a sparse representation and the action-value function simultaneously and incrementally. We investigate this question by employing several regularization techniques and observing how they affect sparsity of the representation learned by a DQN agent in two different benchmark domains. Our results show that with appropriate regularization it is possible to increase the sparsity of the representations learned by DQN agents. Moreover, we found that learning sparse representations also resulted in improved performance in terms of cumulative reward. Finally, we found that the performance of th

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyhernandezgarcia2019learning

Related papers

• The Utility Of Sparse Representations For Control In Reinforcement Learning (2018)10.48
• Dynamic Sparse Training For Deep Reinforcement Learning (2021)0.00
• Reinforcement Learning With Sparse-executing Actions Via Sparsity Regularization (2021)0.00
• Long-term Visitation Value For Deep Exploration In Sparse Reward Reinforcement Learning (2020)7.24
• DQN With Model-based Exploration: Efficient Learning On Environments With Sparse Rewards (2019)0.00
• Learning Sparse Representations In Reinforcement Learning With Sparse Coding (2017)8.82
• Data-efficient Reinforcement Learning With Self-predictive Representations (2020)0.00
• Learning Sparse Representations In Reinforcement Learning (2019)0.00