A Dual Memory Structure For Efficient Use Of Replay Memory In Deep Reinforcement Learning

Abstract

In this paper, we propose a dual memory structure for reinforcement learning algorithms with replay memory. The dual memory consists of a main memory that stores various data and a cache memory that manages the data and trains the reinforcement learning agent efficiently. Experimental results show that the dual memory structure achieves higher training and test scores than the conventional single memory structure in three selected environments of OpenAI Gym. This implies that the dual memory structure enables better and more efficient training than the single memory structure.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyko2019a

Related papers

• Map-based Experience Replay: A Memory-efficient Solution To Catastrophic Forgetting In Reinforcement Learning (2023)9.23
• Augmented Replay Memory In Reinforcement Learning With Continuous Control (2019)5.24
• A Deeper Look At Experience Replay (2017)0.00
• Learning Offline: Memory Replay In Biological And Artificial Reinforcement Learning (2021)11.67
• Stable Hadamard Memory: Revitalizing Memory-augmented Agents For Reinforcement Learning (2024)0.00
• Associative Memory Based Experience Replay For Deep Reinforcement Learning (2022)6.34
• A Dual-memory Architecture For Reinforcement Learning On Neuromorphic Platforms (2021)6.34
• Stabilising Experience Replay For Deep Multi-agent Reinforcement Learning (2017)0.00