Augmented Replay Memory In Reinforcement Learning With Continuous Control

Abstract

Online reinforcement learning agents are currently able to process an increasing amount of data by converting it into a higher order value functions. This expansion of the information collected from the environment increases the agent's state space enabling it to scale up to a more complex problems but also increases the risk of forgetting by learning on redundant or conflicting data. To improve the approximation of a large amount of data, a random mini-batch of the past experiences that are stored in the replay memory buffer is often replayed at each learning step. The proposed work takes inspiration from a biological mechanism which act as a protective layer of human brain higher cognitive functions: active memory consolidation mitigates the effect of forgetting of previous memories by dynamically processing the new ones. The similar dynamics are implemented by a proposed augmented memory replay AMR capable of optimizing the replay of the experiences from the agent's memory structure

Stats

• citations4
• S2 citations—
• github stars0
• HF likes0
• heat score5.24
• arxiv keyramicic2019augmented

Related papers

• Replay-enhanced Continual Reinforcement Learning (2023)0.00
• Learning Offline: Memory Replay In Biological And Artificial Reinforcement Learning (2021)11.67
• Map-based Experience Replay: A Memory-efficient Solution To Catastrophic Forgetting In Reinforcement Learning (2023)9.23
• Augmenting Replay In World Models For Continual Reinforcement Learning (2024)0.00
• Experience Replay For Continual Learning (2018)0.00
• Prioritized Generative Replay (2024)0.00
• A Dual Memory Structure For Efficient Use Of Replay Memory In Deep Reinforcement Learning (2019)0.00
• Stable Hadamard Memory: Revitalizing Memory-augmented Agents For Reinforcement Learning (2024)0.00