Enhancing Data Efficiency In Reinforcement Learning: A Novel Imagination Mechanism Based On Mesh Information Propagation

Abstract

Reinforcement learning(RL) algorithms face the challenge of limited data efficiency, particularly when dealing with high-dimensional state spaces and large-scale problems. Most of RL methods often rely solely on state transition information within the same episode when updating the agent's Critic, which can lead to low data efficiency and sub-optimal training time consumption. Inspired by human-like analogical reasoning abilities, we introduce a novel mesh information propagation mechanism, termed the 'Imagination Mechanism (IM)', designed to significantly enhance the data efficiency of RL algorithms. Specifically, IM enables information generated by a single sample to be effectively broadcasted to different states across episodes, instead of simply transmitting in the same episode. This capability enhances the model's comprehension of state interdependencies and facilitates more efficient learning of limited sample information. To promote versatility, we extend the IM to function as a

Stats

• citations0
• S2 citations—
• github stars13
• HF likes0
• heat score2.29
• arxiv keywang2023enhancing

Related papers

• Generative Adversarial Imagination For Sample Efficient Deep Reinforcement Learning (2019)0.00
• Human-inspired Framework To Accelerate Reinforcement Learning (2023)0.00
• Higher Replay Ratio Empowers Sample-efficient Multi-agent Reinforcement Learning (2024)0.00
• Episodic Reinforcement Learning With Expanded State-reward Space (2024)0.00
• Novelty-guided Data Reuse For Efficient And Diversified Multi-agent Reinforcement Learning (2024)2.26
• Reinforcement Learning, Bit By Bit (2021)3.58
• Experience Augmentation: Boosting And Accelerating Off-policy Multi-agent Reinforcement Learning (2020)0.00
• Imagine, Initialize, And Explore: An Effective Exploration Method In Multi-agent Reinforcement Learning (2024)2.26