Knowru: Knowledge Reusing Via Knowledge Distillation In Multi-agent Reinforcement Learning

Abstract

Recently, deep Reinforcement Learning (RL) algorithms have achieved dramatically progress in the multi-agent area. However, training the increasingly complex tasks would be time-consuming and resources-exhausting. To alleviate this problem, efficient leveraging the historical experience is essential, which is under-explored in previous studies as most of the exiting methods may fail to achieve this goal in a continuously variational system due to their complicated design and environmental dynamics. In this paper, we propose a method, named "KnowRU" for knowledge reusing which can be easily deployed in the majority of the multi-agent reinforcement learning algorithms without complicated hand-coded design. We employ the knowledge distillation paradigm to transfer the knowledge among agents with the goal to accelerate the training phase for new tasks, while improving the asymptotic performance of agents. To empirically demonstrate the robustness and effectiveness of KnowRU, we perform ext

Stats

• citations16
• S2 citations—
• github stars0
• HF likes0
• heat score9.23
• arxiv keygao2021knowru

Related papers

• Knowsr: Knowledge Sharing Among Homogeneous Agents In Multi-agent Reinforcement Learning (2021)0.00
• KD-MARL: Resource-aware Knowledge Distillation In Multi-agent Reinforcement Learning (2026)0.00
• Efficient Open-world Reinforcement Learning Via Knowledge Distillation And Autonomous Rule Discovery (2023)0.00
• Improved Reinforcement Learning In Cooperative Multi-agent Environments Using Knowledge Transfer (2021)0.00
• Periodic Intra-ensemble Knowledge Distillation For Reinforcement Learning (2020)4.52
• Stabilising Experience Replay For Deep Multi-agent Reinforcement Learning (2017)0.00
• Expert-free Online Transfer Learning In Multi-agent Reinforcement Learning (2023)3.58
• Cautiously-optimistic Knowledge Sharing For Cooperative Multi-agent Reinforcement Learning (2023)5.84