Improving Generalization To New Environments And Removing Catastrophic Forgetting In Reinforcement Learning By Using An Eco-system Of Agents

Abstract

Adapting a Reinforcement Learning (RL) agent to an unseen environment is a difficult task due to typical over-fitting on the training environment. RL agents are often capable of solving environments very close to the trained environment, but when environments become substantially different, their performance quickly drops. When agents are retrained on new environments, a second issue arises: there is a risk of catastrophic forgetting, where the performance on previously seen environments is seriously hampered. This paper proposes a novel approach that exploits an eco-system of agents to address both concerns. Hereby, the (limited) adaptive power of individual agents is harvested to build a highly adaptive eco-system.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keymoulin2022improving

Related papers

• Discovering General Reinforcement Learning Algorithms With Adversarial Environment Design (2023)0.00
• Discovering Minimal Reinforcement Learning Environments (2024)0.00
• Ecological Reinforcement Learning (2020)8.35
• Efficient Reinforcement Learning Via Decoupling Exploration And Utilization (2023)2.56
• Simple Agent, Complex Environment: Efficient Reinforcement Learning With Agent States (2021)0.00
• Dynamics Generalization Via Information Bottleneck In Deep Reinforcement Learning (2020)0.00
• Learning A Subspace Of Policies For Online Adaptation In Reinforcement Learning (2021)0.00
• Continual Knowledge Adaptation For Reinforcement Learning (2025)0.00