Reducing Catastrophic Forgetting When Evolving Neural Networks

Abstract

A key stepping stone in the development of an artificial general intelligence (a machine that can perform any task), is the production of agents that can perform multiple tasks at once instead of just one. Unfortunately, canonical methods are very prone to catastrophic forgetting (CF) - the act of overwriting previous knowledge about a task when learning a new task. Recent efforts have developed techniques for overcoming CF in learning systems, but no attempt has been made to apply these new techniques to evolutionary systems. This research presents a novel technique, weight protection, for reducing CF in evolutionary systems by adapting a method from learning systems. It is used in conjunction with other evolutionary approaches for overcoming CF and is shown to be effective at alleviating CF when applied to a suite of reinforcement learning tasks. It is speculated that this work could indicate the potential for a wider application of existing learning-based approaches to evolutionary

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyearly2019reducing

Related papers

• Continual Reinforcement Learning With Complex Synapses (2018)0.00
• Neuroevolution Of Recurrent Architectures On Control Tasks (2023)4.52
• Improving Generalization To New Environments And Removing Catastrophic Forgetting In Reinforcement Learning By Using An Eco-system Of Agents (2022)0.00
• Experience Replay For Continual Learning (2018)0.00
• Map-based Experience Replay: A Memory-efficient Solution To Catastrophic Forgetting In Reinforcement Learning (2023)9.23
• Mimicking Evolution With Reinforcement Learning (2020)0.00
• Improving Performance In Reinforcement Learning By Breaking Generalization In Neural Networks (2020)0.00
• P2DT: Mitigating Forgetting In Task-incremental Learning With Progressive Prompt Decision Transformer (2024)3.58