Learning To Act Through Evolution Of Neural Diversity In Random Neural Networks

Abstract

Biological nervous systems consist of networks of diverse, sophisticated information processors in the form of neurons of different classes. In most artificial neural networks (ANNs), neural computation is abstracted to an activation function that is usually shared between all neurons within a layer or even the whole network; training of ANNs focuses on synaptic optimization. In this paper, we propose the optimization of neuro-centric parameters to attain a set of diverse neurons that can perform complex computations. Demonstrating the promise of the approach, we show that evolving neural parameters alone allows agents to solve various reinforcement learning tasks without optimizing any synaptic weights. While not aiming to be an accurate biological model, parameterizing neurons to a larger degree than the current common practice, allows us to ask questions about the computational abilities afforded by neural diversity in random neural networks. The presented results open up interestin

Stats

• citations1
• S2 citations—
• github stars0
• HF likes0
• heat score2.26
• arxiv keypedersen2023learning

Related papers

• Neuroevolution Of Recurrent Architectures On Control Tasks (2023)4.52
• System Neural Diversity: Measuring Behavioral Heterogeneity In Multi-agent Learning (2023)0.00
• Learning As Reinforcement: Applying Principles Of Neuroscience For More General Reinforcement Learning Agents (2020)0.00
• Giving Up Control: Neurons As Reinforcement Learning Agents (2020)0.00
• Evolving-to-learn Reinforcement Learning Tasks With Spiking Neural Networks (2022)0.00
• Reinforcement Learning With A Network Of Spiking Agents (2019)0.00
• Reinforcement Learning With Brain-inspired Modulation Can Improve Adaptation To Environmental Changes (2022)0.00
• Diversity Is All You Need: Learning Skills Without A Reward Function (2018)0.00