VINE: An Open Source Interactive Data Visualization Tool For Neuroevolution

Abstract

Recent advances in deep neuroevolution have demonstrated that evolutionary algorithms, such as evolution strategies (ES) and genetic algorithms (GA), can scale to train deep neural networks to solve difficult reinforcement learning (RL) problems. However, it remains a challenge to analyze and interpret the underlying process of neuroevolution in such high dimensions. To begin to address this challenge, this paper presents an interactive data visualization tool called VINE (Visual Inspector for NeuroEvolution) aimed at helping neuroevolution researchers and end-users better understand and explore this family of algorithms. VINE works seamlessly with a breadth of neuroevolution algorithms, including ES and GA, and addresses the difficulty of observing the underlying dynamics of the learning process through an interactive visualization of the evolving agent's behavior characterizations over generations. As neuroevolution scales to neural networks with millions or more connections, visuali

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keywang2018vine

Related papers

• VIME: Variational Information Maximizing Exploration (2016)0.00
• Adaptive Combination Of A Genetic Algorithm And Novelty Search For Deep Neuroevolution (2022)0.00
• REVEAL-IT: Reinforcement Learning With Visibility Of Evolving Agent Policy For Interpretability (2024)0.00
• Autoencoder-augmented Neuroevolution For Visual Doom Playing (2017)11.49
• Interactive Visualization For Debugging RL (2020)0.00
• MAVIPER: Learning Decision Tree Policies For Interpretable Multi-agent Reinforcement Learning (2022)5.84
• Efficacy Of Modern Neuro-evolutionary Strategies For Continuous Control Optimization (2019)0.00
• Improving Exploration In Evolution Strategies For Deep Reinforcement Learning Via A Population Of Novelty-seeking Agents (2017)0.00