Illuminating Generalization In Deep Reinforcement Learning Through Procedural Level Generation

Abstract

Deep reinforcement learning (RL) has shown impressive results in a variety of domains, learning directly from high-dimensional sensory streams. However, when neural networks are trained in a fixed environment, such as a single level in a video game, they will usually overfit and fail to generalize to new levels. When RL models overfit, even slight modifications to the environment can result in poor agent performance. This paper explores how procedurally generated levels during training can increase generality. We show that for some games procedural level generation enables generalization to new levels within the same distribution. Additionally, it is possible to achieve better performance with less data by manipulating the difficulty of the levels in response to the performance of the agent. The generality of the learned behaviors is also evaluated on a set of human-designed levels. The results suggest that the ability to generalize to human-designed levels highly depends on the design

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyjustesen2018illuminating

Related papers

• Assessing Generalization In Deep Reinforcement Learning (2018)0.00
• Leveraging Procedural Generation To Benchmark Reinforcement Learning (2019)0.00
• Generalizing Skills With Semi-supervised Reinforcement Learning (2016)0.00
• How The Level Sampling Process Impacts Zero-shot Generalisation In Deep Reinforcement Learning (2023)0.00
• Dynamics Generalization Via Information Bottleneck In Deep Reinforcement Learning (2020)0.00
• Quantifying Generalization In Reinforcement Learning (2018)0.00
• Procedural Generalization By Planning With Self-supervised World Models (2021)0.00
• Generalization And Regularization In DQN (2018)0.00