A Survey Analyzing Generalization In Deep Reinforcement Learning

Abstract

Reinforcement learning research obtained significant success and attention with the utilization of deep neural networks to solve problems in high dimensional state or action spaces. While deep reinforcement learning policies are currently being deployed in many different fields from medical applications to large language models, there are still ongoing questions the field is trying to answer on the generalization capabilities of deep reinforcement learning policies. In this paper, we will formalize and analyze generalization in deep reinforcement learning. We will explain the fundamental reasons why deep reinforcement learning policies encounter overfitting problems that limit their generalization capabilities. Furthermore, we will categorize and explain the manifold solution approaches to increase generalization, and overcome overfitting in deep reinforcement learning policies. From exploration to adversarial analysis and from regularization to robustness our paper provides an analysi

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keykorkmaz2024a

Related papers

• Measuring And Characterizing Generalization In Deep Reinforcement Learning (2018)9.76
• Assessing Generalization In Deep Reinforcement Learning (2018)0.00
• A Survey On Deep Reinforcement Learning-based Approaches For Adaptation And Generalization (2022)0.00
• Quantifying Generalization In Reinforcement Learning (2018)0.00
• Improving Performance In Reinforcement Learning By Breaking Generalization In Neural Networks (2020)0.00
• Generalization Through The Lens Of Learning Dynamics (2022)0.00
• Theoretical Analysis Of Meta Reinforcement Learning: Generalization Bounds And Convergence Guarantees (2024)10.35
• Generalizing Skills With Semi-supervised Reinforcement Learning (2016)0.00