Unsupervised Representation Learning In Deep Reinforcement Learning: A Review

Abstract

This review addresses the problem of learning abstract representations of the measurement data in the context of Deep Reinforcement Learning (DRL). While the data are often ambiguous, high-dimensional, and complex to interpret, many dynamical systems can be effectively described by a low-dimensional set of state variables. Discovering these state variables from the data is a crucial aspect for (i) improving the data efficiency, robustness, and generalization of DRL methods, (ii) tackling the curse of dimensionality, and (iii) bringing interpretability and insights into black-box DRL. This review provides a comprehensive and complete overview of unsupervised representation learning in DRL by describing the main Deep Learning tools used for learning representations of the world, providing a systematic view of the method and principles, summarizing applications, benchmarks and evaluation strategies, and discussing open challenges and future directions.

Stats

• citations18
• S2 citations—
• github stars0
• HF likes0
• heat score9.59
• arxiv keybotteghi2022unsupervised

Related papers

• A Survey Of State Representation Learning For Deep Reinforcement Learning (2025)0.00
• State Representation Learning For Control: An Overview (2018)17.39
• On The Importance Of Feature Decorrelation For Unsupervised Representation Learning In Reinforcement Learning (2023)0.00
• Bootstrapped Representations In Reinforcement Learning (2023)0.00
• Learning Temporally-consistent Representations For Data-efficient Reinforcement Learning (2021)0.00
• Reinforcement Learning With Knowledge Representation And Reasoning: A Brief Survey (2023)0.00
• Learning Dynamic Abstract Representations For Sample-efficient Reinforcement Learning (2022)0.00
• Visual Processing In Context Of Reinforcement Learning (2022)0.00