An Information-theoretic Perspective On Intrinsic Motivation In Reinforcement Learning: A Survey

Abstract

The reinforcement learning (RL) research area is very active, with an important number of new contributions; especially considering the emergent field of deep RL (DRL). However a number of scientific and technical challenges still need to be resolved, amongst which we can mention the ability to abstract actions or the difficulty to explore the environment in sparse-reward settings which can be addressed by intrinsic motivation (IM). We propose to survey these research works through a new taxonomy based on information theory: we computationally revisit the notions of surprise, novelty and skill learning. This allows us to identify advantages and disadvantages of methods and exhibit current outlooks of research. Our analysis suggests that novelty and surprise can assist the building of a hierarchy of transferable skills that further abstracts the environment and makes the exploration process more robust.

Stats

• citations38
• S2 citations—
• github stars0
• HF likes0
• heat score11.93
• arxiv keyaubret2022an

Related papers

• A Survey On Intrinsic Motivation In Reinforcement Learning (2019)0.00
• Autotelic Reinforcement Learning: Exploring Intrinsic Motivations For Skill Acquisition In Open-ended Environments (2025)5.24
• Intrinsic Motivation In Model-based Reinforcement Learning: A Brief Review (2023)0.00
• Rlexplore: Accelerating Research In Intrinsically-motivated Reinforcement Learning (2024)5.33
• A Survey Of Inverse Reinforcement Learning: Challenges, Methods And Progress (2018)0.00
• A Survey On Explainable Reinforcement Learning: Concepts, Algorithms, Challenges (2022)0.00
• A Comprehensive Survey Of Reinforcement Learning: From Algorithms To Practical Challenges (2024)0.00
• Reward Models In Deep Reinforcement Learning: A Survey (2025)0.00