Deconstructing Deep Active Inference

Abstract

Active inference is a theory of perception, learning and decision making, which can be applied to neuroscience, robotics, and machine learning. Recently, reasearch has been taking place to scale up this framework using Monte-Carlo tree search and deep learning. The goal of this activity is to solve more complicated tasks using deep active inference. First, we review the existing literature, then, we progresively build a deep active inference agent. For two agents, we have experimented with five definitions of the expected free energy and three different action selection strategies. According to our experiments, the models able to solve the dSprites environment are the ones that maximise rewards. Finally, we compare the similarity of the representation learned by the layers of various agents using centered kernel alignment. Importantly, the agent maximising reward and the agent minimising expected free energy learn very similar representations except for the last layer of the critic net

Stats

• citations1
• S2 citations—
• github stars0
• HF likes0
• heat score2.26
• arxiv keychampion2023deconstructing

Related papers

• Deep Active Inference Agents Using Monte-carlo Methods (2020)0.00
• Active Inference: Demystified And Compared (2019)15.98
• Sophisticated Inference (2020)14.83
• Contrastive Active Inference (2021)0.00
• Expanding The Active Inference Landscape: More Intrinsic Motivations In The Perception-action Loop (2018)9.92
• Reward Maximisation Through Discrete Active Inference (2020)10.74
• Active Inference As A Model Of Agency (2024)0.00
• Branching Time Active Inference: Empirical Study And Complexity Class Analysis (2021)6.77