Deep Active Inference Agents Using Monte-carlo Methods

Abstract

Active inference is a Bayesian framework for understanding biological intelligence. The underlying theory brings together perception and action under one single imperative: minimizing free energy. However, despite its theoretical utility in explaining intelligence, computational implementations have been restricted to low-dimensional and idealized situations. In this paper, we present a neural architecture for building deep active inference agents operating in complex, continuous state-spaces using multiple forms of Monte-Carlo (MC) sampling. For this, we introduce a number of techniques, novel to active inference. These include: i) selecting free-energy-optimal policies via MC tree search, ii) approximating this optimal policy distribution via a feed-forward `habitual' network, iii) predicting future parameter belief updates using MC dropouts and, finally, iv) optimizing state transition precision (a high-end form of attention). Our approach enables agents to learn environmental dynam

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyfountas2020deep

Related papers

• Deconstructing Deep Active Inference (2023)2.26
• Branching Time Active Inference: Empirical Study And Complexity Class Analysis (2021)6.77
• Active Inference: Demystified And Compared (2019)15.98
• Reward Maximisation Through Discrete Active Inference (2020)10.74
• Active Inference As A Model Of Agency (2024)0.00
• Deep Active Inference For Partially Observable Mdps (2020)9.59
• Sophisticated Inference (2020)14.83
• Expanding The Active Inference Landscape: More Intrinsic Motivations In The Perception-action Loop (2018)9.92