Contrastive Active Inference

Abstract

Active inference is a unifying theory for perception and action resting upon the idea that the brain maintains an internal model of the world by minimizing free energy. From a behavioral perspective, active inference agents can be seen as self-evidencing beings that act to fulfill their optimistic predictions, namely preferred outcomes or goals. In contrast, reinforcement learning requires human-designed rewards to accomplish any desired outcome. Although active inference could provide a more natural self-supervised objective for control, its applicability has been limited because of the shortcomings in scaling the approach to complex environments. In this work, we propose a contrastive objective for active inference that strongly reduces the computational burden in learning the agent's generative model and planning future actions. Our method performs notably better than likelihood-based active inference in image-based tasks, while also being computationally cheaper and easier to train

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keymazzaglia2021contrastive

Related papers

• Deconstructing Deep Active Inference (2023)2.26
• Active Inference: Demystified And Compared (2019)15.98
• Expanding The Active Inference Landscape: More Intrinsic Motivations In The Perception-action Loop (2018)9.92
• Sophisticated Inference (2020)14.83
• Reward Maximisation Through Discrete Active Inference (2020)10.74
• Active Inference As A Model Of Agency (2024)0.00
• Deep Active Inference Agents Using Monte-carlo Methods (2020)0.00
• Prior Preference Learning From Experts:designing A Reward With Active Inference (2021)0.00