Curiosity-driven Exploration Via Latent Bayesian Surprise

Abstract

The human intrinsic desire to pursue knowledge, also known as curiosity, is considered essential in the process of skill acquisition. With the aid of artificial curiosity, we could equip current techniques for control, such as Reinforcement Learning, with more natural exploration capabilities. A promising approach in this respect has consisted of using Bayesian surprise on model parameters, i.e. a metric for the difference between prior and posterior beliefs, to favour exploration. In this contribution, we propose to apply Bayesian surprise in a latent space representing the agent's current understanding of the dynamics of the system, drastically reducing the computational costs. We extensively evaluate our method by measuring the agent's performance in terms of environment exploration, for continuous tasks, and looking at the game scores achieved, for video games. Our model is computationally cheap and compares positively with current state-of-the-art methods on several problems. We a

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keymazzaglia2021curiosity

Related papers

• Beyond Surprise: Improving Exploration Through Surprise Novelty (2023)0.00
• Wonder Wins Ways: Curiosity-driven Exploration Through Multi-agent Contextual Calibration (2025)0.00
• Is Curiosity All You Need? On The Utility Of Emergent Behaviours From Curious Exploration (2021)0.00
• Intrinsic Rewards For Exploration Without Harm From Observational Noise: A Simulation Study Based On The Free Energy Principle (2024)0.00
• Curiosity-driven Multi-agent Exploration With Mixed Objectives (2022)0.00
• Information Content Exploration (2023)0.00
• What You Think Is What You See: Driving Exploration In VLM Agents Via Visual-linguistic Curiosity (2026)0.00
• Dynamic Memory-based Curiosity: A Bootstrap Approach For Exploration (2022)0.00