Five Properties Of Specific Curiosity You Didn't Know Curious Machines Should Have

Abstract

Curiosity for machine agents has been a focus of lively research activity. The study of human and animal curiosity, particularly specific curiosity, has unearthed several properties that would offer important benefits for machine learners, but that have not yet been well-explored in machine intelligence. In this work, we conduct a comprehensive, multidisciplinary survey of the field of animal and machine curiosity. As a principal contribution of this work, we use this survey as a foundation to introduce and define what we consider to be five of the most important properties of specific curiosity: 1) directedness towards inostensible referents, 2) cessation when satisfied, 3) voluntary exposure, 4) transience, and 5) coherent long-term learning. As a second main contribution of this work, we show how these properties may be implemented together in a proof-of-concept reinforcement learning agent: we demonstrate how the properties manifest in the behaviour of this agent in a simple non-ep

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyady2022five

Related papers

• Prototyping Three Key Properties Of Specific Curiosity In Computational Reinforcement Learning (2022)0.00
• From Psychological Curiosity To Artificial Curiosity: Curiosity-driven Learning In Artificial Intelligence Tasks (2022)0.00
• Is Curiosity All You Need? On The Utility Of Emergent Behaviours From Curious Exploration (2021)0.00
• Wonder Wins Ways: Curiosity-driven Exploration Through Multi-agent Contextual Calibration (2025)0.00
• Curiosity-driven Multi-agent Exploration With Mixed Objectives (2022)0.00
• Curiosity-driven Exploration Via Latent Bayesian Surprise (2021)0.00
• A Unified Strategy For Implementing Curiosity And Empowerment Driven Reinforcement Learning (2018)0.00
• Episodic Curiosity Through Reachability (2018)0.00