A Definition Of Open-ended Learning Problems For Goal-conditioned Agents

Abstract

A lot of recent machine learning research papers have ``open-ended learning'' in their title. But very few of them attempt to define what they mean when using the term. Even worse, when looking more closely there seems to be no consensus on what distinguishes open-ended learning from related concepts such as continual learning, lifelong learning or autotelic learning. In this paper, we contribute to fixing this situation. After illustrating the genealogy of the concept and more recent perspectives about what it truly means, we outline that open-ended learning is generally conceived as a composite notion encompassing a set of diverse properties. In contrast with previous approaches, we propose to isolate a key elementary property of open-ended processes, which is to produce elements from time to time (e.g., observations, options, reward functions, and goals), over an infinite horizon, that are considered novel from an observer's perspective. From there, we build the notion of open-ended

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keysigaud2023a

Related papers

• Open-ended Learning Leads To Generally Capable Agents (2021)0.00
• Autotelic Agents With Intrinsically Motivated Goal-conditioned Reinforcement Learning: A Short Survey (2020)0.00
• Learning Curricula In Open-ended Worlds (2023)0.00
• A Definition Of Continual Reinforcement Learning (2023)7.50
• Augmentative Topology Agents For Open-ended Learning (2022)2.26
• Autotelic Reinforcement Learning: Exploring Intrinsic Motivations For Skill Acquisition In Open-ended Environments (2025)5.24
• An Agent Design With Goal Reaching Guarantees For Enhancement Of Learning (2024)0.00
• Robust Agents In Open-ended Worlds (2025)0.00