Interesting Object, Curious Agent: Learning Task-agnostic Exploration

Abstract

Common approaches for task-agnostic exploration learn tabula-rasa --the agent assumes isolated environments and no prior knowledge or experience. However, in the real world, agents learn in many environments and always come with prior experiences as they explore new ones. Exploration is a lifelong process. In this paper, we propose a paradigm change in the formulation and evaluation of task-agnostic exploration. In this setup, the agent first learns to explore across many environments without any extrinsic goal in a task-agnostic manner. Later on, the agent effectively transfers the learned exploration policy to better explore new environments when solving tasks. In this context, we evaluate several baseline exploration strategies and present a simple yet effective approach to learning task-agnostic exploration policies. Our key idea is that there are two components of exploration: (1) an agent-centric component encouraging exploration of unseen parts of the environment based on an age

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyparisi2021interesting

Related papers

• Investigating The Role Of Model-based Learning In Exploration And Transfer (2023)0.00
• Is Curiosity All You Need? On The Utility Of Emergent Behaviours From Curious Exploration (2021)0.00
• Explore-go: Leveraging Exploration For Generalisation In Deep Reinforcement Learning (2024)0.00
• Never Give Up: Learning Directed Exploration Strategies (2020)0.00
• From Curiosity To Competence: How World Models Interact With The Dynamics Of Exploration (2025)0.00
• Temporal Representations For Exploration: Learning Complex Exploratory Behavior Without Extrinsic Rewards (2026)0.00
• What You Think Is What You See: Driving Exploration In VLM Agents Via Visual-linguistic Curiosity (2026)0.00
• Open-ended Learning Leads To Generally Capable Agents (2021)0.00