An Autonomous Non-monolithic Agent With Multi-mode Exploration Based On Options Framework

Abstract

Most exploration research on reinforcement learning (RL) has paid attention to `the way of exploration', which is `how to explore'. The other exploration research, `when to explore', has not been the main focus of RL exploration research. The issue of `when' of a monolithic exploration in the usual RL exploration behaviour binds an exploratory action to an exploitational action of an agent. Recently, a non-monolithic exploration research has emerged to examine the mode-switching exploration behaviour of humans and animals. The ultimate purpose of our research is to enable an agent to decide when to explore or exploit autonomously. We describe the initial research of an autonomous multi-mode exploration of non-monolithic behaviour in an options framework. The higher performance of our method is shown against the existing non-monolithic exploration method through comparative experimental results.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keykim2023an

Related papers

• When Should Agents Explore? (2021)0.00
• LESSON: Learning To Integrate Exploration Strategies For Reinforcement Learning Via An Option Framework (2023)0.00
• First-explore, Then Exploit: Meta-learning To Solve Hard Exploration-exploitation Trade-offs (2023)0.00
• MULEX: Disentangling Exploitation From Exploration In Deep RL (2019)0.00
• Coordinated Exploration Via Intrinsic Rewards For Multi-agent Reinforcement Learning (2019)0.00
• Exploitation Is All You Need... For Exploration (2025)0.00
• Exploration Conscious Reinforcement Learning Revisited (2018)0.00
• Off-policy Reinforcement Learning With Model-based Exploration Augmentation (2025)0.00