Is Exploration All You Need? Effective Exploration Characteristics For Transfer In Reinforcement Learning

Abstract

In deep reinforcement learning (RL) research, there has been a concerted effort to design more efficient and productive exploration methods while solving sparse-reward problems. These exploration methods often share common principles (e.g., improving diversity) and implementation details (e.g., intrinsic reward). Prior work found that non-stationary Markov decision processes (MDPs) require exploration to efficiently adapt to changes in the environment with online transfer learning. However, the relationship between specific exploration characteristics and effective transfer learning in deep RL has not been characterized. In this work, we seek to understand the relationships between salient exploration characteristics and improved performance and efficiency in transfer learning. We test eleven popular exploration algorithms on a variety of transfer types -- or ``novelties'' -- to identify the characteristics that positively affect online transfer learning. Our analysis shows that some c

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyballoch2024is

Related papers

• The Role Of Exploration For Task Transfer In Reinforcement Learning (2022)0.00
• Investigating The Role Of Model-based Learning In Exploration And Transfer (2023)0.00
• Is Exploration Or Optimization The Problem For Deep Reinforcement Learning? (2025)0.00
• Exploitation Is All You Need... For Exploration (2025)0.00
• Exploration In Knowledge Transfer Utilizing Reinforcement Learning (2024)0.00
• Exploration In Feature Space For Reinforcement Learning (2017)0.00
• Exploration Conscious Reinforcement Learning Revisited (2018)0.00
• A Survey Of Exploration Methods In Reinforcement Learning (2021)0.00