The Role Of Exploration For Task Transfer In Reinforcement Learning

Abstract

The exploration--exploitation trade-off in reinforcement learning (RL) is a well-known and much-studied problem that balances greedy action selection with novel experience, and the study of exploration methods is usually only considered in the context of learning the optimal policy for a single learning task. However, in the context of online task transfer, where there is a change to the task during online operation, we hypothesize that exploration strategies that anticipate the need to adapt to future tasks can have a pronounced impact on the efficiency of transfer. As such, we re-examine the exploration--exploitation trade-off in the context of transfer learning. In this work, we review reinforcement learning exploration methods, define a taxonomy with which to organize them, analyze these methods' differences in the context of task transfer, and suggest avenues for future investigation.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyballoch2022the

Related papers

• Is Exploration All You Need? Effective Exploration Characteristics For Transfer In Reinforcement Learning (2024)0.00
• Investigating The Role Of Model-based Learning In Exploration And Transfer (2023)0.00
• Exploration Conscious Reinforcement Learning Revisited (2018)0.00
• Extra: Transfer-guided Exploration (2019)0.00
• Exploration In Knowledge Transfer Utilizing Reinforcement Learning (2024)0.00
• Exploitation Is All You Need... For Exploration (2025)0.00
• When Should Agents Explore? (2021)0.00
• First-explore, Then Exploit: Meta-learning To Solve Hard Exploration-exploitation Trade-offs (2023)0.00