Hierarchical Reinforcement Learning In Starcraft II With Human Expertise In Subgoals Selection
2020 · Xinyi Xu, Tiancheng Huang, Pengfei Wei, et al.
Abstract
This work is inspired by recent advances in hierarchical reinforcement learning (HRL) (Barto and Mahadevan 2003; Hengst 2010), and improvements in learning efficiency from heuristic-based subgoal selection, experience replay (Lin 1993; Andrychowicz et al. 2017), and task-based curriculum learning (Bengio et al. 2009; Zaremba and Sutskever 2014). We propose a new method to integrate HRL, experience replay and effective subgoal selection through an implicit curriculum design based on human expertise to support sample-efficient learning and enhance interpretability of the agent's behavior. Human expertise remains indispensable in many areas such as medicine (Buch, Ahmed, and Maruthappu 2018) and law (Cath 2018), where interpretability, explainability and transparency are crucial in the decision making process, for ethical and legal reasons. Our method simplifies the complex task sets for achieving the overall objectives by decomposing them into subgoals at different levels of abstraction.
Authors
(none)
Tags
Stats
Related papers
- Efficient Reinforcement Learning For Starcraft By Abstract Forward Models And Transfer Learning (2019)8.60
- High-level Strategy Selection Under Partial Observability In Starcraft: Brood War (2018)0.00
- MENTOR: Guiding Hierarchical Reinforcement Learning With Human Feedback And Dynamic Distance Constraint (2024)6.34
- Learning And Exploiting Multiple Subgoals For Fast Exploration In Hierarchical Reinforcement Learning (2019)0.00
- Applying Supervised And Reinforcement Learning Methods To Create Neural-network-based Agents For Playing Starcraft II (2021)0.00
- Macro Action Selection With Deep Reinforcement Learning In Starcraft (2018)9.92
- Starcraft Micromanagement With Reinforcement Learning And Curriculum Transfer Learning (2018)16.19
- Starcraft II: A New Challenge For Reinforcement Learning (2017)0.00