Improving Interactive Reinforcement Learning: What Makes A Good Teacher?

Abstract

Interactive reinforcement learning has become an important apprenticeship approach to speed up convergence in classic reinforcement learning problems. In this regard, a variant of interactive reinforcement learning is policy shaping which uses a parent-like trainer to propose the next action to be performed and by doing so reduces the search space by advice. On some occasions, the trainer may be another artificial agent which in turn was trained using reinforcement learning methods to afterward becoming an advisor for other learner-agents. In this work, we analyze internal representations and characteristics of artificial agents to determine which agent may outperform others to become a better trainer-agent. Using a polymath agent, as compared to a specialist agent, an advisor leads to a larger reward and faster convergence of the reward signal and also to a more stable behavior in terms of the state visit frequency of the learner-agents. Moreover, we analyze system interaction paramet

Stats

• citations30
• S2 citations—
• github stars0
• HF likes0
• heat score11.19
• arxiv keycruz2019improving

Related papers

• Influencing Reinforcement Learning Through Natural Language Guidance (2021)0.00
• TGRL: An Algorithm For Teacher Guided Reinforcement Learning (2023)0.00
• Learning Shaping Strategies In Human-in-the-loop Interactive Reinforcement Learning (2018)0.00
• Human AI Interaction Loop Training: New Approach For Interactive Reinforcement Learning (2020)0.00
• Human Engagement Providing Evaluative And Informative Advice For Interactive Reinforcement Learning (2020)9.23
• Subgoal-based Reward Shaping To Improve Efficiency In Reinforcement Learning (2021)0.00
• Shaping Advice In Deep Reinforcement Learning (2022)0.00
• Policy Composition In Reinforcement Learning Via Multi-objective Policy Optimization (2023)0.00