A Hierarchical Approach To Population Training For Human-ai Collaboration

Abstract

A major challenge for deep reinforcement learning (DRL) agents is to collaborate with novel partners that were not encountered by them during the training phase. This is specifically worsened by an increased variance in action responses when the DRL agents collaborate with human partners due to the lack of consistency in human behaviors. Recent work have shown that training a single agent as the best response to a diverse population of training partners significantly increases an agent's robustness to novel partners. We further enhance the population-based training approach by introducing a Hierarchical Reinforcement Learning (HRL) based method for Human-AI Collaboration. Our agent is able to learn multiple best-response policies as its low-level policy while at the same time, it learns a high-level policy that acts as a manager which allows the agent to dynamically switch between the low-level best-response policies based on its current partner. We demonstrate that our method is able

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyloo2023a

Related papers

• Collaborating With Humans Without Human Data (2021)0.00
• Subgoal-based Hierarchical Reinforcement Learning For Multi-agent Collaboration (2024)0.00
• Maximum Entropy Population-based Training For Zero-shot Human-ai Coordination (2021)0.00
• Hierarchical Reinforcement Learning With Opponent Modeling For Distributed Multi-agent Cooperation (2022)5.84
• Human-ai Coordination Via Human-regularized Search And Learning (2022)0.00
• Real-world Human-robot Collaborative Reinforcement Learning (2020)9.41
• Human AI Interaction Loop Training: New Approach For Interactive Reinforcement Learning (2020)0.00
• Multi-agent Deep Reinforcement Learning With Human Strategies (2018)8.09