Human-ai Coordination Via Human-regularized Search And Learning

Abstract

We consider the problem of making AI agents that collaborate well with humans in partially observable fully cooperative environments given datasets of human behavior. Inspired by piKL, a human-data-regularized search method that improves upon a behavioral cloning policy without diverging far away from it, we develop a three-step algorithm that achieve strong performance in coordinating with real humans in the Hanabi benchmark. We first use a regularized search algorithm and behavioral cloning to produce a better human model that captures diverse skill levels. Then, we integrate the policy regularization idea into reinforcement learning to train a human-like best response to the human model. Finally, we apply regularized search on top of the best response policy at test time to handle out-of-distribution challenges when playing with humans. We evaluate our method in two large scale experiments with humans. First, we show that our method outperforms experts when playing with a group of d

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyhu2022human

Related papers

• Collaborating With Humans Without Human Data (2021)0.00
• Modeling Strong And Human-like Gameplay With Kl-regularized Search (2021)0.00
• Reinforcement Learning On Human Decision Models For Uniquely Collaborative AI Teammates (2021)0.00
• Real-world Human-robot Collaborative Reinforcement Learning (2020)9.41
• Evaluation Of Human-ai Teams For Learned And Rule-based Agents In Hanabi (2021)0.00
• A Hierarchical Approach To Population Training For Human-ai Collaboration (2023)0.00
• Implicitly Aligning Humans And Autonomous Agents Through Shared Task Abstractions (2025)4.52
• Enhancing Human Experience In Human-agent Collaboration: A Human-centered Modeling Approach Based On Positive Human Gain (2024)0.00