Model-based Opponent Modeling

Abstract

When one agent interacts with a multi-agent environment, it is challenging to deal with various opponents unseen before. Modeling the behaviors, goals, or beliefs of opponents could help the agent adjust its policy to adapt to different opponents. In addition, it is also important to consider opponents who are learning simultaneously or capable of reasoning. However, existing work usually tackles only one of the aforementioned types of opponents. In this paper, we propose model-based opponent modeling (MBOM), which employs the environment model to adapt to all kinds of opponents. MBOM simulates the recursive reasoning process in the environment model and imagines a set of improving opponent policies. To effectively and accurately represent the opponent policy, MBOM further mixes the imagined opponent policies according to the similarity with the real behaviors of opponents. Empirically, we show that MBOM achieves more effective adaptation than existing methods in a variety of tasks, re

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyyu2021model

Related papers

• Learning To Model Opponent Learning (2020)0.00
• Metric Policy Representations For Opponent Modeling (2021)0.00
• Variational Autoencoders For Opponent Modeling In Multi-agent Systems (2020)0.00
• Model-based Multi-agent Policy Optimization With Adaptive Opponent-wise Rollouts (2021)0.00
• Consistent Opponent Modeling In Imperfect-information Games (2025)0.00
• Double Deep Q-learning In Opponent Modeling (2022)0.00
• Robust Opponent Modeling Via Adversarial Ensemble Reinforcement Learning In Asymmetric Imperfect-information Games (2019)0.00
• Decision-making With Speculative Opponent Models (2022)2.26