Metric Policy Representations For Opponent Modeling

Abstract

In multi-agent reinforcement learning, the inherent non-stationarity of the environment caused by other agents' actions posed significant difficulties for an agent to learn a good policy independently. One way to deal with non-stationarity is opponent modeling, by which the agent takes into consideration the influence of other agents' policies. Most existing work relies on predicting other agents' actions or goals, or discriminating between different policies. However, such modeling fails to capture the similarities and differences between policies simultaneously and thus cannot provide enough useful information when generalizing to unseen agents. To address this, we propose a general method to learn representations of other agents' policies, such that the distance between policies is deliberately reflected by the distance between representations, while the policy distance is inferred from the sampled joint action distributions during training. We empirically show that the agent condit

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyjiang2021metric

Related papers

• Model-based Opponent Modeling (2021)0.00
• Learning To Model Opponent Learning (2020)0.00
• Learning Policy Representations In Multiagent Systems (2018)0.00
• Model-based Multi-agent Policy Optimization With Adaptive Opponent-wise Rollouts (2021)0.00
• Adaptive Opponent Policy Detection In Multi-agent Mdps: Real-time Strategy Switch Identification Using Running Error Estimation (2024)0.00
• Variational Autoencoders For Opponent Modeling In Multi-agent Systems (2020)0.00
• Learning Meta Representations For Agents In Multi-agent Reinforcement Learning (2021)0.00
• Agent Modelling Under Partial Observability For Deep Reinforcement Learning (2020)0.00