Learning Policy Representations In Multiagent Systems

Abstract

Modeling agent behavior is central to understanding the emergence of complex phenomena in multiagent systems. Prior work in agent modeling has largely been task-specific and driven by hand-engineering domain-specific prior knowledge. We propose a general learning framework for modeling agent behavior in any multiagent system using only a handful of interaction data. Our framework casts agent modeling as a representation learning problem. Consequently, we construct a novel objective inspired by imitation learning and agent identification and design an algorithm for unsupervised learning of representations of agent policies. We demonstrate empirically the utility of the proposed framework in (i) a challenging high-dimensional competitive environment for continuous control and (ii) a cooperative environment for communication, on supervised predictive tasks, unsupervised clustering, and policy optimization using deep reinforcement learning.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keygrover2018learning

Related papers

• Metric Policy Representations For Opponent Modeling (2021)0.00
• Learning Meta Representations For Agents In Multi-agent Reinforcement Learning (2021)0.00
• Learning Latent Representations To Influence Multi-agent Interaction (2020)0.00
• Agent Modelling Under Partial Observability For Deep Reinforcement Learning (2020)0.00
• Fact-based Agent Modeling For Multi-agent Reinforcement Learning (2023)0.00
• Embedded Universal Predictive Intelligence: A Coherent Framework For Multi-agent Learning (2025)0.00
• Non-cooperative Multi-agent Systems With Exploring Agents (2020)0.00
• Learning Strategy Representation For Imitation Learning In Multi-agent Games (2024)0.00