Contrastive Learning-based Agent Modeling For Deep Reinforcement Learning

Abstract

Multi-agent systems often require agents to collaborate with or compete against other agents with diverse goals, behaviors, or strategies. Agent modeling is essential when designing adaptive policies for intelligent machine agents in multiagent systems, as this is the means by which the ego agent understands other agents' behavior and extracts their meaningful policy representations. These representations can be used to enhance the ego agent's adaptive policy which is trained by reinforcement learning. However, existing agent modeling approaches typically assume the availability of local observations from other agents (modeled agents) during training or a long observation trajectory for policy adaption. To remove these constrictive assumptions and improve agent modeling performance, we devised a Contrastive Learning-based Agent Modeling (CLAM) method that relies only on the local observations from the ego agent during training and execution. With these observations, CLAM is capable of

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyma2023contrastive

Related papers

• Fact-based Agent Modeling For Multi-agent Reinforcement Learning (2023)0.00
• Attention-guided Contrastive Role Representations For Multi-agent Reinforcement Learning (2023)3.64
• Agent Modelling Under Partial Observability For Deep Reinforcement Learning (2020)0.00
• Learning Latent Representations To Influence Multi-agent Interaction (2020)0.00
• Learning In Cooperative Multiagent Systems Using Cognitive And Machine Models (2023)7.81
• Learning Policy Representations In Multiagent Systems (2018)0.00
• Deep Multiagent Reinforcement Learning: Challenges And Directions (2021)0.00
• Revisiting The Master-slave Architecture In Multi-agent Deep Reinforcement Learning (2017)0.00