Reliably Re-acting To Partner's Actions With The Social Intrinsic Motivation Of Transfer Empowerment

Abstract

We consider multi-agent reinforcement learning (MARL) for cooperative communication and coordination tasks. MARL agents can be brittle because they can overfit their training partners' policies. This overfitting can produce agents that adopt policies that act under the expectation that other agents will act in a certain way rather than react to their actions. Our objective is to bias the learning process towards finding reactive strategies towards other agents' behaviors. Our method, transfer empowerment, measures the potential influence between agents' actions. Results from three simulated cooperation scenarios support our hypothesis that transfer empowerment improves MARL performance. We discuss how transfer empowerment could be a useful principle to guide multi-agent coordination by ensuring reactiveness to one's partner.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyvanderheiden2022reliably

Related papers

• Robust Multi-agent Reinforcement Learning With Social Empowerment For Coordination And Communication (2020)0.00
• Influence-based Reinforcement Learning For Intrinsically-motivated Agents (2021)0.00
• Social Influence As Intrinsic Motivation For Multi-agent Deep Reinforcement Learning (2018)0.00
• Cooperative Multi-agent Transfer Learning With Level-adaptive Credit Assignment (2021)0.00
• Coordinating Policies Among Multiple Agents Via An Intelligent Communication Channel (2022)0.00
• Contextual Knowledge Sharing In Multi-agent Reinforcement Learning With Decentralized Communication And Coordination (2025)0.00
• Communicating Plans, Not Percepts: Scalable Multi-agent Coordination With Embodied World Models (2025)0.00
• AC2C: Adaptively Controlled Two-hop Communication For Multi-agent Reinforcement Learning (2023)0.00