Reducing Redundant Computation In Multi-agent Coordination Through Locally Centralized Execution

Abstract

In multi-agent reinforcement learning, decentralized execution is a common approach, yet it suffers from the redundant computation problem. This occurs when multiple agents redundantly perform the same or similar computation due to overlapping observations. To address this issue, this study introduces a novel method referred to as locally centralized team transformer (LCTT). LCTT establishes a locally centralized execution framework where selected agents serve as leaders, issuing instructions, while the rest agents, designated as workers, act as these instructions without activating their policy networks. For LCTT, we proposed the team-transformer (T-Trans) architecture that allows leaders to provide specific instructions to each worker, and the leadership shift mechanism that allows agents autonomously decide their roles as leaders or workers. Our experimental results demonstrate that the proposed method effectively reduces redundant computation, does not decrease reward levels, and l

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keybai2024reducing

Related papers

• Towards Efficient Collaboration Via Graph Modeling In Reinforcement Learning (2024)0.00
• CTDS: Centralized Teacher With Decentralized Student For Multi-agent Reinforcement Learning (2022)0.00
• Locality Matters: A Scalable Value Decomposition Approach For Cooperative Multi-agent Reinforcement Learning (2021)0.00
• Decentralized Multi-agents By Imitation Of A Centralized Controller (2019)0.00
• STAS: Spatial-temporal Return Decomposition For Multi-agent Reinforcement Learning (2023)0.00
• PTDE: Personalized Training With Distilled Execution For Multi-agent Reinforcement Learning (2022)0.00
• Intrinsic Action Tendency Consistency For Cooperative Multi-agent Reinforcement Learning (2024)5.24
• Reducing Overestimation Bias In Multi-agent Domains Using Double Centralized Critics (2019)0.00