Strategic Coordination For Evolving Multi-agent Systems: A Hierarchical Reinforcement And Collective Learning Approach
2025 · Chuhao Qin, Evangelos Pournaras
Abstract
Decentralized combinatorial optimization in evolving multi-agent systems poses significant challenges, requiring agents to balance long-term decision-making, short-term optimized collective outcomes, while preserving autonomy of interactive agents under unanticipated changes. Reinforcement learning offers a way to model sequential decision-making through dynamic programming to anticipate future environmental changes. However, applying multi-agent reinforcement learning (MARL) to decentralized combinatorial optimization problems remains an open challenge due to the exponential growth of the joint state-action space, high communication overhead, and privacy concerns in centralized training. To address these limitations, this paper proposes Hierarchical Reinforcement and Collective Learning (HRCL), a novel approach that leverages both MARL and decentralized collective learning based on a hierarchical framework. Agents take high-level strategies using MARL to group possible plans for actio
Authors
(none)
Tags
Stats
Related papers
- Learning To Advise And Learning From Advice In Cooperative Multi-agent Reinforcement Learning (2022)0.00
- Fully Decentralized Cooperative Multi-agent Reinforcement Learning: A Survey (2024)0.00
- Contextual Knowledge Sharing In Multi-agent Reinforcement Learning With Decentralized Communication And Coordination (2025)0.00
- Self-clustering Hierarchical Multi-agent Reinforcement Learning With Extensible Cooperation Graph (2024)2.26
- Dealing With Non-stationarity In Decentralized Cooperative Multi-agent Deep Reinforcement Learning Via Multi-timescale Learning (2023)0.00
- Optimization For Reinforcement Learning: From Single Agent To Cooperative Agents (2019)14.62
- Mean-field Multi-agent Reinforcement Learning: A Decentralized Network Approach (2021)0.00
- Evolution Of Societies Via Reinforcement Learning (2024)0.00