A Policy Resonance Approach To Solve The Problem Of Responsibility Diffusion In Multiagent Reinforcement Learning

Abstract

SOTA multiagent reinforcement algorithms distinguish themselves in many ways from their single-agent equivalences. However, most of them still totally inherit the single-agent exploration-exploitation strategy. Naively inheriting this strategy from single-agent algorithms causes potential collaboration failures, in which the agents blindly follow mainstream behaviors and reject taking minority responsibility. We name this problem the Responsibility Diffusion (RD) as it shares similarities with a same-name social psychology effect. In this work, we start by theoretically analyzing the cause of this RD problem, which can be traced back to the exploration-exploitation dilemma of multiagent systems (especially large-scale multiagent systems). We address this RD problem by proposing a Policy Resonance (PR) approach which modifies the collaborative exploration strategy of agents by refactoring the joint agent policy while keeping individual policies approximately invariant. Next, we show tha

Stats

• citations1
• S2 citations—
• github stars0
• HF likes0
• heat score2.26
• arxiv keyfu2022a

Related papers

• Policy Distillation And Value Matching In Multiagent Reinforcement Learning (2019)10.48
• A Policy Gradient Algorithm For Learning To Learn In Multiagent Reinforcement Learning (2020)0.00
• Responsible Emergent Multi-agent Behavior (2023)0.00
• Role Play: Learning Adaptive Role-specific Strategies In Multi-agent Interactions (2024)0.00
• How Exploration Breaks Cooperation In Shared-policy Multi-agent Reinforcement Learning (2026)0.00
• Multi-agent Assignment Via State Augmented Reinforcement Learning (2024)0.00
• Coordinated Exploration Via Intrinsic Rewards For Multi-agent Reinforcement Learning (2019)0.00
• Assigning Credit With Partial Reward Decoupling In Multi-agent Proximal Policy Optimization (2024)0.00