Challenges In Credit Assignment For Multi-agent Reinforcement Learning In Open Agent Systems

Abstract

In the rapidly evolving field of multi-agent reinforcement learning (MARL), understanding the dynamics of open systems is crucial. Openness in MARL refers to the dynam-ic nature of agent populations, tasks, and agent types with-in a system. Specifically, there are three types of openness as reported in (Eck et al. 2023) [2]: agent openness, where agents can enter or leave the system at any time; task openness, where new tasks emerge, and existing ones evolve or disappear; and type openness, where the capabil-ities and behaviors of agents change over time. This report provides a conceptual and empirical review, focusing on the interplay between openness and the credit assignment problem (CAP). CAP involves determining the contribution of individual agents to the overall system performance, a task that becomes increasingly complex in open environ-ments. Traditional credit assignment (CA) methods often assume static agent populations, fixed and pre-defined tasks, and stationary types, mak

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyabadi2025challenges

Related papers

• Asynchronous Credit Assignment For Multi-agent Reinforcement Learning (2024)0.00
• MACCA: Offline Multi-agent Reinforcement Learning With Causal Credit Assignment (2023)0.00
• Cooperative Game-theoretic Credit Assignment For Multi-agent Policy Gradients Via The Core (2025)0.00
• A Survey Of Temporal Credit Assignment In Deep Reinforcement Learning (2023)0.00
• Adaptability In Multi-agent Reinforcement Learning: A Framework And Unified Review (2025)0.00
• Cooperative Multi-agent Transfer Learning With Level-adaptive Credit Assignment (2021)0.00
• Multi-agent Reinforcement Learning: A Comprehensive Survey (2023)0.00
• Learning Implicit Credit Assignment For Cooperative Multi-agent Reinforcement Learning (2020)0.00