System Neural Diversity: Measuring Behavioral Heterogeneity In Multi-agent Learning

Abstract

Evolutionary science provides evidence that diversity confers resilience in natural systems. Yet, traditional multi-agent reinforcement learning techniques commonly enforce homogeneity to increase training sample efficiency. When a system of learning agents is not constrained to homogeneous policies, individuals may develop diverse behaviors, resulting in emergent complementarity that benefits the system. Despite this, there is a surprising lack of tools that quantify behavioral diversity. Such techniques would pave the way towards understanding the impact of diversity in collective artificial intelligence and enabling its control. In this paper, we introduce System Neural Diversity (SND): a measure of behavioral heterogeneity in multi-agent systems. We discuss and prove its theoretical properties, and compare it with alternate, state-of-the-art behavioral diversity metrics used in the robotics domain. Through simulations of a variety of cooperative multi-robot tasks, we show how our m

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keybettini2023system

Related papers

• The Impact Of Behavioral Diversity In Multi-agent Reinforcement Learning (2024)0.00
• Structured Diversity Control: A Dual-level Framework For Group-aware Multi-agent Coordination (2025)0.00
• Graph-snd: Sparse Aggregation For Behavioral Diversity In Multi-agent Reinforcement Learning (2026)0.00
• Quantifying The Effects Of Environment And Population Diversity In Multi-agent Reinforcement Learning (2021)9.03
• Unifying Behavioral And Response Diversity For Open-ended Learning In Zero-sum Games (2021)0.00
• Learning To Act Through Evolution Of Neural Diversity In Random Neural Networks (2023)2.26
• Social Diversity And Social Preferences In Mixed-motive Reinforcement Learning (2020)0.00
• Effective Diversity In Population Based Reinforcement Learning (2020)0.00