Social Diversity And Social Preferences In Mixed-motive Reinforcement Learning

Abstract

Recent research on reinforcement learning in pure-conflict and pure-common interest games has emphasized the importance of population heterogeneity. In contrast, studies of reinforcement learning in mixed-motive games have primarily leveraged homogeneous approaches. Given the defining characteristic of mixed-motive games--the imperfect correlation of incentives between group members--we study the effect of population heterogeneity on mixed-motive reinforcement learning. We draw on interdependence theory from social psychology and imbue reinforcement learning agents with Social Value Orientation (SVO), a flexible formalization of preferences over group outcome distributions. We subsequently explore the effects of diversity in SVO on populations of reinforcement learning agents in two mixed-motive Markov games. We demonstrate that heterogeneity in SVO generates meaningful and complex behavioral variation among agents similar to that suggested by interdependence theory. Empirical results

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keymckee2020social

Related papers

• Heterogeneous Social Value Orientation Leads To Meaningful Diversity In Sequential Social Dilemmas (2023)0.00
• The Impact Of Behavioral Diversity In Multi-agent Reinforcement Learning (2024)0.00
• Effective Diversity In Population Based Reinforcement Learning (2020)0.00
• Dynamics Of Moral Behavior In Heterogeneous Populations Of Learning Agents (2024)4.52
• Unifying Behavioral And Response Diversity For Open-ended Learning In Zero-sum Games (2021)0.00
• Quantifying The Effects Of Environment And Population Diversity In Multi-agent Reinforcement Learning (2021)9.03
• Balancing Rational And Other-regarding Preferences In Cooperative-competitive Environments (2021)0.00
• System Neural Diversity: Measuring Behavioral Heterogeneity In Multi-agent Learning (2023)0.00