Dynamics Of Moral Behavior In Heterogeneous Populations Of Learning Agents

Abstract

Growing concerns about safety and alignment of AI systems highlight the importance of embedding moral capabilities in artificial agents: a promising solution is the use of learning from experience, i.e., Reinforcement Learning. In multi-agent (social) environments, complex population-level phenomena may emerge from interactions between individual learning agents. Many of the existing studies rely on simulated social dilemma environments to study the interactions of independent learning agents; however, they tend to ignore the moral heterogeneity that is likely to be present in societies of agents in practice. For example, at different points in time a single learning agent may face opponents who are consequentialist (i.e., focused on maximizing outcomes over time), norm-based (i.e., conforming to specific norms), or virtue-based (i.e., considering a combination of different virtues). The extent to which agents' co-development may be impacted by such moral heterogeneity in populations i

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keytennant2024dynamics

Related papers

• Evolving Intrinsic Motivations For Altruistic Behavior (2018)2.26
• The Impact Of Behavioral Diversity In Multi-agent Reinforcement Learning (2024)0.00
• Understanding The World To Solve Social Dilemmas Using Multi-agent Reinforcement Learning (2023)0.00
• Social Diversity And Social Preferences In Mixed-motive Reinforcement Learning (2020)0.00
• Evolutionary Multi-agent Reinforcement Learning In Group Social Dilemmas (2024)0.00
• An Efficient Open World Environment For Multi-agent Social Learning (2025)0.00
• The Evolutionary Dynamics Of Independent Learning Agents In Population Games (2020)0.00
• Innate-values-driven Reinforcement Learning Based Cooperative Multi-agent Cognitive Modeling (2024)0.00