Improved Cooperation By Balancing Exploration And Exploitation In Intertemporal Social Dilemma Tasks

Abstract

When an individual's behavior has rational characteristics, this may lead to irrational collective actions for the group. A wide range of organisms from animals to humans often evolve the social attribute of cooperation to meet this challenge. Therefore, cooperation among individuals is of great significance for allowing social organisms to adapt to changes in the natural environment. Based on multi-agent reinforcement learning, we propose a new learning strategy for achieving coordination by incorporating a learning rate that can balance exploration and exploitation. We demonstrate that agents that use the simple strategy improve a relatively collective return in a decision task called the intertemporal social dilemma, where the conflict between the individual and the group is particularly sharp. We also explore the effects of the diversity of learning rates on the population of reinforcement learning agents and show that agents trained in heterogeneous populations develop particularl

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keycheng2021improved

Related papers

• Intrinsic Fluctuations Of Reinforcement Learning Promote Cooperation (2022)9.23
• Evolving Intrinsic Motivations For Altruistic Behavior (2018)2.26
• Cooperation Dynamics In Multi-agent Systems: Exploring Game-theoretic Scenarios With Mean-field Equilibria (2023)0.00
• Balancing Rational And Other-regarding Preferences In Cooperative-competitive Environments (2021)0.00
• Understanding The World To Solve Social Dilemmas Using Multi-agent Reinforcement Learning (2023)0.00
• Multi-agent Cooperation Through Learning-aware Policy Gradients (2024)0.00
• Cooperation And Reputation Dynamics With Reinforcement Learning (2021)3.58
• Towards Cooperation In Sequential Prisoner's Dilemmas: A Deep Multiagent Reinforcement Learning Approach (2018)0.00