Social Learning Spontaneously Emerges By Searching Optimal Heuristics With Deep Reinforcement Learning

Abstract

How have individuals of social animals in nature evolved to learn from each other, and what would be the optimal strategy for such learning in a specific environment? Here, we address both problems by employing a deep reinforcement learning model to optimize the social learning strategies (SLSs) of agents in a cooperative game in a multi-dimensional landscape. Throughout the training for maximizing the overall payoff, we find that the agent spontaneously learns various concepts of social learning, such as copying, focusing on frequent and well-performing neighbors, self-comparison, and the importance of balancing between individual and social learning, without any explicit guidance or prior knowledge about the system. The SLS from a fully trained agent outperforms all of the traditional, baseline SLSs in terms of mean payoff. We demonstrate the superior performance of the reinforcement learning agent in various environments, including temporally changing environments and real social ne

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyha2022social

Related papers

• Emergent Social Learning Via Multi-agent Reinforcement Learning (2020)0.00
• Deception In Social Learning: A Multi-agent Reinforcement Learning Perspective (2021)0.00
• Prosocial Learning Agents Solve Generalized Stag Hunts Better Than Selfish Ones (2017)0.00
• Improved Cooperation By Balancing Exploration And Exploitation In Intertemporal Social Dilemma Tasks (2021)0.00
• An Optimal Rewiring Strategy For Reinforcement Social Learning In Cooperative Multiagent Systems (2018)0.00
• Evolving Intrinsic Motivations For Altruistic Behavior (2018)2.26
• SA-IGA: A Multiagent Reinforcement Learning Method Towards Socially Optimal Outcomes (2018)0.00
• Inclusive Fitness As A Key Step Towards More Advanced Social Behaviors In Multi-agent Reinforcement Learning Settings (2025)0.00