Modeling The Formation Of Social Conventions From Embodied Real-time Interactions

Abstract

What is the role of real-time control and learning in the formation of social conventions? To answer this question, we propose a computational model that matches human behavioral data in a social decision-making game that was analyzed both in discrete-time and continuous-time setups. Furthermore, unlike previous approaches, our model takes into account the role of sensorimotor control loops in embodied decision-making scenarios. For this purpose, we introduce the Control-based Reinforcement Learning (CRL) model. CRL is grounded in the Distributed Adaptive Control (DAC) theory of mind and brain, where low-level sensorimotor control is modulated through perceptual and behavioral learning in a layered structure. CRL follows these principles by implementing a feedback control loop handling the agent's reactive behaviors (pre-wired reflexes), along with an adaptive layer that uses reinforcement learning to maximize long-term reward. We test our model in a multi-agent game-theoretic task in

Stats

• citations9
• S2 citations—
• github stars0
• HF likes0
• heat score7.50
• arxiv keyfreire2018modeling

Related papers

• Learning Existing Social Conventions Via Observationally Augmented Self-play (2018)7.81
• Model-free Conventions In Multi-agent Reinforcement Learning With Heterogeneous Preferences (2020)0.00
• Modeling Human Reputation-seeking Behavior In A Spatio-temporally Complex Public Good Provision Game (2025)0.00
• Understanding The World To Solve Social Dilemmas Using Multi-agent Reinforcement Learning (2023)0.00
• Learning Complex Spatial Behaviours In ABM: An Experimental Observational Study (2022)0.00
• A Goal-based Movement Model For Continuous Multi-agent Tasks (2017)0.00
• Human-level Reinforcement Learning Through Theory-based Modeling, Exploration, And Planning (2021)0.00
• Adversarially Guided Self-play For Adopting Social Conventions (2020)0.00