Relational Forward Models For Multi-agent Learning

Abstract

The behavioral dynamics of multi-agent systems have a rich and orderly structure, which can be leveraged to understand these systems, and to improve how artificial agents learn to operate in them. Here we introduce Relational Forward Models (RFM) for multi-agent learning, networks that can learn to make accurate predictions of agents' future behavior in multi-agent environments. Because these models operate on the discrete entities and relations present in the environment, they produce interpretable intermediate representations which offer insights into what drives agents' behavior, and what events mediate the intensity and valence of social interactions. Furthermore, we show that embedding RFM modules inside agents results in faster learning systems compared to non-augmented baselines. As more and more of the autonomous systems we develop and interact with become multi-agent in nature, developing richer analysis tools for characterizing how and why agents make decisions is increasingl

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keytacchetti2018relational

Related papers

• Reward-sharing Relational Networks In Multi-agent Reinforcement Learning As A Framework For Emergent Behavior (2022)2.26
• Impact Of Relational Networks In Multi-agent Learning: A Value-based Factorization View (2023)0.00
• Learning Policy Representations In Multiagent Systems (2018)0.00
• Fact-based Agent Modeling For Multi-agent Reinforcement Learning (2023)0.00
• Embedded Universal Predictive Intelligence: A Coherent Framework For Multi-agent Learning (2025)0.00
• Emergent Social Learning Via Multi-agent Reinforcement Learning (2020)0.00
• Learning And Calibrating Heterogeneous Bounded Rational Market Behaviour With Multi-agent Reinforcement Learning (2024)0.00
• Mingling Foresight With Imagination: Model-based Cooperative Multi-agent Reinforcement Learning (2022)0.00