Causal Model-based Reinforcement Learning For Sample-efficient Iot Channel Access

Abstract

Despite the advantages of multi-agent reinforcement learning (MARL) for wireless use case such as medium access control (MAC), their real-world deployment in Internet of Things (IoT) is hindered by their sample inefficiency. To alleviate this challenge, one can leverage model-based reinforcement learning (MBRL) solutions, however, conventional MBRL approaches rely on black-box models that are not interpretable and cannot reason. In contrast, in this paper, a novel causal model-based MARL framework is developed by leveraging tools from causal learn- ing. In particular, the proposed model can explicitly represent causal dependencies between network variables using structural causal models (SCMs) and attention-based inference networks. Interpretable causal models are then developed to capture how MAC control messages influence observations, how transmission actions determine outcomes, and how channel observations affect rewards. Data augmentation techniques are then used to generate synth

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyarun2025causal

Related papers

• MACIE: Multi-agent Causal Intelligence Explainer For Collective Behavior Understanding (2025)2.26
• RMIO: A Model-based MARL Framework For Scenarios With Observation Loss In Some Agents (2024)0.00
• Dynamic Channel Access Via Meta-reinforcement Learning (2021)5.84
• Dual-mind World Models: A General Framework For Learning In Dynamic Wireless Networks (2025)0.00
• MACCA: Offline Multi-agent Reinforcement Learning With Causal Credit Assignment (2023)0.00
• Model-based Multi-agent Reinforcement Learning: Recent Progress And Prospects (2022)0.00
• A Roadmap Towards Improving Multi-agent Reinforcement Learning With Causal Discovery And Inference (2025)0.00
• Voting-based Multi-agent Reinforcement Learning For Intelligent Iot (2019)0.00