Federated Ensemble Model-based Reinforcement Learning In Edge Computing

Abstract

Federated learning (FL) is a privacy-preserving distributed machine learning paradigm that enables collaborative training among geographically distributed and heterogeneous devices without gathering their data. Extending FL beyond the supervised learning models, federated reinforcement learning (FRL) was proposed to handle sequential decision-making problems in edge computing systems. However, the existing FRL algorithms directly combine model-free RL with FL, thus often leading to high sample complexity and lacking theoretical guarantees. To address the challenges, we propose a novel FRL algorithm that effectively incorporates model-based RL and ensemble knowledge distillation into FL for the first time. Specifically, we utilise FL and knowledge distillation to create an ensemble of dynamics models for clients, and then train the policy by solely using the ensemble model without interacting with the environment. Furthermore, we theoretically prove that the monotonic improvement of the

Stats

• citations34
• S2 citations—
• github stars0
• HF likes0
• heat score11.58
• arxiv keywang2021federated

Related papers

• Optimized Local Updates In Federated Learning Via Reinforcement Learning (2025)0.00
• A Fair Federated Learning Framework With Reinforcement Learning (2022)0.00
• Provably Robust Federated Reinforcement Learning (2025)0.00
• Communication-efficient Consensus Mechanism For Federated Reinforcement Learning (2022)6.77
• Federated Ensemble-directed Offline Reinforcement Learning (2023)0.00
• A Multi-agent Reinforcement Learning Approach For Efficient Client Selection In Federated Learning (2022)15.00
• Fedhpd: Heterogeneous Federated Reinforcement Learning Via Policy Distillation (2025)2.26
• A Safe Deep Reinforcement Learning Approach For Energy Efficient Federated Learning In Wireless Communication Networks (2023)8.09