A Multi-agent Reinforcement Learning Approach For Efficient Client Selection In Federated Learning

Abstract

Federated learning (FL) is a training technique that enables client devices to jointly learn a shared model by aggregating locally-computed models without exposing their raw data. While most of the existing work focuses on improving the FL model accuracy, in this paper, we focus on the improving the training efficiency, which is often a hurdle for adopting FL in real-world applications. Specifically, we design an efficient FL framework which jointly optimizes model accuracy, processing latency and communication efficiency, all of which are primary design considerations for real implementation of FL. Inspired by the recent success of Multi-Agent Reinforcement Learning (MARL) in solving complex control problems, we present \textit\{FedMarl\}, an MARL-based FL framework which performs efficient run-time client selection. Experiments show that FedMarl can significantly improve model accuracy with much lower processing latency and communication cost.

Stats

• citations99
• S2 citations—
• github stars0
• HF likes0
• heat score15.00
• arxiv keyzhang2022a

Related papers

• Optimized Local Updates In Federated Learning Via Reinforcement Learning (2025)0.00
• A Fair Federated Learning Framework With Reinforcement Learning (2022)0.00
• Fedmrl: Data Heterogeneity Aware Federated Multi-agent Deep Reinforcement Learning For Medical Imaging (2024)0.00
• Heterogeneity-aware Personalized Federated Learning Via Adaptive Dual-agent Reinforcement Learning (2025)0.00
• Communication-efficient Consensus Mechanism For Federated Reinforcement Learning (2022)6.77
• Adaptive Incentive For Cross-silo Federated Learning: A Multi-agent Reinforcement Learning Approach (2023)10.74
• Federated Ensemble Model-based Reinforcement Learning In Edge Computing (2021)11.58
• Small-scale-fading-aware Resource Allocation In Wireless Federated Learning (2025)0.00