A Fair Federated Learning Framework With Reinforcement Learning

Abstract

Federated learning (FL) is a paradigm where many clients collaboratively train a model under the coordination of a central server, while keeping the training data locally stored. However, heterogeneous data distributions over different clients remain a challenge to mainstream FL algorithms, which may cause slow convergence, overall performance degradation and unfairness of performance across clients. To address these problems, in this study we propose a reinforcement learning framework, called PG-FFL, which automatically learns a policy to assign aggregation weights to clients. Additionally, we propose to utilize Gini coefficient as the measure of fairness for FL. More importantly, we apply the Gini coefficient and validation accuracy of clients in each communication round to construct a reward function for the reinforcement learning. Our PG-FFL is also compatible to many existing FL algorithms. We conduct extensive experiments over diverse datasets to verify the effectiveness of our f

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keysun2022a

Related papers

• Optimized Local Updates In Federated Learning Via Reinforcement Learning (2025)0.00
• A Multi-agent Reinforcement Learning Approach For Efficient Client Selection In Federated Learning (2022)15.00
• Federated Ensemble Model-based Reinforcement Learning In Edge Computing (2021)11.58
• Heterogeneity-aware Personalized Federated Learning Via Adaptive Dual-agent Reinforcement Learning (2025)0.00
• Dearfsac: An Approach To Optimizing Unreliable Federated Learning Via Deep Reinforcement Learning (2022)0.00
• Communication-efficient Consensus Mechanism For Federated Reinforcement Learning (2022)6.77
• Adaptive Incentive For Cross-silo Federated Learning: A Multi-agent Reinforcement Learning Approach (2023)10.74
• On The Linear Speedup Of Personalized Federated Reinforcement Learning With Shared Representations (2024)0.00