Heterogeneity-aware Personalized Federated Learning Via Adaptive Dual-agent Reinforcement Learning

Abstract

Federated Learning (FL) empowers multiple clients to collaboratively train machine learning models without sharing local data, making it highly applicable in heterogeneous Internet of Things (IoT) environments. However, intrinsic heterogeneity in clients' model architectures and computing capabilities often results in model accuracy loss and the intractable straggler problem, which significantly impairs training effectiveness. To tackle these challenges, this paper proposes a novel Heterogeneity-aware Personalized Federated Learning method, named HAPFL, via multi-level Reinforcement Learning (RL) mechanisms. HAPFL optimizes the training process by incorporating three strategic components: 1) An RL-based heterogeneous model allocation mechanism. The parameter server employs a Proximal Policy Optimization (PPO)-based RL agent to adaptively allocate appropriately sized, differentiated models to clients based on their performance, effectively mitigating performance disparities. 2) An RL-ba

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keychen2025heterogeneity

Related papers

• Fedmrl: Data Heterogeneity Aware Federated Multi-agent Deep Reinforcement Learning For Medical Imaging (2024)0.00
• Optimized Local Updates In Federated Learning Via Reinforcement Learning (2025)0.00
• A Multi-agent Reinforcement Learning Approach For Efficient Client Selection In Federated Learning (2022)15.00
• A Fair Federated Learning Framework With Reinforcement Learning (2022)0.00
• Dearfsac: An Approach To Optimizing Unreliable Federated Learning Via Deep Reinforcement Learning (2022)0.00
• On The Linear Speedup Of Personalized Federated Reinforcement Learning With Shared Representations (2024)0.00
• Federated Reinforcement Learning With Constraint Heterogeneity (2024)0.00
• Fedhpd: Heterogeneous Federated Reinforcement Learning Via Policy Distillation (2025)2.26