Federated Reinforcement Learning At The Edge

Abstract

Modern cyber-physical architectures use data collected from systems at different physical locations to learn appropriate behaviors and adapt to uncertain environments. However, an important challenge arises as communication exchanges at the edge of networked systems are costly due to limited resources. This paper considers a setup where multiple agents need to communicate efficiently in order to jointly solve a reinforcement learning problem over time-series data collected in a distributed manner. This is posed as learning an approximate value function over a communication network. An algorithm for achieving communication efficiency is proposed, supported with theoretical guarantees, practical implementations, and numerical evaluations. The approach is based on the idea of communicating only when sufficiently informative data is collected.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keygatsis2021federated

Related papers

• Ubiquitous Distributed Deep Reinforcement Learning At The Edge: Analyzing Byzantine Agents In Discrete Action Spaces (2020)0.00
• Federated Ensemble Model-based Reinforcement Learning In Edge Computing (2021)11.58
• Edge-compatible Reinforcement Learning For Recommendations (2021)0.00
• Federated Stochastic Approximation Under Markov Noise And Heterogeneity: Applications In Reinforcement Learning (2022)0.00
• A Safe Deep Reinforcement Learning Approach For Energy Efficient Federated Learning In Wireless Communication Networks (2023)8.09
• Provably Efficient Multi-agent Reinforcement Learning With Fully Decentralized Communication (2021)0.00
• The Gradient Convergence Bound Of Federated Multi-agent Reinforcement Learning With Efficient Communication (2021)0.00
• Communication-efficient Consensus Mechanism For Federated Reinforcement Learning (2022)6.77