MACS: Deep Reinforcement Learning Based SDN Controller Synchronization Policy Design

Abstract

In distributed software-defined networks (SDN), multiple physical SDN controllers, each managing a network domain, are implemented to balance centralised control, scalability, and reliability requirements. In such networking paradigms, controllers synchronize with each other, in attempts to maintain a logically centralised network view. Despite the presence of various design proposals for distributed SDN controller architectures, most existing works only aim at eliminating anomalies arising from the inconsistencies in different controllers' network views. However, the performance aspect of controller synchronization designs with respect to given SDN applications are generally missing. To fill this gap, we formulate the controller synchronization problem as a Markov decision process (MDP) and apply reinforcement learning techniques combined with deep neural networks (DNNs) to train a smart, scalable, and fine-grained controller synchronization policy, called the Multi-Armed Cooperative

Stats

• citations20
• S2 citations—
• github stars0
• HF likes0
• heat score9.92
• arxiv keyzhang2019macs

Related papers

• Constrained Reinforcement Learning For Adaptive Controller Synchronization In Distributed SDN (2024)0.00
• Learning To Simulate Self-driven Particles System With Coordinated Policy Optimization (2021)0.00
• Application Of Deep Reinforcement Learning To Event-triggered Control For Networked Artificial Pancreas Systems (2026)0.00
• Multi-timescale Ensemble Q-learning For Markov Decision Process Policy Optimization (2024)6.34
• Specialized Deep Residual Policy Safe Reinforcement Learning-based Controller For Complex And Continuous State-action Spaces (2023)4.52
• Multi-agent Reinforcement Learning For Power Control In Wireless Networks Via Adaptive Graphs (2023)7.16
• Structured Diversity Control: A Dual-level Framework For Group-aware Multi-agent Coordination (2025)0.00
• Scalable Centralized Deep Multi-agent Reinforcement Learning Via Policy Gradients (2018)0.00