Anomaly Detection For Scalable Task Grouping In Reinforcement Learning-based RAN Optimization

Abstract

The use of learning-based methods for optimizing cellular radio access networks (RAN) has received increasing attention in recent years. This coincides with a rapid increase in the number of cell sites worldwide, driven largely by dramatic growth in cellular network traffic. Training and maintaining learned models that work well across a large number of cell sites has thus become a pertinent problem. This paper proposes a scalable framework for constructing a reinforcement learning policy bank that can perform RAN optimization across a large number of cell sites with varying traffic patterns. Central to our framework is a novel application of anomaly detection techniques to assess the compatibility between sites (tasks) and the policy bank. This allows our framework to intelligently identify when a policy can be reused for a task, and when a new policy needs to be trained and added to the policy bank. Our results show that our approach to compatibility assessment leads to an efficient

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyli2023anomaly

Related papers

• Generalization In Reinforcement Learning For Radio Access Networks (2025)0.00
• FORLORN: A Framework For Comparing Offline Methods And Reinforcement Learning For Optimization Of RAN Parameters (2022)0.00
• Practical Policy Distillation For Reinforcement Learning In Radio Access Networks (2025)0.00
• Multi-agent Reinforcement Learning With Common Policy For Antenna Tilt Optimization (2023)0.00
• Deep Reinforcement Learning For Joint Spectrum And Power Allocation In Cellular Networks (2020)0.00
• Meta-reinforcement Learning For Fast And Data-efficient Spectrum Allocation In Dynamic Wireless Networks (2025)0.00
• A Multi-task Approach To Robust Deep Reinforcement Learning For Resource Allocation (2023)0.00
• Offline Reinforcement Learning For Wireless Network Optimization With Mixture Datasets (2023)9.59