Reinforcement Learning With Budget-constrained Nonparametric Function Approximation For Opportunistic Spectrum Access

Abstract

Opportunistic spectrum access is one of the emerging techniques for maximizing throughput in congested bands and is enabled by predicting idle slots in spectrum. We propose a kernel-based reinforcement learning approach coupled with a novel budget-constrained sparsification technique that efficiently captures the environment to find the best channel access actions. This approach allows learning and planning over the intrinsic state-action space and extends well to large state spaces. We apply our methods to evaluate coexistence of a reinforcement learning-based radio with a multi-channel adversarial radio and a single-channel CSMA-CA radio. Numerical experiments show the performance gains over carrier-sense systems.

Stats

• citations4
• S2 citations—
• github stars0
• HF likes0
• heat score5.24
• arxiv keytsiligkaridis2017reinforcement

Related papers

• Deep Reinforcement Learning For Joint Spectrum And Power Allocation In Cellular Networks (2020)0.00
• Dynamic Channel Access Via Meta-reinforcement Learning (2021)5.84
• Meta-reinforcement Learning For Fast And Data-efficient Spectrum Allocation In Dynamic Wireless Networks (2025)0.00
• Deep Reinforcement Learning For Distributed Uncoordinated Cognitive Radios Resource Allocation (2019)0.00
• Implications Of Decentralized Q-learning Resource Allocation In Wireless Networks (2017)0.00
• Bayesian Nonparametric Modelling For Model-free Reinforcement Learning In LTE-LAA And Wi-fi Coexistence (2021)0.00
• Dynamic Spectrum Access For Ambient Backscatter Communication-assisted D2D Systems With Quantum Reinforcement Learning (2024)0.00
• Deep Reinforcement Learning For Distributed And Uncoordinated Cognitive Radios Resource Allocation (2022)0.00