Enhancing Spectrum Efficiency In 6G Satellite Networks: A Gail-powered Policy Learning Via Asynchronous Federated Inverse Reinforcement Learning

Abstract

In this paper, a novel generative adversarial imitation learning (GAIL)-powered policy learning approach is proposed for optimizing beamforming, spectrum allocation, and remote user equipment (RUE) association in NTNs. Traditional reinforcement learning (RL) methods for wireless network optimization often rely on manually designed reward functions, which can require extensive parameter tuning. To overcome these limitations, we employ inverse RL (IRL), specifically leveraging the GAIL framework, to automatically learn reward functions without manual design. We augment this framework with an asynchronous federated learning approach, enabling decentralized multi-satellite systems to collaboratively derive optimal policies. The proposed method aims to maximize spectrum efficiency (SE) while meeting minimum information rate requirements for RUEs. To address the non-convex, NP-hard nature of this problem, we combine the many-to-one matching theory with a multi-agent asynchronous federated IR

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyhassan2024enhancing

Related papers

• Meta-reinforcement Learning For Fast And Data-efficient Spectrum Allocation In Dynamic Wireless Networks (2025)0.00
• The Cost Of Learning: Efficiency Vs. Efficacy Of Learning-based RRM For 6G (2022)0.00
• An Overview Of Machine Learning-enabled Optimization For Reconfigurable Intelligent Surfaces-aided 6G Networks: From Reinforcement Learning To Large Language Models (2024)0.00
• Multi-agent Reinforcement Learning With Common Policy For Antenna Tilt Optimization (2023)0.00
• Deep Reinforcement Learning For Joint Spectrum And Power Allocation In Cellular Networks (2020)0.00
• Bayesian Nonparametric Modelling For Model-free Reinforcement Learning In LTE-LAA And Wi-fi Coexistence (2021)0.00
• Multi-agent Reinforcement Learning For Power Control In Wireless Networks Via Adaptive Graphs (2023)7.16
• C-GAIL: Stabilizing Generative Adversarial Imitation Learning With Control Theory (2024)0.00