Sensor Control For Information Gain In Dynamic, Sparse And Partially Observed Environments

Abstract

We present an approach for autonomous sensor control for information gathering under partially observable, dynamic and sparsely sampled environments that maximizes information about entities present in that space. We describe our approach for the task of Radio-Frequency (RF) spectrum monitoring, where the goal is to search for and track unknown, dynamic signals in the environment. To this end, we extend the Deep Anticipatory Network (DAN) Reinforcement Learning (RL) framework by (1) improving exploration in sparse, non-stationary environments using a novel information gain reward, and (2) scaling up the control space and enabling the monitoring of complex, dynamic activity patterns using hybrid convolutional-recurrent neural layers. We also extend this problem to situations in which sampling from the intended RF spectrum/field is limited and propose a model-based version of the original RL algorithm that fine-tunes the controller via a model that is iteratively improved from the limite

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyburns2022sensor

Related papers

• Cooperative Informative Sensing For Monitoring Dynamic Indoor Environments Via Multi-agent Reinforcement Learning (2026)0.00
• Actively Learning Reinforcement Learning: A Stochastic Optimal Control Approach (2023)0.00
• Information Is Power: Intrinsic Control Via Information Capture (2021)0.00
• Dynamic Channel Access Via Meta-reinforcement Learning (2021)5.84
• Pid-inspired Inductive Biases For Deep Reinforcement Learning In Partially Observable Control Tasks (2023)0.00
• Adversarial Reinforcement Learning For Observer Design In Autonomous Systems Under Cyber Attacks (2018)0.00
• Mutual Information Tracks Policy Coherence In Reinforcement Learning (2025)0.00
• Data-assimilated Model-informed Reinforcement Learning (2025)0.00