Anomaly Detection Via Learning-based Sequential Controlled Sensing

Abstract

In this paper, we address the problem of detecting anomalies among a given set of binary processes via learning-based controlled sensing. Each process is parameterized by a binary random variable indicating whether the process is anomalous. To identify the anomalies, the decision-making agent is allowed to observe a subset of the processes at each time instant. Also, probing each process has an associated cost. Our objective is to design a sequential selection policy that dynamically determines which processes to observe at each time with the goal to minimize the delay in making the decision and the total sensing cost. We cast this problem as a sequential hypothesis testing problem within the framework of Markov decision processes. This formulation utilizes both a Bayesian log-likelihood ratio-based reward and an entropy-based reward. The problem is then solved using two approaches: 1) a deep reinforcement learning-based approach where we design both deep Q-learning and policy gradient

Stats

• citations5
• S2 citations—
• github stars0
• HF likes0
• heat score5.84
• arxiv keyjoseph2023anomaly

Related papers

• A Scalable Algorithm For Anomaly Detection Via Learning-based Controlled Sensing (2021)0.00
• Scalable And Decentralized Algorithms For Anomaly Detection Via Learning-based Controlled Sensing (2021)0.00
• Anomaly Detection Under Controlled Sensing Using Actor-critic Reinforcement Learning (2020)0.00
• Temporal Detection Of Anomalies Via Actor-critic Based Controlled Sensing (2022)0.00
• Sequential Anomaly Detection Using Inverse Reinforcement Learning (2020)0.00
• Time Series Anomaly Detection Via Reinforcement Learning-based Model Selection (2022)0.00
• OIL-AD: An Anomaly Detection Framework For Sequential Decision Sequences (2024)0.00
• Time-series-informed Closed-loop Learning For Sequential Decision Making And Control (2024)0.00