Sequential Anomaly Detection Using Inverse Reinforcement Learning

Abstract

One of the most interesting application scenarios in anomaly detection is when sequential data are targeted. For example, in a safety-critical environment, it is crucial to have an automatic detection system to screen the streaming data gathered by monitoring sensors and to report abnormal observations if detected in real-time. Oftentimes, stakes are much higher when these potential anomalies are intentional or goal-oriented. We propose an end-to-end framework for sequential anomaly detection using inverse reinforcement learning (IRL), whose objective is to determine the decision-making agent's underlying function which triggers his/her behavior. The proposed method takes the sequence of actions of a target agent (and possibly other meta information) as input. The agent's normal behavior is then understood by the reward function which is inferred via IRL. We use a neural network to represent a reward function. Using a learned reward function, we evaluate whether a new observation from

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyoh2020sequential

Related papers

• OIL-AD: An Anomaly Detection Framework For Sequential Decision Sequences (2024)0.00
• Anomaly Detection Via Learning-based Sequential Controlled Sensing (2023)5.84
• Time Series Anomaly Detection Via Reinforcement Learning-based Model Selection (2022)0.00
• Anomaly Detection Under Controlled Sensing Using Actor-critic Reinforcement Learning (2020)0.00
• A Scalable Algorithm For Anomaly Detection Via Learning-based Controlled Sensing (2021)0.00
• Inverse Reinforcement Learning With Missing Data (2019)0.00
• Inverse Reinforcement Learning With Simultaneous Estimation Of Rewards And Dynamics (2016)0.00
• Distance-rank Aware Sequential Reward Learning For Inverse Reinforcement Learning With Sub-optimal Demonstrations (2023)0.00