Learning Temporal Point Processes Via Reinforcement Learning

Abstract

Social goods, such as healthcare, smart city, and information networks, often produce ordered event data in continuous time. The generative processes of these event data can be very complex, requiring flexible models to capture their dynamics. Temporal point processes offer an elegant framework for modeling event data without discretizing the time. However, the existing maximum-likelihood-estimation (MLE) learning paradigm requires hand-crafting the intensity function beforehand and cannot directly monitor the goodness-of-fit of the estimated model in the process of training. To alleviate the risk of model-misspecification in MLE, we propose to generate samples from the generative model and monitor the quality of the samples in the process of training until the samples and the real data are indistinguishable. We take inspiration from reinforcement learning (RL) and treat the generation of each event as the action taken by a stochastic policy. We parameterize the policy as a flexible re

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyli2018learning

Related papers

• Deep Reinforcement Learning Of Marked Temporal Point Processes (2018)0.00
• Reinforcement Learning With Policy Mixture Model For Temporal Point Processes Clustering (2019)0.00
• Robust And Adaptive Temporal-difference Learning Using An Ensemble Of Gaussian Processes (2021)0.00
• Markov Decision Processes Under External Temporal Processes (2023)0.00
• Imitation Learning Of Neural Spatio-temporal Point Processes (2019)9.23
• Generative Planning For Temporally Coordinated Exploration In Reinforcement Learning (2022)0.00
• Live In The Moment: Learning Dynamics Model Adapted To Evolving Policy (2022)0.00
• An MRP Formulation For Supervised Learning: Generalized Temporal Difference Learning Models (2024)0.00