paper-with-me

홈 › Papers

Meta-Learning for Neural Network-based Temporal Point Processes

2024-01-29 · Yoshiaki Takimoto, Yusuke Tanaka, Tomoharu Iwata, Maya Okawa, Hideaki Kim, Hiroyuki Toda, Takeshi Kurashima

Human activities generate various event sequences such as taxi trip records, bike-sharing pick-ups, crime occurrence, and infectious disease transmission. The point process is widely used in many applications to predict such events related to human activities. However, point processes present two problems in predicting events related to human activities. First, recent high-performance point process models require the input of sufficient numbers of events collected over a long period (i.e., long sequences) for training, which are often unavailable in realistic situations. Second, the long-term predictions required in real-world applications are difficult. To tackle these problems, we propose a novel meta-learning approach for periodicity-aware prediction of future events given short sequences. The proposed method first embeds short sequences into hidden representations (i.e., task representations) via recurrent neural networks for creating predictions from short sequences. It then models the intensity of the point process by monotonic neural networks (MNNs), with the input being the task representations. We transfer the prior knowledge learned from related tasks and can improve event prediction given short sequences of target tasks. We design the MNNs to explicitly take temporal periodic patterns into account, contributing to improved long-term prediction performance. Experiments on multiple real-world datasets demonstrate that the proposed method has higher prediction performance than existing alternatives.

📄 PDF Abstract BibTeX arXiv:2401.15846

Code (0)

등록된 구현이 없습니다.

Tasks

Meta-LearningPoint ProcessesPrediction

Similar Papers 제목 키워드 기반

Meta Temporal Point Processes

2023-01-27 · Wonho Bae, Mohamed Osama Ahmed, Frederick Tung, Gabriel L. Oliveira

A temporal point process (TPP) is a stochastic process where its realization is a sequence of discrete events in time. Recent work in TPPs model the process using a neural network in a supervised learning framework, wher…

Meta-LearningPoint Processes

Time Associated Meta Learning for Clinical Prediction

2023-03-05 · Hao liu, Muhan Zhang, Zehao Dong, Lecheng Kong 외

Rich Electronic Health Records (EHR), have created opportunities to improve clinical processes using machine learning methods. Prediction of the same patient events at different time horizons can have very different appl…

Disease PredictionMeta-LearningPrediction

Attentive Sequential Neural Processes

2019-09-25 · Jaesik Yoon, Gautam Singh, Sungjin Ahn

Sequential Neural Processes (SNP) is a new class of models that can meta-learn a temporal stochastic process of stochastic processes by modeling temporal transition between Neural Processes. As Neural Processes (NP) suff…

regression

Sharp Convergence Rates of Empirical Unbalanced Optimal Transport for Spatio-Temporal Point Processes

2025-09-04 · Marina Struleva, Shayan Hundrieser, Dominic Schuhmacher, Axel Munk arxiv

We statistically analyze empirical plug-in estimators for unbalanced optimal transport (UOT) formalisms, focusing on the Kantorovich-Rubinstein distance, between general intensity measures based on observations from spat…

Point Processes

Transformer Neural Processes: Uncertainty-Aware Meta Learning Via Sequence Modeling

2022-07-09 · Tung Nguyen, Aditya Grover

Neural Processes (NPs) are a popular class of approaches for meta-learning. Similar to Gaussian Processes (GPs), NPs define distributions over functions and can estimate uncertainty in their predictions. However, unlike …

Bayesian OptimizationDecision MakingGaussian ProcessesMeta-Learning+2