paper-with-me

홈 › Papers

Sequential online prediction in the presence of outliers and change points: an instant temporal structure learning approach

2019-07-15 · Bin Liu, Yu Qi, Ke-Jia Chen

In this paper, we consider sequential online prediction (SOP) for streaming data in the presence of outliers and change points. We propose an INstant TEmporal structure Learning (INTEL) algorithm to address this problem. Our INTEL algorithm is developed based on a full consideration of the duality between online prediction and anomaly detection. We first employ a mixture of weighted Gaussian process models (WGPs) to cover the expected possible temporal structures of the data. Then, based on the rich modeling capacity of this WGP mixture, we develop an efficient technique to instantly learn (capture) the temporal structure of the data that follows a regime shift. This instant learning is achieved only by adjusting one hyper-parameter value of the mixture model. A weighted generalization of the product of experts (POE) model is used for fusing predictions yielded from multiple GP models. An outlier is declared once a real observation seriously deviates from the fused prediction. If a certain number of outliers are consecutively declared, then a change point is declared. Extensive experiments are performed using a diverse of real datasets. Results show that the proposed algorithm is significantly better than benchmark methods for SOP in the presence of outliers and change points.

📄 PDF Abstract BibTeX arXiv:1907.06377

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly Detection

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Changepoint Detection in the Presence of Outliers

2016-09-23 · Paul Fearnhead, Guillem Rigaill

Many traditional methods for identifying changepoints can struggle in the presence of outliers, or when the noise is heavy-tailed. Often they will infer additional changepoints in order to fit the outliers. To overcome t…

Robust contrastive learning and nonlinear ICA in the presence of outliers

2019-11-01 · Hiroaki Sasaki, Takashi Takenouchi, Ricardo Monti, Aapo Hyvärinen

Nonlinear independent component analysis (ICA) is a general framework for unsupervised representation learning, and aimed at recovering the latent variables in data. Recent practical methods perform nonlinear ICA by solv…

Causal DiscoveryContrastive LearningregressionRepresentation Learning

Outlier-Robust Convex Segmentation

2014-11-17 · Itamar Katz, Koby Crammer

We derive a convex optimization problem for the task of segmenting sequential data, which explicitly treats presence of outliers. We describe two algorithms for solving this problem, one exact and one a top-down novel ap…

Segmentation

Robust Online Convex Optimization in the Presence of Outliers

2021-07-05 · Tim van Erven, Sarah Sachs, Wouter M. Koolen, Wojciech Kotłowski

We consider online convex optimization when a number k of data points are outliers that may be corrupted. We model this by introducing the notion of robust regret, which measures the regret only on rounds that are not ou…

Sequential Changepoint Detection in Neural Networks with Checkpoints

2020-10-06 · Michalis K. Titsias, Jakub Sygnowski, Yutian Chen

We introduce a framework for online changepoint detection and simultaneous model learning which is applicable to highly parametrized models, such as deep neural networks. It is based on detecting changepoints across time…

Continual Learning