paper-with-me

홈 › Papers

Time Series Clustering with General State Space Models via Stochastic Variational Inference

2024-06-29 · Ryoichi Ishizuka, Takashi Imai, Kaoru Kawamoto

In this paper, we propose a novel method of model-based time series clustering with mixtures of general state space models (MSSMs). Each component of MSSMs is associated with each cluster. An advantage of the proposed method is that it enables the use of time series models appropriate to the specific time series. This not only improves clustering and prediction accuracy but also enhances the interpretability of the estimated parameters. The parameters of the MSSMs are estimated using stochastic variational inference, a subtype of variational inference. The proposed method estimates the latent variables of an arbitrary state space model by using neural networks with a normalizing flow as a variational estimator. The number of clusters can be estimated using the Bayesian information criterion. In addition, to prevent MSSMs from converging to the local optimum, we propose several optimization tricks, including an additional penalty term called entropy annealing. To our best knowledge, the proposed method is the first computationally feasible one for time series clustering based on general (possibly nonlinear, non-Gaussian) state space models. Experiments on simulated datasets show that the proposed method is effective for clustering, parameter estimation, and estimating the number of clusters.

📄 PDF Abstract BibTeX arXiv:2407.00429

Code (1)

ryoichi0917/svi_mssm 공식 구현 pytorch

Tasks

Clusteringparameter estimationState Space ModelsTime SeriesTime Series ClusteringVariational Inference

Similar Papers 제목 키워드 기반

A self-organising eigenspace map for time series clustering

2019-05-14 · Donya Rahmani, Damien Fay, Jacek Brodzki

This paper presents a novel time series clustering method, the self-organising eigenspace map (SOEM), based on a generalisation of the well-known self-organising feature map (SOFM). The SOEM operates on the eigenspaces o…

ClusteringTime SeriesTime Series AnalysisTime Series Clustering+2

Time Series Clustering with an EM algorithm for Mixtures of Linear Gaussian State Space Models

2022-08-25 · Ryohei Umatani, Takashi Imai, Kaoru Kawamoto, Shutaro Kunimasa

In this paper, we consider the task of clustering a set of individual time series while modeling each cluster, that is, model-based time series clustering. The task requires a parametric model with sufficient flexibility…

ClusteringModel Selectionparameter estimationState Space Models+3

Anomaly Detection in Time Series of EDFA Pump Currents to Monitor Degeneration Processes using Fuzzy Clustering

2024-08-12 · Dominic Schneider, Lutz Rapp, Christoph Ament

This article proposes a novel fuzzy clustering based anomaly detection method for pump current time series of EDFA systems. The proposed change detection framework (CDF) strategically combines the advantages of entropy a…

Anomaly DetectionChange DetectionClusteringTime Series

Neural Ordinary Differential Equation Model for Evolutionary Subspace Clustering and Its Applications

2021-07-22 · Mingyuan Bai, S. T. Boris Choy, Junping Zhang, Junbin Gao

The neural ordinary differential equation (neural ODE) model has attracted increasing attention in time series analysis for its capability to process irregular time steps, i.e., data are not observed over equally-spaced …

ClusteringTime SeriesTime Series Analysis

Clustering Time Series with Nonlinear Dynamics: A Bayesian Non-Parametric and Particle-Based Approach

2018-10-23 · Alexander Lin, Yingzhuo Zhang, Jeremy Heng, Stephen A. Allsop 외

We propose a general statistical framework for clustering multiple time series that exhibit nonlinear dynamics into an a-priori-unknown number of sub-groups. Our motivation comes from neuroscience, where an important pro…

Bayesian InferenceClusteringState Space ModelsTime Series+1