Time Series Clustering with General State Space Models via Stochastic Variational Inference
In this paper, we propose a novel method of model-based time series clustering with mixtures of general state space models (MSSMs). Each component of MSSMs is associated with each cluster. An advantage of the proposed method is that it enables the use of time series models appropriate to the specific time series. This not only improves clustering and prediction accuracy but also enhances the interpretability of the estimated parameters. The parameters of the MSSMs are estimated using stochastic variational inference, a subtype of variational inference. The proposed method estimates the latent variables of an arbitrary state space model by using neural networks with a normalizing flow as a variational estimator. The number of clusters can be estimated using the Bayesian information criterion. In addition, to prevent MSSMs from converging to the local optimum, we propose several optimization tricks, including an additional penalty term called entropy annealing. To our best knowledge, the proposed method is the first computationally feasible one for time series clustering based on general (possibly nonlinear, non-Gaussian) state space models. Experiments on simulated datasets show that the proposed method is effective for clustering, parameter estimation, and estimating the number of clusters.
Code (1)
Tasks
Clusteringparameter estimationState Space ModelsTime SeriesTime Series ClusteringVariational InferenceSimilar Papers 제목 키워드 기반
A self-organising eigenspace map for time series clustering
This paper presents a novel time series clustering method, the self-organising eigenspace map (SOEM), based on a generalisation of the well-known self-organising feature map (SOFM). The SOEM operates on the eigenspaces o…
ClusteringTime SeriesTime Series AnalysisTime Series Clustering+2Time Series Clustering with an EM algorithm for Mixtures of Linear Gaussian State Space Models
In this paper, we consider the task of clustering a set of individual time series while modeling each cluster, that is, model-based time series clustering. The task requires a parametric model with sufficient flexibility…
ClusteringModel Selectionparameter estimationState Space Models+3Anomaly Detection in Time Series of EDFA Pump Currents to Monitor Degeneration Processes using Fuzzy Clustering
This article proposes a novel fuzzy clustering based anomaly detection method for pump current time series of EDFA systems. The proposed change detection framework (CDF) strategically combines the advantages of entropy a…
Anomaly DetectionChange DetectionClusteringTime SeriesNeural Ordinary Differential Equation Model for Evolutionary Subspace Clustering and Its Applications
The neural ordinary differential equation (neural ODE) model has attracted increasing attention in time series analysis for its capability to process irregular time steps, i.e., data are not observed over equally-spaced …
ClusteringTime SeriesTime Series AnalysisClustering Time Series with Nonlinear Dynamics: A Bayesian Non-Parametric and Particle-Based Approach
We propose a general statistical framework for clustering multiple time series that exhibit nonlinear dynamics into an a-priori-unknown number of sub-groups. Our motivation comes from neuroscience, where an important pro…
Bayesian InferenceClusteringState Space ModelsTime Series+1