Interpretable Spectral Variational AutoEncoder (ISVAE) for time series clustering
The best encoding is the one that is interpretable in nature. In this work, we introduce a novel model that incorporates an interpretable bottleneck-termed the Filter Bank (FB)-at the outset of a Variational Autoencoder (VAE). This arrangement compels the VAE to attend on the most informative segments of the input signal, fostering the learning of a novel encoding ${f_0}$ which boasts enhanced interpretability and clusterability over traditional latent spaces. By deliberately constraining the VAE with this FB, we intentionally constrict its capacity to access broad input domain information, promoting the development of an encoding that is discernible, separable, and of reduced dimensionality. The evolutionary learning trajectory of ${f_0}$ further manifests as a dynamic hierarchical tree, offering profound insights into cluster similarities. Additionally, for handling intricate data configurations, we propose a tailored decoder structure that is symmetrically aligned with FB's architecture. Empirical evaluations highlight the superior efficacy of ISVAE, which compares favorably to state-of-the-art results in clustering metrics across real-world datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringDecoderTime SeriesTime Series ClusteringSimilar Papers 제목 키워드 기반
BasisVAE: Translation-invariant feature-level clustering with Variational Autoencoders
Variational Autoencoders (VAEs) provide a flexible and scalable framework for non-linear dimensionality reduction. However, in application domains such as genomics where data sets are typically tabular and high-dimension…
ClusteringDecoderDimensionality ReductionTranslation+1Efficient Mixture Learning in Black-Box Variational Inference
Mixture variational distributions in black box variational inference (BBVI) have demonstrated impressive results in challenging density estimation tasks. However, currently scaling the number of mixture components can le…
Density EstimationVariational InferenceA Revisit of Total Correlation in Disentangled Variational Auto-Encoder with Partial Disentanglement
A fully disentangled variational auto-encoder (VAE) aims to identify disentangled latent components from observations. However, enforcing full independence between all latent components may be too strict for certain data…
DisentanglementBasisVAE: Orthogonal Latent Space for Deep Disentangled Representation
The variational autoencoder, one of the generative models, defines the latent space for the data representation, and uses variational inference to infer the posterior probability. Several methods have been devised to dis…
DisentanglementVariational InferenceVariational Autoencoder with Normalizing flow for X-ray spectral fitting
Black hole X-ray binaries (BHBs) can be studied with spectral fitting to provide physical constraints on accretion in extreme gravitational environments. Traditional methods of spectral fitting such as Markov Chain Monte…