paper-with-me

홈 › Papers

$β$-Annealed Variational Autoencoder for glitches

2021-07-20 · Sivaramakrishnan Sankarapandian, Brian Kulis

Gravitational wave detectors such as LIGO and Virgo are susceptible to various types of instrumental and environmental disturbances known as glitches which can mask and mimic gravitational waves. While there are 22 classes of non-Gaussian noise gradients currently identified, the number of classes is likely to increase as these detectors go through commissioning between observation runs. Since identification and labelling new noise gradients can be arduous and time-consuming, we propose $\beta$-Annelead VAEs to learn representations from spectograms in an unsupervised way. Using the same formulation as \cite{alemi2017fixing}, we view Bottleneck-VAEs~cite{burgess2018understanding} through the lens of information theory and connect them to $\beta$-VAEs~cite{higgins2017beta}. Motivated by this connection, we propose an annealing schedule for the hyperparameter $\beta$ in $\beta$-VAEs which has advantages of: 1) One fewer hyperparameter to tune, 2) Better reconstruction quality, while producing similar levels of disentanglement.

📄 PDF Abstract BibTeX arXiv:2107.10667

Code (0)

등록된 구현이 없습니다.

Tasks

Disentanglement

Similar Papers 제목 키워드 기반

Cross-Temporal Spectrogram Autoencoder (CTSAE): Unsupervised Dimensionality Reduction for Clustering Gravitational Wave Glitches

2024-04-23 · Yi Li, Yunan Wu, Aggelos K. Katsaggelos

The advancement of The Laser Interferometer Gravitational-Wave Observatory (LIGO) has significantly enhanced the feasibility and reliability of gravitational wave detection. However, LIGO's high sensitivity makes it susc…

ClusteringDimensionality ReductionGravitational Wave Detection

SQ-VAE: Variational Bayes on Discrete Representation with Self-annealed Stochastic Quantization

2022-05-16 · Yuhta Takida, Takashi Shibuya, WeiHsiang Liao, Chieh-Hsin Lai 외

One noted issue of vector-quantized variational autoencoder (VQ-VAE) is that the learned discrete representation uses only a fraction of the full capacity of the codebook, also known as codebook collapse. We hypothesize …

Quantization

Improving Explorability in Variational Inference with Annealed Variational Objectives

2018-09-06 · NeurIPS 2018 12 · Chin-wei Huang, Shawn Tan, Alexandre Lacoste, Aaron Courville

Despite the advances in the representational capacity of approximate distributions for variational inference, the optimization process can still limit the density that is ultimately learned. We demonstrate the drawbacks …

Variational Inference

Martian time-series unraveled: A multi-scale nested approach with factorial variational autoencoders

2023-05-25 · Ali Siahkoohi, Rudy Morel, Randall Balestriero, Erwan Allys 외

Unsupervised source separation involves unraveling an unknown set of source signals recorded through a mixing operator, with limited prior knowledge about the sources, and only access to a dataset of signal mixtures. Thi…

Time Series

Continual Repeated Annealed Flow Transport Monte Carlo

2022-01-31 · Alexander G. D. G. Matthews, Michael Arbel, Danilo J. Rezende, Arnaud Doucet

We propose Continual Repeated Annealed Flow Transport Monte Carlo (CRAFT), a method that combines a sequential Monte Carlo (SMC) sampler (itself a generalization of Annealed Importance Sampling) with variational inferenc…

Variational Inference