paper-with-me

Papers

Encoding Temporal Statistical-space Priors via Augmented Representation

2024-01-30 · Insu Choi, Woosung Koh, Gimin Kang, Yuntae Jang, Woo Chang Kim

Modeling time series data remains a pervasive issue as the temporal dimension is inherent to numerous domains. Despite significant strides in time series forecasting, high noise-to-signal ratio, non-normality, non-stationarity, and lack of data continue challenging practitioners. In response, we leverage a simple representation augmentation technique to overcome these challenges. Our augmented representation acts as a statistical-space prior encoded at each time step. In response, we name our method Statistical-space Augmented Representation (SSAR). The underlying high-dimensional data-generating process inspires our representation augmentation. We rigorously examine the empirical generalization performance on two data sets with two downstream temporal learning algorithms. Our approach significantly beats all five up-to-date baselines. Moreover, the highly modular nature of our approach can easily be applied to various settings. Lastly, fully-fledged theoretical perspectives are available throughout the writing for a clear and rigorous understanding.

📄 PDF Abstract BibTeX arXiv:2401.16808

Code (0)

등록된 구현이 없습니다.

Tasks

Time SeriesTime Series Forecasting

Similar Papers 제목 키워드 기반

Weakly Augmented Variational Autoencoder in Time Series Anomaly Detection

2024-01-07 · Zhangkai Wu, Longbing Cao, Qi Zhang, Junxian Zhou 외

Due to their unsupervised training and uncertainty estimation, deep Variational Autoencoders (VAEs) have become powerful tools for reconstruction-based Time Series Anomaly Detection (TSAD). Existing VAE-based TSAD method…

Anomaly DetectionSelf-Supervised LearningTime SeriesTime Series Anomaly Detection

PriorVAE: Encoding spatial priors with VAEs for small-area estimation

2021-10-20 · Elizaveta Semenova, Yidan Xu, Adam Howes, Theo Rashid 외

Gaussian processes (GPs), implemented through multivariate Gaussian distributions for a finite collection of data, are the most popular approach in small-area spatial statistical modelling. In this context they are used …

DecoderGaussian Processes

Tree-Augmented Cross-Modal Encoding for Complex-Query Video Retrieval

2020-07-06 · Xun Yang, Jianfeng Dong, Yixin Cao, Xun Wang 외

The rapid growth of user-generated videos on the Internet has intensified the need for text-based video retrieval systems. Traditional methods mainly favor the concept-based paradigm on retrieval with simple queries, whi…

RetrievalVideo Retrieval

Generating Diverse High-Resolution Images with VQ-VAE

2019-03-27 · ICLR Workshop DeepGenStruct 2019 · Ali Razavi, Aaron van den Oord, Oriol Vinyals

We explore the use of Vector Quantized Variational AutoEncoder (VQ-VAE) models for large scale image generation. To this end, we scale and enhance the autoregressive priors used in VQ-VAE to generate synthetic samples of…

DecoderDiversityImage GenerationVocal Bursts Intensity Prediction

Generating Diverse High-Fidelity Images with VQ-VAE-2

2019-06-02 · NeurIPS 2019 12 · Ali Razavi, Aaron van den Oord, Oriol Vinyals

We explore the use of Vector Quantized Variational AutoEncoder (VQ-VAE) models for large scale image generation. To this end, we scale and enhance the autoregressive priors used in VQ-VAE to generate synthetic samples of…

DecoderDiversityImage GenerationVocal Bursts Intensity Prediction