paper-with-me

홈 › Papers

Disentangling Long-Short Term State Under Unknown Interventions for Online Time Series Forecasting

2025-02-18 · Ruichu Cai, Haiqin Huang, Zhifang Jiang, Zijian Li, Changze Zhou, Yuequn Liu, Yuming Liu, Zhifeng Hao

Current methods for time series forecasting struggle in the online scenario, since it is difficult to preserve long-term dependency while adapting short-term changes when data are arriving sequentially. Although some recent methods solve this problem by controlling the updates of latent states, they cannot disentangle the long/short-term states, leading to the inability to effectively adapt to nonstationary. To tackle this challenge, we propose a general framework to disentangle long/short-term states for online time series forecasting. Our idea is inspired by the observations where short-term changes can be led by unknown interventions like abrupt policies in the stock market. Based on this insight, we formalize a data generation process with unknown interventions on short-term states. Under mild assumptions, we further leverage the independence of short-term states led by unknown interventions to establish the identification theory to achieve the disentanglement of long/short-term states. Built on this theory, we develop a long short-term disentanglement model (LSTD) to extract the long/short-term states with long/short-term encoders, respectively. Furthermore, the LSTD model incorporates a smooth constraint to preserve the long-term dependencies and an interrupted dependency constraint to enforce the forgetting of short-term dependencies, together boosting the disentanglement of long/short-term states. Experimental results on several benchmark datasets show that our \textbf{LSTD} model outperforms existing methods for online time series forecasting, validating its efficacy in real-world applications.

📄 PDF Abstract BibTeX arXiv:2502.12603

Code (1)

DMIRLAB-Group/LSTD 공식 구현 pytorch

Tasks

DisentanglementTime SeriesTime Series Forecasting

Similar Papers 제목 키워드 기반

Disentangling Long and Short-Term Interests for Recommendation

2022-02-26 · Yu Zheng, Chen Gao, Jianxin Chang, Yanan Niu 외

Modeling user's long-term and short-term interests is crucial for accurate recommendation. However, since there is no manually annotated label for user interests, existing approaches always follow the paradigm of entangl…

Contrastive LearningcounterfactualDisentanglement

Quantum RNNs and LSTMs Through Entangling and Disentangling Power of Unitary Transformations

2025-05-10 · Ammar Daskin

In this paper, we discuss how quantum recurrent neural networks (RNNs) and their enhanced version, long short-term memory (LSTM) networks, can be modeled using the core ideas presented in Ref.[1], where the entangling an…

A tale of two sentiment scales: Disentangling short-run and long-run components in multivariate sentiment dynamics

2019-10-03 · Danilo Vassallo, Giacomo Bormetti, Fabrizio Lillo

We propose a novel approach to sentiment data filtering for a portfolio of assets. In our framework, a dynamic factor model drives the evolution of the observed sentiment and allows to identify two distinct components: a…

Human Mesh Recovery from Monocular Images via a Skeleton-disentangled Representation

2019-08-20 · ICCV 2019 10 · Sun Yu, Ye Yun, Liu Wu, Gao Wenpeng 외

We describe an end-to-end method for recovering 3D human body mesh from single images and monocular videos. Different from the existing methods try to obtain all the complex 3D pose, shape, and camera parameters from one…

3D Human Pose Estimation3D Pose EstimationHuman Mesh Recovery

Exploiting video sequences for unsupervised disentangling in generative adversarial networks

2019-10-16 · Facundo Tuesca, Lucas C. Uzal

In this work we present an adversarial training algorithm that exploits correlations in video to learn --without supervision-- an image generator model with a disentangled latent space. The proposed methodology requires …