paper-with-me

홈 › Papers

What If We Let Forecasting Forget? A Sparse Bottleneck for Cross-Variable Dependencies

2026-05-08 · Fan Zhang, Shiming Fan, Hua Wang arxiv

Multivariate time series forecasting is critical in many real-world systems, and thus modeling cross-channel dependencies is essential. Although existing methods improve overall accuracy by enhancing representations and cross-channel interactions, it remains challenging to reliably capture inter-variable dependencies under specific conditions. We observe that dependencies in real data are often state-dependent and noisy; in such cases, dense interactions can amplify spurious correlations and lead to representation over-smoothing, which may yield unreliable predictions in certain scenarios. Motivated by this, we propose MS-FLOW, a sparse-bottleneck framework that explicitly models inter-variable interaction as capacity-limited information flow. Specifically, MS-FLOW replaces fully connected communication with selective sparse routing, retaining only a few critical dependency paths and injecting cross-variable signals under a strict communication budget, thereby suppressing redundant connections and spurious-correlation propagation. Extensive experiments demonstrate that MS-FLOW learns more reliable multivariate correlations, achieving state-of-the-art forecasting accuracy on 12 real-world benchmarks while producing fewer yet more reliable dependencies, shifting multivariate forecasting from "more interaction" to "more effective interaction".

📄 PDF Abstract BibTeX arXiv:2605.08289

Code (0)

등록된 구현이 없습니다.

Tasks

Multivariate Time Series Forecasting

Similar Papers 제목 키워드 기반

What Will My Model Forget? Forecasting Forgotten Examples in Language Model Refinement

2024-02-02 · Xisen Jin, Xiang Ren

Language models deployed in the wild make errors. However, simply updating the model with the corrected error instances causes catastrophic forgetting -- the updated model makes errors on instances learned during the ins…

Language ModelingLanguage Modellingmodel

Efficient Reinforcement Learning by Reducing Forgetting with Elephant Activation Functions

2025-09-23 · Qingfeng Lan, Gautham Vasan, A. Rupam Mahmood arxiv

Catastrophic forgetting has remained a significant challenge for efficient reinforcement learning for decades (Ring 1994, Rivest and Precup 2003). While recent works have proposed effective methods to mitigate this issue…

Reinforcement Learning

Unlearning via Sparse Representations

2023-11-26 · Vedant Shah, Frederik Träuble, Ashish Malik, Hugo Larochelle 외

Machine \emph{unlearning}, which involves erasing knowledge about a \emph{forget set} from a trained model, can prove to be costly and infeasible by existing techniques. We propose a nearly compute-free zero-shot unlearn…

Knowledge Distillation

Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting

2019-06-29 · NeurIPS 2019 12 · Shiyang Li, Xiaoyong Jin, Yao Xuan, Xiyou Zhou 외

Time series forecasting is an important problem across many domains, including predictions of solar plant energy output, electricity consumption, and traffic jam situation. In this paper, we propose to tackle such foreca…

Time SeriesTime Series AnalysisTime Series Forecasting

Elephant Neural Networks: Born to Be a Continual Learner

2023-10-02 · Qingfeng Lan, A. Rupam Mahmood

Catastrophic forgetting remains a significant challenge to continual learning for decades. While recent works have proposed effective methods to mitigate this problem, they mainly focus on the algorithmic side. Meanwhile…

class-incremental learningClass Incremental LearningContinual LearningIncremental Learning+1