paper-with-me

홈 › Papers

Lightweight Channel-wise Dynamic Fusion Model: Non-stationary Time Series Forecasting via Entropy Analysis

2025-03-04 · Tianyu Jia, Zongxia Xie, Yanru Sun, Dilfira Kudrat, QinGhua Hu

Non-stationarity is an intrinsic property of real-world time series and plays a crucial role in time series forecasting. Previous studies primarily adopt instance normalization to attenuate the non-stationarity of original series for better predictability. However, instance normalization that directly removes the inherent non-stationarity can lead to three issues: (1) disrupting global temporal dependencies, (2) ignoring channel-specific differences, and (3) producing over-smoothed predictions. To address these issues, we theoretically demonstrate that variance can be a valid and interpretable proxy for quantifying non-stationarity of time series. Based on the analysis, we propose a novel lightweight \textit{C}hannel-wise \textit{D}ynamic \textit{F}usion \textit{M}odel (\textit{CDFM}), which selectively and dynamically recovers intrinsic non-stationarity of the original series, while keeping the predictability of normalized series. First, we design a Dual-Predictor Module, which involves two branches: a Time Stationary Predictor for capturing stable patterns and a Time Non-stationary Predictor for modeling global dynamics patterns. Second, we propose a Fusion Weight Learner to dynamically characterize the intrinsic non-stationary information across different samples based on variance. Finally, we introduce a Channel Selector to selectively recover non-stationary information from specific channels by evaluating their non-stationarity, similarity, and distribution consistency, enabling the model to capture relevant dynamic features and avoid overfitting. Comprehensive experiments on seven time series datasets demonstrate the superiority and generalization capabilities of CDFM.

📄 PDF Abstract BibTeX arXiv:2503.02609

Code (0)

등록된 구현이 없습니다.

Tasks

Time SeriesTime Series Forecasting

Methods 이 논문이 사용한 방법론

Instance Normalization Instance Normalization (also known as contrast normalization) is a normalization layer where: $$ y_{tijk} = \frac{x_{tijk} - \mu_{ti}}{\sqrt{\sigma_{ti}^2 +…
ADOPT Please enter a description about the method here

Similar Papers 제목 키워드 기반

Semantic Routing: Exploring Multi-Layer LLM Feature Weighting for Diffusion Transformers

2026-02-03 · Bozhou Li, Yushuo Guan, Haolin Li, Bohan Zeng 외 arxiv

Recent DiT-based text-to-image models increasingly adopt LLMs as text encoders, yet text conditioning remains largely static and often utilizes only a single LLM layer, despite pronounced semantic hierarchy across LLM la…

PeLAP-A: Adaptive Latent Pruning for Lightweight Latent Diffusion Models

2026-06-22 · Kissa Zahra, Zaib Un Nisa arxiv

Latent diffusion models achieve strong generative performance by operating in a compressed latent space produced by a variational autoencoder (VAE). However, it remains unclear whether all latent channels contribute equa…

GatedLinear: Adaptive Routing of Complementary Linear Bases for Time Series Forecasting

2026-07-10 · Qitai Tan, Ruiwen Gu, Yilin Su, Mo Li 외 arxiv

Time series forecasting requires models to capture diverse, often mutually exclusive, temporal dynamics, from smooth trend continuation to nonstationary drift and strict phase-aligned recurrence. While recent deep learni…

Time Series Forecasting

MM-DETR: An Efficient Multimodal Detection Transformer with Mamba-Driven Dual-Granularity Fusion and Frequency-Aware Modality Adapters

2025-11-29 · Jianhong Han, Yupei Wang, Yuan Zhang, Liang Chen arxiv

Multimodal remote sensing object detection aims to achieve more accurate and robust perception under challenging conditions by fusing complementary information from different modalities. However, existing approaches that…

Object Detection

LYT-NET: Lightweight YUV Transformer-based Network for Low-light Image Enhancement

2024-01-26 · A. Brateanu, R. Balmez, A. Avram, C. Orhei 외

This letter introduces LYT-Net, a novel lightweight transformer-based model for low-light image enhancement (LLIE). LYT-Net consists of several layers and detachable blocks, including our novel blocks--Channel-Wise Denoi…

Color Image DenoisingImage EnhancementLow-Light Image Enhancement