paper-with-me

Papers

A Multi-Scale Decomposition MLP-Mixer for Time Series Analysis

2023-10-18 · Shuhan Zhong, Sizhe Song, Weipeng Zhuo, Guanyao Li, Yang Liu, S. -H. Gary Chan

Time series data, including univariate and multivariate ones, are characterized by unique composition and complex multi-scale temporal variations. They often require special consideration of decomposition and multi-scale modeling to analyze. Existing deep learning methods on this best fit to univariate time series only, and have not sufficiently considered sub-series modeling and decomposition completeness. To address these challenges, we propose MSD-Mixer, a Multi-Scale Decomposition MLP-Mixer, which learns to explicitly decompose and represent the input time series in its different layers. To handle the multi-scale temporal patterns and multivariate dependencies, we propose a novel temporal patching approach to model the time series as multi-scale patches, and employ MLPs to capture intra- and inter-patch variations and channel-wise correlations. In addition, we propose a novel loss function to constrain both the mean and the autocorrelation of the decomposition residual for better decomposition completeness. Through extensive experiments on various real-world datasets for five common time series analysis tasks, we demonstrate that MSD-Mixer consistently and significantly outperforms other state-of-the-art algorithms with better efficiency.

📄 PDF Abstract BibTeX arXiv:2310.11959

Code (1)

zshhans/msd-mixer 공식 구현 pytorch

Tasks

Anomaly DetectionImputationTime SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Average Pooling 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
MLP-Mixer 설명 없음

Similar Papers 제목 키워드 기반

LLM-Mixer: Multiscale Mixing in LLMs for Time Series Forecasting

2024-10-15 · Md Kowsher, Md. Shohanur Islam Sobuj, Nusrat Jahan Prottasha, E. Alejandro Alanis 외

Time series forecasting remains a challenging task, particularly in the context of complex multiscale temporal patterns. This study presents LLM-Mixer, a framework that improves forecasting accuracy through the combinati…

Time SeriesTime Series Forecasting

TimeMixer: Decomposable Multiscale Mixing for Time Series Forecasting

2024-05-23 · ICLR 2024 1 · Shiyu Wang, Haixu Wu, Xiaoming Shi, Tengge Hu 외

Time series forecasting is widely used in extensive applications, such as traffic planning and weather forecasting. However, real-world time series usually present intricate temporal variations, making forecasting extrem…

Future predictionTime SeriesTime Series ForecastingWeather Forecasting

WPMixer: Efficient Multi-Resolution Mixing for Long-Term Time Series Forecasting

2024-12-22 · Md Mahmuddun Nabi Murad, Mehmet Aktukmak, Yasin Yilmaz

Time series forecasting is crucial for various applications, such as weather forecasting, power load forecasting, and financial analysis. In recent studies, MLP-mixer models for time series forecasting have been shown as…

Financial AnalysisLoad ForecastingTime SeriesTime Series Forecasting+1

DPWMixer: Dual-Path Wavelet Mixer for Long-Term Time Series Forecasting

2025-11-30 · Li Qianyang, Zhang Xingjun, Wang Shaoxun, Wei Jia arxiv

Long-term time series forecasting (LTSF) is a critical task in computational intelligence. While Transformer-based models effectively capture long-range dependencies, they often suffer from quadratic complexity and overf…

Time Series Forecasting

SEMixer: Semantics Enhanced MLP-Mixer for Multiscale Mixing and Long-term Time Series Forecasting

2026-02-18 · Xu Zhang, Qitong Wang, Peng Wang, Wei Wang arxiv

Modeling multiscale patterns is crucial for long-term time series forecasting (TSF). However, redundancy and noise in time series, together with semantic gaps between non-adjacent scales, make the efficient alignment and…

Time Series Forecasting