paper-with-me

Papers

LightCTS: A Lightweight Framework for Correlated Time Series Forecasting

2023-02-23 · Zhichen Lai, Dalin Zhang, Huan Li, Christian S. Jensen, Hua Lu, Yan Zhao

Correlated time series (CTS) forecasting plays an essential role in many practical applications, such as traffic management and server load control. Many deep learning models have been proposed to improve the accuracy of CTS forecasting. However, while models have become increasingly complex and computationally intensive, they struggle to improve accuracy. Pursuing a different direction, this study aims instead to enable much more efficient, lightweight models that preserve accuracy while being able to be deployed on resource-constrained devices. To achieve this goal, we characterize popular CTS forecasting models and yield two observations that indicate directions for lightweight CTS forecasting. On this basis, we propose the LightCTS framework that adopts plain stacking of temporal and spatial operators instead of alternate stacking that is much more computationally expensive. Moreover, LightCTS features light temporal and spatial operator modules, called L-TCN and GL-Former, that offer improved computational efficiency without compromising their feature extraction capabilities. LightCTS also encompasses a last-shot compression scheme to reduce redundant temporal features and speed up subsequent computations. Experiments with single-step and multi-step forecasting benchmark datasets show that LightCTS is capable of nearly state-of-the-art accuracy at much reduced computational and storage overheads.

📄 PDF Abstract BibTeX arXiv:2302.11974

Code (1)

ai4cts/lightcts 공식 구현 pytorch

Tasks

Computational EfficiencyCorrelated Time Series ForecastingMultivariate Time Series ForecastingTime SeriesTime Series AnalysisTime Series ForecastingTraffic PredictionUnivariate Time Series Forecasting

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음

Similar Papers 제목 키워드 기반

High-Quality Synthetic Financial Time-Series using a GAN-Diffusion Framework

2026-05-26 · Giuseppe Masi, Andrea Coletta, Novella Bartolini arxiv

In recent years, financial institutions and firms have increasingly adopted synthetic data to address data scarcity and to generate counterfactual market scenarios. However, reproducing all the statistical properties of …

Gait complexity assessed by detrended fluctuation analysis is sensitive to inconsistencies in stride time series: A modeling study

2020-08-14

Background: Human gait exhibits complex fractal fluctuations among consecutive strides. The time series of gait parameters are long-range correlated (statistical persistence). In contrast, when gait is synchronized with …

Time SeriesTime Series Analysis

Correlated Time Series Forecasting using Deep Neural Networks: A Summary of Results

2018-08-29 · Razvan-Gabriel Cirstea, Darius-Valer Micu, Gabriel-Marcel Muresan, Chenjuan Guo 외

Cyber-physical systems often consist of entities that interact with each other over time. Meanwhile, as part of the continued digitization of industrial processes, various sensor technologies are deployed that enable us …

Correlated Time Series ForecastingMulti-Task LearningTime SeriesTime Series Analysis+1

Adjusting for Autocorrelated Errors in Neural Networks for Time Series

2021-01-28 · NeurIPS 2021 12 · Fan-Keng Sun, Christopher I. Lang, Duane S. Boning

An increasing body of research focuses on using neural networks to model time series. A common assumption in training neural networks via maximum likelihood estimation on time series is that the errors across time steps …

Time SeriesTime Series AnalysisTime Series ForecastingTime Series Regression

Theory of Acceleration of Decision Making by Correlated Time Sequences

2022-03-30 · Norihiro Okada, Tomoki Yamagami, Nicolas Chauvet, Yusuke Ito 외

Photonic accelerators have been intensively studied to provide enhanced information processing capability to benefit from the unique attributes of physical processes. Recently, it has been reported that chaotically oscil…

Decision MakingTime SeriesTime Series Analysis