Shape and Time Distortion Loss for Training Deep Time Series Forecasting Models
This paper addresses the problem of time series forecasting for non-stationary signals and multiple future steps prediction. To handle this challenging task, we introduce DILATE (DIstortion Loss including shApe and TimE), a new objective function for training deep neural networks. DILATE aims at accurately predicting sudden changes, and explicitly incorporates two terms supporting precise shape and temporal change detection. We introduce a differentiable loss function suitable for training deep neural nets, and provide a custom back-prop implementation for speeding up optimization. We also introduce a variant of DILATE, which provides a smooth generalization of temporally-constrained Dynamic Time Warping (DTW). Experiments carried out on various non-stationary datasets reveal the very good behaviour of DILATE compared to models trained with the standard Mean Squared Error (MSE) loss function, and also to DTW and variants. DILATE is also agnostic to the choice of the model, and we highlight its benefit for training fully connected networks as well as specialized recurrent architectures, showing its capacity to improve over state-of-the-art trajectory forecasting approaches.
Code (3)
Tasks
Change DetectionDynamic Time WarpingTime SeriesTime Series AnalysisTime Series ForecastingTrajectory ForecastingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deep Time Series Forecasting with Shape and Temporal Criteria
This paper addresses the problem of multi-step time series forecasting for non-stationary signals that can present sudden changes. Current state-of-the-art deep learning forecasting methods, often trained with variants o…
Change DetectionDiversityDynamic Time WarpingTime Series+2TILDE-Q: A Transformation Invariant Loss Function for Time-Series Forecasting
Time-series forecasting has gained increasing attention in the field of artificial intelligence due to its potential to address real-world problems across various domains, including energy, weather, traffic, and economy.…
Dynamic Time WarpingTime SeriesTime Series AnalysisTime Series ForecastingLIMP: Learning Latent Shape Representations with Metric Preservation Priors
In this paper, we advocate the adoption of metric preservation as a powerful prior for learning latent representations of deformable 3D shapes. Key to our construction is the introduction of a geometric distortion criter…
Style TransferBounded-Rationality, Hedging, and Generalization
A learner does not only fit data; it also determines how strongly the training sample may shape its output and how much distortion it can hedge. We study this relation as a bounded-rational decision problem whose primiti…
How Neural Losses Shape VAE Latents
Modern VAEs are rarely trained with the pointwise likelihood implied by the standard $β$-VAE objective. In practice, pointwise reconstruction is often combined with perceptual and adversarial losses, despite a lack of un…