Inter-Series Transformer: Attending to Products in Time Series Forecasting
Time series forecasting is an important task in many fields ranging from supply chain management to weather forecasting. Recently, Transformer neural network architectures have shown promising results in forecasting on common time series benchmark datasets. However, application to supply chain demand forecasting, which can have challenging characteristics such as sparsity and cross-series effects, has been limited. In this work, we explore the application of Transformer-based models to supply chain demand forecasting. In particular, we develop a new Transformer-based forecasting approach using a shared, multi-task per-time series network with an initial component applying attention across time series, to capture interactions and help address sparsity. We provide a case study applying our approach to successfully improve demand prediction for a medical device manufacturing company. To further validate our approach, we also apply it to public demand forecasting datasets as well and demonstrate competitive to superior performance compared to a variety of baseline and state-of-the-art forecast methods across the private and public datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Demand ForecastingTime SeriesTime Series ForecastingWeather ForecastingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Using Pre-trained LLMs for Multivariate Time Series Forecasting
Pre-trained Large Language Models (LLMs) encapsulate large amounts of knowledge and take enormous amounts of compute to train. We make use of this resource, together with the observation that LLMs are able to transfer kn…
DecoderMultivariate Time Series ForecastingTime SeriesTime Series ForecastingS2TX: Cross-Attention Multi-Scale State-Space Transformer for Time Series Forecasting
Time series forecasting has recently achieved significant progress with multi-scale models to address the heterogeneity between long and short range patterns. Despite their state-of-the-art performance, we identify two p…
MambaTime SeriesTime Series ForecastingTransformers for scientific data: a pedagogical review for astronomers
The deep learning architecture associated with ChatGPT and related generative AI products is known as transformers. Initially applied to Natural Language Processing, transformers and the self-attention mechanism they exp…
AstronomyTime SeriesAttending to Emotional Narratives
Attention mechanisms in deep neural networks have achieved excellent performance on sequence-prediction tasks. Here, we show that these recently-proposed attention-based mechanisms---in particular, the Transformer with i…
Emotion RecognitionTime SeriesTime Series AnalysisSepTr: Separable Transformer for Audio Spectrogram Processing
Following the successful application of vision transformers in multiple computer vision tasks, these models have drawn the attention of the signal processing community. This is because signals are often represented as sp…
Audio ClassificationSpeech Emotion RecognitionTime Series Analysis