paper-with-me

홈 › Papers

D2Vformer: A Flexible Time Series Prediction Model Based on Time Position Embedding

2024-09-17 · Xiaobao Song, Hao Wang, Liwei Deng, Yuxin He, Wenming Cao, Chi-Sing Leungc

Time position embeddings capture the positional information of time steps, often serving as auxiliary inputs to enhance the predictive capabilities of time series models. However, existing models exhibit limitations in capturing intricate time positional information and effectively utilizing these embeddings. To address these limitations, this paper proposes a novel model called D2Vformer. Unlike typical prediction methods that rely on RNNs or Transformers, this approach can directly handle scenarios where the predicted sequence is not adjacent to the input sequence or where its length dynamically changes. In comparison to conventional methods, D2Vformer undoubtedly saves a significant amount of training resources. In D2Vformer, the Date2Vec module uses the timestamp information and feature sequences to generate time position embeddings. Afterward, D2Vformer introduces a new fusion block that utilizes an attention mechanism to explore the similarity in time positions between the embeddings of the input sequence and the predicted sequence, thereby generating predictions based on this similarity. Through extensive experiments on six datasets, we demonstrate that Date2Vec outperforms other time position embedding methods, and D2Vformer surpasses state-of-the-art methods in both fixed-length and variable-length prediction tasks.

📄 PDF Abstract BibTeX arXiv:2409.11024

Code (0)

등록된 구현이 없습니다.

Tasks

PositionTime SeriesTime Series Prediction

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

EdgeConvFormer: Dynamic Graph CNN and Transformer based Anomaly Detection in Multivariate Time Series

2023-12-04 · Jie Liu, Qilin Li, Senjian An, Bradley Ezard 외

Transformer-based models for anomaly detection in multivariate time series can benefit from the self-attention mechanism due to its advantage in modeling long-term dependencies. However, Transformer-based anomaly detecti…

Anomaly DetectionTime Series

Temporal Enhanced Training of Multi-view 3D Object Detector via Historical Object Prediction

2023-04-03 · ICCV 2023 1 · Zhuofan Zong, Dongzhi Jiang, Guanglu Song, Zeyue Xue 외

In this paper, we propose a new paradigm, named Historical Object Prediction (HoP) for multi-view 3D detection to leverage temporal information more effectively. The HoP approach is straightforward: given the current tim…

3D Object DetectionObject

CvFormer: Cross-view transFormers with Pre-training for fMRI Analysis of Human Brain

2023-09-14 · Xiangzhu Meng, Qiang Liu, Shu Wu, Liang Wang

In recent years, functional magnetic resonance imaging (fMRI) has been widely utilized to diagnose neurological disease, by exploiting the region of interest (RoI) nodes as well as their connectivities in human brain. Ho…

Contrastive Learning

Unified Spatio-Temporal Tri-Perspective View Representation for 3D Semantic Occupancy Prediction

2024-01-24 · Sathira Silva, Savindu Bhashitha Wannigama, Gihan Jayatilaka, Muhammad Haris Khan 외

Holistic understanding and reasoning in 3D scenes play a vital role in the success of autonomous driving systems. The evolution of 3D semantic occupancy prediction as a pretraining task for autonomous driving and robotic…

3D Semantic Occupancy PredictionAutonomous DrivingComputational Efficiency

JANET: Joint Adaptive predictioN-region Estimation for Time-series

2024-07-08 · Eshant English, Eliot Wong-Toi, Matteo Fontana, Stephan Mandt 외

Conformal prediction provides machine learning models with prediction sets that offer theoretical guarantees, but the underlying assumption of exchangeability limits its applicability to time series data. Furthermore, ex…

Conformal PredictionPredictionTime SeriesUncertainty Quantification+1