paper-with-me

Papers

DSformer: A Double Sampling Transformer for Multivariate Time Series Long-term Prediction

2023-08-07 · Chengqing Yu, Fei Wang, Zezhi Shao, Tao Sun, Lin Wu, Yongjun Xu

Multivariate time series long-term prediction, which aims to predict the change of data in a long time, can provide references for decision-making. Although transformer-based models have made progress in this field, they usually do not make full use of three features of multivariate time series: global information, local information, and variables correlation. To effectively mine the above three features and establish a high-precision prediction model, we propose a double sampling transformer (DSformer), which consists of the double sampling (DS) block and the temporal variable attention (TVA) block. Firstly, the DS block employs down sampling and piecewise sampling to transform the original series into feature vectors that focus on global information and local information respectively. Then, TVA block uses temporal attention and variable attention to mine these feature vectors from different dimensions and extract key information. Finally, based on a parallel structure, DSformer uses multiple TVA blocks to mine and integrate different features obtained from DS blocks respectively. The integrated feature information is passed to the generative decoder based on a multi-layer perceptron to realize multivariate time series long-term prediction. Experimental results on nine real-world datasets show that DSformer can outperform eight existing baselines.

📄 PDF Abstract BibTeX arXiv:2308.03274

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingDecoderTime Series

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

DSFormer: A Dual-domain Self-supervised Transformer for Accelerated Multi-contrast MRI Reconstruction

2022-01-26 · Bo Zhou, Neel Dey, Jo Schlemper, Seyed Sadegh Mohseni Salehi 외

Multi-contrast MRI (MC-MRI) captures multiple complementary imaging modalities to aid in radiological decision-making. Given the need for lowering the time cost of multiple acquisitions, current deep accelerated MRI reco…

Decision MakingMRI ReconstructionSelf-Supervised Learning

Decision SpikeFormer: Spike-Driven Transformer for Decision Making

2025-04-04 · CVPR 2025 1 · Wei Huang, Qinying Gu, Nanyang Ye

Offline reinforcement learning (RL) enables policy training solely on pre-collected data, avoiding direct environment interaction - a crucial benefit for energy-constrained embodied AI applications. Although Artificial N…

D4RLDecision MakingOffline RLReinforcement Learning (RL)

DSFormer: Effective Compression of Text-Transformers by Dense-Sparse Weight Factorization

2023-12-20 · Rahul Chand, Yashoteja Prabhu, Pratyush Kumar

With the tremendous success of large transformer models in natural language understanding, down-sizing them for cost-effective deployments has become critical. Recent studies have explored the low-rank weight factorizati…

Knowledge DistillationNatural Language Understanding

Quantum Doubly Stochastic Transformers

2025-04-22 · Jannis Born, Filip Skogh, Kahn Rhrissorrakrai, Filippo Utro 외

At the core of the Transformer, the Softmax normalizes the attention matrix to be right stochastic. Previous research has shown that this often destabilizes training and that enforcing the attention matrix to be doubly s…

Inductive BiasObject Recognition

DSFormer: A Dual-Scale Cross-Learning Transformer for Visual Place Recognition

2025-07-24 · Haiyang Jiang, Songhao Piao, Chao Gao, Lei Yu 외 arxiv

Visual Place Recognition (VPR) is crucial for robust mobile robot localization, yet it faces significant challenges in maintaining reliable performance under varying environmental conditions and viewpoints. To address th…

Visual Place RecognitionComputational Efficiency