paper-with-me

Papers

ACFormer: Mitigating Non-linearity with Auto Convolutional Encoder for Time Series Forecasting

2026-01-28 · Gawon Lee, Hanbyeol Park, Minseop Kim, Dohee Kim, Hyerim Bae arxiv

Time series forecasting (TSF) faces challenges in modeling complex intra-channel temporal dependencies and inter-channel correlations. Although recent research has highlighted the efficiency of linear architectures in capturing global trends, these models often struggle with non-linear signals. To address this gap, we conducted a systematic receptive field analysis of convolutional neural network (CNN) TSF models. We introduce the "individual receptive field" to uncover granular structural dependencies, revealing that convolutional layers act as feature extractors that mirror channel-wise attention while exhibiting superior robustness to non-linear fluctuations. Based on these insights, we propose ACFormer, an architecture designed to reconcile the efficiency of linear projections with the non-linear feature-extraction power of convolutions. ACFormer captures fine-grained information through a shared compression module, preserves temporal locality via gated attention, and reconstructs variable-specific temporal patterns using an independent patch expansion layer. Extensive experiments on multiple benchmark datasets demonstrate that ACFormer consistently achieves state-of-the-art performance, effectively mitigating the inherent drawbacks of linear models in capturing high-frequency components.

📄 PDF Abstract BibTeX arXiv:2601.20611

Code (0)

등록된 구현이 없습니다.

Tasks

Time Series Forecasting

Similar Papers 제목 키워드 기반

Tractable Transformers for Flexible Conditional Generation

2025-02-11 · Anji Liu, Xuejie Liu, Dayuan Zhao, Mathias Niepert 외

Non-autoregressive (NAR) generative models are valuable because they can handle diverse conditional generation tasks in a more principled way than their autoregressive (AR) counterparts, which are constrained by sequenti…

Decoder

Self-Organized Variational Autoencoders (Self-VAE) for Learned Image Compression

2021-05-25 · M. Akin Yilmaz, Onur Keleş, Hilal Güven, A. Murat Tekalp 외

In end-to-end optimized learned image compression, it is standard practice to use a convolutional variational autoencoder with generalized divisive normalization (GDN) to transform images into a latent space. Recently, O…

Image Compression

MacFormer: Semantic Segmentation with Fine Object Boundaries

2024-08-11 · Guoan Xu, Wenfeng Huang, Tao Wu, Ligeng Chen 외

Semantic segmentation involves assigning a specific category to each pixel in an image. While Vision Transformer-based models have made significant progress, current semantic segmentation methods often struggle with prec…

DecoderObjectSegmentationSemantic Segmentation

Macformer: Transformer with Random Maclaurin Feature Attention

2024-08-21 · Yuhan Guo, Lizhong Ding, Ye Yuan, Guoren Wang

Random feature attention (RFA) adopts random fourier feature (RFF) methods to approximate the softmax function, resulting in a linear time and space attention mechanism that enables the construction of an efficient Trans…

LACFormer: Toward accurate and efficient polyp segmentation

2023-11-23 · BMVC 2023 11 · Quan Van Nguyen, Mai Nguyen, Thanh Tung Nguyen, Huy Trịnh Quang 외

Polyp segmentation is an essential task in medical image analysis for early detection of colorectal cancer. Deep learning models, particularly encoder-decoder architectures, have been successful in polyp segmentation. Ho…

DecoderImage SegmentationMedical Image AnalysisMedical Image Segmentation+1