paper-with-me

홈 › Papers

Fourier Basis Mapping: A Time-Frequency Learning Framework for Time Series Forecasting

2025-07-13 · Runze Yang, Longbing Cao, Xin You, Kun Fang, Jianxun Li, Jie Yang arxiv

The integration of Fourier transform and deep learning opens new avenues for time series forecasting. We reconsider the Fourier transform from a basis functions perspective. Specifically, the real and imaginary parts of the frequency components can be regarded as the coefficients of cosine and sine basis functions at tiered frequency levels, respectively. We find that existing Fourier-based methods face inconsistent starting cycles and inconsistent series length issues. They fail to interpret frequency components precisely and overlook temporal information. Accordingly, the novel Fourier Basis Mapping (FBM) method addresses these issues by integrating time-frequency features through Fourier basis expansion and mapping in the time-frequency space. Our approach extracts explicit frequency features while preserving temporal characteristics. FBM supports plug-and-play integration with various types of neural networks by only adjusting the first initial projection layer for better performance. First, we propose FBM-L, FBM-NL, and FBM-NP to enhance linear, MLP-based, and Transformer-based models, respectively, demonstrating the effectiveness of time-frequency features. Next, we propose a synergetic model architecture, termed FBM-S, which decomposes the seasonal, trend, and interaction effects into three separate blocks, each designed to model time-frequency features in a specialized manner. Finally, we introduce several techniques tailored for time-frequency features, including interaction masking, centralization, patching, rolling window projection, and multi-scale down-sampling. The results are validated on diverse real-world datasets for both long-term and short-term forecasting tasks with SOTA performance.

📄 PDF Abstract BibTeX arXiv:2507.09445

Code (0)

등록된 구현이 없습니다.

Tasks

Time Series Forecasting

Similar Papers 제목 키워드 기반

Fourier Sensitivity and Regularization of Computer Vision Models

2023-01-31 · Kiran Krishnamachari, See-Kiong Ng, Chuan-Sheng Foo

Recent work has empirically shown that deep neural networks latch on to the Fourier statistics of training data and show increased sensitivity to Fourier-basis directions in the input. Understanding and modifying this Fo…

Sensitivity

Rethinking Positional Encoding

2021-07-06 · Jianqiao Zheng, Sameera Ramasinghe, Simon Lucey

It is well noted that coordinate based MLPs benefit -- in terms of preserving high-frequency information -- through the encoding of coordinate positions as an array of Fourier features. Hitherto, the rationale for the ef…

Fourier PINNs: From Strong Boundary Conditions to Adaptive Fourier Bases

2024-10-04 · Madison Cooley, Varun Shankar, Robert M. Kirby, Shandian Zhe

Interest is rising in Physics-Informed Neural Networks (PINNs) as a mesh-free alternative to traditional numerical solvers for partial differential equations (PDEs). However, PINNs often struggle to learn high-frequency …

Iterative Training of Physics-Informed Neural Networks with Fourier-enhanced Features

2025-10-22 · Yulun Wu, Miguel Aguiar, Karl H. Johansson, Matthieu Barreau arxiv

Spectral bias, the tendency of neural networks to learn low-frequency features first, is a well-known issue with many training algorithms for physics-informed neural networks (PINNs). To overcome this issue, we propose I…

Optimizing Basis Function Selection in Constructive Wavelet Neural Networks and Its Applications

2025-07-12 · Dunsheng Huang, Dong Shen, Lei Lu, Ying Tan arxiv

Wavelet neural network (WNN), which learns an unknown nonlinear mapping from the data, has been widely used in signal processing, and time-series analysis. However, challenges in constructing accurate wavelet bases and h…

Computational Efficiency