paper-with-me

Papers

Neural Fourier Modelling: A Highly Compact Approach to Time-Series Analysis

2024-10-07 · Minjung Kim, Yusuke Hioka, Michael Witbrock

Neural time-series analysis has traditionally focused on modeling data in the time domain, often with some approaches incorporating equivalent Fourier domain representations as auxiliary spectral features. In this work, we shift the main focus to frequency representations, modeling time-series data fully and directly in the Fourier domain. We introduce Neural Fourier Modelling (NFM), a compact yet powerful solution for time-series analysis. NFM is grounded in two key properties of the Fourier transform (FT): (i) the ability to model finite-length time series as functions in the Fourier domain, treating them as continuous-time elements in function space, and (ii) the capacity for data manipulation (such as resampling and timespan extension) within the Fourier domain. We reinterpret Fourier-domain data manipulation as frequency extrapolation and interpolation, incorporating this as a core learning mechanism in NFM, applicable across various tasks. To support flexible frequency extension with spectral priors and effective modulation of frequency representations, we propose two learning modules: Learnable Frequency Tokens (LFT) and Implicit Neural Fourier Filters (INFF). These modules enable compact and expressive modeling in the Fourier domain. Extensive experiments demonstrate that NFM achieves state-of-the-art performance on a wide range of tasks (forecasting, anomaly detection, and classification), including challenging time-series scenarios with previously unseen sampling rates at test time. Moreover, NFM is highly compact, requiring fewer than 40K parameters in each task, with time-series lengths ranging from 100 to 16K.

📄 PDF Abstract BibTeX arXiv:2410.04703

Code (1)

minkiml/NFM 공식 구현 pytorch

Tasks

16kAnomaly DetectionTime SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Index Set Fourier Series Features for Approximating Multi-dimensional Periodic Kernels

2018-05-14 · Anthony Tompkins, Fabio Ramos

Periodicity is often studied in timeseries modelling with autoregressive methods but is less popular in the kernel literature, particularly for higher dimensional problems such as in textures, crystallography, and quantu…

Gaussian Processes

High-Fidelity Prediction of Perturbed Optical Fields using Fourier Feature Networks

2025-08-27 · Joshua R. Jandrell, Mitchell A. Cox arxiv

Predicting the effects of physical perturbations on optical channels is critical for advanced photonic devices, but existing modelling techniques are often computationally intensive or require exhaustive characterisation…

Fourier-RNNs for Modelling Noisy Physics Data

2023-02-13 · Vignesh Gopakumar, Stanislas Pamela, Lorenzo Zanisi

Classical sequential models employed in time-series prediction rely on learning the mappings from the past to the future instances by way of a hidden state. The Hidden states characterise the historical information and e…

Operator learningTime SeriesTime Series AnalysisTime Series Prediction

Interpretable Multivariate Time Series Forecasting Using Neural Fourier Transform

2024-05-22 · Noam Koren, Kira Radinsky

Multivariate time series forecasting is a pivotal task in several domains, including financial planning, medical diagnostics, and climate science. This paper presents the Neural Fourier Transform (NFT) algorithm, which c…

Multivariate Time Series ForecastingTime SeriesTime Series Forecasting

An Optimally Weighted Echo State Neural Network for Highly Chaotic Time Series Modelling

2021-09-29 · Gianfranco Bino, Gabriel Bruno Benigno, Lyle Muller, Shantanu Basu

We demonstrate the development and implementation of a series of echo state neural networks in conjunction with optimal weighted averaging to produce robust, model-free predictions of highly chaotic time series. We deplo…

Time SeriesTime Series Analysis