paper-with-me

홈 › Papers

Enhancing Representation Learning for Periodic Time Series with Floss: A Frequency Domain Regularization Approach

2023-08-02 · Chunwei Yang, Xiaoxu Chen, Lijun Sun, Hongyu Yang, Yuankai Wu

Time series analysis is a fundamental task in various application domains, and deep learning approaches have demonstrated remarkable performance in this area. However, many real-world time series data exhibit significant periodic or quasi-periodic dynamics that are often not adequately captured by existing deep learning-based solutions. This results in an incomplete representation of the underlying dynamic behaviors of interest. To address this gap, we propose an unsupervised method called Floss that automatically regularizes learned representations in the frequency domain. The Floss method first automatically detects major periodicities from the time series. It then employs periodic shift and spectral density similarity measures to learn meaningful representations with periodic consistency. In addition, Floss can be easily incorporated into both supervised, semi-supervised, and unsupervised learning frameworks. We conduct extensive experiments on common time series classification, forecasting, and anomaly detection tasks to demonstrate the effectiveness of Floss. We incorporate Floss into several representative deep learning solutions to justify our design choices and demonstrate that it is capable of automatically discovering periodic dynamics and improving state-of-the-art deep learning models.

📄 PDF Abstract BibTeX arXiv:2308.01011

Code (1)

agustdd/floss 공식 구현 pytorch

Tasks

Anomaly DetectionDeep LearningRepresentation LearningTime SeriesTime Series AnalysisTime Series Classification

Similar Papers 제목 키워드 기반

Gradient Flossing: Improving Gradient Descent through Dynamic Control of Jacobians

2023-12-28 · NeurIPS 2023 11 · Rainer Engelken

Training recurrent neural networks (RNNs) remains a challenge due to the instability of gradients across long time horizons, which can lead to exploding and vanishing gradients. Recent research has linked these problems …

PENGUIN: Enhancing Transformer with Periodic-Nested Group Attention for Long-term Time Series Forecasting

2025-08-19 · Tian Sun, Yuqi Chen, Weiwei Sun arxiv

Despite advances in the Transformer architecture, their effectiveness for long-term time series forecasting (LTSF) remains controversial. In this paper, we investigate the potential of integrating explicit periodicity mo…

Time Series Forecasting

Modeling Time Series Dynamics with Fourier Ordinary Differential Equations

2025-10-05 · Muhao Guo, Yang Weng arxiv

Neural ODEs (NODEs) have emerged as powerful tools for modeling time series data, offering the flexibility to adapt to varying input scales and capture complex dynamics. However, they face significant challenges: first, …

High Fidelity Deep Learning-based MRI Reconstruction with Instance-wise Discriminative Feature Matching Loss

2021-08-27 · Ke Wang, Jonathan I Tamir, Alfredo De Goyeneche, Uri Wollner 외

Purpose: To improve reconstruction fidelity of fine structures and textures in deep learning (DL) based reconstructions. Methods: A novel patch-based Unsupervised Feature Loss (UFLoss) is proposed and incorporated into t…

MRI ReconstructionSSIM

An Unsupervised Approach for Periodic Source Detection in Time Series

2024-06-01 · Berken Utku Demirel, Christian Holz

Detection of periodic patterns of interest within noisy time series data plays a critical role in various tasks, spanning from health monitoring to behavior analysis. Existing learning techniques often rely on labels or …

Self-Supervised LearningTime Series