paper-with-me

Papers

Learnable Adaptive Time-Frequency Representation via Differentiable Short-Time Fourier Transform

2025-06-26 · Maxime Leiber, Yosra Marnissi, Axel Barrau, Sylvain Meignen, Laurent Massoulié

The short-time Fourier transform (STFT) is widely used for analyzing non-stationary signals. However, its performance is highly sensitive to its parameters, and manual or heuristic tuning often yields suboptimal results. To overcome this limitation, we propose a unified differentiable formulation of the STFT that enables gradient-based optimization of its parameters. This approach addresses the limitations of traditional STFT parameter tuning methods, which often rely on computationally intensive discrete searches. It enables fine-tuning of the time-frequency representation (TFR) based on any desired criterion. Moreover, our approach integrates seamlessly with neural networks, allowing joint optimization of the STFT parameters and network weights. The efficacy of the proposed differentiable STFT in enhancing TFRs and improving performance in downstream tasks is demonstrated through experiments on both simulated and real-world data.

📄 PDF Abstract BibTeX arXiv:2506.21440

Code (1)

maxime-leiber/dstft 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Content Adaptive Front End For Audio Classification

2023-03-18 · Prateek Verma, Chris Chafe

We propose a learnable content adaptive front end for audio signal processing. Before the modern advent of deep learning, we used fixed representation non-learnable front-ends like spectrogram or mel-spectrogram with/wit…

Audio ClassificationAudio Signal ProcessingClassificationScene Understanding

Differentiable adaptive short-time Fourier transform with respect to the window length

2023-07-26 · Maxime Leiber, Yosra Marnissi, Axel Barrau, Mohammed El Badaoui

This paper presents a gradient-based method for on-the-fly optimization for both per-frame and per-frequency window length of the short-time Fourier transform (STFT), related to previous work in which we developed a diff…

FACT-GS: Frequency-Aligned Complexity-Aware Texture Reparameterization for 2D Gaussian Splatting

2025-11-28 · Tianhao Xie, Linlian Jiang, Xinxin Zuo, Yang Wang 외 arxiv

Realistic scene appearance modeling has advanced rapidly with Gaussian Splatting, which enables real-time, high-quality rendering. Recent advances introduced per-primitive textures that incorporate spatial color variatio…

Bridging Time and Frequency: A Joint Modeling Framework for Irregular Multivariate Time Series Forecasting

2026-01-31 · Xiangfei Qiu, Kangjia Yan, Xvyuan Liu, Xingjian Wu 외 arxiv

Irregular multivariate time series forecasting (IMTSF) is challenging due to non-uniform sampling and variable asynchronicity. These irregularities violate the equidistant assumptions of standard models, hindering local …

Multivariate Time Series Forecasting

Soft Anisotropic Diagrams for Differentiable Image Representation

2026-04-23 · Laki Iinbor, Zhiyang Dou, Wojciech Matusik arxiv

We introduce Soft Anisotropic Diagrams (SAD), an explicit and differentiable image representation parameterized by a set of adaptive sites in the image plane. In SAD, each site specifies an anisotropic metric and an addi…