paper-with-me

Papers

Frequency Estimation Using Complex-Valued Shifted Window Transformer

2023-09-17 · Josiah W. Smith, Murat Torlak

Estimating closely spaced frequency components of a signal is a fundamental problem in statistical signal processing. In this letter, we introduce 1-D real-valued and complex-valued shifted window (Swin) transformers, referred to as SwinFreq and CVSwinFreq, respectively, for line-spectra frequency estimation on 1-D complex-valued signals. Whereas 2-D Swin transformer-based models have gained traction for optical image super-resolution, we introduce for the first time a complex-valued Swin module designed to leverage the complex-valued nature of signals for a wide array of applications. The proposed approach overcomes the limitations of the classical algorithms such as the periodogram, MUSIC, and OMP in addition to state-of-the-art deep learning approach cResFreq. SwinFreq and CVSwinFreq boast superior performance at low signal-to-noise ratio SNR and improved resolution capability while requiring fewer model parameters than cResFreq, thus deeming it more suitable for edge and mobile applications. We find that the real-valued Swin-Freq outperforms its complex-valued counterpart CVSwinFreq for several tasks while touting a smaller model size. Finally, we apply the proposed techniques for radar range profile super-resolution using real data. The results from both synthetic and real experimentation validate the numerical and empirical superiority of SwinFreq and CVSwinFreq to the state-of-the-art deep learning-based techniques and traditional frequency estimation algorithms. The code and models are publicly available at https://github.com/josiahwsmith10/spectral-super-resolution-swin.

📄 PDF Abstract BibTeX arXiv:2309.09352

Code (1)

josiahwsmith10/spectral-super-resolution-swin 공식 구현 pytorch

Tasks

Image Super-ResolutionSpectral Super-ResolutionSuper-Resolution

Similar Papers 제목 키워드 기반

Efficient Time Series Forecasting via Hyper-Complex Models and Frequency Aggregation

2025-02-27 · Eyal Yakir, Dor Tsur, Haim Permuter

Time series forecasting is a long-standing problem in statistics and machine learning. One of the key challenges is processing sequences with long-range dependencies. To that end, a recent line of work applied the short-…

Time SeriesTime Series Forecasting

A mathematical motivation for complex-valued convolutional networks

2015-03-11 · Joan Bruna, Soumith Chintala, Yann Lecun, Serkan Piantino 외

A complex-valued convolutional network (convnet) implements the repeated application of the following composition of three operations, recursively applying the composition to an input vector of nonnegative real numbers: …

FwNet-ECA: Facilitating Window Attention with Global Receptive Fields through Fourier Filtering Operations

2025-02-25 · Shengtian Mian, Ya Wang, Nannan Gu, Yuping Wang 외

Windowed attention mechanisms were introduced to mitigate the issue of excessive computation inherent in global attention mechanisms. However, In this paper, we present FwNet-ECA, a novel method that utilizes Fourier tra…

Visual Mechanisms Inspired Efficient Transformers for Image and Video Quality Assessment

2022-03-28 · Junyong You, Zheng Zhang

Visual (image, video) quality assessments can be modelled by visual features in different domains, e.g., spatial, frequency, and temporal domains. Perceptual mechanisms in the human visual system (HVS) play a crucial rol…

Image Quality AssessmentVideo Quality AssessmentVisual Question Answering (VQA)

Swin DiT: Diffusion Transformer using Pseudo Shifted Windows

2025-05-19 · Jiafu Wu, Yabiao Wang, Jian Li, Jinlong Peng 외

Diffusion Transformers (DiTs) achieve remarkable performance within the domain of image generation through the incorporation of the transformer architecture. Conventionally, DiTs are constructed by stacking serial isotro…

Image Generation