paper-with-me

Papers

From Attention to Frequency: Integration of Vision Transformer and FFT-ReLU for Enhanced Image Deblurring

2025-11-13 · Syed Mumtahin Mahmud, Mahdi Mohd Hossain Noki, Prothito Shovon Majumder, Abdul Mohaimen Al Radi, Md. Haider Ali, Md. Mosaddek Khan arxiv

Image deblurring is vital in computer vision, aiming to recover sharp images from blurry ones caused by motion or camera shake. While deep learning approaches such as CNNs and Vision Transformers (ViTs) have advanced this field, they often struggle with complex or high-resolution blur and computational demands. We propose a new dual-domain architecture that unifies Vision Transformers with a frequency-domain FFT-ReLU module, explicitly bridging spatial attention modeling and frequency sparsity. In this structure, the ViT backbone captures local and global dependencies, while the FFT-ReLU component enforces frequency-domain sparsity to suppress blur-related artifacts and preserve fine details. Extensive experiments on benchmark datasets demonstrate that this architecture achieves superior PSNR, SSIM, and perceptual quality compared to state-of-the-art models. Both quantitative metrics, qualitative comparisons, and human preference evaluations confirm its effectiveness, establishing a practical and generalizable paradigm for real-world image restoration.

📄 PDF Abstract BibTeX arXiv:2511.10806

Code (0)

등록된 구현이 없습니다.

Tasks

Image RestorationImage Deblurring

Similar Papers 제목 키워드 기반

Replacing softmax with ReLU in Vision Transformers

2023-09-15 · Mitchell Wortsman, Jaehoon Lee, Justin Gilmer, Simon Kornblith

Previous research observed accuracy degradation when replacing the attention softmax with a point-wise activation such as ReLU. In the context of vision transformers, we find that this degradation is mitigated when divid…

High-Fidelity Differential-information Driven Binary Vision Transformer

2025-07-03 · Tian Gao, Zhiyuan Zhang, Kaijie Yin, Xu-Cheng Zhong 외 arxiv

The binarization of vision transformers (ViTs) offers a promising approach to addressing the trade-off between high computational/storage demands and the constraints of edge-device deployment. However, existing binary Vi…

Computational EfficiencyImage Classification

A Study on ReLU and Softmax in Transformer

2023-02-13 · Kai Shen, Junliang Guo, Xu Tan, Siliang Tang 외

The Transformer architecture consists of self-attention and feed-forward networks (FFNs) which can be viewed as key-value memories according to previous works. However, FFN and traditional memory utilize different activa…

Document Translation

ManipForce: Force-Guided Policy Learning with Frequency-Aware Representation for Contact-Rich Manipulation

2025-09-23 · Geonhyup Lee, Yeongjin Lee, Kangmin Kim, Seongju Lee 외 arxiv

Contact-rich manipulation tasks such as precision assembly require precise control of interaction forces, yet existing imitation learning methods rely mainly on vision-only demonstrations. We propose ManipForce, a handhe…

Discrete Cosine Transform Based Decorrelated Attention for Vision Transformers

2024-05-22 · Hongyi Pan, Emadeldeen Hamdan, Xin Zhu, Ahmet Enis Cetin 외

Central to the Transformer architectures' effectiveness is the self-attention mechanism, a function that maps queries, keys, and values into a high-dimensional vector space. However, training the attention weights of que…

Quantization