paper-with-me

홈 › Papers

CFAT: Unleashing TriangularWindows for Image Super-resolution

2024-03-24 · Abhisek Ray, Gaurav Kumar, Maheshkumar H. Kolekar

Transformer-based models have revolutionized the field of image super-resolution (SR) by harnessing their inherent ability to capture complex contextual features. The overlapping rectangular shifted window technique used in transformer architecture nowadays is a common practice in super-resolution models to improve the quality and robustness of image upscaling. However, it suffers from distortion at the boundaries and has limited unique shifting modes. To overcome these weaknesses, we propose a non-overlapping triangular window technique that synchronously works with the rectangular one to mitigate boundary-level distortion and allows the model to access more unique sifting modes. In this paper, we propose a Composite Fusion Attention Transformer (CFAT) that incorporates triangular-rectangular window-based local attention with a channel-based global attention technique in image super-resolution. As a result, CFAT enables attention mechanisms to be activated on more image pixels and captures long-range, multi-scale features to improve SR performance. The extensive experimental results and ablation study demonstrate the effectiveness of CFAT in the SR domain. Our proposed model shows a significant 0.7 dB performance improvement over other state-of-the-art SR architectures.

📄 PDF Abstract BibTeX arXiv:2403.16143

Code (1)

rayabhisek123/cfat 공식 구현 pytorch

Tasks

Image Super-ResolutionSuper-Resolution

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

CFAT: Unleashing Triangular Windows for Image Super-resolution

2024-01-01 · CVPR 2024 1 · Abhisek Ray, Gaurav Kumar, Maheshkumar H. Kolekar

Transformer-based models have revolutionized the field of image super-resolution (SR) by harnessing their inherent ability to capture complex contextual features. The overlapping rectangular shifted window technique …

Image Super-ResolutionSuper-Resolution

IG-CFAT: An Improved GAN-Based Framework for Effectively Exploiting Transformers in Real-World Image Super-Resolution

2024-06-19 · Alireza Aghelan, Ali Amiryan, Abolfazl Zarghani, Modjtaba Rouhani

In the field of single image super-resolution (SISR), transformer-based models, have demonstrated significant advancements. However, the potential and efficiency of these models in applied fields such as real-world image…

Image Super-ResolutionSuper-Resolution

REHRSeg: Unleashing the Power of Self-Supervised Super-Resolution for Resource-Efficient 3D MRI Segmentation

2024-10-14 · Zhiyun Song, Yinjie Zhao, Xiaomin Li, Manman Fei 외

High-resolution (HR) 3D magnetic resonance imaging (MRI) can provide detailed anatomical structural information, enabling precise segmentation of regions of interest for various medical image analysis tasks. Due to the h…

Knowledge DistillationMedical Image AnalysisMRI segmentationSegmentation+1

FreeScale: Unleashing the Resolution of Diffusion Models via Tuning-Free Scale Fusion

2024-12-12 · Haonan Qiu, Shiwei Zhang, Yujie Wei, Ruihang Chu 외

Visual diffusion models achieve remarkable progress, yet they are typically trained at limited resolutions due to the lack of high-resolution data and constrained computation resources, hampering their ability to generat…

8k

FaithDiff: Unleashing Diffusion Priors for Faithful Image Super-resolution

2024-11-27 · CVPR 2025 1 · Junyang Chen, Jinshan Pan, Jiangxin Dong

Faithful image super-resolution (SR) not only needs to recover images that appear realistic, similar to image generation tasks, but also requires that the restored images maintain fidelity and structural consistency with…

Image GenerationImage Super-ResolutionSuper-Resolution