paper-with-me

홈 › Papers

IG-CFAT: An Improved GAN-Based Framework for Effectively Exploiting Transformers in Real-World Image Super-Resolution

2024-06-19 · Alireza Aghelan, Ali Amiryan, Abolfazl Zarghani, Modjtaba Rouhani

In the field of single image super-resolution (SISR), transformer-based models, have demonstrated significant advancements. However, the potential and efficiency of these models in applied fields such as real-world image super-resolution have been less noticed and there are substantial opportunities for improvement. Recently, composite fusion attention transformer (CFAT), outperformed previous state-of-the-art (SOTA) models in classic image super-resolution. In this paper, we propose a novel GAN-based framework by incorporating the CFAT model to effectively exploit the performance of transformers in real-world image super-resolution. In our proposed approach, we integrate a semantic-aware discriminator to reconstruct fine details more accurately and employ an adaptive degradation model to better simulate real-world degradations. Moreover, we introduce a new combination of loss functions by adding wavelet loss to loss functions of GAN-based models to better recover high-frequency details. Empirical results demonstrate that IG-CFAT significantly outperforms existing SOTA models in both quantitative and qualitative metrics. Our proposed model revolutionizes the field of real-world image super-resolution and demonstrates substantially better performance in recovering fine details and generating realistic textures. The introduction of IG-CFAT offers a robust and adaptable solution for real-world image super-resolution tasks.

📄 PDF Abstract BibTeX arXiv:2406.13815

Code (1)

alireza-aghelan/ig-cfat 공식 구현 pytorch

Tasks

Image Super-ResolutionSuper-Resolution

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

CFAT: Unleashing TriangularWindows for Image Super-resolution

2024-03-24 · Abhisek Ray, Gaurav Kumar, Maheshkumar H. Kolekar

Transformer-based models have revolutionized the field of image super-resolution (SR) by harnessing their inherent ability to capture complex contextual features. The overlapping rectangular shifted window technique used…

Image Super-ResolutionSuper-Resolution

CFAT: Unleashing Triangular Windows for Image Super-resolution

2024-01-01 · CVPR 2024 1 · Abhisek Ray, Gaurav Kumar, Maheshkumar H. Kolekar

Transformer-based models have revolutionized the field of image super-resolution (SR) by harnessing their inherent ability to capture complex contextual features. The overlapping rectangular shifted window technique …

Image Super-ResolutionSuper-Resolution

ID-like Prompt Learning for Few-Shot Out-of-Distribution Detection

2023-11-26 · CVPR 2024 1 · Yichen Bai, Zongbo Han, Changqing Zhang, Bing Cao 외

Out-of-distribution (OOD) detection methods often exploit auxiliary outliers to train model identifying OOD samples, especially discovering challenging outliers from auxiliary outliers dataset to improve OOD detection. H…

Few-Shot LearningOut-of-Distribution DetectionOut of Distribution (OOD) DetectionPrompt Learning

Action Quality Assessment using Transformers

2022-07-20 · Abhay Iyer, Mohammad Alali, Hemanth Bodala, Sunit Vaidya

Action quality assessment (AQA) is an active research problem in video-based applications that is a challenging task due to the score variance per frame. Existing methods address this problem via convolutional-based appr…

Action Quality Assessment

SPoT: Subpixel Placement of Tokens in Vision Transformers

2025-07-02 · Martine Hjelkrem-Tan, Marius Aasan, Gabriel Y. Arteaga, Adín Ramírez Rivera arxiv

Vision Transformers naturally accommodate sparsity, yet standard tokenization methods confine features to discrete patch grids. This constraint prevents models from fully exploiting sparse regimes, forcing awkward compro…