paper-with-me

홈 › Papers

Image Super-Resolution using Efficient Striped Window Transformer

2023-01-24 · Jinpeng Shi, Hui Li, Tianle Liu, Yulong Liu, Mingjian Zhang, Jinchen Zhu, Ling Zheng, Shizhuang Weng

Transformers have achieved remarkable results in single-image super-resolution (SR). However, the challenge of balancing model performance and complexity has hindered their application in lightweight SR (LSR). To tackle this challenge, we propose an efficient striped window transformer (ESWT). We revisit the normalization layer in the transformer and design a concise and efficient transformer structure to build the ESWT. Furthermore, we introduce a striped window mechanism to model long-term dependencies more efficiently. To fully exploit the potential of the ESWT, we propose a novel flexible window training strategy that can improve the performance of the ESWT without additional cost. Extensive experiments show that ESWT outperforms state-of-the-art LSR transformers, and achieves a better trade-off between model performance and complexity. The ESWT requires fewer parameters, incurs faster inference, smaller FLOPs, and less memory consumption, making it a promising solution for LSR.

📄 PDF Abstract BibTeX arXiv:2301.09869

Code (1)

fried-rice-lab/friedricelab 공식 구현 pytorch

Tasks

Image Super-Resolution

Similar Papers 제목 키워드 기반

Efficient Mixed Transformer for Single Image Super-Resolution

2023-05-19 · Ling Zheng, Jinchen Zhu, Jinpeng Shi, Shizhuang Weng

Recently, Transformer-based methods have achieved impressive results in single image super-resolution (SISR). However, the lack of locality mechanism and high complexity limit their application in the field of super-reso…

Image Super-ResolutionSuper-Resolution

CFAT: Unleashing TriangularWindows for Image Super-resolution

2024-03-24 · Abhisek Ray, Gaurav Kumar, Maheshkumar H. Kolekar

Transformer-based models have revolutionized the field of image super-resolution (SR) by harnessing their inherent ability to capture complex contextual features. The overlapping rectangular shifted window technique used…

Image Super-ResolutionSuper-Resolution

CFAT: Unleashing Triangular Windows for Image Super-resolution

2024-01-01 · CVPR 2024 1 · Abhisek Ray, Gaurav Kumar, Maheshkumar H. Kolekar

Transformer-based models have revolutionized the field of image super-resolution (SR) by harnessing their inherent ability to capture complex contextual features. The overlapping rectangular shifted window technique …

Image Super-ResolutionSuper-Resolution

HiT-SR: Hierarchical Transformer for Efficient Image Super-Resolution

2024-07-08 · Xiang Zhang, Yulun Zhang, Fisher Yu

Transformers have exhibited promising performance in computer vision tasks including image super-resolution (SR). However, popular transformer-based SR methods often employ window self-attention with quadratic computatio…

Image Super-ResolutionSuper-Resolution

HAAT: Hybrid Attention Aggregation Transformer for Image Super-Resolution

2024-11-27 · Song-Jiang Lai, Tsun-Hin Cheung, Ka-Chun Fung, Kai-wen Xue 외

In the research area of image super-resolution, Swin-transformer-based models are favored for their global spatial modeling and shifting window attention mechanism. However, existing methods often limit self-attention to…

Image Super-ResolutionSuper-Resolution