Super Resolution Using Segmentation-Prior Self-Attention Generative Adversarial Network
Convolutional Neural Network (CNN) is intensively implemented to solve super resolution (SR) tasks because of its superior performance. However, the problem of super resolution is still challenging due to the lack of prior knowledge and small receptive field of CNN. We propose the Segmentation-Piror Self-Attention Generative Adversarial Network (SPSAGAN) to combine segmentation-priors and feature attentions into a unified framework. This combination is led by a carefully designed weighted addition to balance the influence of feature and segmentation attentions, so that the network can emphasize textures in the same segmentation category and meanwhile focus on the long-distance feature relationship. We also propose a lightweight skip connection architecture called Residual-in-Residual Sparse Block (RRSB) to further improve the super-resolution performance and save computation. Extensive experiments show that SPSAGAN can generate more realistic and visually pleasing textures compared to state-of-the-art SFTGAN and ESRGAN on many SR datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Generative Adversarial NetworkSegmentationSuper-ResolutionSimilar Papers 제목 키워드 기반
HartleyMHA: Self-Attention in Frequency Domain for Resolution-Robust and Parameter-Efficient 3D Image Segmentation
With the introduction of Transformers, different attention-based models have been proposed for image segmentation with promising results. Although self-attention allows capturing of long-range dependencies, it suffers fr…
Image SegmentationSemantic SegmentationSuper-ResolutionReal-Time Image Segmentation via Hybrid Convolutional-Transformer Architecture Search
Image segmentation is one of the most fundamental problems in computer vision and has drawn a lot of attentions due to its vast applications in image understanding and autonomous driving. However, designing effective and…
Autonomous DrivingImage SegmentationSegmentationSemantic SegmentationMaxSR: Image Super-Resolution Using Improved MaxViT
While transformer models have been demonstrated to be effective for natural language processing tasks and high-level vision tasks, only a few attempts have been made to use powerful transformer models for single image su…
Image Super-ResolutionSuper-ResolutionLow-Resolution Self-Attention for Semantic Segmentation
Semantic segmentation tasks naturally require high-resolution information for pixel-wise segmentation and global context information for class prediction. While existing vision transformers demonstrate promising performa…
DecoderSegmentationSemantic SegmentationSaliency Guided Self-attention Network for Weakly and Semi-supervised Semantic Segmentation
Weakly supervised semantic segmentation (WSSS) using only image-level labels can greatly reduce the annotation cost and therefore has attracted considerable research interest. However, its performance is still inferior t…
SegmentationSemantic SegmentationSemi-Supervised Semantic SegmentationWeakly supervised Semantic Segmentation+1