Pyramidal Edge-maps and Attention based Guided Thermal Super-resolution
Guided super-resolution (GSR) of thermal images using visible range images is challenging because of the difference in the spectral-range between the images. This in turn means that there is significant texture-mismatch between the images, which manifests as blur and ghosting artifacts in the super-resolved thermal image. To tackle this, we propose a novel algorithm for GSR based on pyramidal edge-maps extracted from the visible image. Our proposed network has two sub-networks. The first sub-network super-resolves the low-resolution thermal image while the second obtains edge-maps from the visible image at a growing perceptual scale and integrates them into the super-resolution sub-network with the help of attention-based fusion. Extraction and integration of multi-level edges allows the super-resolution network to process texture-to-object level information progressively, enabling more straightforward identification of overlapping edges between the input images. Extensive experiments show that our model outperforms the state-of-the-art GSR methods, both quantitatively and qualitatively.
Code (0)
등록된 구현이 없습니다.
Tasks
Super-ResolutionSimilar Papers 제목 키워드 기반
Quality-aware Selective Fusion Network for V-D-T Salient Object Detection
Depth images and thermal images contain the spatial geometry information and surface temperature information, which can act as complementary information for the RGB modality. However, the quality of the depth and thermal…
object-detectionObject DetectionPseudo LabelSalient Object DetectionExploring Spatial Significance via Hybrid Pyramidal Graph Network for Vehicle Re-identification
Existing vehicle re-identification methods commonly use spatial pooling operations to aggregate feature maps extracted via off-the-shelf backbone networks. They ignore exploring the spatial significance of feature maps, …
Vehicle Re-IdentificationPolarimetric Thermal to Visible Face Verification via Self-Attention Guided Synthesis
Polarimetric thermal to visible face verification entails matching two images that contain significant domain differences. Several recent approaches have attempted to synthesize visible faces from thermal images for cros…
Face VerificationGenerative Adversarial NetworkImage GenerationIGFNet: Illumination-Guided Fusion Network for Semantic Scene Understanding using RGB-Thermal Images
Semantic scene understanding is a fundamental task for autonomous driving. It serves as a build block for many downstream tasks. Under challenging illumination conditions, thermal images can provide complementary informa…
Autonomous DrivingScene UnderstandingThermal Image SegmentationEdge-aware Guidance Fusion Network for RGB Thermal Scene Parsing
RGB thermal scene parsing has recently attracted increasing research interest in the field of computer vision. However, most existing methods fail to perform good boundary extraction for prediction maps and cannot fully …
Scene ParsingThermal Image Segmentation