Bilateral Network with Channel Splitting Network and Transformer for Thermal Image Super-Resolution
In recent years, the Thermal Image Super-Resolution (TISR) problem has become an attractive research topic. TISR would been used in a wide range of fields, including military, medical, agricultural and animal ecology. Due to the success of PBVS-2020 and PBVS-2021 workshop challenge, the result of TISR keeps improving and attracts more researchers to sign up for PBVS-2022 challenge. In this paper, we will introduce the technical details of our submission to PBVS-2022 challenge designing a Bilateral Network with Channel Splitting Network and Transformer(BN-CSNT) to tackle the TISR problem. Firstly, we designed a context branch based on channel splitting network with transformer to obtain sufficient context information. Secondly, we designed a spatial branch with shallow transformer to extract low level features which can preserve the spatial information. Finally, for the context branch in order to fuse the features from channel splitting network and transformer, we proposed an attention refinement module, and then features from context branch and spatial branch are fused by proposed feature fusion module. The proposed method can achieve PSNR=33.64, SSIM=0.9263 for x4 and PSNR=21.08, SSIM=0.7803 for x2 in the PBVS-2022 challenge test dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Image Super-ResolutionSSIMSuper-ResolutionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multi-Scale Feature Fusion using Channel Transformers for Guided Thermal Image Super Resolution
Thermal imaging, leveraging the infrared spectrum, offers a compelling alternative to visible spectrum (VIS) imagery in challenging environmental conditions like low-light, occlusions, and adverse weather. However, its w…
Image Super-ResolutionInfrared And Visible Image FusionInfrared image super-resolutionSuper-ResolutionLATIS: Lambda Abstraction-based Thermal Image Super-resolution
Single image super-resolution (SISR) is an effective technique to improve the quality of low-resolution thermal images. Recently, transformer-based methods have achieved significant performance in SISR. However, in the S…
Image Super-ResolutionSuper-ResolutionBilateral Interaction for Local-Global Collaborative Perception in Low-Light Image Enhancement
Low-light image enhancement is a challenging task due to the limited visibility in dark environments. While recent advances have shown progress in integrating CNNs and Transformers, the inadequate local-global perceptual…
Image EnhancementLow-Light Image EnhancementCyber-Secure Teleoperation With Encrypted Four-Channel Bilateral Control
This study developed an encrypted four-channel bilateral control system that enables posture synchronization and force feedback for leader and follower robot arms. The encrypted bilateral control system communicates encr…
Robot ManipulationDecoupled Scaling 4ch Bilateral Control on the Cartesian coordinate by 6-DoF Manipulator using Rotation Matrix
Four-channel bilateral control is a method for achieving remote control with force feedback and adjustment operability by synchronizing the positions and forces of two manipulators. This is expected to significantly impr…