Learning Parallax Transformer Network for Stereo Image JPEG Artifacts Removal
Under stereo settings, the performance of image JPEG artifacts removal can be further improved by exploiting the additional information provided by a second view. However, incorporating this information for stereo image JPEG artifacts removal is a huge challenge, since the existing compression artifacts make pixel-level view alignment difficult. In this paper, we propose a novel parallax transformer network (PTNet) to integrate the information from stereo image pairs for stereo image JPEG artifacts removal. Specifically, a well-designed symmetric bi-directional parallax transformer module is proposed to match features with similar textures between different views instead of pixel-level view alignment. Due to the issues of occlusions and boundaries, a confidence-based cross-view fusion module is proposed to achieve better feature fusion for both views, where the cross-view features are weighted with confidence maps. Especially, we adopt a coarse-to-fine design for the cross-view interaction, leading to better performance. Comprehensive experimental results demonstrate that our PTNet can effectively remove compression artifacts and achieves superior performance than other testing state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
PFT-SSR: Parallax Fusion Transformer for Stereo Image Super-Resolution
Stereo image super-resolution aims to boost the performance of image super-resolution by exploiting the supplementary information provided by binocular systems. Although previous methods have achieved promising results, …
Image Super-ResolutionStereo Image Super-ResolutionSuper-ResolutionLearning Parallax Attention for Stereo Image Super-Resolution
Stereo image pairs can be used to improve the performance of super-resolution (SR) since additional information is provided from a second viewpoint. However, it is challenging to incorporate this information for SR since…
Image Super-ResolutionStereo Image Super-ResolutionSuper-ResolutionParallax Attention for Unsupervised Stereo Correspondence Learning
Stereo image pairs encode 3D scene cues into stereo correspondences between the left and right images. To exploit 3D cues within stereo images, recent CNN based methods commonly use cost volume techniques to capture ster…
Image Super-ResolutionStereo Image Super-ResolutionStereo MatchingSuper-ResolutionOAPT: Offset-Aware Partition Transformer for Double JPEG Artifacts Removal
Deep learning-based methods have shown remarkable performance in single JPEG artifacts removal task. However, existing methods tend to degrade on double JPEG images, which are prevalent in real-world scenarios. To addres…
Image RestorationEnhancing the Spatial Resolution of Stereo Images Using a Parallax Prior
We present a novel method that can enhance the spatial resolution of stereo images using a parallax prior. While traditional stereo imaging has focused on estimating depth from stereo images, our method utilizes stereo i…
Image Super-ResolutionStereo Image Super-ResolutionSuper-Resolution