paper-with-me

홈 › Papers

Learning Accurate and Enriched Features for Stereo Image Super-Resolution

2024-06-23 · Hu Gao, Depeng Dang

Stereo image super-resolution (stereoSR) aims to enhance the quality of super-resolution results by incorporating complementary information from an alternative view. Although current methods have shown significant advancements, they typically operate on representations at full resolution to preserve spatial details, facing challenges in accurately capturing contextual information. Simultaneously, they utilize all feature similarities to cross-fuse information from the two views, potentially disregarding the impact of irrelevant information. To overcome this problem, we propose a mixed-scale selective fusion network (MSSFNet) to preserve precise spatial details and incorporate abundant contextual information, and adaptively select and fuse most accurate features from two views to enhance the promotion of high-quality stereoSR. Specifically, we develop a mixed-scale block (MSB) that obtains contextually enriched feature representations across multiple spatial scales while preserving precise spatial details. Furthermore, to dynamically retain the most essential cross-view information, we design a selective fusion attention module (SFAM) that searches and transfers the most accurate features from another view. To learn an enriched set of local and non-local features, we introduce a fast fourier convolution block (FFCB) to explicitly integrate frequency domain knowledge. Extensive experiments show that MSSFNet achieves significant improvements over state-of-the-art approaches on both quantitative and qualitative evaluations.

📄 PDF Abstract BibTeX arXiv:2406.16001

Code (1)

Tombs98/MSSFNet 공식 구현 pytorch

Tasks

Image Super-ResolutionStereo Image Super-ResolutionSuper-Resolution

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Blind Stereo Image Quality Assessment Inspired by Brain Sensory-Motor Fusion

2017-09-03 · Maryam Karimi, Najmeh Soltanian, Shadrokh Samavi, Nader Karimi 외

The use of 3D and stereo imaging is rapidly increasing. Compression, transmission, and processing could degrade the quality of stereo images. Quality assessment of such images is different than their 2D counterparts. Met…

Image Quality Assessment

Multi-Level Feature Fusion Network for Lightweight Stereo Image Super-Resolution

2024-05-09 · Yunxiang Li, Wenbin Zou, Qiaomu Wei, Feng Huang 외

Stereo image super-resolution utilizes the cross-view complementary information brought by the disparity effect of left and right perspective images to reconstruct higher-quality images. Cascading feature extraction modu…

Image Super-ResolutionStereo Image Super-ResolutionSuper-Resolution

LIGA-Stereo: Learning LiDAR Geometry Aware Representations for Stereo-based 3D Detector

2021-08-18 · ICCV 2021 10 · Xiaoyang Guo, Shaoshuai Shi, Xiaogang Wang, Hongsheng Li

Stereo-based 3D detection aims at detecting 3D object bounding boxes from stereo images using intermediate depth maps or implicit 3D geometry representations, which provides a low-cost solution for 3D perception. However…

3D geometry3D Object Detection From Stereo ImagesStereo Matching

Cross-View Hierarchy Network for Stereo Image Super-Resolution

2023-04-13 · Wenbin Zou, Hongxia Gao, Liang Chen, Yunchen Zhang 외

Stereo image super-resolution aims to improve the quality of high-resolution stereo image pairs by exploiting complementary information across views. To attain superior performance, many methods have prioritized designin…

Image Super-ResolutionStereo Image Super-ResolutionSuper-Resolution

Perception-Oriented Stereo Image Super-Resolution

2022-07-14 · Chenxi Ma, Bo Yan, Weimin Tan, Xuhao Jiang

Recent studies of deep learning based stereo image super-resolution (StereoSR) have promoted the development of StereoSR. However, existing StereoSR models mainly concentrate on improving quantitative evaluation metrics …

Disparity EstimationImage Super-ResolutionStereo Image Super-ResolutionSuper-Resolution