Guided Depth Map Super-Resolution via Multi-Scale Fusion U-shaped Mamba Network
Depth map super-resolution technology aims to improve the spatial resolution of low-resolution depth maps and effectively restore high-frequency detail information. Traditional convolutional neural network has limitations in dealing with long-range dependencies and are unable to fully model the global contextual information in depth maps. Although transformer can model global dependencies, its computational complexity and memory consumption are quadratic, which significantly limits its ability to process high-resolution depth maps. In this paper, we propose a multi-scale fusion U-shaped Mamba (MSF-UM) model, a novel guided depth map super-resolution framework. The core innovation of this model is to integrate Mamba's efficient state-space modeling capabilities into a multi-scale U-shaped fusion structure guided by a color image. The structure combining the residual dense channel attention block and the Mamba state space module is designed, which combines the local feature extraction capability of the convolutional layer with the modeling advantage of the state space model for long-distance dependencies. At the same time, the model adopts a multi-scale cross-modal fusion strategy to make full use of the high-frequency texture information from the color image to guide the super-resolution process of the depth map. Compared with existing mainstream methods, the proposed MSF-UM significantly reduces the number of model parameters while achieving better reconstruction accuracy. Extensive experiments on multiple publicly available datasets validate the effectiveness of the model, especially showing excellent generalization ability in the task of large-scale depth map super-resolution.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
IGAF: Incremental Guided Attention Fusion for Depth Super-Resolution
Accurate depth estimation is crucial for many fields, including robotics, navigation, and medical imaging. However, conventional depth sensors often produce low-resolution (LR) depth maps, making detailed scene perceptio…
Depth EstimationSensor FusionSuper-ResolutionGuided Depth Super-Resolution by Deep Anisotropic Diffusion
Performing super-resolution of a depth image using the guidance from an RGB image is a problem that concerns several fields, such as robotics, medical imaging, and remote sensing. While deep learning methods have achieve…
Super-ResolutionDepth Super-Resolution from Explicit and Implicit High-Frequency Features
We propose a novel multi-stage depth super-resolution network, which progressively reconstructs high-resolution depth maps from explicit and implicit high-frequency features. The former are extracted by an efficient tran…
Super-ResolutionVocal Bursts Intensity PredictionSymmetric Uncertainty-Aware Feature Transmission for Depth Super-Resolution
Color-guided depth super-resolution (DSR) is an encouraging paradigm that enhances a low-resolution (LR) depth map guided by an extra high-resolution (HR) RGB image from the same scene. Existing methods usually use inter…
Super-ResolutionCoReGAN: Contrastive Regularized Generative Adversarial Network for Guided Depth Map Super Resolution
Consumer-grade depth sensors provide low-resolution depth maps; however, a high-resolution RGB camera is usually mounted on the same device and acquires a high-resolution image of the same scene. While deep learning and …
Contrastive LearningDecoderDepth Map Super-ResolutionGenerative Adversarial Network+1