paper-with-me

홈 › Papers

HQDec: Self-Supervised Monocular Depth Estimation Based on a High-Quality Decoder

2023-05-30 · Fei Wang, Jun Cheng

Decoders play significant roles in recovering scene depths. However, the decoders used in previous works ignore the propagation of multilevel lossless fine-grained information, cannot adaptively capture local and global information in parallel, and cannot perform sufficient global statistical analyses on the final output disparities. In addition, the process of mapping from a low-resolution feature space to a high-resolution feature space is a one-to-many problem that may have multiple solutions. Therefore, the quality of the recovered depth map is low. To this end, we propose a high-quality decoder (HQDec), with which multilevel near-lossless fine-grained information, obtained by the proposed adaptive axial-normalized position-embedded channel attention sampling module (AdaAxialNPCAS), can be adaptively incorporated into a low-resolution feature map with high-level semantics utilizing the proposed adaptive information exchange scheme. In the HQDec, we leverage the proposed adaptive refinement module (AdaRM) to model the local and global dependencies between pixels in parallel and utilize the proposed disparity attention module to model the distribution characteristics of disparity values from a global perspective. To recover fine-grained high-resolution features with maximal accuracy, we adaptively fuse the high-frequency information obtained by constraining the upsampled solution space utilizing the local and global dependencies between pixels into the high-resolution feature map generated from the nonlearning method. Extensive experiments demonstrate that each proposed component improves the quality of the depth estimation results over the baseline results, and the developed approach achieves state-of-the-art results on the KITTI and DDAD datasets. The code and models will be publicly available at \href{https://github.com/fwucas/HQDec}{HQDec}.

📄 PDF Abstract BibTeX arXiv:2305.18706

Code (1)

fwucas/hqdec 공식 구현 pytorch

Tasks

DecoderDepth EstimationMonocular Depth Estimation

Similar Papers 제목 키워드 기반

FA-Depth: Toward Fast and Accurate Self-supervised Monocular Depth Estimation

2024-05-17 · Fei Wang, Jun Cheng

Most existing methods often rely on complex models to predict scene depth with high accuracy, resulting in slow inference that is not conducive to deployment. To better balance precision and speed, we first designed Smal…

Depth EstimationMonocular Depth Estimation

SelfTune: Metrically Scaled Monocular Depth Estimation through Self-Supervised Learning

2022-03-10 · Jaehoon Choi, Dongki Jung, Yonghan Lee, Deokhwa Kim 외

Monocular depth estimation in the wild inherently predicts depth up to an unknown scale. To resolve scale ambiguity issue, we present a learning algorithm that leverages monocular simultaneous localization and mapping (S…

Depth EstimationMonocular Depth EstimationRobot NavigationSelf-Supervised Learning+1

RealMonoDepth: Self-Supervised Monocular Depth Estimation for General Scenes

2020-04-14 · Mertalp Ocal, Armin Mustafa

We present a generalised self-supervised learning approach for monocular estimation of the real depth across scenes with diverse depth ranges from 1--100s of meters. Existing supervised methods for monocular depth estima…

Depth EstimationMonocular Depth EstimationSelf-Supervised Learning

FusionDepth: Complement Self-Supervised Monocular Depth Estimation with Cost Volume

2023-05-10 · Zhuofei Huang, Jianlin Liu, Shang Xu, Ying Chen 외

Multi-view stereo depth estimation based on cost volume usually works better than self-supervised monocular depth estimation except for moving objects and low-textured surfaces. So in this paper, we propose a multi-frame…

Depth EstimationMonocular Depth EstimationStereo Depth Estimation

A high-precision self-supervised monocular visual odometry in foggy weather based on robust cycled generative adversarial networks and multi-task learning aided depth estimation

2022-03-09 · Xiuyuan Li, Jiangang Yu, Fengchao Li, Guowen An

This paper proposes a high-precision self-supervised monocular VO, which is specifically designed for navigation in foggy weather. A cycled generative adversarial network is designed to obtain high-quality self-supervise…

Depth EstimationGenerative Adversarial NetworkMonocular Visual OdometryMulti-Task Learning+2