A Weakly-Supervised Depth Estimation Network Using Attention Mechanism
Monocular depth estimation (MDE) is a fundamental task in many applications such as scene understanding and reconstruction. However, most of the existing methods rely on accurately labeled datasets. A weakly-supervised framework based on attention nested U-net (ANU) named as ANUW is introduced in this paper for cases with wrong labels. The ANUW is trained end-to-end to convert an input single RGB image into a depth image. It consists of a dense residual network structure, an adaptive weight channel attention (AWCA) module, a patch second non-local (PSNL) module and a soft label generation method. The dense residual network is the main body of the network to encode and decode the input. The AWCA module can adaptively adjust the channel weights to extract important features. The PSNL module implements the spatial attention mechanism through a second-order non-local method. The proposed soft label generation method uses the prior knowledge of the dataset to produce soft labels to replace false ones. The proposed ANUW is trained on a defective monocular depth dataset and the trained model is tested on three public datasets, and the results demonstrate the superiority of ANUW in comparison with the state-of-the-art MDE methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationMonocular Depth EstimationScene UnderstandingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Weakly-Supervised Monocular Depth Estimationwith Resolution-Mismatched Data
Depth estimation from a single image is an active research topic in computer vision. The most accurate approaches are based on fully supervised learning models, which rely on a large amount of dense and high-resolution (…
Depth EstimationMonocular Depth EstimationWeakly-supervised 3D Hand Pose Estimation from Monocular RGB Images
Compared with depth-based 3D hand pose estimation, it is more challenging to infer 3D hand pose from monocular RGB images, due to substantial depth ambiguity and the difficulty of obtaining fully-annotated training data…
3D Hand Pose EstimationHand Pose EstimationPose EstimationMaskingDepth: Masked Consistency Regularization for Semi-supervised Monocular Depth Estimation
We propose MaskingDepth, a novel semi-supervised learning framework for monocular depth estimation to mitigate the reliance on large ground-truth depth quantities. MaskingDepth is designed to enforce consistency between …
Data AugmentationDepth EstimationDomain AdaptationImage Classification+4Self-Supervised Attention Learning for Depth and Ego-motion Estimation
We address the problem of depth and ego-motion estimation from image sequences. Recent advances in the domain propose to train a deep learning model for both tasks using image reconstruction in a self-supervised manner. …
Depth EstimationImage ReconstructionMotion EstimationH-Net: Unsupervised Attention-based Stereo Depth Estimation Leveraging Epipolar Geometry
Depth estimation from a stereo image pair has become one of the most explored applications in computer vision, with most of the previous methods relying on fully supervised learning settings. However, due to the difficul…
Depth EstimationDepth PredictionStereo Depth EstimationStereo Matching