paper-with-me

Papers

Self-Supervised Monocular Depth Estimation of Untextured Indoor Rotated Scenes

2021-06-24 · Benjamin Keltjens, Tom van Dijk, Guido de Croon

Self-supervised deep learning methods have leveraged stereo images for training monocular depth estimation. Although these methods show strong results on outdoor datasets such as KITTI, they do not match performance of supervised methods on indoor environments with camera rotation. Indoor, rotated scenes are common for less constrained applications and pose problems for two reasons: abundance of low texture regions and increased complexity of depth cues for images under rotation. In an effort to extend self-supervised learning to more generalised environments we propose two additions. First, we propose a novel Filled Disparity Loss term that corrects for ambiguity of image reconstruction error loss in textureless regions. Specifically, we interpolate disparity in untextured regions, using the estimated disparity from surrounding textured areas, and use L1 loss to correct the original estimation. Our experiments show that depth estimation is substantially improved on low-texture scenes, without any loss on textured scenes, when compared to Monodepth by Godard et al. Secondly, we show that training with an application's representative rotations, in both pitch and roll, is sufficient to significantly improve performance over the entire range of expected rotation. We demonstrate that depth estimation is successfully generalised as performance is not lost when evaluated on test sets with no camera rotation. Together these developments enable a broader use of self-supervised learning of monocular depth estimation for complex environments.

📄 PDF Abstract BibTeX arXiv:2106.12958

Code (1)

tudelft/filled-disparity-monodepth 공식 구현 tf

Tasks

Depth EstimationImage ReconstructionMonocular Depth EstimationSelf-Supervised Learning

Similar Papers 제목 키워드 기반

Multiple Prior Representation Learning for Self-Supervised Monocular Depth Estimation via Hybrid Transformer

2024-06-13 · Guodong Sun, Junjie Liu, Mingxuan Liu, Moyun Liu 외

Self-supervised monocular depth estimation aims to infer depth information without relying on labeled data. However, the lack of labeled information poses a significant challenge to the model's representation, limiting i…

DecoderDepth EstimationMonocular Depth EstimationRepresentation Learning

SelfTune: Metrically Scaled Monocular Depth Estimation through Self-Supervised Learning

2022-03-10 · Jaehoon Choi, Dongki Jung, Yonghan Lee, Deokhwa Kim 외

Monocular depth estimation in the wild inherently predicts depth up to an unknown scale. To resolve scale ambiguity issue, we present a learning algorithm that leverages monocular simultaneous localization and mapping (S…

Depth EstimationMonocular Depth EstimationRobot NavigationSelf-Supervised Learning+1

RealMonoDepth: Self-Supervised Monocular Depth Estimation for General Scenes

2020-04-14 · Mertalp Ocal, Armin Mustafa

We present a generalised self-supervised learning approach for monocular estimation of the real depth across scenes with diverse depth ranges from 1--100s of meters. Existing supervised methods for monocular depth estima…

Depth EstimationMonocular Depth EstimationSelf-Supervised Learning

FusionDepth: Complement Self-Supervised Monocular Depth Estimation with Cost Volume

2023-05-10 · Zhuofei Huang, Jianlin Liu, Shang Xu, Ying Chen 외

Multi-view stereo depth estimation based on cost volume usually works better than self-supervised monocular depth estimation except for moving objects and low-textured surfaces. So in this paper, we propose a multi-frame…

Depth EstimationMonocular Depth EstimationStereo Depth Estimation

A high-precision self-supervised monocular visual odometry in foggy weather based on robust cycled generative adversarial networks and multi-task learning aided depth estimation

2022-03-09 · Xiuyuan Li, Jiangang Yu, Fengchao Li, Guowen An

This paper proposes a high-precision self-supervised monocular VO, which is specifically designed for navigation in foggy weather. A cycled generative adversarial network is designed to obtain high-quality self-supervise…

Depth EstimationGenerative Adversarial NetworkMonocular Visual OdometryMulti-Task Learning+2