paper-with-me

Papers

Self-Supervised Scale Recovery for Monocular Depth and Egomotion Estimation

2020-09-08 · Brandon Wagstaff, Jonathan Kelly

The self-supervised loss formulation for jointly training depth and egomotion neural networks with monocular images is well studied and has demonstrated state-of-the-art accuracy. One of the main limitations of this approach, however, is that the depth and egomotion estimates are only determined up to an unknown scale. In this paper, we present a novel scale recovery loss that enforces consistency between a known camera height and the estimated camera height, generating metric (scaled) depth and egomotion predictions. We show that our proposed method is competitive with other scale recovery techniques that require more information. Further, we demonstrate that our method facilitates network retraining within new environments, whereas other scale-resolving approaches are incapable of doing so. Notably, our egomotion network is able to produce more accurate estimates than a similar method which recovers scale at test time only.

📄 PDF Abstract BibTeX arXiv:2009.03787

Code (1)

utiasSTARS/learned_scale_recovery 공식 구현 pytorch

Similar Papers 제목 키워드 기반

GroCo: Ground Constraint for Metric Self-Supervised Monocular Depth

2024-09-23 · Aurélien Cecille, Stefan Duffner, Franck Davoine, Thibault Neveu 외

Monocular depth estimation has greatly improved in the recent years but models predicting metric depth still struggle to generalize across diverse camera poses and datasets. While recent supervised methods mitigate this …

Depth EstimationDepth PredictionMonocular Depth Estimation

Self-supervised Monocular Underwater Depth Recovery, Image Restoration, and a Real-sea Video Dataset

2023-01-01 · ICCV 2023 1 · Nisha Varghese, Ashish Kumar, A. N. Rajagopalan

Underwater (UW) depth estimation and image restoration is a challenging task due to its fundamental ill-posedness and the unavailability of real large-scale UW-paired datasets. UW depth estimation has been attempted …

Depth EstimationDisentanglementImage Restoration

SelfOdom: Self-supervised Egomotion and Depth Learning via Bi-directional Coarse-to-Fine Scale Recovery

2022-11-16 · Hao Qu, Lilian Zhang, Xiaoping Hu, Xiaofeng He 외

Accurately perceiving location and scene is crucial for autonomous driving and mobile robots. Recent advances in deep learning have made it possible to learn egomotion and depth from monocular images in a self-supervised…

Autonomous DrivingSelf-LearningSelf-Supervised Learning

SelfTune: Metrically Scaled Monocular Depth Estimation through Self-Supervised Learning

2022-03-10 · Jaehoon Choi, Dongki Jung, Yonghan Lee, Deokhwa Kim 외

Monocular depth estimation in the wild inherently predicts depth up to an unknown scale. To resolve scale ambiguity issue, we present a learning algorithm that leverages monocular simultaneous localization and mapping (S…

Depth EstimationMonocular Depth EstimationRobot NavigationSelf-Supervised Learning+1

SelfVIO: Self-Supervised Deep Monocular Visual-Inertial Odometry and Depth Estimation

2019-11-22 · Yasin Almalioglu, Mehmet Turan, Alp Eren Sari, Muhamad Risqi U. Saputra 외

In the last decade, numerous supervised deep learning approaches requiring large amounts of labeled data have been proposed for visual-inertial odometry (VIO) and depth map estimation. To overcome the data limitation, se…

Depth EstimationPose EstimationSelf-Supervised LearningSensor Fusion+1