paper-with-me

Papers

Monocular Depth Estimation with Self-supervised Instance Adaptation

2020-04-13 · Robert McCraith, Lukas Neumann, Andrew Zisserman, Andrea Vedaldi

Recent advances in self-supervised learning havedemonstrated that it is possible to learn accurate monoculardepth reconstruction from raw video data, without using any 3Dground truth for supervision. However, in robotics applications,multiple views of a scene may or may not be available, depend-ing on the actions of the robot, switching between monocularand multi-view reconstruction. To address this mixed setting,we proposed a new approach that extends any off-the-shelfself-supervised monocular depth reconstruction system to usemore than one image at test time. Our method builds on astandard prior learned to perform monocular reconstruction,but uses self-supervision at test time to further improve thereconstruction accuracy when multiple images are available.When used to update the correct components of the model, thisapproach is highly-effective. On the standard KITTI bench-mark, our self-supervised method consistently outperformsall the previous methods with an average 25% reduction inabsolute error for the three common setups (monocular, stereoand monocular+stereo), and comes very close in accuracy whencompared to the fully-supervised state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2004.05821

Code (0)

등록된 구현이 없습니다.

Tasks

Depth EstimationMonocular Depth EstimationMonocular ReconstructionSelf-Supervised Learning

Similar Papers 제목 키워드 기반

Mining Supervision for Dynamic Regions in Self-Supervised Monocular Depth Estimation

2024-04-23 · CVPR 2024 1 · Hoang Chuong Nguyen, Tianyu Wang, Jose M. Alvarez, Miaomiao Liu

This paper focuses on self-supervised monocular depth estimation in dynamic scenes trained on monocular videos. Existing methods jointly estimate pixel-wise depth and motion, relying mainly on an image reconstruction los…

Depth EstimationImage ReconstructionMonocular Depth EstimationMotion Estimation

Monocular Differentiable Rendering for Self-Supervised 3D Object Detection

2020-09-30 · ECCV 2020 8 · Deniz Beker, Hiroharu Kato, Mihai Adrian Morariu, Takahiro Ando 외

3D object detection from monocular images is an ill-posed problem due to the projective entanglement of depth and scale. To overcome this ambiguity, we present a novel self-supervised method for textured 3D shape reconst…

3D Object Detection3D Object Detection From Monocular Images3D Shape ReconstructionDepth Estimation+5

MonoDVPS: A Self-Supervised Monocular Depth Estimation Approach to Depth-aware Video Panoptic Segmentation

2022-10-14 · Andra Petrovai, Sergiu Nedevschi

Depth-aware video panoptic segmentation tackles the inverse projection problem of restoring panoptic 3D point clouds from video sequences, where the 3D points are augmented with semantic classes and temporally consistent…

Depth-aware Video Panoptic SegmentationDepth EstimationDepth PredictionImage Segmentation+5

MGNet: Monocular Geometric Scene Understanding for Autonomous Driving

2022-06-27 · ICCV 2021 10 · Markus Schön, Michael Buchholz, Klaus Dietmayer

We introduce MGNet, a multi-task framework for monocular geometric scene understanding. We define monocular geometric scene understanding as the combination of two known tasks: Panoptic segmentation and self-supervised m…

Autonomous DrivingDepth EstimationGPUMonocular Depth Estimation+2

Towards Comprehensive Representation Enhancement in Semantics-guided Self-supervised Monocular Depth Estimation

2022-10-23 · ECCV 2022 10 · Jingyuan Ma, Xiangyu Lei, Nan Liu, Xian Zhao 외

Semantics-guided self-supervised monocular depth estimation has been widely researched, owing to the strong cross-task correlation of depth and semantics. However, since depth estimation and semantic segmentation are fu…

Depth EstimationMetric LearningMonocular Depth EstimationSemantic Segmentation+1