DnD: Dense Depth Estimation in Crowded Dynamic Indoor Scenes
We present a novel approach for estimating depth from a monocular camera as it moves through complex and crowded indoor environments, e.g., a department store or a metro station. Our approach predicts absolute scale depth maps over the entire scene consisting of a static background and multiple moving people, by training on dynamic scenes. Since it is difficult to collect dense depth maps from crowded indoor environments, we design our training framework without requiring depths produced from depth sensing devices. Our network leverages RGB images and sparse depth maps generated from traditional 3D reconstruction methods to estimate dense depth maps. We use two constraints to handle depth for non-rigidly moving people without tracking their motion explicitly. We demonstrate that our approach offers consistent improvements over recent depth estimation methods on the NAVERLABS dataset, which includes complex and crowded scenes.
Code (0)
등록된 구현이 없습니다.
Tasks
3D ReconstructionDepth EstimationSimilar Papers 제목 키워드 기반
Helvipad: A Real-World Dataset for Omnidirectional Stereo Depth Estimation
Despite progress in stereo depth estimation, omnidirectional imaging remains underexplored, mainly due to the lack of appropriate data. We introduce Helvipad, a real-world dataset for omnidirectional stereo depth estimat…
Depth CompletionDepth EstimationOmnnidirectional Stereo Depth EstimationStereo Depth EstimationEstimating Depth from RGB and Sparse Sensing
We present a deep model that can accurately produce dense depth maps given an RGB image with known depth at a very sparse set of pixels. The model works simultaneously for both indoor/outdoor scenes and produces state-of…
Depth EstimationMonocular Depth EstimationLightedDepth: Video Depth Estimation in Light of Limited Inference View Angles
Video depth estimation infers the dense scene depth from immediate neighboring video frames. While recent works consider it a simplified structure-from-motion (SfM) problem, it still differs from the SfM in that sign…
Depth EstimationMonocular Depth EstimationOptical Flow EstimationPose EstimationSCRREAM : SCan, Register, REnder And Map:A Framework for Annotating Accurate and Dense 3D Indoor Scenes with a Benchmark
Traditionally, 3d indoor datasets have generally prioritized scale over ground-truth accuracy in order to obtain improved generalization. However, using these datasets to evaluate dense geometry tasks, such as depth rend…
6D Pose EstimationPose EstimationPano Popups: Indoor 3D Reconstruction with a Plane-Aware Network
In this work we present a method to train a plane-aware convolutional neural network for dense depth and surface normal estimation as well as plane boundaries from a single indoor $360^\circ$ image. Using our proposed lo…
3D ReconstructionDepth EstimationSurface Normal Estimation