Connecting the Dots: Learning Representations for Active Monocular Depth Estimation
We propose a technique for depth estimation with a monocular structured-light camera, i.e., a calibrated stereo set-up with one camera and one laser projector. Instead of formulating the depth estimation via a correspondence search problem, we show that a simple convolutional architecture is sufficient for high-quality disparity estimates in this setting. As accurate ground-truth is hard to obtain, we train our model in a self-supervised fashion with a combination of photometric and geometric losses. Further, we demonstrate that the projected pattern of the structured light sensor can be reliably separated from the ambient information. This can then be used to improve depth boundaries in a weakly supervised fashion by modeling the joint statistics of image and depth edges. The model trained in this fashion compares favorably to the state-of-the-art on challenging synthetic and real-world datasets. In addition, we contribute a novel simulator, which allows to benchmark active depth prediction algorithms in controlled conditions.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationDepth PredictionMonocular Depth EstimationSimilar Papers 제목 키워드 기반
Mono-Hydra++: Real-Time Monocular Scene Graph Construction with Multi-Task Learning for 3D Indoor Mapping
Autonomous agile robots need more than metric geometry: they must understand objects, rooms, places, and spatial relations for search, inspection, exploration, and human robot interaction. Conventional metric maps suppor…
Multi-Task LearningCollision AvoidanceDepthSplat: Connecting Gaussian Splatting and Depth
Gaussian splatting and single/multi-view depth estimation are typically studied in isolation. In this paper, we present DepthSplat to connect Gaussian splatting and depth estimation and study their interactions. More spe…
Depth EstimationNovel View SynthesisUnsupervised Pre-trainingDepth Estimation Matters Most: Improving Per-Object Depth Estimation for Monocular 3D Detection and Tracking
Monocular image-based 3D perception has become an active research area in recent years owing to its applications in autonomous driving. Approaches to monocular 3D perception including detection and tracking, however, oft…
Autonomous DrivingDepth EstimationObjectActMVS: Active Scene Reconstruction with Monocular Multi-View Stereo
Active scene reconstruction enables robots/UAVs to autonomously plan trajectories and reconstruct environments without costly manual data acquisition. Unlike passive methods, active reconstruction requires real-time cons…
Trajectory PlanningCroMo: Cross-Modal Learning for Monocular Depth Estimation
Learning-based depth estimation has witnessed recent progress in multiple directions; from self-supervision using monocular video to supervised methods offering highest accuracy. Complementary to supervision, further boo…
Depth EstimationMonocular Depth Estimation