Learning Depth Estimation for Transparent and Mirror Surfaces
Inferring the depth of transparent or mirror (ToM) surfaces represents a hard challenge for either sensors, algorithms, or deep networks. We propose a simple pipeline for learning to estimate depth properly for such surfaces with neural networks, without requiring any ground-truth annotation. We unveil how to obtain reliable pseudo labels by in-painting ToM objects in images and processing them with a monocular depth estimation model. These labels can be used to fine-tune existing monocular or stereo networks, to let them learn how to deal with ToM surfaces. Experimental results on the Booster dataset show the dramatic improvements enabled by our remarkably simple proposal.
Code (1)
Tasks
Depth EstimationMonocular Depth EstimationSimilar Papers 제목 키워드 기반
Mirror3D: Depth Refinement for Mirror Surfaces
Despite recent progress in depth sensing and 3D reconstruction, mirror surfaces are a significant source of errors. To address this problem, we create the Mirror3D dataset: a 3D mirror plane dataset based on three RGBD d…
3D ReconstructionDepth EstimationTowards Robust Monocular Depth Estimation in Non-Lambertian Surfaces
In the field of monocular depth estimation (MDE), many models with excellent zero-shot performance in general scenes emerge recently. However, these methods often fail in predicting non-Lambertian surfaces, such as trans…
Depth EstimationMonocular Depth EstimationTone MappingTransNet: Transparent Object Manipulation Through Category-Level Pose Estimation
Transparent objects present multiple distinct challenges to visual perception systems. First, their lack of distinguishing visual features makes transparent objects harder to detect and localize than opaque objects. Even…
Depth CompletionObjectPose EstimationSurface Normal Estimation+1ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulation
Transparent objects are a common part of everyday life, yet they possess unique visual properties that make them incredibly difficult for standard 3D sensors to produce accurate depth estimates for. In many cases, they o…
3D geometryDepth CompletionDepth EstimationMonocular Depth Estimation+5SeeGroup: Multi-Layer Depth Estimation of Transparent Surfaces via Self-Determined Grouping
Transparent objects are common in daily life, and it is important to understand their multilayer depth, including the transparent surface and the objects behind it. Existing methods for multilayer depth typically extend …
Depth Estimation