Boosting Monocular Depth Estimation Models to High-Resolution via Content-Adaptive Multi-Resolution Merging
Neural networks have shown great abilities in estimating depth from a single image. However, the inferred depth maps are well below one-megapixel resolution and often lack fine-grained details, which limits their practicality. Our method builds on our analysis on how the input resolution and the scene structure affects depth estimation performance. We demonstrate that there is a trade-off between a consistent scene structure and the high-frequency details, and merge low- and high-resolution estimations to take advantage of this duality using a simple depth merging network. We present a double estimation method that improves the whole-image depth estimation and a patch selection method that adds local details to the final result. We demonstrate that by merging estimations at different resolutions with changing context, we can generate multi-megapixel depth maps with a high level of detail using a pre-trained model.
Code (1)
Tasks
Depth EstimationMonocular Depth EstimationSimilar Papers 제목 키워드 기반
Weakly-Supervised Monocular Depth Estimationwith Resolution-Mismatched Data
Depth estimation from a single image is an active research topic in computer vision. The most accurate approaches are based on fully supervised learning models, which rely on a large amount of dense and high-resolution (…
Depth EstimationMonocular Depth Estimation360MonoDepth: High-Resolution 360deg Monocular Depth Estimation
360deg cameras can capture complete environments in a single shot, which makes 360deg imagery alluring in many computer vision tasks. However, monocular depth estimation remains a challenge for 360deg data, particula…
2kDepth EstimationGPUMonocular Depth Estimation+2360MonoDepth: High-Resolution 360° Monocular Depth Estimation
360{\deg} cameras can capture complete environments in a single shot, which makes 360{\deg} imagery alluring in many computer vision tasks. However, monocular depth estimation remains a challenge for 360{\deg} data, part…
2kDepth EstimationGPUMonocular Depth Estimation+2Boosting Omnidirectional Stereo Matching with a Pre-trained Depth Foundation Model
Omnidirectional depth perception is essential for mobile robotics applications that require scene understanding across a full 360{\deg} field of view. Camera-based setups offer a cost-effective option by using stereo dep…
Depth EstimationMonocular Depth EstimationOmnnidirectional Stereo Depth EstimationScene Understanding+2SuperDepth: Self-Supervised, Super-Resolved Monocular Depth Estimation
Recent techniques in self-supervised monocular depth estimation are approaching the performance of supervised methods, but operate in low resolution only. We show that high resolution is key towards high-fidelity self-su…
Depth EstimationDepth PredictionImage Super-ResolutionMonocular Depth Estimation+2