Depth from a Single Image by Harmonizing Overcomplete Local Network Predictions
A single color image can contain many cues informative towards different aspects of local geometric structure. We approach the problem of monocular depth estimation by using a neural network to produce a mid-level representation that summarizes these cues. This network is trained to characterize local scene geometry by predicting, at every image location, depth derivatives of different orders, orientations and scales. However, instead of a single estimate for each derivative, the network outputs probability distributions that allow it to express confidence about some coefficients, and ambiguity about others. Scene depth is then estimated by harmonizing this overcomplete set of network predictions, using a globalization procedure that finds a single consistent depth map that best matches all the local derivative distributions. We demonstrate the efficacy of this approach through evaluation on the NYU v2 depth data set.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationMonocular Depth EstimationSimilar Papers 제목 키워드 기반
Exploring Overcomplete Representations for Single Image Deraining using CNNs
Removal of rain streaks from a single image is an extremely challenging problem since the rainy images often contain rain streaks of different size, shape, direction and density. Most recent methods for deraining use a d…
DecoderRain RemovalSingle Image DerainingAligning Motion-Blurred Images Using Contrastive Learning on Overcomplete Pixels
We propose a new contrastive objective for learning overcomplete pixel-level features that are invariant to motion blur. Other invariances (e.g., pose, illumination, or weather) can be learned by applying the correspondi…
Contrastive LearningStable Single-Pixel Contrastive Learning for Semantic and Geometric Tasks
We pilot a family of stable contrastive losses for learning pixel-level representations that jointly capture semantic and geometric information. Our approach maps each pixel of an image to an overcomplete descriptor that…
Contrastive LearningSuper-Resolution of Brain MRI Images using Overcomplete Dictionaries and Nonlocal Similarity
Recently, the Magnetic Resonance Imaging (MRI) images have limited and unsatisfactory resolutions due to various constraints such as physical, technological and economic considerations. Super-resolution techniques can ob…
Compressive SensingImage Super-ResolutionSuper-ResolutionMulti-task Self-Supervised Visual Learning
We investigate methods for combining multiple self-supervised tasks--i.e., supervised tasks where data can be collected without manual labeling--in order to train a single visual representation. First, we provide an appl…
Depth EstimationDepth PredictionGeneral ClassificationSelf-Supervised Image Classification