Single Image Depth Prediction with Wavelet Decomposition
We present a novel method for predicting accurate depths from monocular images with high efficiency. This optimal efficiency is achieved by exploiting wavelet decomposition, which is integrated in a fully differentiable encoder-decoder architecture. We demonstrate that we can reconstruct high-fidelity depth maps by predicting sparse wavelet coefficients. In contrast with previous works, we show that wavelet coefficients can be learned without direct supervision on coefficients. Instead we supervise only the final depth image that is reconstructed through the inverse wavelet transform. We additionally show that wavelet coefficients can be learned in fully self-supervised scenarios, without access to ground-truth depth. Finally, we apply our method to different state-of-the-art monocular depth estimation models, in each case giving similar or better results compared to the original model, while requiring less than half the multiply-adds in the decoder network. Code at https://github.com/nianticlabs/wavelet-monodepth
Code (1)
Tasks
DecoderDepth EstimationDepth PredictionMonocular Depth EstimationPredictionSimilar Papers 제목 키워드 기반
Is Haar Enough? Exploring Symlets and Coiflets for Wavelet Convolution Layers
Wavelet convolution layers have recently emerged as an efficient mechanism for enlarging receptive fields through multiresolution analysis, but prior work has fixed the wavelet basis to Haar or Daubechies at a chosen dec…
Semantic SegmentationImage ClassificationWavelet-Based Observables for Koopman Analysis: An Extended Dynamic Mode Decomposition Framework
We present an in-depth analysis of the Koopman semigroup via wavelet transform. Towards this goal, we start by introducing the wavelet-based observables and show that they are eigenfunctions of the Koopman semigroup when…
Multidimensional Wavelets for Scalable Image Decomposition: Orbital Wavelets
Wavelets are closely related to the Schr\"odinger's wave functions and the interpretation of Born. Similarly to the appearance of atomic orbital, it is proposed to combine anti-symmetric wavelets into orbital wavelets. T…
Unified Depth Prediction and Intrinsic Image Decomposition from a Single Image via Joint Convolutional Neural Fields
We present a method for jointly predicting a depth map and intrinsic images from single-image input. The two tasks are formulated in a synergistic manner through a joint conditional random field (CRF) that is solved usin…
Depth EstimationDepth PredictionIntrinsic Image DecompositionFuzzy thresholding in wavelet domain for speckle reduction in Synthetic Aperture Radar images
The application of wavelet transforms to Synthetic Aperture Radar (SAR) imagery has improved despeckling performance. To deduce the problem of filtering the multiplicative noise to the case of an additive noise, the wave…