paper-with-me

홈 › Papers

Revisiting Deformable Convolution for Depth Completion

2023-08-03 · Xinglong Sun, Jean Ponce, Yu-Xiong Wang

Depth completion, which aims to generate high-quality dense depth maps from sparse depth maps, has attracted increasing attention in recent years. Previous work usually employs RGB images as guidance, and introduces iterative spatial propagation to refine estimated coarse depth maps. However, most of the propagation refinement methods require several iterations and suffer from a fixed receptive field, which may contain irrelevant and useless information with very sparse input. In this paper, we address these two challenges simultaneously by revisiting the idea of deformable convolution. We propose an effective architecture that leverages deformable kernel convolution as a single-pass refinement module, and empirically demonstrate its superiority. To better understand the function of deformable convolution and exploit it for depth completion, we further systematically investigate a variety of representative strategies. Our study reveals that, different from prior work, deformable convolution needs to be applied on an estimated depth map with a relatively high density for better performance. We evaluate our model on the large-scale KITTI dataset and achieve state-of-the-art level performance in both accuracy and inference speed. Our code is available at https://github.com/AlexSunNik/ReDC.

📄 PDF Abstract BibTeX arXiv:2308.01905

Code (2)

alexsunnik/redc 공식 구현 pytorch
alexsunnik/revisiting-deformable-convolution-for-depth-completion 공식 구현 pytorch

Tasks

Depth Completion

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Deformable Kernel 설명 없음
Spatial Propagation Inspired by the spatial propagation mechanism utilized in the depth completion task \cite{NLSPN}, we introduce a normal incorporated non-local disparity propagation module in…
Deformable Convolution Deformable convolutions add 2D offsets to the regular grid sampling locations in the standard convolution. It enables free…

Similar Papers 제목 키워드 기반

Deformable spatial propagation network for depth completion

2020-07-08 · Zheyuan Xu, Hongche Yin, Jian Yao

Depth completion has attracted extensive attention recently due to the development of autonomous driving, which aims to recover dense depth map from sparse depth measurements. Convolutional spatial propagation network (C…

Autonomous DrivingDepth Completion

FCDSN-DC: An Accurate and Lightweight Convolutional Neural Network for Stereo Estimation with Depth Completion

2022-09-14 · Dominik Hirner, Friedrich Fraundorfer

We propose an accurate and lightweight convolutional neural network for stereo estimation with depth completion. We name this method fully-convolutional deformable similarity network with depth completion (FCDSN-DC). Thi…

Depth CompletionMissing Values

Revisiting Depth Completion from a Stereo Matching Perspective for Cross-domain Generalization

2023-12-14 · Luca Bartolomei, Matteo Poggi, Andrea Conti, Fabio Tosi 외

This paper proposes a new framework for depth completion robust against domain-shifting issues. It exploits the generalization capability of modern stereo networks to face depth completion, by processing fictitious stere…

Depth CompletionDomain GeneralizationStereo Matching

Deformable Shape Completion with Graph Convolutional Autoencoders

2017-12-01 · CVPR 2018 6 · Or Litany, Alex Bronstein, Michael Bronstein, Ameesh Makadia

The availability of affordable and portable depth sensors has made scanning objects and people simpler than ever. However, dealing with occlusions and missing parts is still a significant challenge. The problem of recons…

CompletionFormer: Depth Completion with Convolutions and Vision Transformers

2023-04-25 · CVPR 2023 1 · Zhang Youmin, Guo Xianda, Poggi Matteo, Zhu Zheng 외

Given sparse depths and the corresponding RGB images, depth completion aims at spatially propagating the sparse measurements throughout the whole image to get a dense depth prediction. Despite the tremendous progress of …

Depth CompletionDepth EstimationDepth Prediction