Multi-Object Self-Supervised Depth Denoising
Depth cameras are frequently used in robotic manipulation, e.g. for visual servoing. The quality of small and compact depth cameras is though often not sufficient for depth reconstruction, which is required for precise tracking in and perception of the robot's working space. Based on the work of Shabanov et al. (2021), in this work, we present a self-supervised multi-object depth denoising pipeline, that uses depth maps of higher-quality sensors as close-to-ground-truth supervisory signals to denoise depth maps coming from a lower-quality sensor. We display a computationally efficient way to align sets of two frame pairs in space and retrieve a frame-based multi-object mask, in order to receive a clean labeled dataset to train a denoising neural network on. The implementation of our presented work can be found at https://github.com/alr-internship/self-supervised-depth-denoising.
Code (1)
Tasks
DenoisingObjectMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SelfReDepth: Self-Supervised Real-Time Depth Restoration for Consumer-Grade Sensors
Depth maps produced by consumer-grade sensors suffer from inaccurate measurements and missing data from either system or scene-specific sources. Data-driven denoising algorithms can mitigate such problems. However, they …
DenoisingMixed RealitySelf-Supervised LearningSelf-supervised Depth Denoising Using Lower- and Higher-quality RGB-D sensors
Consumer-level depth cameras and depth sensors embedded in mobile devices enable numerous applications, such as AR games and face identification. However, the quality of the captured depth is sometimes insufficient for 3…
3D Object Reconstruction3D ReconstructionDenoisingFace Identification+1MonoDiffusion: Self-Supervised Monocular Depth Estimation Using Diffusion Model
Over the past few years, self-supervised monocular depth estimation that does not depend on ground-truth during the training phase has received widespread attention. Most efforts focus on designing different types of net…
DenoisingDepth EstimationMonocular Depth EstimationSelf-Supervised Deep Depth Denoising
Depth perception is considered an invaluable source of information for various vision tasks. However, depth maps acquired using consumer-level sensors still suffer from non-negligible noise. This fact has recently motiva…
3D ReconstructionDenoisingMonocular Depth Estimation using Diffusion Models
We formulate monocular depth estimation using denoising diffusion models, inspired by their recent successes in high fidelity image generation. To that end, we introduce innovations to address problems arising due to noi…
DenoisingDepth EstimationImage GenerationImage-to-Image Translation+3