paper-with-me

Papers

Depth-aware CNN for RGB-D Segmentation

2018-03-19 · ECCV 2018 9 · Weiyue Wang, Ulrich Neumann

Convolutional neural networks (CNN) are limited by the lack of capability to handle geometric information due to the fixed grid kernel structure. The availability of depth data enables progress in RGB-D semantic segmentation with CNNs. State-of-the-art methods either use depth as additional images or process spatial information in 3D volumes or point clouds. These methods suffer from high computation and memory cost. To address these issues, we present Depth-aware CNN by introducing two intuitive, flexible and effective operations: depth-aware convolution and depth-aware average pooling. By leveraging depth similarity between pixels in the process of information propagation, geometry is seamlessly incorporated into CNN. Without introducing any additional parameters, both operators can be easily integrated into existing CNNs. Extensive experiments and ablation studies on challenging RGB-D semantic segmentation benchmarks validate the effectiveness and flexibility of our approach.

📄 PDF Abstract BibTeX arXiv:1803.06791

Code (4)

laughtervv/DepthAwareCNN 공식 구현 pytorch
aksh1501/DepthAware_CNN_edit pytorch
iriszero/DepthAwareCNNplus pytorch
virkay/DepthAwareCNN2 pytorch

Tasks

SegmentationSemantic SegmentationThermal Image Segmentation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Depth-Aware Mirror Segmentation

2021-06-19 · CVPR 2021 1 · Haiyang Mei, Bo Dong, Wen Dong, Pieter Peers 외

We present a novel mirror segmentation method that leverages depth estimates from ToF-based cameras as an additional cue to disambiguate challenging cases where the contrast or relation in RGB colors between the mirr…

Segmentation

Depth-aware Object Segmentation and Grasp Detection for Robotic Picking Tasks

2021-11-22 · Stefan Ainetter, Christoph Böhm, Rohit Dhakate, Stephan Weiss 외

In this paper, we present a novel deep neural network architecture for joint class-agnostic object segmentation and grasp detection for robotic picking tasks using a parallel-plate gripper. We introduce depth-aware Coord…

Instance SegmentationObjectRobotic GraspingSegmentation+1

Towards Deeply Unified Depth-aware Panoptic Segmentation with Bi-directional Guidance Learning

2023-07-27 · ICCV 2023 1 · Junwen He, Yifan Wang, Lijun Wang, Huchuan Lu 외

Depth-aware panoptic segmentation is an emerging topic in computer vision which combines semantic and geometric understanding for more robust scene interpretation. Recent works pursue unified frameworks to tackle this ch…

Depth EstimationPanoptic SegmentationSegmentation

MonoDVPS: A Self-Supervised Monocular Depth Estimation Approach to Depth-aware Video Panoptic Segmentation

2022-10-14 · Andra Petrovai, Sergiu Nedevschi

Depth-aware video panoptic segmentation tackles the inverse projection problem of restoring panoptic 3D point clouds from video sequences, where the 3D points are augmented with semantic classes and temporally consistent…

Depth-aware Video Panoptic SegmentationDepth EstimationDepth PredictionImage Segmentation+5

PolyphonicFormer: Unified Query Learning for Depth-aware Video Panoptic Segmentation

2021-12-05 · Haobo Yuan, Xiangtai Li, Yibo Yang, Guangliang Cheng 외

The Depth-aware Video Panoptic Segmentation (DVPS) is a new challenging vision problem that aims to predict panoptic segmentation and depth in a video simultaneously. The previous work solves this task by extending the e…

Depth-aware Video Panoptic SegmentationDepth EstimationDepth PredictionPanoptic Segmentation+3