paper-with-me

홈 › Papers

Depth Based Semantic Scene Completion with Position Importance Aware Loss

2020-01-29 · Yu Liu, Jie Li, Xia Yuan, Chunxia Zhao, Roland Siegwart, Ian Reid, Cesar Cadena

Semantic Scene Completion (SSC) refers to the task of inferring the 3D semantic segmentation of a scene while simultaneously completing the 3D shapes. We propose PALNet, a novel hybrid network for SSC based on single depth. PALNet utilizes a two-stream network to extract both 2D and 3D features from multi-stages using fine-grained depth information to efficiently captures the context, as well as the geometric cues of the scene. Current methods for SSC treat all parts of the scene equally causing unnecessary attention to the interior of objects. To address this problem, we propose Position Aware Loss(PA-Loss) which is position importance aware while training the network. Specifically, PA-Loss considers Local Geometric Anisotropy to determine the importance of different positions within the scene. It is beneficial for recovering key details like the boundaries of objects and the corners of the scene. Comprehensive experiments on two benchmark datasets demonstrate the effectiveness of the proposed method and its superior performance. Models and Video demo can be found at: https://github.com/UniLauX/PALNet.

📄 PDF Abstract BibTeX arXiv:2001.10709

Code (1)

UniLauX/PALNet 공식 구현 pytorch

Tasks

3D Semantic SegmentationPositionSemantic Segmentation

Similar Papers 제목 키워드 기반

RGBD Based Dimensional Decomposition Residual Network for 3D Semantic Scene Completion

2019-03-02 · CVPR 2019 6 · Jie Li, Yu Liu, Dong Gong, Qinfeng Shi 외

RGB images differentiate from depth images as they carry more details about the color and texture information, which can be utilized as a vital complementary to depth for boosting the performance of 3D semantic scene com…

3D Semantic Scene CompletionScene Labeling

Semantic Scene Completion from a Single Depth Image

2016-11-28 · CVPR 2017 7 · Shuran Song, Fisher Yu, Andy Zeng, Angel X. Chang 외

This paper focuses on semantic scene completion, a task for producing a complete 3D voxel representation of volumetric occupancy and semantic labels for a scene from a single-view depth map observation. Previous work has…

3D Semantic Scene Completion

Semantic Scene Completion Combining Colour and Depth: preliminary experiments

2018-02-13 · Andre Bernardes Soares Guedes, Teofilo Emidio de Campos, Adrian Hilton

Semantic scene completion is the task of producing a complete 3D voxel representation of volumetric occupancy with semantic labels for a scene from a single-view observation. We built upon the recent work of Song et al. …

3D Semantic Scene Completion

2D Semantic-Guided Semantic Scene Completion

2024-09-12 · International Journal of Computer Vision (IJCV) 2024 9 · Xianzhu Liu, Haozhe Xie, Shengping Zhang, Hongxun Yao 외

Semantic scene completion (SSC) aims to simultaneously perform scene completion (SC) and predict semantic categories of a 3D scene from a single depth and/or RGB image. Most existing SSC methods struggle to handle compl…

2D Semantic Segmentation3D Semantic Scene CompletionMissing ValuesSemantic Segmentation

EdgeNet: Semantic Scene Completion from a Single RGB-D Image

2019-08-08 · Aloisio Dourado, Teofilo Emidio de Campos, Hansung Kim, Adrian Hilton

Semantic scene completion is the task of predicting a complete 3D representation of volumetric occupancy with corresponding semantic labels for a scene from a single point of view. Previous works on Semantic Scene Comple…

3D Semantic Scene CompletionEdge Detection