paper-with-me

홈 › Papers

Relation3D : Enhancing Relation Modeling for Point Cloud Instance Segmentation

2025-01-01 · CVPR 2025 1 · Jiahao Lu, Jiacheng Deng

3D instance segmentation aims to predict a set of object instances in a scene, representing them as binary foreground masks with corresponding semantic labels. Currently, transformer-based methods are gaining increasing attention due to their elegant pipelines and superior predictions. However, these methods primarily focus on modeling the external relationships between scene features and query features through mask attention. They lack effective modeling of the internal relationships among scene features as well as between query features.In light of these disadvantages, we propose Relation3D: Enhancing Relation Modeling for Point Cloud Instance Segmentation. Specifically, we introduce an adaptive superpoint aggregation module and a contrastive learning-guided superpoint refinement module to better represent superpoint features (scene features) and leverage contrastive learning to guide the updates of these features.Furthermore, our relation-aware self-attention mechanism enhances the capabilities of modeling relationships between queries by incorporating positional and geometric relationships into the self-attention mechanism.Extensive experiments on the ScanNetV2, ScanNet++, ScanNet200 and S3DIS datasets demonstrate the superior performance of Relation3D.

📄 PDF Abstract BibTeX

Code (1)

Howard-coder191/Relation3D pytorch

Tasks

3D Instance SegmentationContrastive LearningInstance SegmentationRelationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Focus 설명 없음
Contrastive Learning 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

On Exploring PDE Modeling for Point Cloud Video Representation Learning

2024-04-06 · Zhuoxu Huang, Zhenkun Fan, Tao Xu, Jungong Han

Point cloud video representation learning is challenging due to complex structures and unordered spatial arrangement. Traditional methods struggle with frame-to-frame correlations and point-wise correspondence tracking. …

Contrastive LearningRepresentation Learning

Point2Node: Correlation Learning of Dynamic-Node for Point Cloud Feature Modeling

2019-12-23 · Wenkai Han, Chenglu Wen, Cheng Wang, Xin Li 외

Fully exploring correlation among points in point clouds is essential for their feature modeling. This paper presents a novel end-to-end graph model, named Point2Node, to represent a given point cloud. Point2Node can dyn…

Variational Relational Point Completion Network for Robust 3D Classification

2023-04-18 · Liang Pan, Xinyi Chen, Zhongang Cai, Junzhe Zhang 외

Real-scanned point clouds are often incomplete due to viewpoint, occlusion, and noise, which hampers 3D geometric modeling and perception. Existing point cloud completion methods tend to generate global shape skeletons a…

3D ClassificationClassificationPoint Cloud Completion

Variational Relational Point Completion Network

2021-04-20 · CVPR 2021 1 · Liang Pan, Xinyi Chen, Zhongang Cai, Junzhe Zhang 외

Real-scanned point clouds are often incomplete due to viewpoint, occlusion, and noise. Existing point cloud completion methods tend to generate global shape skeletons and hence lack fine local details. Furthermore, they …

Point Cloud Completion

Contextual Modeling for 3D Dense Captioning on Point Clouds

2022-10-08 · Yufeng Zhong, Long Xu, Jiebo Luo, Lin Ma

3D dense captioning, as an emerging vision-language task, aims to identify and locate each object from a set of point clouds and generate a distinctive natural language sentence for describing each located object. Howeve…

3D dense captioningDense CaptioningObjectSentence