SemAffiNet: Semantic-Affine Transformation for Point Cloud Segmentation
Conventional point cloud semantic segmentation methods usually employ an encoder-decoder architecture, where mid-level features are locally aggregated to extract geometric information. However, the over-reliance on these class-agnostic local geometric representations may raise confusion between local parts from different categories that are similar in appearance or spatially adjacent. To address this issue, we argue that mid-level features can be further enhanced with semantic information, and propose semantic-affine transformation that transforms features of mid-level points belonging to different categories with class-specific affine parameters. Based on this technique, we propose SemAffiNet for point cloud semantic segmentation, which utilizes the attention mechanism in the Transformer module to implicitly and explicitly capture global structural knowledge within local parts for overall comprehension of each category. We conduct extensive experiments on the ScanNetV2 and NYUv2 datasets, and evaluate semantic-affine transformation on various 3D point cloud and 2D image segmentation baselines, where both qualitative and quantitative results demonstrate the superiority and generalization ability of our proposed approach. Code is available at https://github.com/wangzy22/SemAffiNet.
Code (1)
Tasks
DecoderImage SegmentationPoint Cloud SegmentationSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Point-DAE: Denoising Autoencoders for Self-supervised Point Cloud Learning
Masked autoencoder has demonstrated its effectiveness in self-supervised point cloud learning. Considering that masking is a kind of corruption, in this work we explore a more general denoising autoencoder for point clou…
3D Object DetectionDecoderDenoisingFew-Shot Learning+2Spatial Transformer for 3D Point Clouds
Deep neural networks are widely used for understanding 3D point clouds. At each point convolution layer, features are computed from local neighborhoods of 3D points and combined for subsequent processing in order to extr…
Semantic SegmentationPrivacy Analysis of Affine Transformations in Cloud-based MPC: Vulnerability to Side-knowledge
Search for the optimizer in computationally demanding model predictive control (MPC) setups can be facilitated by Cloud as a service provider in cyber-physical systems. This advantage introduces the risk that Cloud can o…
FormModel Predictive ControlPrivacy PreservingBi-PT: Bidirectional Cross-Attention Point Transformers for Four-Chamber Heart Reconstruction from Sparse Cardiac MRI Data
We propose Bi-PT, a pipeline for reconstructing 3D four-chamber human heart meshes from clinical sparsely sampled cardiac magnetic resonance imaging (CMR) data. This work addresses the error-prone generation of 3D cardia…
Spatial Perspective Transform Estimation from Fourier Spectrum Analysis of 2D Patterns in 3D Space
A novel approach to 3D surface imaging is proposed, allowing for the continuous sampling of 3D surfaces to extract localized perspective transformation coefficients from Fourier spectrum analysis of projected patterns. T…