paper-with-me

홈 › Papers

SemAffiNet: Semantic-Affine Transformation for Point Cloud Segmentation

2022-05-26 · CVPR 2022 1 · Ziyi Wang, Yongming Rao, Xumin Yu, Jie zhou, Jiwen Lu

Conventional point cloud semantic segmentation methods usually employ an encoder-decoder architecture, where mid-level features are locally aggregated to extract geometric information. However, the over-reliance on these class-agnostic local geometric representations may raise confusion between local parts from different categories that are similar in appearance or spatially adjacent. To address this issue, we argue that mid-level features can be further enhanced with semantic information, and propose semantic-affine transformation that transforms features of mid-level points belonging to different categories with class-specific affine parameters. Based on this technique, we propose SemAffiNet for point cloud semantic segmentation, which utilizes the attention mechanism in the Transformer module to implicitly and explicitly capture global structural knowledge within local parts for overall comprehension of each category. We conduct extensive experiments on the ScanNetV2 and NYUv2 datasets, and evaluate semantic-affine transformation on various 3D point cloud and 2D image segmentation baselines, where both qualitative and quantitative results demonstrate the superiority and generalization ability of our proposed approach. Code is available at https://github.com/wangzy22/SemAffiNet.

📄 PDF Abstract BibTeX arXiv:2205.13490

Code (1)

wangzy22/SemAffiNet 공식 구현 pytorch

Tasks

DecoderImage SegmentationPoint Cloud SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

Point-DAE: Denoising Autoencoders for Self-supervised Point Cloud Learning

2022-11-13 · Yabin Zhang, Jiehong Lin, Ruihuang Li, Kui Jia 외

Masked autoencoder has demonstrated its effectiveness in self-supervised point cloud learning. Considering that masking is a kind of corruption, in this work we explore a more general denoising autoencoder for point clou…

3D Object DetectionDecoderDenoisingFew-Shot Learning+2

Spatial Transformer for 3D Point Clouds

2019-06-26 · Jiayun Wang, Rudrasis Chakraborty, Stella X. Yu

Deep neural networks are widely used for understanding 3D point clouds. At each point convolution layer, features are computed from local neighborhoods of 3D points and combined for subsequent processing in order to extr…

Semantic Segmentation

Privacy Analysis of Affine Transformations in Cloud-based MPC: Vulnerability to Side-knowledge

2024-01-11 · Teimour Hosseinalizadeh, Nils Schlüter, Moritz Schulze Darup, Nima Monshizadeh

Search for the optimizer in computationally demanding model predictive control (MPC) setups can be facilitated by Cloud as a service provider in cyber-physical systems. This advantage introduces the risk that Cloud can o…

FormModel Predictive ControlPrivacy Preserving

Bi-PT: Bidirectional Cross-Attention Point Transformers for Four-Chamber Heart Reconstruction from Sparse Cardiac MRI Data

2026-07-08 · Chenchuhui Hu, Shaoming Pan, Leon Axel, Meng Ye arxiv

We propose Bi-PT, a pipeline for reconstructing 3D four-chamber human heart meshes from clinical sparsely sampled cardiac magnetic resonance imaging (CMR) data. This work addresses the error-prone generation of 3D cardia…

Spatial Perspective Transform Estimation from Fourier Spectrum Analysis of 2D Patterns in 3D Space

2022-11-27 · Ian J. Maquignaz

A novel approach to 3D surface imaging is proposed, allowing for the continuous sampling of 3D surfaces to extract localized perspective transformation coefficients from Fourier spectrum analysis of projected patterns. T…