paper-with-me

Papers

Spiking Point Transformer for Point Cloud Classification

2025-02-19 · Peixi Wu, Bosong Chai, Hebei Li, Menghua Zheng, Yansong Peng, Zeyu Wang, Xuan Nie, Yueyi Zhang, Xiaoyan Sun

Spiking Neural Networks (SNNs) offer an attractive and energy-efficient alternative to conventional Artificial Neural Networks (ANNs) due to their sparse binary activation. When SNN meets Transformer, it shows great potential in 2D image processing. However, their application for 3D point cloud remains underexplored. To this end, we present Spiking Point Transformer (SPT), the first transformer-based SNN framework for point cloud classification. Specifically, we first design Queue-Driven Sampling Direct Encoding for point cloud to reduce computational costs while retaining the most effective support points at each time step. We introduce the Hybrid Dynamics Integrate-and-Fire Neuron (HD-IF), designed to simulate selective neuron activation and reduce over-reliance on specific artificial neurons. SPT attains state-of-the-art results on three benchmark datasets that span both real-world and synthetic datasets in the SNN domain. Meanwhile, the theoretical energy consumption of SPT is at least 6.4$\times$ less than its ANN counterpart.

📄 PDF Abstract BibTeX arXiv:2502.15811

Code (1)

PeppaWu/SPT 공식 구현 pytorch

Tasks

ClassificationPoint Cloud Classification

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Noise-Injected Spiking Graph Convolution for Energy-Efficient 3D Point Cloud Denoising

2025-02-27 · Zikuan Li, Qiaoyun Wu, Jialin Zhang, Kaijun Zhang 외

Spiking neural networks (SNNs), inspired by the spiking computation paradigm of the biological neural systems, have exhibited superior energy efficiency in 2D classification tasks over traditional artificial neural netwo…

DenoisingRepresentation Learning

Spiking PointNet: Spiking Neural Networks for Point Clouds

2023-10-10 · NeurIPS 2023 11 · Dayong Ren, Zhe Ma, Yuanpei Chen, Weihang Peng 외

Recently, Spiking Neural Networks (SNNs), enjoying extreme energy efficiency, have drawn much research attention on 2D visual recognition and shown gradually increasing application potential. However, it still remains un…

Efficient Converted Spiking Neural Network for 3D and 2D Classification

2023-01-01 · ICCV 2023 1 · Yuxiang Lan, Yachao Zhang, Xu Ma, Yanyun Qu 외

Spiking Neural Networks (SNNs) have attracted enormous research interest due to their low-power and biologically plausible nature. Existing ANN-SNN conversion methods can achieve lossless conversion by converting a w…

image-classificationImage ClassificationPoint Cloud Classification

3DCTN: 3D Convolution-Transformer Network for Point Cloud Classification

2022-03-02 · Dening Lu, Qian Xie, Linlin Xu, Jonathan Li

Although accurate and fast point cloud classification is a fundamental task in 3D applications, it is difficult to achieve this purpose due to the irregularity and disorder of point clouds that make it challenging to ach…

ClassificationPoint Cloud Classification

PCT: Point cloud transformer

2020-12-17 · Meng-Hao Guo, Jun-Xiong Cai, Zheng-Ning Liu, Tai-Jiang Mu 외

The irregular domain and lack of ordering make it challenging to design deep neural networks for point cloud processing. This paper presents a novel framework named Point Cloud Transformer(PCT) for point cloud learning. …

3D Part Segmentation3D Point Cloud ClassificationPoint Cloud Classification