PointMamba: A Simple State Space Model for Point Cloud Analysis
Transformers have become one of the foundational architectures in point cloud analysis tasks due to their excellent global modeling ability. However, the attention mechanism has quadratic complexity, making the design of a linear complexity method with global modeling appealing. In this paper, we propose PointMamba, transferring the success of Mamba, a recent representative state space model (SSM), from NLP to point cloud analysis tasks. Unlike traditional Transformers, PointMamba employs a linear complexity algorithm, presenting global modeling capacity while significantly reducing computational costs. Specifically, our method leverages space-filling curves for effective point tokenization and adopts an extremely simple, non-hierarchical Mamba encoder as the backbone. Comprehensive evaluations demonstrate that PointMamba achieves superior performance across multiple datasets while significantly reducing GPU memory usage and FLOPs. This work underscores the potential of SSMs in 3D vision-related tasks and presents a simple yet effective Mamba-based baseline for future research. The code will be made available at \url{https://github.com/LMD0311/PointMamba}.
Code (1)
Tasks
GPUMambaSimilar Papers 제목 키워드 기반
ZigzagPointMamba: Spatial-Semantic Mamba for Point Cloud Understanding
State Space models (SSMs) such as PointMamba enable efficient feature extraction for point cloud self-supervised learning with linear complexity, outperforming Transformers in computational efficiency. However, existing …
Computational EfficiencyMambaSelf-Supervised LearningState Space ModelsDAPointMamba: Domain Adaptive Point Mamba for Point Cloud Completion
Domain adaptive point cloud completion (DA PCC) aims to narrow the geometric and semantic discrepancies between the labeled source and unlabeled target domains. Existing methods either suffer from limited receptive field…
Point Cloud CompletionPoint CloudsSTREAM: A Universal State-Space Model for Sparse Geometric Data
Handling sparse and unstructured geometric data, such as point clouds or event-based vision, is a pressing challenge in the field of machine vision. Recently, sequence models such as Transformers and state-space models e…
Audio ClassificationEvent-based visionInductive BiasMamba+2HyQuRP: Hybrid quantum-classical neural network with rotational and permutational equivariance
Group-equivariant quantum machine learning has emerged as a promising paradigm by incorporating symmetry into quantum models. However, constructing models simultaneously equivariant to both rotational and permutational s…
3D Point Cloud ClassificationQuantum Machine LearningRethinking the compositionality of point clouds through regularization in the hyperbolic space
Point clouds of 3D objects exhibit an inherent compositional nature where simple parts can be assembled into progressively more complex shapes to form whole objects. Explicitly capturing such part-whole hierarchy is a lo…
3D Point Cloud ClassificationPoint Cloud Classification