Efficient Continuous Group Convolutions for Local SE(3) Equivariance in 3D Point Clouds
Extending the translation equivariance property of convolutional neural networks to larger symmetry groups has been shown to reduce sample complexity and enable more discriminative feature learning. Further, exploiting additional symmetries facilitates greater weight sharing than standard convolutions, leading to an enhanced network expressivity without an increase in parameter count. However, extending the equivariant properties of a convolution layer comes at a computational cost. In particular, for 3D data, expanding equivariance to the SE(3) group (rotation and translation) results in a 6D convolution operation, which is not tractable for larger data samples such as 3D scene scans. While efforts have been made to develop efficient SE(3) equivariant networks, existing approaches rely on discretization or only introduce global rotation equivariance. This limits their applicability to point clouds representing a scene composed of multiple objects. This work presents an efficient, continuous, and local SE(3) equivariant convolution layer for point cloud processing based on general group convolution and local reference frames. Our experiments show that our approach achieves competitive or superior performance across a range of datasets and tasks, including object classification and semantic segmentation, with negligible computational overhead.
Code (1)
Tasks
Semantic SegmentationTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
B-Spline CNNs on Lie Groups
Group convolutional neural networks (G-CNNs) can be used to improve classical CNNs by equipping them with the geometric structure of groups. Central in the success of G-CNNs is the lifting of feature maps to higher dimen…
Face AlignmentRegular SE(3) Group Convolutions for Volumetric Medical Image Analysis
Regular group convolutional neural networks (G-CNNs) have been shown to increase model performance and improve equivariance to different geometrical symmetries. This work addresses the problem of SE(3), i.e., roto-transl…
Medical Image AnalysisPDO-eConvs: Partial Differential Operator Based Equivariant Convolutions
Recent research has shown that incorporating equivariance into neural network architectures is very helpful, and there have been some works investigating the equivariance of networks under group actions. However, as digi…
image-classificationImage ClassificationRotated MNISTScalable and Equivariant Spherical CNNs by Discrete-Continuous (DISCO) Convolutions
No existing spherical convolutional neural network (CNN) framework is both computationally scalable and rotationally equivariant. Continuous approaches capture rotational equivariance but are often prohibitively computat…
4kDepth EstimationSemantic SegmentationAlmost Equivariance via Lie Algebra Convolutions
Recently, the equivariance of models with respect to a group action has become an important topic of research in machine learning. Analysis of the built-in equivariance of existing neural network architectures, as well a…
Benchmarking