paper-with-me

홈 › Papers

Smooth, exact rotational symmetrization for deep learning on point clouds

2023-05-30 · NeurIPS 2023 11 · Sergey N. Pozdnyakov, Michele Ceriotti

Point clouds are versatile representations of 3D objects and have found widespread application in science and engineering. Many successful deep-learning models have been proposed that use them as input. The domain of chemical and materials modeling is especially challenging because exact compliance with physical constraints is highly desirable for a model to be usable in practice. These constraints include smoothness and invariance with respect to translations, rotations, and permutations of identical atoms. If these requirements are not rigorously fulfilled, atomistic simulations might lead to absurd outcomes even if the model has excellent accuracy. Consequently, dedicated architectures, which achieve invariance by restricting their design space, have been developed. General-purpose point-cloud models are more varied but often disregard rotational symmetry. We propose a general symmetrization method that adds rotational equivariance to any given model while preserving all the other requirements. Our approach simplifies the development of better atomic-scale machine-learning schemes by relaxing the constraints on the design space and making it possible to incorporate ideas that proved effective in other domains. We demonstrate this idea by introducing the Point Edge Transformer (PET) architecture, which is not intrinsically equivariant but achieves state-of-the-art performance on several benchmark datasets of molecules and solids. A-posteriori application of our general protocol makes PET exactly equivariant, with minimal changes to its accuracy.

📄 PDF Abstract BibTeX arXiv:2305.19302

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Focus 설명 없음

Similar Papers 제목 키워드 기반

Efficient anti-symmetrization of a neural network layer by taming the sign problem

2022-05-24 · Nilin Abrahamsen, Lin Lin

Explicit antisymmetrization of a neural network is a potential candidate for a universal function approximator for generic antisymmetric functions, which are ubiquitous in quantum physics. However, this procedure is a pr…

Rotational Symmetry based Object Pose Estimation from Point Clouds in the Absence of Known 3D Models

2026-06-15 · Weichen Dai, Ruixun Yu, Yangjie Tang, Yifan Du 외 arxiv

Object pose estimation is crucial to many industrial applications, with one example being automated spray painting using a robot. However, confidentiality concerns often limit access to high-quality 3D models, posing a s…

Pose EstimationPoint Clouds

Stiefel Flow Matching for Moment-Constrained Structure Elucidation

2024-12-17 · Austin Cheng, Alston Lo, Kin Long Kelvin Lee, Santiago Miret 외

Molecular structure elucidation is a fundamental step in understanding chemical phenomena, with applications in identifying molecules in natural products, lab syntheses, forensic samples, and the interstellar medium. We …

Hierarchical Direction Perception via Atomic Dot-Product Operators for Rotation-Invariant Point Clouds Learning

2025-11-11 · Chenyu Hu, Xiaotong Li, Hao Zhu, Biao Hou arxiv

Point cloud processing has become a cornerstone technology in many 3D vision tasks. However, arbitrary rotations introduce variations in point cloud orientations, posing a long-standing challenge for effective representa…

Point Cloud ClassificationRepresentation LearningPoint Clouds

High-Fidelity Point Cloud Completion with Low-Resolution Recovery and Noise-Aware Upsampling

2021-12-21 · Ren-Wu Li, Bo wang, Chun-Peng Li, Ling-Xiao Zhang 외

Completing an unordered partial point cloud is a challenging task. Existing approaches that rely on decoding a latent feature to recover the complete shape, often lead to the completed point cloud being over-smoothing, l…

Point Cloud Completion