Euclidean, Projective, Conformal: Choosing a Geometric Algebra for Equivariant Transformers

2023-11-08 · Pim de Haan, Taco Cohen, Johann Brehmer

The Geometric Algebra Transformer (GATr) is a versatile architecture for geometric deep learning based on projective geometric algebra. We generalize this architecture into a blueprint that allows one to construct a scalable transformer architecture given any geometric (or Clifford) algebra. We study versions of this architecture for Euclidean, projective, and conformal algebras, all of which are suited to represent 3D data, and evaluate them in theory and practice. The simplest Euclidean architecture is computationally cheap, but has a smaller symmetry group and is not as sample-efficient, while the projective model is not sufficiently expressive. Both the conformal algebra and an improved version of the projective algebra define powerful, performant architectures.

📄 PDF Abstract BibTeX arXiv:2311.04744

Code (1)

qualcomm-ai-research/geometric-algebra-transformer pytorch

Methods 이 논문이 사용한 방법론

Attention 설명 없음

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Residual Connection 설명 없음

Multi-Head Attention 설명 없음

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Geometric operations implemented by conformal geometric algebra neural nodes

2013-06-06 · Eckhard Hitzer

Geometric algebra is an optimal frame work for calculating with vectors. The geometric algebra of a space includes elements that represent all the its subspaces (lines, planes, volumes, ...). Conformal geometric algebra …

Geometric Algebra Transformer

2023-05-28 · NeurIPS 2023 11 · Johann Brehmer, Pim de Haan, Sönke Behrends, Taco Cohen

Problems involving geometric data arise in physics, chemistry, robotics, computer vision, and many other fields. Such data can take numerous forms, for instance points, direction vectors, translations, or rotations, but …

Motion Planning

A General Homogeneous Matrix Formulation to 3D Rotation Geometric Transformations

2014-04-24 · Feng Lu, Ziqiang Chen

We present algebraic projective geometry definitions of 3D rotations so as to bridge a small gap between the applications and the definitions of 3D rotations in homogeneous matrix form. A general homogeneous matrix formu…

Form

Projective reconstruction in algebraic vision

2017-10-17 · Atsushi Ito, Makoto Miura, Kazushi Ueda

We discuss the geometry of rational maps from a projective space of an arbitrary dimension to the product of projective spaces of lower dimensions induced by linear projections. In particular, we give an algebro-geometri…

Hybrid Diffusion Policies with Projective Geometric Algebra for Efficient Robot Manipulation Learning

2025-07-08 · Xiatao Sun, Yuxuan Wang, Shuo Yang, Yinxing Chen 외 arxiv

Diffusion policies are a powerful paradigm for robot learning, but their training is often inefficient. A key reason is that networks must relearn fundamental spatial concepts, such as translations and rotations, from sc…

Robot Manipulation