paper-with-me

홈 › Papers

A Lorentz-Equivariant Transformer for All of the LHC

2024-11-01 · Johann Brehmer, Víctor Bresó, Pim de Haan, Tilman Plehn, Huilin Qu, Jonas Spinner, Jesse Thaler

We show that the Lorentz-Equivariant Geometric Algebra Transformer (L-GATr) yields state-of-the-art performance for a wide range of machine learning tasks at the Large Hadron Collider. L-GATr represents data in a geometric algebra over space-time and is equivariant under Lorentz transformations. The underlying architecture is a versatile and scalable transformer, which is able to break symmetries if needed. We demonstrate the power of L-GATr for amplitude regression and jet classification, and then benchmark it as the first Lorentz-equivariant generative network. For all three LHC tasks, we find significant improvements over previous architectures.

📄 PDF Abstract BibTeX arXiv:2411.00446

Code (1)

heidelberg-hepml/lorentz-gatr 공식 구현 pytorch

Tasks

All

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Adam 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Multi-Head Attention 설명 없음
Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Lorentz Local Canonicalization: How to Make Any Network Lorentz-Equivariant

2025-05-26 · Jonas Spinner, Luigi Favaro, Peter Lippmann, Sebastian Pitz 외

Lorentz-equivariant neural networks are becoming the leading architectures for high-energy physics. Current implementations rely on specialized layers, limiting architectural choices. We introduce Lorentz Local Canonical…

Data Augmentation

Lorentz-Equivariant Geometric Algebra Transformers for High-Energy Physics

2024-05-23 · Jonas Spinner, Victor Bresó, Pim de Haan, Tilman Plehn 외

Extracting scientific understanding from particle-physics experiments requires solving diverse learning problems with high precision and good data efficiency. We propose the Lorentz Geometric Algebra Transformer (L-GATr)…

Lorentz Group Equivariant Neural Network for Particle Physics

2020-06-08 · ICML 2020 1 · Alexander Bogatskiy, Brandon Anderson, Jan T. Offermann, Marwah Roussi 외

We present a neural network architecture that is fully equivariant with respect to transformations under the Lorentz group, a fundamental symmetry of space and time in physics. The architecture is based on the theory of …

General Classification

Lie-Equivariant Quantum Graph Neural Networks

2024-11-22 · Jogi Suda Neto, Roy T. Forestano, Sergei Gleyzer, Kyoungchul Kong 외

Discovering new phenomena at the Large Hadron Collider (LHC) involves the identification of rare signals over conventional backgrounds. Thus binary classification tasks are ubiquitous in analyses of the vast amounts of L…

Binary ClassificationGraph Neural NetworkJet Tagging

Lorentz-Equivariant Quantum Graph Neural Network for High-Energy Physics

2024-11-03 · Md Abrar Jahin, Md. Akmol Masud, Md Wahiduzzaman Suva, M. F. Mridha 외

The rapid data surge from the high-luminosity Large Hadron Collider introduces critical computational challenges requiring novel approaches for efficient data processing in particle physics. Quantum machine learning, wit…

Graph Neural NetworkJet TaggingQuantum Machine Learning