paper-with-me

Papers

Rethinking SO(3)-equivariance with Bilinear Tensor Networks

2023-03-20 · Chase Shimmin, Zhelun Li, Ema Smith

Many datasets in scientific and engineering applications are comprised of objects which have specific geometric structure. A common example is data which inhabits a representation of the group SO$(3)$ of 3D rotations: scalars, vectors, tensors, \textit{etc}. One way for a neural network to exploit prior knowledge of this structure is to enforce SO$(3)$-equivariance throughout its layers, and several such architectures have been proposed. While general methods for handling arbitrary SO$(3)$ representations exist, they computationally intensive and complicated to implement. We show that by judicious symmetry breaking, we can efficiently increase the expressiveness of a network operating only on vector and order-2 tensor representations of SO$(2)$. We demonstrate the method on an important problem from High Energy Physics known as \textit{b-tagging}, where particle jets originating from b-meson decays must be discriminated from an overwhelming QCD background. In this task, we find that augmenting a standard architecture with our method results in a \ensuremath{2.3\times} improvement in rejection score.

📄 PDF Abstract BibTeX arXiv:2303.11288

Code (0)

등록된 구현이 없습니다.

Tasks

Tensor Networks

Similar Papers 제목 키워드 기반

Tensor Decomposition Networks for Fast Machine Learning Interatomic Potential Computations

2025-07-01 · Yuchao Lin, Cong Fu, Zachary Krueger, Haiyang Yu 외 arxiv

$\rm{SO}(3)$-equivariant networks are the dominant models for machine learning interatomic potentials (MLIPs). The key operation of such networks is the Clebsch-Gordan (CG) tensor product, which is computationally expens…

Geometric Algebra Meets Cartesian Tensors: Higher-Order Equivariance for Interatomic Potentials

2026-06-28 · Can Polat, Erchin Serpedin, Mustafa Kurban, Hasan Kurban arxiv

$\mathrm{Cl}(3,0)$ interatomic potentials, despite their algebraic elegance, predict force magnitudes accurately but force directions poorly. Across ten rMD17 molecules, every $L \leq 1$ baseline in our twelve-model stud…

Towards Unified AI Models for MU-MIMO Communications: A Tensor Equivariance Framework

2024-06-13 · Yafei Wang, Hongwei Hou, Xinping Yi, Wenjin Wang 외

In this paper, we propose a unified framework based on equivariance for the design of artificial intelligence (AI)-assisted technologies in multi-user multiple-input-multiple-output (MU-MIMO) systems. We first provide de…

Scheduling

Weight-based Decomposition: A Case for Bilinear MLPs

2024-06-06 · Michael T. Pearce, Thomas Dooms, Alice Rigg

Gated Linear Units (GLUs) have become a common building block in modern foundation models. Bilinear layers drop the non-linearity in the "gate" but still have comparable performance to other GLUs. An attractive quality o…

Equivariance by Local Canonicalization: A Matter of Representation

2025-09-30 · Gerrit Gerhartz, Peter Lippmann, Fred A. Hamprecht arxiv

Equivariant neural networks offer strong inductive biases for learning from molecular and geometric data but often rely on specialized, computationally expensive tensor operations. We present a framework to transfers exi…