The Role of Fibration Symmetries in Geometric Deep Learning
Geometric Deep Learning (GDL) unifies a broad class of machine learning techniques from the perspectives of symmetries, offering a framework for introducing problem-specific inductive biases like Graph Neural Networks (GNNs). However, the current formulation of GDL is limited to global symmetries that are not often found in real-world problems. We propose to relax GDL to allow for local symmetries, specifically fibration symmetries in graphs, to leverage regularities of realistic instances. We show that GNNs apply the inductive bias of fibration symmetries and derive a tighter upper bound for their expressive power. Additionally, by identifying symmetries in networks, we collapse network nodes, thereby increasing their computational efficiency during both inference and training of deep neural networks. The mathematical extension introduced here applies beyond graphs to manifolds, bundles, and grids for the development of models with inductive biases induced by local symmetries that can lead to better generalization.
Code (0)
등록된 구현이 없습니다.
Tasks
Computational EfficiencyDeep LearningInductive BiasSimilar Papers 제목 키워드 기반
Quasifibrations of Graphs to Find Symmetries in Biological Networks
A fibration of graphs is an homomorphism that is a local isomorphism of in-neighbourhoods, much in the same way a covering projection is a local isomorphism of neighbourhoods. Recently, it has been shown that graph fibra…
Predicting synchronized gene coexpression patterns from fibration symmetries in gene regulatory networks in bacteria
Background: Gene regulatory networks coordinate the expression of genes across physiological states and ensure a synchronized expression of genes in cellular subsystems, critical for the coherent functioning of cells. He…
Fibration symmetries and cluster synchronization in the Caenorhabditis elegans connectome
Capturing how the Caenorhabditis elegans connectome structure gives rise to its neuron functionality remains unclear. It is through fiber symmetries found in its neuronal connectivity that synchronization of a group of n…
Symmetries of Living Systems: Symmetry Fibrations and Synchronization in Biological Networks
A symmetry is a `change without change'. As simple as it sounds, this concept is the fundamental cornerstone that unifies all branches of theoretical physics. Virtually all physical laws -- ranging from classical mechani…
Fibration symmetries uncover the building blocks of biological networks
A major ambition of systems science is to uncover the building blocks of any biological network to decipher how cellular function emerges from their interactions. Here, we introduce a graph representation of the informat…