Simplicial Regularization
Inspired by the fuzzy topological representation of a dataset employed in UMAP (McInnes et al., 2018), we propose a regularization principle for supervised learning based on the preservation of the simplicial complex structure of the data. We analyze the behavior of our proposal in contrast with the mixup (Zhang et al., 2018) framework on dimensionality reduction and classification tasks. Our experiments show how simplicial regularization induces more appropriate learning biases and alleviates some of the shortcomings of state-of-the art methods for regularization based on data augmentation.
Code (1)
Tasks
Data AugmentationDimensionality ReductionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
The Geometry of Machine Learning Models
This paper presents a mathematical framework for analyzing machine learning models through the geometry of their induced partitions. By representing partitions as Riemannian simplicial complexes, we capture not only adja…
Simplicial Complex Representation Learning
Simplicial complexes form an important class of topological spaces that are frequently used in many application areas such as computer-aided design, computer graphics, and simulation. Representation learning on graphs, w…
Representation LearningSampling and Recovery of Signals on a Simplicial Complex using Neighbourhood Aggregation
In this work, we focus on sampling and recovery of signals over simplicial complexes. In particular, we subsample a simplicial signal of a certain order and focus on recovering multi-order bandlimited simplicial signals …
Simplicial Complex Representation Learning
Simplicial complexes form an important class of topological spaces that are frequently used in many application areas such as computer-aided design, computer graphics, and simulation. Representation learning on graphs, w…
Representation LearningTopoSRL: Topology preserving self-supervised Simplicial Representation Learning
In this paper, we introduce $\texttt{TopoSRL}$, a novel self-supervised learning (SSL) method for simplicial complexes to effectively capture higher-order interactions and preserve topology in the learned representations…