$C^*$-algebra Net: A New Approach Generalizing Neural Network Parameters to $C^*$-algebra
We propose a new framework that generalizes the parameters of neural network models to $C^*$-algebra-valued ones. $C^*$-algebra is a generalization of the space of complex numbers. A typical example is the space of continuous functions on a compact space. This generalization enables us to combine multiple models continuously and use tools for functions such as regression and integration. Consequently, we can learn features of data efficiently and adapt the models to problems continuously. We apply our framework to practical problems such as density estimation and few-shot learning and show that our framework enables us to learn features of data even with a limited number of samples. Our new framework highlights the potential possibility of applying the theory of $C^*$-algebra to general neural network models.
Code (0)
등록된 구현이 없습니다.
Tasks
Density EstimationFew-Shot LearningSimilar Papers 제목 키워드 기반
Algebraic Machine Learning
Machine learning algorithms use error function minimization to fit a large set of parameters in a preexisting model. However, error minimization eventually leads to a memorization of the training dataset, losing the abil…
BIG-bench Machine LearningMemorizationEmbedding Knowledge Graphs in Degenerate Clifford Algebras
Clifford algebras are a natural generalization of the real numbers, the complex numbers, and the quaternions. So far, solely Clifford algebras of the form $Cl_{p,q}$ (i.e., algebras without nilpotent base vectors) have b…
Entity EmbeddingsKnowledge Graph EmbeddingsKnowledge GraphsThe Gradient of Algebraic Model Counting
Algebraic model counting unifies many inference tasks on logic formulas by exploiting semirings. Rather than focusing on inference, we consider learning, especially in statistical-relational and neurosymbolic AI, which c…
modelAlgebraic Machine Learning: Learning as computing an algebraic decomposition of a task
Statistics and Optimization are foundational to modern Machine Learning. Here, we propose an alternative foundation based on Abstract Algebra, with mathematics that facilitates the analysis of learning. In this approach,…
Abstract AlgebraRandomized Geometric Algebra Methods for Convex Neural Networks
We introduce randomized algorithms to Clifford's Geometric Algebra, generalizing randomized linear algebra to hypercomplex vector spaces. This novel approach has many implications in machine learning, including training …
Language ModelingLanguage ModellingLarge Language Modeltext-classification+2