A Sugeno Integral View of Binarized Neural Network Inference
In this article, we establish a precise connection between binarized neural networks (BNNs) and Sugeno integrals. The advantage of the Sugeno integral is that it provides a framework for representing the importance of inputs and their interactions, while being equivalent to a set of if-then rules. For a hidden BNN neuron at inference time, we show that the activation threshold test can be written as a Sugeno integral on binary inputs. This yields an explicit set-function representation of each neuron decision, and an associated rule-based representation. We also provide a Sugeno-integral expression for the last-layer score. Finally, we discuss how the same framework can be adapted to support richer input interactions and how it can be extended beyond the binary case induced by binarized neural networks.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Machine Learning with the Sugeno Integral: The Case of Binary Classification
In this paper, we elaborate on the use of the Sugeno integral in the context of machine learning. More specifically, we propose a method for binary classification, in which the Sugeno integral is used as an aggregation f…
BIG-bench Machine LearningBinary ClassificationGeneral ClassificationSugeno integral generalization applied to improve adaptive image binarization
Classic adaptive binarization methodologies threshold pixels intensity with re-spect to adjacent pixels exploiting integral images. In turn, integral imagesare generally computed optimally by using the summed-area-table …
BinarizationAdaptive binarization based on fuzzy integrals
Adaptive binarization methodologies threshold the intensity of the pixels with respect to adjacent pixels exploiting the integral images. In turn, the integral images are generally computed optimally using the summed-are…
BinarizationOn learning capacities of Sugeno integrals with systems of fuzzy relational equations
In this article, we introduce a method for learning a capacity underlying a Sugeno integral according to training data based on systems of fuzzy relational equations. To the training data, we associate two systems of equ…
Multiple Instance Fuzzy Inference Neural Networks
Fuzzy logic is a powerful tool to model knowledge uncertainty, measurements imprecision, and vagueness. However, there is another type of vagueness that arises when data have multiple forms of expression that fuzzy logic…
LandmineMultiple Instance Learning