paper-with-me

홈 › Papers

Matrix Multilayer Perceptron

2019-09-25 · Jalil Taghia, Maria Bånkestad, Fredrik Lindsten, Thomas Schön

Models that output a vector of responses given some inputs, in the form of a conditional mean vector, are at the core of machine learning. This includes neural networks such as the multilayer perceptron (MLP). However, models that output a symmetric positive definite (SPD) matrix of responses given inputs, in the form of a conditional covariance function, are far less studied, especially within the context of neural networks. Here, we introduce a new variant of the MLP, referred to as the matrix MLP, that is specialized at learning SPD matrices. Our construction not only respects the SPD constraint, but also makes explicit use of it. This translates into a model which effectively performs the task of SPD matrix learning even in scenarios where data are scarce. We present an application of the model in heteroscedastic multivariate regression, including convincing performance on six real-world datasets.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Information flow in multilayer perceptrons: an in-depth analysis

2025-10-11 · Giuliano Armano arxiv

Analysing how information flows along the layers of a multilayer perceptron is a topic of paramount importance in the field of artificial neural networks. After framing the problem from the point of view of information t…

A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix Groups

2021-04-19 · Marc Finzi, Max Welling, Andrew Gordon Wilson

Symmetries and equivariance are fundamental to the generalization of neural networks on domains such as images, graphs, and point clouds. Existing work has primarily focused on a small number of groups, such as the trans…

Rubik's CubeTranslation

Constructing the Matrix Multilayer Perceptron and its Application to the VAE

2019-02-04 · Jalil Taghia, Maria Bånkestad, Fredrik Lindsten, Thomas B. Schön

Like most learning algorithms, the multilayer perceptrons (MLP) is designed to learn a vector of parameters from data. However, in certain scenarios we are interested in learning structured parameters (predictions) in th…

Implementing the ICE Estimator in Multilayer Perceptron Classifiers

2020-07-13 · Tyler Ward

This paper describes the techniques used to implement the ICE estimator for a multilayer perceptron model, and reviews the performance of the resulting models. The ICE estimator is implemented in the Apache Spark Multila…

Asymptotic Freeness of Layerwise Jacobians Caused by Invariance of Multilayer Perceptron: The Haar Orthogonal Case

2021-03-24 · Benoit Collins, Tomohiro Hayase

Free Probability Theory (FPT) provides rich knowledge for handling mathematical difficulties caused by random matrices that appear in research related to deep neural networks (DNNs), such as the dynamical isometry, Fishe…