paper-with-me

홈 › Papers

Restricted Boltzmann machine to determine the input weights for extreme learning machines

2017-08-17 · Andre Pacheco, Renato Krohling, Carlos da Silva

The Extreme Learning Machine (ELM) is a single-hidden layer feedforward neural network (SLFN) learning algorithm that can learn effectively and quickly. The ELM training phase assigns the input weights and bias randomly and does not change them in the whole process. Although the network works well, the random weights in the input layer can make the algorithm less effective and impact on its performance. Therefore, we propose a new approach to determine the input weights and bias for the ELM using the restricted Boltzmann machine (RBM), which we call RBM-ELM. We compare our new approach with a well-known approach to improve the ELM and a state of the art algorithm to select the weights for the ELM. The results show that the RBM-ELM outperforms both methodologies and achieve a better performance than the ELM.

📄 PDF Abstract BibTeX arXiv:1708.05376

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Geometry and Expressive Power of Conditional Restricted Boltzmann Machines

2014-02-14 · Guido Montufar, Nihat Ay, Keyan Ghazi-Zahedi

Conditional restricted Boltzmann machines are undirected stochastic neural networks with a layer of input and output units connected bipartitely to a layer of hidden units. These networks define models of conditional pro…

Variational mean-field theory for training restricted Boltzmann machines with binary synapses

2019-11-11 · Haiping Huang

Unsupervised learning requiring only raw data is not only a fundamental function of the cerebral cortex, but also a foundation for a next generation of artificial neural networks. However, a unified theoretical framework…

Multi-layered Discriminative Restricted Boltzmann Machine with Untrained Probabilistic Layer

2022-10-27 · Yuri Kanno, Muneki Yasuda

An extreme learning machine (ELM) is a three-layered feed-forward neural network having untrained parameters, which are randomly determined before training. Inspired by the idea of ELM, a probabilistic untrained layer ca…

Activation Functions, Statistics and Learning of Higher-Order Interactions in Restricted Boltzmann Machines

2026-05-18 · Giovanni di Sarra, Yasser Roudi arxiv

The great success of neural networks primarily arises from the presence of the large number of weight parameters combined with nonlinearities in the input-output relationship of single neurons. In this work, we study the…

Minimax formula for the replica symmetric free energy of deep restricted Boltzmann machines

2020-05-15 · Giuseppe Genovese

We study the free energy of a most used deep architecture for restricted Boltzmann machines, where the layers are disposed in series. Assuming independent Gaussian distributed random weights, we show that the error term …