paper-with-me

Papers

Random Vector Functional Link Neural Network based Ensemble Deep Learning

2019-06-30 · Rakesh Katuwal, P. N. Suganthan, M. Tanveer

In this paper, we propose a deep learning framework based on randomized neural network. In particular, inspired by the principles of Random Vector Functional Link (RVFL) network, we present a deep RVFL network (dRVFL) with stacked layers. The parameters of the hidden layers of the dRVFL are randomly generated within a suitable range and kept fixed while the output weights are computed using the closed form solution as in a standard RVFL network. We also propose an ensemble deep network (edRVFL) that can be regarded as a marriage of ensemble learning with deep learning. Unlike traditional ensembling approaches that require training several models independently from scratch, edRVFL is obtained by training a single dRVFL network once. Both dRVFL and edRVFL frameworks are generic and can be used with any RVFL variant. To illustrate this, we integrate the deep learning networks with a recently proposed sparse-pretrained RVFL (SP-RVFL). Extensive experiments on benchmark datasets from diverse domains show the superior performance of our proposed deep RVFL networks.

📄 PDF Abstract BibTeX arXiv:1907.00350

Code (0)

등록된 구현이 없습니다.

Tasks

Deep LearningEnsemble Learning

Similar Papers 제목 키워드 기반

Weighting and Pruning based Ensemble Deep Random Vector Functional Link Network for Tabular Data Classification

2022-01-15 · Qiushi Shi, Ponnuthurai Nagaratnam Suganthan, Rakesh Katuwal

In this paper, we first introduce batch normalization to the edRVFL network. This re-normalization method can help the network avoid divergence of the hidden features. Then we propose novel variants of Ensemble Deep Rand…

Diversity

Enhancing Multi-Class Classification of Random Forest using Random Vector Functional Neural Network and Oblique Decision Surfaces

2018-02-05 · Rakesh Katuwal, P. N. Suganthan

Both neural networks and decision trees are popular machine learning methods and are widely used to solve problems from diverse domains. These two classifiers are commonly used base classifiers in an ensemble framework. …

General ClassificationMulti-class Classification

Random vector functional link network: recent developments, applications, and future directions

2022-02-13 · A. K. Malik, Ruobin Gao, M. A. Ganaie, M. Tanveer 외

Neural networks have been successfully employed in various domains such as classification, regression and clustering, etc. Generally, the back propagation (BP) based iterative approaches are used to train the neural netw…

Hyperparameter Optimization

Random vector functional link neural network based ensemble deep learning for short-term load forecasting

2021-07-30 · Ruobin Gao, Liang Du, P. N. Suganthan, Qin Zhou 외

Electricity load forecasting is crucial for the power systems' planning and maintenance. However, its un-stationary and non-linear characteristics impose significant difficulties in anticipating future demand. This paper…

Load ForecastingRepresentation LearningTime SeriesTime Series Analysis

Ensemble Deep Random Vector Functional Link Neural Network Based on Fuzzy Inference System

2024-06-02 · M. Sajid, M. Tanveer, P. N. Suganthan

The ensemble deep random vector functional link (edRVFL) neural network has demonstrated the ability to address the limitations of conventional artificial neural networks. However, since edRVFL generates features for its…