paper-with-me

홈 › Papers

Enhancing Multi-Class Classification of Random Forest using Random Vector Functional Neural Network and Oblique Decision Surfaces

2018-02-05 · Rakesh Katuwal, P. N. Suganthan

Both neural networks and decision trees are popular machine learning methods and are widely used to solve problems from diverse domains. These two classifiers are commonly used base classifiers in an ensemble framework. In this paper, we first present a new variant of oblique decision tree based on a linear classifier, then construct an ensemble classifier based on the fusion of a fast neural network, random vector functional link network and oblique decision trees. Random Vector Functional Link Network has an elegant closed form solution with extremely short training time. The neural network partitions each training bag (obtained using bagging) at the root level into C subsets where C is the number of classes in the dataset and subsequently, C oblique decision trees are trained on such partitions. The proposed method provides a rich insight into the data by grouping the confusing or hard to classify samples for each class and thus, provides an opportunity to employ fine-grained classification rule over the data. The performance of the ensemble classifier is evaluated on several multi-class datasets where it demonstrates a superior performance compared to other state-of- the-art classifiers.

📄 PDF Abstract BibTeX arXiv:1802.01240

Code (0)

등록된 구현이 없습니다.

Tasks

General ClassificationMulti-class Classification

Similar Papers 제목 키워드 기반

Adaptive Forests For Classification

2025-10-27 · Dimitris Bertsimas, Yubing Cui arxiv

Random Forests (RF) and Extreme Gradient Boosting (XGBoost) are two of the most widely used and highly performing classification and regression models. They aggregate equally weighted CART trees, generated randomly in RF…

Multi-class Classification

Random Forest-Supervised Manifold Alignment

2024-11-18 · Jake S. Rhodes, Adam G. Rustad

Manifold alignment is a type of data fusion technique that creates a shared low-dimensional representation of data collected from multiple domains, enabling cross-domain learning and improved performance in downstream ta…

SerendibCoins: Exploring The Sri Lankan Coins Dataset

2025-05-24 · NH Wanigasingha, ES Sithpahan, MKA Ariyaratne, PRS De Silva

The recognition and classification of coins are essential in numerous financial and automated systems. This study introduces a comprehensive Sri Lankan coin image dataset and evaluates its impact on machine learning mode…

Classification

Feature Importance Guided Random Forest Learning with Simulated Annealing Based Hyperparameter Tuning

2025-10-31 · Kowshik Balasubramanian, Andre Williams, Ismail Butun arxiv

This paper introduces a novel framework for enhancing Random Forest classifiers by integrating probabilistic feature sampling and hyperparameter tuning via Simulated Annealing. The proposed framework exhibits substantial…

Feature ImportanceAnomaly Detection

Neural Attention Forests: Transformer-Based Forest Improvement

2023-04-12 · Andrei V. Konstantinov, Lev V. Utkin, Alexey A. Lukashin, Vladimir A. Muliukha

A new approach called NAF (the Neural Attention Forest) for solving regression and classification tasks under tabular training data is proposed. The main idea behind the proposed NAF model is to introduce the attention m…

regression