Embedded all relevant feature selection with Random Ferns
Many machine learning methods can produce variable importance scores expressing the usability of each feature in context of the produced model; those scores on their own are yet not sufficient to generate feature selection, especially when an all relevant selection is required. Although there are wrapper methods aiming to solve this problem, they introduce a substantial increase in the required computational effort. In this paper I investigate an idea of incorporating all relevant selection within the training process by producing importance for implicitly generated shadows, attributes irrelevant by design. I propose and evaluate such a method in context of random ferns classifier. Experiment results confirm the effectiveness of such approach, although show that fully stochastic nature of random ferns limits its applicability either to small dimensions or as a part of a broader feature selection procedure.
Code (0)
등록된 구현이 없습니다.
Tasks
Allfeature selectionSimilar Papers 제목 키워드 기반
rFerns: An Implementation of the Random Ferns Method for General-Purpose Machine Learning
In this paper I present an extended implementation of the Random ferns algorithm contained in the R package rFerns. It differs from the original by the ability of consuming categorical and numerical attributes instead of…
AttributeBIG-bench Machine LearningRandom Ferns for Semantic Segmentation of PolSAR Images
Random Ferns -- as a less known example of Ensemble Learning -- have been successfully applied in many Computer Vision applications ranging from keypoint matching to object detection. This paper extends the Random Fern f…
Ensemble Learningobject-detectionObject DetectionSemantic SegmentationA Comparison of Random Forests and Ferns on Recognition of Instruments in Jazz Recordings
In this paper, we first apply random ferns for classification of real music recordings of a jazz band. No initial segmentation of audio data is assumed, i.e., no onset, offset, nor pitch data are needed. The notion of ra…
ClassificationGeneral ClassificationMulti-label Ferns for Efficient Recognition of Musical Instruments in Recordings
In this paper we introduce multi-label ferns, and apply this technique for automatic classification of musical instruments in audio recordings. We compare the performance of our proposed method to a set of binary random …
ClassificationGeneral ClassificationLarge-scale Nonlinear Variable Selection via Kernel Random Features
We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive mod…
Additive modelsregressionVariable Selection