Evaluation of the impact of the indiscernibility relation on the fuzzy-rough nearest neighbours algorithm
Fuzzy rough sets are well-suited for working with vague, imprecise or uncertain information and have been succesfully applied in real-world classification problems. One of the prominent representatives of this theory is fuzzy-rough nearest neighbours (FRNN), a classification algorithm based on the classical k-nearest neighbours algorithm. The crux of FRNN is the indiscernibility relation, which measures how similar two elements in the data set of interest are. In this paper, we investigate the impact of this indiscernibility relation on the performance of FRNN classification. In addition to relations based on distance functions and kernels, we also explore the effect of distance metric learning on FRNN for the first time. Furthermore, we also introduce an asymmetric, class-specific relation based on the Mahalanobis distance which uses the correlation within each class, and which shows a significant improvement over the regular Mahalanobis distance, but is still beaten by the Manhattan distance. Overall, the Neighbourhood Components Analysis algorithm is found to be the best performer, trading speed for accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationMetric LearningRelationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Novel Machine Learning Approach to Data Inconsistency with respect to a Fuzzy Relation
Inconsistency in prediction problems occurs when instances that relate in a certain way on condition attributes, do not follow the same relation on the decision attribute. For example, in ordinal classification with mono…
AttributeBIG-bench Machine LearningOrdinal ClassificationRelationChoquet-Based Fuzzy Rough Sets
Fuzzy rough set theory can be used as a tool for dealing with inconsistent data when there is a gradual notion of indiscernibility between objects. It does this by providing lower and upper approximations of concepts. In…
BIG-bench Machine LearningOutlier DetectionHandbook of Rough Set Extensions and Uncertainty Models
Rough set theory models uncertainty by approximating target concepts through lower and upper sets induced by indiscernibility, or more generally, by granulation relations in data tables. This perspective captures vaguene…
Enriched Interpretation
The theory introduced, presented and developed in this paper, is concerned with an enriched extension of the theory of Rough Sets pioneered by Zdzislaw Pawlak. The enrichment discussed here is in the sense of valuated ca…
ManagementExtension of Rough Set Based on Positive Transitive Relation
The application of rough set theory in incomplete information systems is a key problem in practice since missing values almost always occur in knowledge acquisition due to the error of data measuring, the limitation of d…
Missing ValuesRelation