Multiclass Text Classification on Unbalanced, Sparse and Noisy Data
This paper discusses methods to improve the performance of text classification on data that is difficult to classify due to a large number of unbalanced classes with noisy examples. A variety of features are tested, in combination with three different neural-network-based methods with increasing complexity. The classifiers are applied to a songtext{--}artist dataset which is large, unbalanced and noisy. We come to the conclusion that substantial improvement can be obtained by removing unbalancedness and sparsity from the data. This fulfils a classification task unsatisfactorily{---}however, with contemporary methods, it is a practical step towards fairly satisfactory results.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral Classificationtext-classificationText ClassificationSimilar Papers 제목 키워드 기반
Unconfused Ultraconservative Multiclass Algorithms
We tackle the problem of learning linear classifiers from noisy datasets in a multiclass setting. The two-class version of this problem was studied a few years ago by, e.g. Bylander (1994) and Blum et al. (1996): in thes…
General ClassificationScalable Twin Neural Networks for Classification of Unbalanced Data
Twin Support Vector Machines (TWSVMs) have emerged an efficient alternative to Support Vector Machines (SVM) for learning from imbalanced datasets. The TWSVM learns two non-parallel classifying hyperplanes by solving a c…
ClassificationGeneral ClassificationGeneralization Error Bounds for Multiclass Sparse Linear Classifiers
We consider high-dimensional multiclass classification by sparse multinomial logistic regression. Unlike binary classification, in the multiclass setup one can think about an entire spectrum of possible notions of sparsi…
Binary Classificationfeature selectionregressionMultilabel Classification with Group Testing and Codes
In recent years, the multiclass and mutlilabel classification problems we encounter in many applications have very large ($10^3$–$10^6$) number of classes. However, each instance belongs to only one or few classes, …
ClassificationGeneral ClassificationVisualization of Tradeoff in Evaluation: from Precision-Recall & PN to LIFT, ROC & BIRD
Evaluation often aims to reduce the correctness or error characteristics of a system down to a single number, but that always involves trade-offs. Another way of dealing with this is to quote two numbers, such as Recall …
SensitivitySpecificity