Solving Feature Sparseness in Text Classification using Core-Periphery Decomposition
Feature sparseness is a problem common to cross-domain and short-text classification tasks. To overcome this feature sparseness problem, we propose a novel method based on graph decomposition to find candidate features for expanding feature vectors. Specifically, we first create a feature-relatedness graph, which is subsequently decomposed into core-periphery (CP) pairs and use the peripheries as the expansion candidates of the cores. We expand both training and test instances using the computed related features and use them to train a text classifier. We observe that prioritising features that are common to both training and test instances as cores during the CP decomposition to further improve the accuracy of text classification. We evaluate the proposed CP-decomposition-based feature expansion method on benchmark datasets for cross-domain sentiment classification and short-text classification. Our experimental results show that the proposed method consistently outperforms all baselines on short-text classification tasks, and perform competitively with pivot-based cross-domain sentiment classification methods.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDomain AdaptationGeneral ClassificationSentiment AnalysisSentiment Classificationtext-classificationText ClassificationSimilar Papers 제목 키워드 기반
ClassiNet -- Predicting Missing Features for Short-Text Classification
The fundamental problem in short-text classification is \emph{feature sparseness} -- the lack of feature overlap between a trained model and a test instance to be classified. We propose \emph{ClassiNet} -- a network of c…
ClassificationGeneral Classificationtext-classificationText ClassificationDifferential response of the retinal neural code with respect to the sparseness of natural images
Natural images follow statistics inherited by the structure of our physical (visual) environment. In particular, a prominent facet of this structure is that images can be described by a relatively sparse number of featur…
Sparse Named Entity Classification using Factorization Machines
Named entity classification is the task of classifying text-based elements into various categories, including places, names, dates, times, and monetary values. A bottleneck in named entity classification, however, is the…
ClassificationGeneral ClassificationSparseness helps: Sparsity Augmented Collaborative Representation for Classification
Many classification approaches first represent a test sample using the training samples of all the classes. This collaborative representation is then used to label the test sample. It was a common belief that sparseness …
ClassificationGeneral ClassificationShort Text Classification Improved by Feature Space Extension
With the explosive development of mobile Internet, short text has been applied extensively. The difference between classifying short text and long documents is that short text is of shortness and sparsity. Thus, it is ch…
ClassificationGeneral Classificationtext-classificationText Classification