Efficient Text Classification Using Tree-structured Multi-linear Principal Component Analysis
A novel text data dimension reduction technique, called the tree-structured multi-linear principal component anal- ysis (TMPCA), is proposed in this work. Being different from traditional text dimension reduction methods that deal with the word-level representation, the TMPCA technique reduces the dimension of input sequences and sentences to simplify the following text classification tasks. It is shown mathematically and experimentally that the TMPCA tool demands much lower complexity (and, hence, less computing power) than the ordinary principal component analysis (PCA). Furthermore, it is demon- strated by experimental results that the support vector machine (SVM) method applied to the TMPCA-processed data achieves commensurable or better performance than the state-of-the-art recurrent neural network (RNN) approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Dimensionality ReductionGeneral Classificationtext-classificationText ClassificationSimilar Papers 제목 키워드 기반
Span Classification with Structured Information for Disfluency Detection in Spoken Utterances
Existing approaches in disfluency detection focus on solving a token-level classification task for identifying and removing disfluencies in text. Moreover, most works focus on leveraging only contextual information captu…
ClassificationS-MART: Novel Tree-based Structured Learning Algorithms Applied to Tweet Entity Linking
Non-linear models recently receive a lot of attention as people are starting to discover the power of statistical and embedding features. However, tree-based models are seldom studied in the context of structured learnin…
Entity LinkingBeyond Trees: Classification with Sparse Pairwise Dependencies
Several classification methods assume that the underlying distributions follow tree-structured graphical models. Indeed, trees capture statistical dependencies between pairs of variables, which may be crucial to attain l…
ClassificationGeneral ClassificationEvaluating Discourse in Structured Text Representations
Discourse structure is integral to understanding a text and is helpful in many NLP tasks. Learning latent representations of discourse is an attractive alternative to acquiring expensive labeled discourse data. Liu and L…
text-classificationText ClassificationRecursive Tree Attention: Improving Semantic Representations with Syntactic Tree Structured Attention Mechanism
Attention mechanism has shown its effectiveness in state-of-the-art methods on various tasks in natural language processing (NLP). However, these methods are still using attention mechanism in plain, linear topological s…
Constituency ParsingRepresentation LearningSentencetext-classification+1