A Novel Method of Extracting Topological Features from Word Embeddings
In recent years, topological data analysis has been utilized for a wide range of problems to deal with high dimensional noisy data. While text representations are often high dimensional and noisy, there are only a few work on the application of topological data analysis in natural language processing. In this paper, we introduce a novel algorithm to extract topological features from word embedding representation of text that can be used for text classification. Working on word embeddings, topological data analysis can interpret the embedding high-dimensional space and discover the relations among different embedding dimensions. We will use persistent homology, the most commonly tool from topological data analysis, for our experiment. Examining our topological algorithm on long textual documents, we will show our defined topological features may outperform conventional text mining features.
Code (0)
등록된 구현이 없습니다.
Tasks
text-classificationText ClassificationTopological Data AnalysisWord EmbeddingsSimilar Papers 제목 키워드 기반
Topological Data Analysis in Text Classification: Extracting Features with Additive Information
While the strength of Topological Data Analysis has been explored in many studies on high dimensional numeric data, it is still a challenging task to apply it to text. As the primary goal in topological data analysis is …
General ClassificationInformation RetrievalRetrievaltext-classification+4Second-Order Word Embeddings from Nearest Neighbor Topological Features
We introduce second-order vector representations of words, induced from nearest neighborhood topological features in pre-trained contextual word embeddings. We then analyze the effects of using second-order embeddings as…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Natural Language Inference+2Topological Data Analysis for Word Sense Disambiguation
We develop and test a novel unsupervised algorithm for word sense induction and disambiguation which uses topological data analysis. Typical approaches to the problem involve clustering, based on simple low level feature…
ClusteringTopological Data AnalysisWord EmbeddingsWord Sense Disambiguation+1Dialogue Term Extraction using Transfer Learning and Topological Data Analysis
Goal oriented dialogue systems were originally designed as a natural language interface to a fixed data-set of entities that users might inquire about, further described by domain, slots, and values. As we move towards a…
Goal-Oriented Dialogue SystemsLanguage ModellingTerm ExtractionTopological Data Analysis+2Extracting domain-specific terms using contextual word embeddings
Automated terminology extraction refers to the task of extracting meaningful terms from domain-specific texts. This paper proposes a novel machine learning approach to terminology extraction, which combines features from…
Term ExtractionWord Embeddings