Complex networks based word embeddings
Most of the time, the first step to learn word embeddings is to build a word co-occurrence matrix. As such matrices are equivalent to graphs, complex networks theory can naturally be used to deal with such data. In this paper, we consider applying community detection, a main tool of this field, to the co-occurrence matrix corresponding to a huge corpus. Community structure is used as a way to reduce the dimensionality of the initial space. Using this community structure, we propose a method to extract word embeddings that are comparable to the state-of-the-art approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Community DetectionWord EmbeddingsSimilar Papers 제목 키워드 기반
Encoding word order in complex embeddings
Sequential word order is important when processing text. Currently, neural networks (NNs) address this by modeling word position using position embeddings. The problem is that position embeddings capture the position of …
Language ModelingLanguage ModellingMachine TranslationPosition+4Learning Complex Word Embeddings in Classical and Quantum Spaces
We present a variety of methods for training complex-valued word embeddings, based on the classical Skip-gram model, with a straightforward adaptation simply replacing the real-valued vectors with arbitrary vectors of co…
C++ codeWord EmbeddingsSub-Word Similarity based Search for Embeddings: Inducing Rare-Word Embeddings for Word Similarity Tasks and Language Modelling
Training good word embeddings requires large amounts of data. Out-of-vocabulary words will still be encountered at test-time, leaving these words without embeddings. To overcome this lack of embeddings for rare words, ex…
Language ModelingLanguage ModellingMorphological AnalysisWord Embeddings+1Concatenated Power Mean Word Embeddings as Universal Cross-Lingual Sentence Representations
Average word embeddings are a common baseline for more sophisticated sentence embedding techniques. However, they typically fall short of the performances of more complex models such as InferSent. Here, we generalize the…
SentenceSentence EmbeddingSentence-EmbeddingWord EmbeddingsA comparative study of word embeddings and other features for lexical complexity detection in French
Lexical complexity detection is an important step for automatic text simplification which serves to make informed lexical substitutions. In this study, we experiment with word embeddings for measuring the complexity of F…
Text SimplificationWord Embeddings