Using pseudo-senses for improving the extraction of synonyms from word embeddings
The methods proposed recently for specializing word embeddings according to a particular perspective generally rely on external knowledge. In this article, we propose Pseudofit, a new method for specializing word embeddings according to semantic similarity without any external knowledge. Pseudofit exploits the notion of pseudo-sense for building several representations for each word and uses these representations for making the initial embeddings more generic. We illustrate the interest of Pseudofit for acquiring synonyms and study several variants of Pseudofit according to this perspective.
Code (0)
등록된 구현이 없습니다.
Tasks
Dimensionality ReductionSemantic SimilaritySemantic Textual SimilarityWord EmbeddingsWord Sense DisambiguationSimilar Papers 제목 키워드 기반
Des pseudo-sens pour am\'eliorer l'extraction de synonymes \`a partir de plongements lexicaux (Pseudo-senses for improving the extraction of synonyms from word embeddings)
Au-del{\`a} des mod{\`e}les destin{\'e}s {\`a} construire des plongements lexicaux {\`a} partir de corpus, des m{\'e}thodes de sp{\'e}cialisation de ces repr{\'e}sentations selon diff{\'e}rentes orientations ont {\'e}t{\…
Word EmbeddingsSupervised and Unsupervised Word Sense Disambiguation on Word Embedding Vectors of Unambigous Synonyms
This paper compares two approaches to word sense disambiguation using word embeddings trained on unambiguous synonyms. The first is unsupervised method based on computing log probability from sequences of word embedding …
Word EmbeddingsWord Sense DisambiguationUnderstanding and Improving Multi-Sense Word Embeddings via Extended Robust Principal Component Analysis
Unsupervised learned representations of polysemous words generate a large of pseudo multi senses since unsupervised methods are overly sensitive to contextual variations. In this paper, we address the pseudo multi-sense …
Dimensionality ReductionWord EmbeddingsWord SimilarityImplicit Subjective and Sentimental Usages in Multi-sense Word Embeddings
In multi-sense word embeddings, contextual variations in corpus may cause a univocal word to be embedded into different sense vectors. Shi et al. (2016) show that this kind of \textit{pseudo multi-senses} can be eliminat…
TAGWord EmbeddingsLost in Context? On the Sense-wise Variance of Contextualized Word Embeddings
Contextualized word embeddings in language models have given much advance to NLP. Intuitively, sentential information is integrated into the representation of words, which can help model polysemy. However, context sensit…
PositionSentenceWord EmbeddingsWord Sense Disambiguation