AutoExtend: Combining Word Embeddings with Semantic Resources
We present AutoExtend, a system that combines word embeddings with semantic resources by learning embeddings for non-word objects like synsets and entities and learning word embeddings that incorporate the semantic information from the resource. The method is based on encoding and decoding the word embeddings and is flexible in that it can take any word embeddings as input and does not need an additional training corpus. The obtained embeddings live in the same vector space as the input word embeddings. A sparse tensor formalization guarantees efficiency and parallelizability. We use WordNet, GermaNet, and Freebase as semantic resources. AutoExtend achieves state-of-the-art performance on Word-in-Context Similarity and Word Sense Disambiguation tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Learning Word EmbeddingsSentiment AnalysisWord EmbeddingsWord Sense DisambiguationSimilar Papers 제목 키워드 기반
AutoExtend: Extending Word Embeddings to Embeddings for Synsets and Lexemes
We present \textit{AutoExtend}, a system to learn embeddings for synsets and lexemes. It is flexible in that it can take any word embeddings as input and does not need an additional training corpus. The synset/lexeme emb…
Word EmbeddingsWord Sense DisambiguationWord SimilarityVisualising WordNet Embeddings: some preliminary results
AutoExtend is a method for learning unambiguous vector embeddings for word senses. We visualise these word embeddings with t-SNE, which further compresses the vectors to the x,y plane. We show that the t-SNE co-ordinates…
Semantic SimilaritySemantic Textual SimilarityWord EmbeddingsHCCL at SemEval-2017 Task 2: Combining Multilingual Word Embeddings and Transliteration Model for Semantic Similarity
In this paper, we introduce an approach to combining word embeddings and machine translation for multilingual semantic word similarity, the task2 of SemEval-2017. Thanks to the unsupervised transliteration model, our cro…
Cross-Lingual Word EmbeddingsMachine TranslationMultilingual Word EmbeddingsSemantic Similarity+9Evaluation of Taxonomy Enrichment on Diachronic WordNet Versions
The vast majority of the existing approaches for taxonomy enrichment apply word embeddings as they have proven to accumulate contexts (in a broad sense) extracted from texts which are sufficient for attaching orphan word…
Word EmbeddingsBuilding Sense Representations in Danish by Combining Word Embeddings with Lexical Resources
Our aim is to identify suitable sense representations for NLP in Danish. We investigate sense inventories that correlate with human interpretations of word meaning and ambiguity as typically described in dictionaries and…
SentenceWord EmbeddingsWord Sense Disambiguation