Learning Sense Embeddings from Definitions in Dictionaries
We introduce a method for learning to embed word senses as defined in a given set of given dictionaries. In our approach, sense definition pairs, <word, definition> are transformed into low-dimension vectors aimed at maximizing the probability of reconstructing the definitions in an autoencoding setting. The method involves automatically training sense autoencoder for encoding sense definitions, automatically aligning sense definitions, and automatically generating embeddings of arbitrary description. At run-time, queries from users are mapped to the embedding space and re-ranking is performed on the sense definition retrieved. We present a prototype sense definition embedding, SenseNet, that applies the method to two dictionaries. Blind evaluation on a set of real queries shows that the method significantly outperforms a baseline based on the Lesk algorithm. Our methodology clearly supports combining multiple dictionaries resulting in additional improvement in representing sense definitions in dictionaries.
Code (0)
등록된 구현이 없습니다.
Tasks
Re-RankingSimilar Papers 제목 키워드 기반
Lacking the embedding of a word? Look it up into a traditional dictionary
Word embeddings are powerful dictionaries, which may easily capture language variations. However, these dictionaries fail to give sense to rare words, which are surprisingly often covered by traditional dictionaries. In …
Word EmbeddingsUsing English Dictionaries to generate Commonsense Knowledge in Natural Language
This paper presents an approach to generating common sense knowledge written in raw English sentences. Instead of using public contributors to feed this source, this system chose to employ expert linguistics decisions by…
Common Sense ReasoningNatural Language InferenceWord Definitions from Large Language Models
Dictionary definitions are historically the arbitrator of what words mean, but this primacy has come under threat by recent progress in NLP, including word embeddings and generative models like ChatGPT. We present an exp…
Word EmbeddingsSemeval-2022 Task 1: CODWOE – Comparing Dictionaries and Word Embeddings
Word embeddings have advanced the state of the art in NLP across numerous tasks. Understanding the contents of dense neural representations is of utmost interest to the computational semantics community. We propose to fo…
Word EmbeddingsSemeval-2022 Task 1: CODWOE -- Comparing Dictionaries and Word Embeddings
Word embeddings have advanced the state of the art in NLP across numerous tasks. Understanding the contents of dense neural representations is of utmost interest to the computational semantics community. We propose to fo…
Word Embeddings