Synonyms, Antonyms and Beyond
This paper examines fine-tuning for a well-studied task, synonym/antonym classification, and a novel task, VAD regression. The proposed method is almost as good as SOTA methods on standard benchmarks, but generalizes better to a new benchmark based on the Fallows Thesaurus (1898). Moreover the proposed method generalizes from words to (multilingual) texts: e.g., MWEs, OOVs, sentences, paragraphs. The second task was introduced to address concerns with leakage in benchmarks. The second task also makes it easier to study the (in)-effectiveness of transfer learning to unseen words.
Code (0)
등록된 구현이 없습니다.
Tasks
regressionTransfer LearningSimilar Papers 제목 키워드 기반
Unraveling Antonym's Word Vectors through a Siamese-like Network
Discriminating antonyms and synonyms is an important NLP task that has the difficulty that both, antonyms and synonyms, contains similar distributional information. Consequently, pairs of antonyms and synonyms may have s…
Uncovering Distributional Differences between Synonyms and Antonyms in a Word Space Model
A Mixture-of-Experts Model for Antonym-Synonym Discrimination
Discrimination between antonyms and synonyms is an important and challenging NLP task. Antonyms and synonyms often share the same or similar contexts and thus are hard to make a distinction. This paper proposes two under…
Mixture-of-ExpertsIntegrating Distributional Lexical Contrast into Word Embeddings for Antonym-Synonym Distinction
We propose a novel vector representation that integrates lexical contrast into distributional vectors and strengthens the most salient features for determining degrees of word similarity. The improved vectors significant…
Word EmbeddingsWord SimilarityDistinguishing Antonyms and Synonyms in a Pattern-based Neural Network
Distinguishing between antonyms and synonyms is a key task to achieve high performance in NLP systems. While they are notoriously difficult to distinguish by distributional co-occurrence models, pattern-based methods hav…
General Classification