paper-with-me

홈 › Papers

Data Augmentation for Hypernymy Detection

2020-05-04 · EACL 2021 2 · Thomas Kober, Julie Weeds, Lorenzo Bertolini, David Weir

The automatic detection of hypernymy relationships represents a challenging problem in NLP. The successful application of state-of-the-art supervised approaches using distributed representations has generally been impeded by the limited availability of high quality training data. We have developed two novel data augmentation techniques which generate new training examples from existing ones. First, we combine the linguistic principles of hypernym transitivity and intersective modifier-noun composition to generate additional pairs of vectors, such as "small dog - dog" or "small dog - animal", for which a hypernymy relationship can be assumed. Second, we use generative adversarial networks (GANs) to generate pairs of vectors for which the hypernymy relation can also be assumed. We furthermore present two complementary strategies for extending an existing dataset by leveraging linguistic resources such as WordNet. Using an evaluation across 3 different datasets for hypernymy detection and 2 different vector spaces, we demonstrate that both of the proposed automatic data augmentation and dataset extension strategies substantially improve classifier performance.

📄 PDF Abstract BibTeX arXiv:2005.01854

Code (1)

tttthomasssss/le-augmentation 공식 구현 pytorch

Tasks

Data Augmentation

Similar Papers 제목 키워드 기반

Hypernymy Detection for Low-Resource Languages via Meta Learning

2020-07-01 · ACL 2020 6 · Changlong Yu, Jialong Han, Haisong Zhang, Wilfred Ng

Hypernymy detection, a.k.a, lexical entailment, is a fundamental sub-task of many natural language understanding tasks. Previous explorations mostly focus on monolingual hypernymy detection on high-resource languages, e.…

Lexical EntailmentMeta-LearningNatural Language Understanding

Hierarchical Embeddings for Hypernymy Detection and Directionality

2017-07-23 · EMNLP 2017 9 · Kim Anh Nguyen, Maximilian Köper, Sabine Schulte im Walde, Ngoc Thang Vu

We present a novel neural model HyperVec to learn hierarchical embeddings for hypernymy detection and directionality. While previous embeddings have shown limitations on prototypical hypernyms, HyperVec represents an uns…

Lexical Entailment

BiRRE: Learning Bidirectional Residual Relation Embeddings for Supervised Hypernymy Detection

2020-07-01 · ACL 2020 6 · Chengyu Wang, Xiaofeng He

The hypernymy detection task has been addressed under various frameworks. Previously, the design of unsupervised hypernymy scores has been extensively studied. In contrast, supervised classifiers, especially distribution…

General ClassificationMemorizationRelationRepresentation Learning

Supervised Hypernymy Detection in Spanish through Order Embeddings

2020-05-01 · LREC 2020 5 · Gun Woo Lee, Mathias Etcheverry, Fern, Daniel ez Sanchez 외

This paper addresses the task of supervised hypernymy detection in Spanish through an order embedding and using pretrained word vectors as input. Although the task has been widely addressed in English, there is not much …

Transfer Learning

Robust Cross-lingual Hypernymy Detection using Dependency Context

2018-03-30 · NAACL 2018 6 · Shyam Upadhyay, Yogarshi Vyas, Marine Carpuat, Dan Roth

Cross-lingual Hypernymy Detection involves determining if a word in one language ("fruit") is a hypernym of a word in another language ("pomme" i.e. apple in French). The ability to detect hypernymy cross-lingually can a…

Natural Language InferenceWord Embeddings