Addressing Limited Data for Textual Entailment Across Domains
We seek to address the lack of labeled data (and high cost of annotation) for textual entailment in some domains. To that end, we first create (for experimental purposes) an entailment dataset for the clinical domain, and a highly competitive supervised entailment system, ENT, that is effective (out of the box) on two domains. We then explore self-training and active learning strategies to address the lack of labeled data. With self-training, we successfully exploit unlabeled data to improve over ENT by 15% F-score on the newswire domain, and 13% F-score on clinical data. On the other hand, our active learning experiments demonstrate that we can match (and even beat) ENT using only 6.6% of the training data in the clinical domain, and only 5.8% of the training data in the newswire domain.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningNatural Language InferenceSimilar Papers 제목 키워드 기반
Universal Natural Language Processing with Limited Annotations: Try Few-shot Textual Entailment as a Start
A standard way to address different NLP problems is by first constructing a problem-specific dataset, then building a model to fit this dataset. To build the ultimate artificial intelligence, we desire a single machine t…
coreference-resolutionCoreference ResolutionNatural Language InferenceQuestion AnsweringDr.Quad at MEDIQA 2019: Towards Textual Inference and Question Entailment using contextualized representations
This paper presents the submissions by Team Dr.Quad to the ACL-BioNLP 2019 shared task on Textual Inference and Question Entailment in the Medical Domain. Our system is based on the prior work Liu et al. (2019) which use…
Data AugmentationNatural Language InferenceGrounded Textual Entailment
Capturing semantic relations between sentences, such as entailment, is a long-standing challenge for computational semantics. Logic-based models analyse entailment in terms of possible worlds (interpretations, or situati…
Natural Language InferenceVisual Denotations for Recognizing Textual Entailment
In the logic approach to Recognizing Textual Entailment, identifying phrase-to-phrase semantic relations is still an unsolved problem. Resources such as the Paraphrase Database offer limited coverage despite their large …
Natural Language InferenceSemantic CompositionEnhancing Systematic Decompositional Natural Language Inference Using Informal Logic
Recent language models enable new opportunities for structured reasoning with text, such as the construction of intuitive, proof-like textual entailment trees without relying on brittle formal logic. However, progress in…
Formal LogicKnowledge DistillationNatural Language Inferencevalid