Exploiting Open IE for Deriving Multiple Premises Entailment Corpus
Natural language inference (NLI) is a key part of natural language understanding. The NLI task is defined as a decision problem whether a given sentence {--} hypothesis {--} can be inferred from a given text. Typically, we deal with a text consisting of just a single premise/single sentence, which is called a single premise entailment (SPE) task. Recently, a derived task of NLI from multiple premises (MPE) was introduced together with the first annotated corpus and corresponding several strong baselines. Nevertheless, the further development in MPE field requires accessibility of huge amounts of annotated data. In this paper we introduce a novel method for rapid deriving of MPE corpora from an existing NLI (SPE) annotated data that does not require any additional annotation work. This proposed approach is based on using an open information extraction system. We demonstrate the application of the method on a well known SNLI corpus. Over the obtained corpus, we provide the first evaluations as well as we state a strong baseline.
Code (0)
등록된 구현이 없습니다.
Tasks
Natural Language InferenceNatural Language UnderstandingOpen Information ExtractionSentenceSimilar Papers 제목 키워드 기반
Relative Entailment Among Probabilistic Implications
We study a natural variant of the implicational fragment of propositional logic. Its formulas are pairs of conjunctions of positive literals, related together by an implicational-like connective; the semantics of this so…
Neural Natural Logic Inference for Interpretable Question Answering
Many open-domain question answering problems can be cast as a textual entailment task, where a question and candidate answers are concatenated to form hypotheses. A QA system then determines if the supporting knowledge b…
Multiple-choiceNatural Language InferenceOpen-Domain Question AnsweringQuestion AnsweringAre Machines Better at Complex Reasoning? Unveiling Human-Machine Inference Gaps in Entailment Verification
Making inferences in text comprehension to understand the meaning is essential in language processing. This work studies the entailment verification (EV) problem of multi-sentence premises that requires a system to make …
BenchmarkingMultiple-choiceQuestion AnsweringReading Comprehension+1Natural Language Inference from Multiple Premises
We define a novel textual entailment task that requires inference over multiple premise sentences. We present a new dataset for this task that minimizes trivial lexical inferences, emphasizes knowledge of everyday events…
Natural Language InferenceEntailment Tree Explanations via Iterative Retrieval-Generation Reasoner
Large language models have achieved high performance on various question answering (QA) benchmarks, but the explainability of their output remains elusive. Structured explanations, called entailment trees, were recently …
DecoderQuestion AnsweringRetrieval