paper-with-me

Papers

Active entailment encoding for explanation tree construction using parsimonious generation of hard negatives

2022-08-02 · Alex Bogatu, Zili Zhou, Dónal Landers, André Freitas

Entailment trees have been proposed to simulate the human reasoning process of explanation generation in the context of open--domain textual question answering. However, in practice, manually constructing these explanation trees proves a laborious process that requires active human involvement. Given the complexity of capturing the line of reasoning from question to the answer or from claim to premises, the issue arises of how to assist the user in efficiently constructing multi--level entailment trees given a large set of available facts. In this paper, we frame the construction of entailment trees as a sequence of active premise selection steps, i.e., for each intermediate node in an explanation tree, the expert needs to annotate positive and negative examples of premise facts from a large candidate list. We then iteratively fine--tune pre--trained Transformer models with the resulting positive and tightly controlled negative samples and aim to balance the encoding of semantic relationships and explanatory entailment relationships. Experimental evaluation confirms the measurable efficiency gains of the proposed active fine--tuning method in facilitating entailment trees construction: up to 20\% improvement in explanatory premise selection when compared against several alternatives.

📄 PDF Abstract BibTeX arXiv:2208.01376

Code (0)

등록된 구현이 없습니다.

Tasks

Explanation GenerationQuestion Answering

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Position-Wise Feed-Forward Layer 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Adam 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Integrating Hierarchical Semantic into Iterative Generation Model for Entailment Tree Explanation

2024-09-26 · Qin Wang, Jianzhou Feng, Yiming Xu

Manifestly and logically displaying the line of reasoning from evidence to answer is significant to explainable question answering (QA). The entailment tree exhibits the lines structurally, which is different from the se…

Question Answering

METGEN: A Module-Based Entailment Tree Generation Framework for Answer Explanation

2022-05-05 · Findings (NAACL) 2022 7 · Ruixin Hong, Hongming Zhang, Xintong Yu, ChangShui Zhang

Knowing the reasoning chains from knowledge to the predicted answers can help construct an explainable question answering (QA) system. Advances on QA explanation propose to explain the answers with entailment trees compo…

Question Answeringvalid

Explaining Answers with Entailment Trees

2021-04-17 · EMNLP 2021 11 · Bhavana Dalvi, Peter Jansen, Oyvind Tafjord, Zhengnan Xie 외

Our goal, in the context of open-domain textual question-answering (QA), is to explain answers by showing the line of reasoning from what is known to the answer, rather than simply showing a fragment of textual evidence …

Language ModellingQuestion Answeringvalid

Entailment Tree Explanations via Iterative Retrieval-Generation Reasoner

2022-05-18 · Findings (NAACL) 2022 7 · Danilo Ribeiro, Shen Wang, Xiaofei Ma, Rui Dong 외

Large language models have achieved high performance on various question answering (QA) benchmarks, but the explainability of their output remains elusive. Structured explanations, called entailment trees, were recently …

DecoderQuestion AnsweringRetrieval

A Logical Pattern Memory Pre-trained Model for Entailment Tree Generation

2024-03-11 · Li Yuan, Yi Cai, Haopeng Ren, Jiexin Wang

Generating coherent and credible explanations remains a significant challenge in the field of AI. In recent years, researchers have delved into the utilization of entailment trees to depict explanations, which exhibit a …