paper-with-me

Papers

A Question-Answer Driven Approach to Reveal Affirmative Interpretations from Verbal Negations

2022-05-23 · Findings (NAACL) 2022 7 · Md Mosharaf Hossain, Luke Holman, Anusha Kakileti, Tiffany Iris Kao, Nathan Raul Brito, Aaron Abraham Mathews, Eduardo Blanco

This paper explores a question-answer driven approach to reveal affirmative interpretations from verbal negations (i.e., when a negation cue grammatically modifies a verb). We create a new corpus consisting of 4,472 verbal negations and discover that 67.1% of them convey that an event actually occurred. Annotators generate and answer 7,277 questions for the 3,001 negations that convey an affirmative interpretation. We first cast the problem of revealing affirmative interpretations from negations as a natural language inference (NLI) classification task. Experimental results show that state-of-the-art transformers trained with existing NLI corpora are insufficient to reveal affirmative interpretations. We also observe, however, that fine-tuning brings small improvements. In addition to NLI classification, we also explore the more realistic task of generating affirmative interpretations directly from negations with the T5 transformer. We conclude that the generation task remains a challenge as T5 substantially underperforms humans.

📄 PDF Abstract BibTeX arXiv:2205.11467

Code (1)

mosharafhossain/afin 공식 구현 pytorch

Tasks

Natural Language InferenceNegation

Methods 이 논문이 사용한 방법론

Gated Linear Unit A Gated Linear Unit, or GLU computes: $$ \mathrm{GLU}(a, b) = a \otimes \sigma(b) $$ It is used in natural language processing architectures, for example the Gated CNN,…
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Inverse Square Root Schedule Inverse Square Root is a learning rate schedule 1 / $\sqrt{\max\left(n, k\right)}$ where $n$ is the current training iteration and $k$ is the number of warm-up steps. This…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Similar Papers 제목 키워드 기반

Paraphrasing in Affirmative Terms Improves Negation Understanding

2024-06-11 · MohammadHossein Rezaei, Eduardo Blanco

Negation is a common linguistic phenomenon. Yet language models face challenges with negation in many natural language understanding tasks such as question answering and natural language inference. In this paper, we expe…

Natural Language InferenceNatural Language UnderstandingNegationQuestion Answering

Leveraging Affirmative Interpretations from Negation Improves Natural Language Understanding

2022-10-26 · Md Mosharaf Hossain, Eduardo Blanco

Negation poses a challenge in many natural language understanding tasks. Inspired by the fact that understanding a negated statement often requires humans to infer affirmative interpretations, in this paper we show that …

Natural Language InferenceNatural Language UnderstandingNegationSentiment Analysis

DiscoTrace: Representing and Comparing Answering Strategies of Humans and LLMs in Information-Seeking Question Answering

2026-04-16 · Neha Srikanth, Jordan Boyd-Graber, Rachel Rudinger arxiv

We introduce DiscoTrace, a method to identify the rhetorical strategies that answerers use when responding to information-seeking questions. DiscoTrace represents answers as a sequence of question-related discourse acts …

Question Answering

Diversify-verify-adapt: Efficient and Robust Retrieval-Augmented Ambiguous Question Answering

2024-09-04 · Yeonjun In, Sungchul Kim, Ryan A. Rossi, Md Mehrab Tanjim 외

The retrieval augmented generation (RAG) framework addresses an ambiguity in user queries in QA systems by retrieving passages that cover all plausible interpretations and generating comprehensive responses based on the …

Question AnsweringRAGRetrievalRetrieval-augmented Generation

Near-Exact Recovery for Sparse-View CT via Data-Driven Methods

2021-10-19 · NeurIPS Workshop Deep_Invers 2021 12 · Martin Genzel, Ingo Gühring, Jan Macdonald, Maximilian März

This work presents an empirical study on the design and training of iterative neural networks for image reconstruction from tomographic measurements with unknown geometry. It is based on insights gained during our partic…

Image Reconstruction