paper-with-me

홈 › Papers

Ranking Clarification Questions via Natural Language Inference

2020-08-18 · Vaibhav Kumar, Vikas Raunak, Jamie Callan

Given a natural language query, teaching machines to ask clarifying questions is of immense utility in practical natural language processing systems. Such interactions could help in filling information gaps for better machine comprehension of the query. For the task of ranking clarification questions, we hypothesize that determining whether a clarification question pertains to a missing entry in a given post (on QA forums such as StackExchange) could be considered as a special case of Natural Language Inference (NLI), where both the post and the most relevant clarification question point to a shared latent piece of information or context. We validate this hypothesis by incorporating representations from a Siamese BERT model fine-tuned on NLI and Multi-NLI datasets into our models and demonstrate that our best performing model obtains a relative performance improvement of 40 percent and 60 percent respectively (on the key metric of Precision@1), over the state-of-the-art baseline(s) on the two evaluation sets of the StackExchange dataset, thereby, significantly surpassing the state-of-the-art.

📄 PDF Abstract BibTeX arXiv:2008.07688

Code (0)

등록된 구현이 없습니다.

Tasks

Natural Language InferenceReading Comprehension

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Weight Decay 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Python Code Generation by Asking Clarification Questions

2022-12-19 · Haau-Sing Li, Mohsen Mesgar, André F. T. Martins, Iryna Gurevych

Code generation from text requires understanding the user's intent from a natural language description and generating an executable code snippet that satisfies this intent. While recent pretrained language models demonst…

Code GenerationLanguage ModelingLanguage Modelling

Learning to Ask Good Questions: Ranking Clarification Questions using Neural Expected Value of Perfect Information

2018-05-12 · ACL 2018 7 · Sudha Rao, Hal Daumé III

Inquiry is fundamental to communication, and machines cannot effectively collaborate with humans unless they can ask questions. In this work, we build a neural network model for the task of ranking clarification question…

Ranking Clarifying Questions Based on Predicted User Engagement

2021-03-10 · Tom Lotze, Stefan Klut, Mohammad Aliannejadi, Evangelos Kanoulas

To improve online search results, clarification questions can be used to elucidate the information need of the user. This research aims to predict the user engagement with the clarification pane as an indicator of releva…

When and What to Ask Through World States and Text Instructions: IGLU NLP Challenge Solution

2023-05-09 · Zhengxiang Shi, Jerome Ramos, To Eun Kim, Xi Wang 외

In collaborative tasks, effective communication is crucial for achieving joint goals. One such task is collaborative building where builders must communicate with each other to construct desired structures in a simulated…

ClassificationMinecraft

Open-domain clarification question generation without question examples

2021-10-19 · EMNLP 2021 11 · Julia White, Gabriel Poesia, Robert Hawkins, Dorsa Sadigh 외

An overarching goal of natural language processing is to enable machines to communicate seamlessly with humans. However, natural language can be ambiguous or unclear. In cases of uncertainty, humans engage in an interact…

Question GenerationQuestion-Generation