Ranking Clarification Questions via Natural Language Inference
Given a natural language query, teaching machines to ask clarifying questions is of immense utility in practical natural language processing systems. Such interactions could help in filling information gaps for better machine comprehension of the query. For the task of ranking clarification questions, we hypothesize that determining whether a clarification question pertains to a missing entry in a given post (on QA forums such as StackExchange) could be considered as a special case of Natural Language Inference (NLI), where both the post and the most relevant clarification question point to a shared latent piece of information or context. We validate this hypothesis by incorporating representations from a Siamese BERT model fine-tuned on NLI and Multi-NLI datasets into our models and demonstrate that our best performing model obtains a relative performance improvement of 40 percent and 60 percent respectively (on the key metric of Precision@1), over the state-of-the-art baseline(s) on the two evaluation sets of the StackExchange dataset, thereby, significantly surpassing the state-of-the-art.
Code (0)
등록된 구현이 없습니다.
Tasks
Natural Language InferenceReading ComprehensionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Python Code Generation by Asking Clarification Questions
Code generation from text requires understanding the user's intent from a natural language description and generating an executable code snippet that satisfies this intent. While recent pretrained language models demonst…
Code GenerationLanguage ModelingLanguage ModellingLearning to Ask Good Questions: Ranking Clarification Questions using Neural Expected Value of Perfect Information
Inquiry is fundamental to communication, and machines cannot effectively collaborate with humans unless they can ask questions. In this work, we build a neural network model for the task of ranking clarification question…
Ranking Clarifying Questions Based on Predicted User Engagement
To improve online search results, clarification questions can be used to elucidate the information need of the user. This research aims to predict the user engagement with the clarification pane as an indicator of releva…
When and What to Ask Through World States and Text Instructions: IGLU NLP Challenge Solution
In collaborative tasks, effective communication is crucial for achieving joint goals. One such task is collaborative building where builders must communicate with each other to construct desired structures in a simulated…
ClassificationMinecraftOpen-domain clarification question generation without question examples
An overarching goal of natural language processing is to enable machines to communicate seamlessly with humans. However, natural language can be ambiguous or unclear. In cases of uncertainty, humans engage in an interact…
Question GenerationQuestion-Generation