Transforming Question Answering Datasets Into Natural Language Inference Datasets
Existing datasets for natural language inference (NLI) have propelled research on language understanding. We propose a new method for automatically deriving NLI datasets from the growing abundance of large-scale question answering datasets. Our approach hinges on learning a sentence transformation model which converts question-answer pairs into their declarative forms. Despite being primarily trained on a single QA dataset, we show that it can be successfully applied to a variety of other QA resources. Using this system, we automatically derive a new freely available dataset of over 500k NLI examples (QA-NLI), and show that it exhibits a wide range of inference phenomena rarely seen in previous NLI datasets.
Code (2)
Tasks
Natural Language InferenceQuestion AnsweringSentenceSimilar Papers 제목 키워드 기반
Improving Unsupervised Question Answering via Summarization-Informed Question Generation
Question Generation (QG) is the task of generating a plausible question for a given <passage, answer> pair. Template-based QG uses linguistically-informed heuristics to transform declarative sentences into interrogatives…
ArticlesDependency Parsingnamed-entity-recognitionNamed Entity Recognition+7Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation
The rapid development of vision language models (VLMs) demands rigorous and reliable evaluation. However, current visual question answering (VQA) benchmarks often depend on open-ended questions, making accurate evaluatio…
Language Model EvaluationLanguage ModelingLanguage ModellingMultiple-choice+3Keeping the Questions Conversational: Using Structured Representations to Resolve Dependency in Conversational Question Answering
Having an intelligent dialogue agent that can engage in conversational question answering (ConvQA) is now no longer limited to Sci-Fi movies only and has, in fact, turned into a reality. These intelligent agents are requ…
Conversational Question AnsweringQuestion AnsweringQuestion RewritingTowards Natural Language Question Answering over Earth Observation Linked Data using Attention-based Neural Machine Translation
With an increase in Geospatial Linked Open Data being adopted and published over the web, there is a need to develop intuitive interfaces and systems for seamless and efficient exploratory analysis of such rich heterogen…
Earth ObservationMachine TranslationQuestion AnsweringTranslationKnowledge Graph Question Answering using Graph-Pattern Isomorphism
Knowledge Graph Question Answering (KGQA) systems are based on machine learning algorithms, requiring thousands of question-answer pairs as training examples or natural language processing pipelines that need module fine…
Domain AdaptationGraph Question AnsweringQuestion Answering