Unsupervised Natural Question Answering with a Small Model
The recent (2019-02) demonstration of the power of huge language models such as GPT-2 to memorise the answers to factoid questions raises questions about the extent to which knowledge is being embedded directly within these large models. This short paper describes an architecture through which much smaller models can also answer such questions - by making use of 'raw' external knowledge. The contribution of this work is that the methods presented here rely on unsupervised learning techniques, complementing the unsupervised training of the Language Model. The goal of this line of research is to be able to add knowledge explicitly, without extensive training.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingmodelQuestion AnsweringMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
End-to-End Training of Neural Retrievers for Open-Domain Question Answering
Recent work on training neural retrievers for open-domain question answering (OpenQA) has employed both supervised and unsupervised approaches. However, it remains unclear how unsupervised and supervised methods can be u…
Natural QuestionsOpen-Domain Question AnsweringQuestion AnsweringRAG+3Unsupervised Question Answering by Cloze Translation
Obtaining training data for Question Answering (QA) is time-consuming and resource-intensive, and existing QA datasets are only available for limited domains and languages. In this work, we explore to what extent high qu…
Natural QuestionsNMTQuestion AnsweringTranslationUnsupervised Question Answering for Fact-Checking
Recent Deep Learning (DL) models have succeeded in achieving human-level accuracy on various natural language tasks such as question-answering, natural language inference (NLI), and textual entailment. These tasks not on…
Fact CheckingNatural Language InferenceQuestion AnsweringUnsupervised Domain Adaptation of Contextual Embeddings for Low-Resource Duplicate Question Detection
Answering questions is a primary goal of many conversational systems or search products. While most current systems have focused on answering questions against structured databases or curated knowledge graphs, on-line co…
Domain AdaptationKnowledge GraphsQuestion AnsweringSelf-Supervised Learning+1Transformer based Natural Language Generation for Question-Answering
This paper explores Natural Language Generation within the context of Question-Answering task. The several works addressing this task only focused on generating a short answer or a long text span that contains the answer…
Question AnsweringText Generation