Pretrained Transformers for Simple Question Answering
Answering simple questions over knowledge graphs is a well-studied problem in question answering. Previous approaches for this task built on recurrent and convolutional neural networks (RNNs and CNNs) based architectures that use pretrained word embeddings. It was recently shown that a pretrained transformer network (BERT) can outperform RNN- and CNN based approaches on various natural language processing tasks. In this work, we investigate how well network BERT performs on the entity span prediction and relation prediction subtasks of simple QA. In addition, we provide an evaluation of both BERT and BiLSTM-based models in datasparse scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge GraphsPredictionQuestion AnsweringRelation PredictionWord EmbeddingsSimilar Papers 제목 키워드 기반
Pretrained Transformers for Simple Question Answering over Knowledge Graphs
Answering simple questions over knowledge graphs is a well-studied problem in question answering. Previous approaches for this task built on recurrent and convolutional neural network based architectures that use pretrai…
Knowledge GraphsQuestion AnsweringWord EmbeddingsDesigning Templates for Eliciting Commonsense Knowledge from Pretrained Sequence-to-Sequence Models
While internalized {``}implicit knowledge{''} in pretrained transformers has led to fruitful progress in many natural language understanding tasks, how to most effectively elicit such knowledge remains an open question. …
Multiple-choiceNatural Language UnderstandingOpen-Ended Question AnsweringQuestion AnsweringDo Transformers Dream of Inference, or Can Pretrained Generative Models Learn Implicit Inferential Rules?
Large pretrained language models (LM) have been used successfully for multi-hop question answering. However, most of these directions are not interpretable, as they do not make the inference hops necessary to explain a c…
Multi-hop Question AnsweringQuestion AnsweringLK2022 at Qur’an QA 2022: Simple Transformers Model for Finding Answers to Questions from Qur’an
Question answering is a specialized area in the field of NLP that aims to extract the answer to a user question from a given text. Most studies in this area focus on the English language, while other languages, such as A…
Question AnsweringReading ComprehensionQuestion answering using deep learning in low resource Indian language Marathi
Precise answers are extracted from a text for a given input question in a question answering system. Marathi question answering system is created in recent studies by using ontology, rule base and machine learning based …
Question AnsweringReading ComprehensionTransfer Learning