Encoding Explanatory Knowledge for Zero-shot Science Question Answering
This paper describes N-XKT (Neural encoding based on eXplanatory Knowledge Transfer), a novel method for the automatic transfer of explanatory knowledge through neural encoding mechanisms. We demonstrate that N-XKT is able to improve accuracy and generalization on science Question Answering (QA). Specifically, by leveraging facts from background explanatory knowledge corpora, the N-XKT model shows a clear improvement on zero-shot QA. Furthermore, we show that N-XKT can be fine-tuned on a target QA dataset, enabling faster convergence and more accurate results. A systematic analysis is conducted to quantitatively analyze the performance of the N-XKT model and the impact of different categories of knowledge on the zero-shot generalization task.
Code (0)
등록된 구현이 없습니다.
Tasks
Question AnsweringScience Question AnsweringTransfer LearningZero-shot GeneralizationSimilar Papers 제목 키워드 기반
Explanatory Instructions: Towards Unified Vision Tasks Understanding and Zero-shot Generalization
Computer Vision (CV) has yet to fully achieve the zero-shot task generalization observed in Natural Language Processing (NLP), despite following many of the milestones established in NLP, such as large transformer models…
Image SegmentationSemantic SegmentationZero-shot GeneralizationSIGN: Spatial-information Incorporated Generative Network for Generalized Zero-shot Semantic Segmentation
Unlike conventional zero-shot classification, zero-shot semantic segmentation predicts a class label at the pixel level instead of the image level. When solving zero-shot semantic segmentation problems, the need for pixe…
Knowledge DistillationSegmentationSemantic Segmentationzero-shot-classification+2Multi-label Few/Zero-shot Learning with Knowledge Aggregated from Multiple Label Graphs
Few/Zero-shot learning is a big challenge of many classifications tasks, where a classifier is required to recognise instances of classes that have very few or even no training samples. It becomes more difficult in multi…
Document ClassificationGeneral ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+2OAG-BERT: Towards A Unified Backbone Language Model For Academic Knowledge Services
Academic knowledge services have substantially facilitated the development of the science enterprise by providing a plenitude of efficient research tools. However, many applications highly depend on ad-hoc models and exp…
Language ModelingLanguage ModellingLink PredictionGenerating Zero-shot Abstractive Explanations for Rumour Verification
The task of rumour verification in social media concerns assessing the veracity of a claim on the basis of conversation threads that result from it. While previous work has focused on predicting a veracity label, here we…
Few-Shot LearningInformativenessLanguage ModelingLanguage Modelling+1