Enhancing lexical-based approach with external knowledge for Vietnamese multiple-choice machine reading comprehension
Although Vietnamese is the 17th most popular native-speaker language in the world, there are not many research studies on Vietnamese machine reading comprehension (MRC), the task of understanding a text and answering questions about it. One of the reasons is because of the lack of high-quality benchmark datasets for this task. In this work, we construct a dataset which consists of 2,783 pairs of multiple-choice questions and answers based on 417 Vietnamese texts which are commonly used for teaching reading comprehension for elementary school pupils. In addition, we propose a lexical-based MRC method that utilizes semantic similarity measures and external knowledge sources to analyze questions and extract answers from the given text. We compare the performance of the proposed model with several baseline lexical-based and neural network-based models. Our proposed method achieves 61.81% by accuracy, which is 5.51% higher than the best baseline model. We also measure human performance on our dataset and find that there is a big gap between machine-model and human performances. This indicates that significant progress can be made on this task. The dataset is freely available on our website for research purposes.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine Reading ComprehensionMultiple-choiceReading ComprehensionSemantic SimilaritySemantic Textual SimilarityVietnamese Machine Reading ComprehensionSimilar Papers 제목 키워드 기반
ViLexNorm: A Lexical Normalization Corpus for Vietnamese Social Media Text
Lexical normalization, a fundamental task in Natural Language Processing (NLP), involves the transformation of words into their canonical forms. This process has been proven to benefit various downstream NLP tasks greatl…
Lexical NormalizationVietnamese Lexical NormalizationVietnamese Social Media Text ProcessingViLLM-Eval: A Comprehensive Evaluation Suite for Vietnamese Large Language Models
The rapid advancement of large language models (LLMs) necessitates the development of new benchmarks to accurately assess their capabilities. To address this need for Vietnamese, this work aims to introduce ViLLM-Eval, t…
Language ModelingLanguage ModellingLarge Language ModelMultiple-choiceViSoLex: An Open-Source Repository for Vietnamese Social Media Lexical Normalization
ViSoLex is an open-source system designed to address the unique challenges of lexical normalization for Vietnamese social media text. The platform provides two core services: Non-Standard Word (NSW) Lookup and Lexical No…
Lexical NormalizationWeakly-supervised LearningPhonetic Modeling of Dialectal Variation in Vietnamese Speech
Vietnamese exhibits substantial dialectal phonetic variation across Northern, Central, and Southern regions, where identical lexical items may be realized with markedly different pronunciations. Such variation poses chal…
Speech RecognitionHMMs for Unsupervised Vietnamese WordSegmentation
Word segmentation is an important problem in nat-ural language processing. Most of previous works on Vietnameseword segmentation are supervised learning. In this paper, wepropose an unsupervised method for Vietnamese wor…
Segmentation