Monolingual versus Multilingual BERTology for Vietnamese Extractive Multi-Document Summarization
Recent researches have demonstrated that BERT shows potential in a wide range of natural language processing tasks. It is adopted as an encoder for many state-of-the-art automatic summarizing systems, which achieve excellent performance. However, so far, there is not much work done for Vietnamese. In this paper, we showcase how BERT can be implemented for extractive text summarization in Vietnamese on multi-document. We introduce a novel comparison between different multilingual and monolingual BERT models. The experiment results indicate that monolingual models produce promising results compared to other multilingual models and previous text summarizing models for Vietnamese.
Code (0)
등록된 구현이 없습니다.
Tasks
Document SummarizationExtractive Text SummarizationMulti-Document SummarizationText SummarizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Monolingual vs multilingual BERTology for Vietnamese extractive multi-document summarization
SMTCE: A Social Media Text Classification Evaluation Benchmark and BERTology Models for Vietnamese
Text classification is a typical natural language processing or computational linguistics task with various interesting applications. As the number of users on social media platforms increases, data acceleration promotes…
Classificationtext-classificationText ClassificationXLM-RViCGCN: Graph Convolutional Network with Contextualized Language Models for Social Media Mining in Vietnamese
Social media processing is a fundamental task in natural language processing with numerous applications. As Vietnamese social media and information science have grown rapidly, the necessity of information-based mining on…
Language Modellingtext-classificationText ClassificationVietnamese Social Media Text ProcessingInvestigating Monolingual and Multilingual BERTModels for Vietnamese Aspect Category Detection
Aspect category detection (ACD) is one of the challenging tasks in the Aspect-based sentiment Analysis problem. The purpose of this task is to identify the aspect categories mentioned in user-generated reviews from a set…
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Aspect Category DetectionSentiment AnalysisRevealing Weaknesses of Vietnamese Language Models Through Unanswerable Questions in Machine Reading Comprehension
Although the curse of multilinguality significantly restricts the language abilities of multilingual models in monolingual settings, researchers now still have to rely on multilingual models to develop state-of-the-art s…
Machine Reading ComprehensionReading ComprehensionVietnamese Language ModelsVietnamese Machine Reading Comprehension