Introducing a Large-Scale Dataset for Vietnamese POS Tagging on Conversational Texts
This paper introduces a large-scale human-labeled dataset for the Vietnamese POS tagging task on conversational texts. To this end, wepropose a new tagging scheme (with 36 POS tags) consisting of exclusive tags for special phenomena of conversational words, developthe annotation guideline and manually annotate 16.310K sentences using this guideline. Based on this corpus, a series of state-of-the-art tagging methods has been conducted to estimate their performances. Experimental results showed that the Conditional Random Fields model using both automatically learnt features from deep neural networks and handcrafted features yielded the best performance. Thismodel achieved 93.36{\%} in the accuracy score which is 1.6{\%} and 2.7{\%} higher than the model using either handcrafted features orautomatically-learnt features, respectively. This result is also a little bit higher than the model of fine-tuning BERT by 0.94{\%} in theaccuracy score. The performance measured on each POS tag is also very high with {\textgreater}90{\%} in the F1 score for 20 POS tags and {\textgreater}80{\%}in the F1 score for 11 POS tags. This work provides the public dataset and preliminary results for follow-up research on this interesting direction.
Code (0)
등록된 구현이 없습니다.
Tasks
POSPOS TaggingTAGMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A neural joint model for Vietnamese word segmentation, POS tagging and dependency parsing
We propose the first multi-task learning model for joint Vietnamese word segmentation, part-of-speech (POS) tagging and dependency parsing. In particular, our model extends the BIST graph-based dependency parser (Kiperwa…
Dependency ParsingMulti-Task LearningPart-Of-Speech TaggingPOS+3PhoBERT: Pre-trained language models for Vietnamese
We present PhoBERT with two versions, PhoBERT-base and PhoBERT-large, the first public large-scale monolingual language models pre-trained for Vietnamese. Experimental results show that PhoBERT consistently outperforms t…
Dependency Parsingnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+4Augmenting Part-of-speech Tagging with Syntactic Information for Vietnamese and Chinese
Word segmentation and part-of-speech tagging are two critical preliminary steps for downstream tasks in Vietnamese natural language processing. In reality, people tend to consider also the phrase boundary when performing…
Part-Of-Speech TaggingSegmentationPhoNLP: A joint multi-task learning model for Vietnamese part-of-speech tagging, named entity recognition and dependency parsing
We present the first multi-task learning model -- named PhoNLP -- for joint Vietnamese part-of-speech (POS) tagging, named entity recognition (NER) and dependency parsing. Experiments on Vietnamese benchmark datasets sho…
Dependency ParsingLanguage ModelingLanguage ModellingMulti-Task Learning+7ViSoBERT: A Pre-Trained Language Model for Vietnamese Social Media Text Processing
English and Chinese, known as resource-rich languages, have witnessed the strong development of transformer-based language models for natural language processing tasks. Although Vietnam has approximately 100M people spea…
Language ModelingLanguage ModellingVietnamese Hate Speech DetectionVietnamese Language Models+2