State-of-the-Art Vietnamese Word Segmentation
Word segmentation is the first step of any tasks in Vietnamese language processing. This paper reviews stateof-the-art approaches and systems for word segmentation in Vietnamese. To have an overview of all stages from building corpora to developing toolkits, we discuss building the corpus stage, approaches applied to solve the word segmentation and existing toolkits to segment words in Vietnamese sentences. In addition, this study shows clearly the motivations on building corpus and implementing machine learning techniques to improve the accuracy for Vietnamese word segmentation. According to our observation, this study also reports a few of achivements and limitations in existing Vietnamese word segmentation systems.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningSegmentationVietnamese Word SegmentationSimilar Papers 제목 키워드 기반
A neural joint model for Vietnamese word segmentation, POS tagging and dependency parsing
We propose the first multi-task learning model for joint Vietnamese word segmentation, part-of-speech (POS) tagging and dependency parsing. In particular, our model extends the BIST graph-based dependency parser (Kiperwa…
Dependency ParsingMulti-Task LearningPart-Of-Speech TaggingPOS+3Span Labeling Approach for Vietnamese and Chinese Word Segmentation
In this paper, we propose a span labeling approach to model n-gram information for Vietnamese word segmentation, namely SPAN SEG. We compare the span labeling approach with the conditional random field by using encoders …
Chinese Word SegmentationLanguage ModelingLanguage ModellingSegmentation+1Vietnamese Word Segmentation with SVM: Ambiguity Reduction and Suffix Capture
In this paper, we approach Vietnamese word segmentation as a binary classification by using the Support Vector Machine classifier. We inherit features from prior works such as n-gram of syllables, n-gram of syllable type…
Binary ClassificationSegmentationVietnamese DatasetsVietnamese Word SegmentationIs word segmentation necessary for Vietnamese sentiment classification?
To the best of our knowledge, this paper made the first attempt to answer whether word segmentation is necessary for Vietnamese sentiment classification. To do this, we presented five pre-trained monolingual S4- based la…
ClassificationSegmentationSentiment AnalysisSentiment ClassificationA hybrid approach to Vietnamese word segmentation
Word segmentation is the very first task for Vietnamese language processing. Word-segmented text is the input of almost other NLP tasks. This task faces some challenges due to specific characteristics of the language. As…
SegmentationSentenceVietnamese Word Segmentation