Sentence Segmentation for Classical Chinese Based on LSTM with Radical Embedding
In this paper, we develop a low than character feature embedding called radical embedding, and apply it on LSTM model for sentence segmentation of pre modern Chinese texts. The datasets includes over 150 classical Chinese books from 3 different dynasties and contains different literary styles. LSTM CRF model is a state of art method for the sequence labeling problem. Our new model adds a component of radical embedding, which leads to improved performances. Experimental results based on the aforementioned Chinese books demonstrates a better accuracy than earlier methods on sentence segmentation, especial in Tang Epitaph texts.
Code (0)
등록된 구현이 없습니다.
Tasks
SegmentationSentenceSentence segmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Bi-directional LSTM Recurrent Neural Network for Chinese Word Segmentation
Recurrent neural network(RNN) has been broadly applied to natural language processing(NLP) problems. This kind of neural network is designed for modeling sequential data and has been testified to be quite efficient in se…
ArticlesChinese Word SegmentationSegmentationDual Long Short-Term Memory Networks for Sub-Character Representation Learning
Characters have commonly been regarded as the minimal processing unit in Natural Language Processing (NLP). But many non-latin languages have hieroglyphic writing systems, involving a big alphabet with thousands or milli…
Chinese Word SegmentationRepresentation LearningSegmentationA Seq-to-Seq Transformer Premised Temporal Convolutional Network for Chinese Word Segmentation
The prevalent approaches of Chinese word segmentation task almost rely on the Bi-LSTM neural network. However, the methods based the Bi-LSTM have some inherent drawbacks: hard to parallel computing, little efficient in a…
Chinese Word SegmentationDecoderSegmentationSentenceRadical-Enhanced Chinese Character Embedding
We present a method to leverage radical for learning Chinese character embedding. Radical is a semantic and phonetic component of Chinese character. It plays an important role as characters with the same radical usually …
Chinese Word SegmentationIntegration of Automatic Sentence Segmentation and Lexical Analysis of Ancient Chinese based on BiLSTM-CRF Model
The basic tasks of ancient Chinese information processing include automatic sentence segmentation, word segmentation, part-of-speech tagging and named entity recognition. Tasks such as lexical analysis need to be based o…
Lexical Analysisnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+4