Papers Japanese Word Segmentation
“Japanese Word Segmentation” 태그가 달린 논문 7편 · 필터 해제
LATTE: Lattice ATTentive Encoding for Character-based Word Segmentation
A character sequence comprises at least one or more segmentation alternatives. This can be considered segmentation ambiguity and may weaken segmentation performance in word segmentation. Proper handling of such ambiguity…
Chinese Word SegmentationJapanese Word SegmentationSegmentationThai Word SegmentationWord Segmentation by Separation Inference for East Asian Languages
Chinese Word Segmentation (CWS) intends to divide a raw sentence into words through sequence labeling. Thinking in reverse, CWS can also be viewed as a process of grouping a sequence of characters into a sequence of word…
Chinese Word SegmentationJapanese Word SegmentationSegmentationSentenceA Text Editing Approach to Joint Japanese Word Segmentation, POS Tagging, and Lexical Normalization
Lexical normalization, in addition to word segmentation and part-of-speech tagging, is a fundamental task for Japanese user-generated text processing. In this paper, we propose a text editing model to solve the three tas…
Japanese Word SegmentationLexical NormalizationPart-Of-Speech TaggingPOS+1Character Feature Engineering for Japanese Word Segmentation
On word segmentation problems, machine learning architecture engineering often draws attention. The problem representation itself, however, has remained almost static as either word lattice ranking or character sequence …
Active LearningFeature EngineeringJapanese Word SegmentationA Japanese Word Segmentation Proposal
Current Japanese word segmentation methods, that use a morpheme-based approach, may produce different segmentations for the same strings. This occurs when these strings appear in different sentences. The cause is the inf…
Japanese Word SegmentationSegmentationSentenceIncorporating Word Attention into Character-Based Word Segmentation
Neural network models have been actively applied to word segmentation, especially Chinese, because of the ability to minimize the effort in feature engineering. Typical segmentation models are categorized as character-ba…
Feature EngineeringJapanese Word SegmentationSegmentationLong Short-Term Memory for Japanese Word Segmentation
This study presents a Long Short-Term Memory (LSTM) neural network approach to Japanese word segmentation (JWS). Previous studies on Chinese word segmentation (CWS) succeeded in using recurrent neural networks such as LS…
Chinese Word SegmentationJapanese Word SegmentationSegmentation