Improving Chinese Segmentation-free Word Embedding With Unsupervised Association Measure
Recent work on segmentation-free word embedding(sembei) developed a new pipeline of word embedding for unsegmentated language while avoiding segmentation as a preprocessing step. However, too many noisy n-grams existing in the embedding vocabulary that do not have strong association strength between characters would limit the quality of learned word embedding. To deal with this problem, a new version of segmentation-free word embedding model is proposed by collecting n-grams vocabulary via a novel unsupervised association measure called pointwise association with times information(PATI). Comparing with the commonly used n-gram filtering method like frequency used in sembei and pointwise mutual information(PMI), the proposed method leverages more latent information from the corpus and thus is able to collect more valid n-grams that have stronger cohesion as embedding targets in unsegmented language data, such as Chinese texts. Further experiments on Chinese SNS data show that the proposed model improves performance of word embedding in downstream tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
SegmentationvalidSimilar Papers 제목 키워드 기반
Segmentation-Free Word Embedding for Unsegmented Languages
In this paper, we propose a new pipeline of word embedding for unsegmented languages, called segmentation-free word embedding, which does not require word segmentation as a preprocessing step. Unlike space-delimited lang…
Machine TranslationSegmentationSegmentation-free Compositional $n$-gram Embedding
We propose a new type of representation learning method that models words, phrases and sentences seamlessly. Our method does not depend on word segmentation and any human-annotated resources (e.g., word dictionaries), ye…
Representation LearningSegmentationWord EmbeddingsImproving Cross-Domain Chinese Word Segmentation with Word Embeddings
Cross-domain Chinese Word Segmentation (CWS) remains a challenge despite recent progress in neural-based CWS. The limited amount of annotated data in the target domain has been the key obstacle to a satisfactory performa…
Chinese Word SegmentationSegmentationWord EmbeddingsWord-like character n-gram embedding
We propose a new word embedding method called \textit{word-like character} n\textit{-gram embedding}, which learns distributed representations of words by embedding word-like character n-grams. Our method is an extension…
SegmentationWord EmbeddingsEffective Subword Segmentation for Text Comprehension
Representation learning is the foundation of machine reading comprehension and inference. In state-of-the-art models, character-level representations have been broadly adopted to alleviate the problem of effectively repr…
Machine Reading ComprehensionReading ComprehensionRepresentation LearningSegmentation