Using a Goodness Measurement for Domain Adaptation: A Case Study on Chinese Word Segmentation
Domain adaptation is an important topic for natural language processing. There has been extensive research on the topic and various methods have been explored, including training data selection, model combination, semi-supervised learning. In this study, we propose to use a goodness measure, namely, description length gain (DLG), for domain adaptation for Chinese word segmentation. We demonstrate that DLG can help domain adaptation in two ways: as additional features for supervised segmenters to improve system performance, and also as a similarity measure for selecting training data to better match a test set. We evaluated our systems on the Chinese Penn Treebank version 7.0, which has 1.2 million words from five different genres, and the Chinese Word Segmentation Bakeoff-3 data.
Code (0)
등록된 구현이 없습니다.
Tasks
Chinese Word SegmentationDomain AdaptationSegmentationSimilar Papers 제목 키워드 기반
Investigating a domain adaptation approach for integrating different measurement instruments in a longitudinal clinical registry
In a longitudinal clinical registry, different measurement instruments might have been used for assessing individuals at different time points. To combine them, we investigate deep learning techniques for obtaining a joi…
Domain AdaptationInterpreting DNN output layer activations: A strategy to cope with unseen data in speech recognition
Unseen data can degrade performance of deep neural net acoustic models. To cope with unseen data, adaptation techniques are deployed. For unlabeled unseen data, one must generate some hypothesis given an existing model, …
speech-recognitionSpeech RecognitionKRADA: Known-region-aware Domain Alignment for Open-set Domain Adaptation in Semantic Segmentation
In semantic segmentation, we aim to train a pixel-level classifier to assign category labels to all pixels in an image, where labeled training images and unlabeled test images are from the same distribution and share the…
Domain AdaptationSegmentationSemantic SegmentationCase Study of Novelty, Complexity, and Adaptation in a Multicellular System
Continuing generation of novelty, complexity, and adaptation are well-established as core aspects of open-ended evolution. However, it has yet to be firmly established to what extent these phenomena are coupled and by wh…
On the Optimality of Kernel-Embedding Based Goodness-of-Fit Tests
The reproducing kernel Hilbert space (RKHS) embedding of distributions offers a general and flexible framework for testing problems in arbitrary domains and has attracted considerable amount of attention in recent years.…