Domain adaptation for sequence labeling using hidden Markov models
Most natural language processing systems based on machine learning are not robust to domain shift. For example, a state-of-the-art syntactic dependency parser trained on Wall Street Journal sentences has an absolute drop in performance of more than ten points when tested on textual data from the Web. An efficient solution to make these methods more robust to domain shift is to first learn a word representation using large amounts of unlabeled data from both domains, and then use this representation as features in a supervised learning algorithm. In this paper, we propose to use hidden Markov models to learn word representations for part-of-speech tagging. In particular, we study the influence of using data from the source, the target or both domains to learn the representation and the different ways to represent words using an HMM.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationPart-Of-Speech TaggingSimilar Papers 제목 키워드 기반
Supervised Opinion Aspect Extraction by Exploiting Past Extraction Results
One of the key tasks of sentiment analysis of product reviews is to extract product aspects or features that users have expressed opinions on. In this work, we focus on using supervised sequence labeling as the base appr…
Aspect ExtractionSentiment AnalysisFine-grained Knowledge Fusion for Sequence Labeling Domain Adaptation
In sequence labeling, previous domain adaptation methods focus on the adaptation from the source domain to the entire target domain without considering the diversity of individual target domain samples, which may lead to…
DiversityDomain AdaptationLearning Hidden Markov Models with Distributed State Representations for Domain Adaptation
Scalable Adaptation of State Complexity for Nonparametric Hidden Markov Models
Bayesian nonparametric hidden Markov models are typically learned via fixed truncations of the infinite state space or local Monte Carlo proposals that make small changes to the state space. We develop an inference algor…
speaker-diarizationSpeaker DiarizationMouse Movement and Probabilistic Graphical Models Based E-Learning Activity Recognition Improvement Possibilistic Model
Automatically recognizing the e-learning activities is an important task for improving the online learning process. Probabilistic graphical models such as hidden Markov models and conditional random fields have been succ…
Activity Recognition