Bootstrap Domain-Specific Sentiment Classifiers from Unlabeled Corpora
There is often the need to perform sentiment classification in a particular domain where no labeled document is available. Although we could make use of a general-purpose off-the-shelf sentiment classifier or a pre-built one for a different domain, the effectiveness would be inferior. In this paper, we explore the possibility of building domain-specific sentiment classifiers with unlabeled documents only. Our investigation indicates that in the word embeddings learned from the unlabeled corpus of a given domain, the distributed word representations (vectors) for opposite sentiments form distinct clusters, though those clusters are not transferable across domains. Exploiting such a clustering structure, we are able to utilize machine learning algorithms to induce a quality domain-specific sentiment lexicon from just a few typical sentiment words ({``}seeds{''}). An important finding is that simple linear model based supervised learning algorithms (such as linear SVM) can actually work better than more sophisticated semi-supervised/transductive learning algorithms which represent the state-of-the-art technique for sentiment lexicon induction. The induced lexicon could be applied directly in a lexicon-based method for sentiment classification, but a higher performance could be achieved through a two-phase bootstrapping method which uses the induced lexicon to assign positive/negative sentiment scores to unlabeled documents first, a nd t hen u ses those documents found to have clear sentiment signals as pseudo-labeled examples to train a document sentiment classifier v ia supervised learning algorithms (such as LSTM). On several benchmark datasets for document sentiment classification, our end-to-end pipelined approach which is overall unsupervised (except for a tiny set of seed words) outperforms existing unsupervised approaches and achieves an accuracy comparable to that of fully supervised approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringGeneral ClassificationSentiment AnalysisSentiment ClassificationTransductive LearningWord EmbeddingsSimilar Papers 제목 키워드 기반
Bootstrapping Sentiment Labels For Unannotated Documents With Polarity PageRank
We present a novel graph-theoretic method for the initial annotation of high-confidence training data for bootstrapping sentiment classifiers. We estimate polarity using topic-specific PageRank. Sentiment information is …
Document ClassificationGeneral ClassificationSentiment AnalysisActive Sentiment Domain Adaptation
Domain adaptation is an important technology to handle domain dependence problem in sentiment analysis field. Existing methods usually rely on sentiment classifiers trained in source domains. However, their performance m…
Active LearningDomain AdaptationSentiment AnalysisTransfer LearningPerformance Evaluation of Machine Learning Classifiers in Sentiment Mining
In recent years, the use of machine learning classifiers is of great value in solving a variety of problems in text classification. Sentiment mining is a kind of text classification in which, messages are classified acco…
BIG-bench Machine LearningClassificationGeneral Classificationtext-classification+1Adaptive Semi-supervised Learning for Cross-domain Sentiment Classification
We consider the cross-domain sentiment classification problem, where a sentiment classifier is to be learned from a source domain and to be generalized to a target domain. Our approach explicitly minimizes the distance b…
ClassificationGeneral ClassificationSentiment AnalysisSentiment ClassificationPretraining Sentiment Classifiers with Unlabeled Dialog Data
The huge cost of creating labeled training data is a common problem for supervised learning tasks such as sentiment classification. Recent studies showed that pretraining with unlabeled data via a language model can impr…
ClassificationDecoderGeneral ClassificationLanguage Modeling+3