Sentiment Classification Using Document Embeddings Trained with Cosine Similarity
In document-level sentiment classification, each document must be mapped to a fixed length vector. Document embedding models map each document to a dense, low-dimensional vector in continuous vector space. This paper proposes training document embeddings using cosine similarity instead of dot product. Experiments on the IMDB dataset show that accuracy is improved when using cosine similarity compared to using dot product, while using feature combination with Naive Bayes weighted bag of n-grams achieves a new state of the art accuracy of 97.42{\%}. Code to reproduce all experiments is available at https://github.com/tanthongtan/dv-cosine
Code (2)
Tasks
ClassificationDocument EmbeddingGeneral ClassificationSentiment AnalysisSentiment ClassificationSimilar Papers 제목 키워드 기반
Leveraging Auxiliary Tasks for Document-Level Cross-Domain Sentiment Classification
In this paper, we study domain adaptation with a state-of-the-art hierarchical neural network for document-level sentiment classification. We first design a new auxiliary task based on sentiment scores of domain-independ…
ClassificationDenoisingDomain AdaptationGeneral Classification+5Learning Word Embeddings for Data Sparse and Sentiment Rich Data Sets
This research proposal describes two algorithms that are aimed at learning word embeddings for data sparse and sentiment rich data sets. The goal is to use word embeddings adapted for domain specific data sets in downstr…
General ClassificationLearning Word EmbeddingsSentiment AnalysisSentiment Classification+2Hybrid Improved Document-level Embedding (HIDE)
In recent times, word embeddings are taking a significant role in sentiment analysis. As the generation of word embeddings needs huge corpora, many applications use pretrained embeddings. In spite of the success, word em…
Sentiment AnalysisWord EmbeddingsLex2Sent: A bagging approach to unsupervised sentiment analysis
Unsupervised sentiment analysis is traditionally performed by counting those words in a text that are stored in a sentiment lexicon and then assigning a label depending on the proportion of positive and negative words re…
Sentiment AnalysisAdapted Sentiment Similarity Seed Words For French Tweets' Polarity Classification
We present, in this paper, our contribution in DEFT 2018 task 2 : {``}Global polarity{''}, determining the overall polarity (Positive, Negative, Neutral or MixPosNeg) of tweets regarding public transport, in French langu…
General ClassificationTask 2Word Embeddings