Quality of Word Embeddings on Sentiment Analysis Tasks

2020-03-06 · Erion Çano, Maurizio Morisio

Word embeddings or distributed representations of words are being used in various applications like machine translation, sentiment analysis, topic identification etc. Quality of word embeddings and performance of their applications depends on several factors like training method, corpus size and relevance etc. In this study we compare performance of a dozen of pretrained word embedding models on lyrics sentiment analysis and movie review polarity tasks. According to our results, Twitter Tweets is the best on lyrics sentiment analysis, whereas Google News and Common Crawl are the top performers on movie polarity analysis. Glove trained models slightly outrun those trained with Skipgram. Also, factors like topic relevance and size of corpus significantly impact the quality of the models. When medium or large-sized text sets are available, obtaining word embeddings from same training dataset is usually the best choice.

📄 PDF Abstract BibTeX arXiv:2003.03264

Code (0)

등록된 구현이 없습니다.

Tasks

Machine Translation Sentiment Analysis TranslationWord Embeddings

Methods 이 논문이 사용한 방법론

GloVe GloVe Embeddings are a type of word embedding that encode the co-occurrence probability ratio between two words as vector differences. GloVe uses a weighted least squares…

Simple Algorithms For Sentiment Analysis On Sentiment Rich, Data Poor Domains.

2018-08-01 · COLING 2018 8 · Prathusha K Sarma, William Sethares

Standard word embedding algorithms learn vector representations from large corpora of text documents in an unsupervised fashion. However, the quality of word embeddings learned from these algorithms is affected by the si…

Sentiment Analysis Text Classification Word Embeddings

Sentiment Analysis by Joint Learning of Word Embeddings and Classifier

2017-08-14 · Prathusha Kameswara Sarma, Bill Sethares

Word embeddings are representations of individual words of a text document in a vector space and they are often use- ful for performing natural language pro- cessing tasks. Current state of the art al- gorithms for learn…

Learning Word Embeddings Sentiment Analysis Word Embeddings

Learning Word Embeddings for Data Sparse and Sentiment Rich Data Sets

2018-06-01 · NAACL 2018 6 · Prathusha Kameswara Sarma

This research proposal describes two algorithms that are aimed at learning word embeddings for data sparse and sentiment rich data sets. The goal is to use word embeddings adapted for domain specific data sets in downstr…

General Classification Learning Word Embeddings Sentiment Analysis Sentiment Classification+2

Improving the Accuracy of Pre-trained Word Embeddings for Sentiment Analysis

2017-11-23 · Seyed Mahdi Rezaeinia, Ali Ghodsi, Rouhollah Rahmani

Sentiment analysis is one of the well-known tasks and fast growing research areas in natural language processing (NLP) and text classifications. This technique has become an essential part of a wide range of applications…

Marketing Part-Of-Speech Tagging POS POS Tagging+3

Refining Word Embeddings for Sentiment Analysis

2017-09-01 · EMNLP 2017 9 · Liang-Chih Yu, Jin Wang, K. Robert Lai, Xue-jie Zhang

Word embeddings that can capture semantic and syntactic information from contexts have been extensively used for various natural language processing tasks. However, existing methods for learning context-based word embedd…