Contextual and Position-Aware Factorization Machines for Sentiment Classification
While existing machine learning models have achieved great success for sentiment classification, they typically do not explicitly capture sentiment-oriented word interaction, which can lead to poor results for fine-grained analysis at the snippet level (a phrase or sentence). Factorization Machine provides a possible approach to learning element-wise interaction for recommender systems, but they are not directly applicable to our task due to the inability to model contexts and word sequences. In this work, we develop two Position-aware Factorization Machines which consider word interaction, context and position information. Such information is jointly encoded in a set of sentiment-oriented word interaction vectors. Compared to traditional word embeddings, SWI vectors explicitly capture sentiment-oriented word interaction and simplify the parameter learning. Experimental results show that while they have comparable performance with state-of-the-art methods for document-level classification, they benefit the snippet/sentence-level sentiment analysis.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationPositionRecommendation SystemsSentenceSentiment AnalysisSentiment ClassificationWord EmbeddingsSimilar Papers 제목 키워드 기반
attr2vec: Jointly Learning Word and Contextual Attribute Embeddings with Factorization Machines
The widespread use of word embeddings is associated with the recent successes of many natural language processing (NLP) systems. The key approach of popular models such as word2vec and GloVe is to learn dense vector repr…
AttributeDependency ParsingInformation RetrievalMachine Translation+5Hierarchical Attention Based Position-Aware Network for Aspect-Level Sentiment Analysis
Aspect-level sentiment analysis aims to identify the sentiment of a specific target in its context. Previous works have proved that the interactions between aspects and the contexts are important. On this basis, we also …
Aspect-Based Sentiment Analysis (ABSA)Feature EngineeringPositionSentence+1Field-aware factorization machines for CTR prediction
Click-through rate (CTR) prediction plays an important role in computational advertising. Models based on degree-2 polynomial mappings and factorization machines (FMs) are widely used for this task. Recently, a varian…
Click-Through Rate PredictionPredictionRecommendation SystemsAn Introduction to Matrix factorization and Factorization Machines in Recommendation System, and Beyond
This paper aims at a better understanding of matrix factorization (MF), factorization machines (FM), and their combination with deep algorithms' application in recommendation systems. Specifically, this paper will focus …
Recommendation Systems