A Systematic Comparison of Architectures for Document-Level Sentiment Classification
Documents are composed of smaller pieces - paragraphs, sentences, and tokens - that have complex relationships between one another. Sentiment classification models that take into account the structure inherent in these documents have a theoretical advantage over those that do not. At the same time, transfer learning models based on language model pretraining have shown promise for document classification. However, these two paradigms have not been systematically compared and it is not clear under which circumstances one approach is better than the other. In this work we empirically compare hierarchical models and transfer learning for document-level sentiment classification. We show that non-trivial hierarchical models outperform previous baselines and transfer learning on document-level sentiment classification in five languages.
Code (1)
Tasks
ClassificationDocument ClassificationGeneral ClassificationLanguage ModelingLanguage ModellingSentiment AnalysisSentiment ClassificationTransfer LearningSimilar Papers 제목 키워드 기반
A Comparison of Approaches to Document-level Machine Translation
Document-level machine translation conditions on surrounding sentences to produce coherent translations. There has been much recent work in this area with the introduction of custom model architectures and decoding algor…
Document Level Machine TranslationMachine TranslationTranslationLeveraging Auxiliary Tasks for Document-Level Cross-Domain Sentiment Classification
In this paper, we study domain adaptation with a state-of-the-art hierarchical neural network for document-level sentiment classification. We first design a new auxiliary task based on sentiment scores of domain-independ…
ClassificationDenoisingDomain AdaptationGeneral Classification+5Sentiment Lexicon Construction with Representation Learning Based on Hierarchical Sentiment Supervision
Sentiment lexicon is an important tool for identifying the sentiment polarity of words and texts. How to automatically construct sentiment lexicons has become a research topic in the field of sentiment analysis and opini…
Opinion MiningRepresentation LearningSentiment AnalysisSentiment Classification+1Multimodal Approaches for Visually-Rich Document Type Classification: A Comparative Analysis
Document type classification in visually rich documents remains challenging, as relevant information is distributed across textual, visual, and layout modalities. To capture this complexity, current approaches rely on di…
Document-level Neural MT: A Systematic Comparison
In this paper we provide a systematic comparison of existing and new document-level neural machine translation solutions. As part of this comparison, we introduce and evaluate a document-level variant of the recently pro…
Machine TranslationTranslation