Deep Transfer Learning Baselines for Sentiment Analysis in Russian
Recently, transfer learning from pre-trained language models has proven to be effective in a variety of natural language processing tasks, including sentiment analysis. This paper aims at identifying deep transfer learning baselines for sentiment analysis in Russian. Firstly, we identified the most used publicly available sentiment analysis datasets in Russian and recent language models which officially support the Russian language. Secondly, we fine-tuned Multilingual Bidirectional Encoder Representations from Transformers (BERT), RuBERT, and two versions of the Multilingual Universal Sentence Encoder and obtained strong, or even new, state-of-the-art results on seven sentiment datasets in Russian: SentRuEval-2016, SentiRuEval-2015, RuTweetCorp, RuSentiment, LINIS Crowd, and Kaggle Russian News Dataset, and RuReviews. Lastly, we made fine-tuned models publicly available for the research community.
Code (1)
Tasks
SentenceSentiment AnalysisTransfer LearningSimilar Papers 제목 키워드 기반
Transfer Learning for Improving Results on Russian Sentiment Datasets
In this study, we test transfer learning approach on Russian sentiment benchmark datasets using additional train sample created with distant supervision technique. We compare several variants of combining additional data…
Natural Language InferenceSentiment AnalysisSentiment ClassificationTransfer LearningRuSentiment: An Enriched Sentiment Analysis Dataset for Social Media in Russian
This paper presents RuSentiment, a new dataset for sentiment analysis of social media posts in Russian, and a new set of comprehensive annotation guidelines that are extensible to other languages. RuSentiment is currentl…
Active LearningGeneral ClassificationSentiment AnalysisWord EmbeddingsAdaptation of Deep Bidirectional Multilingual Transformers for Russian Language
The paper introduces methods of adaptation of multilingual masked language models for a specific language. Pre-trained bidirectional language models show state-of-the-art performance on a wide range of tasks including re…
Natural Language InferenceParaphrase IdentificationQuestion AnsweringReading Comprehension+2Current Landscape of the Russian Sentiment Corpora
Currently, there are more than a dozen Russian-language corpora for sentiment analysis, differing in the source of the texts, domain, size, number and ratio of sentiment classes, and annotation method. This work examines…
Sentiment AnalysisLANGUAGE MODEL EMBEDDINGS IMPROVE SENTIMENT ANALYSIS IN RUSSIAN
Sentiment analysis is one of the most popular natural language processing tasks. In this paper we introduce pre-trained Russian language models which are used to extract embeddings (ELMo) to improve accuracy for classifi…
ArticlesLanguage ModelingLanguage Modellingmodel+2