Pretraining and Fine-Tuning Strategies for Sentiment Analysis of Latvian Tweets
In this paper, we present various pre-training strategies that aid in im-proving the accuracy of the sentiment classification task. We, at first, pre-trainlanguage representation models using these strategies and then fine-tune them onthe downstream task. Experimental results on a time-balanced tweet evaluation setshow the improvement over the previous technique. We achieve 76% accuracy forsentiment analysis on Latvian tweets, which is a substantial improvement over pre-vious work
Code (1)
Tasks
Sentiment AnalysisSentiment ClassificationSimilar Papers 제목 키워드 기반
UIO at SemEval-2023 Task 12: Multilingual fine-tuning for sentiment classification in low-resource languages
Our contribution to the 2023 AfriSenti-SemEval shared task 12: Sentiment Analysis for African Languages, provides insight into how a multilingual large language model can be a resource for sentiment analysis in languages…
Language ModelingLanguage ModellingLarge Language ModelSentiment Analysis+1Bag of Tricks for Effective Language Model Pretraining and Downstream Adaptation: A Case Study on GLUE
This technical report briefly describes our JDExplore d-team's submission Vega v1 on the General Language Understanding Evaluation (GLUE) leaderboard, where GLUE is a collection of nine natural language understanding tas…
Contrastive LearningDenoisingLanguage ModelingLanguage Modelling+11Unified Instance and Knowledge Alignment Pretraining for Aspect-based Sentiment Analysis
Aspect-based Sentiment Analysis (ABSA) aims to determine the sentiment polarity towards an aspect. Because of the expensive and limited labelled data, the pretraining strategy has become the de-facto standard for ABSA. H…
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)RetrievalSentiment Analysis+1Pretraining Sentiment Classifiers with Unlabeled Dialog Data
The huge cost of creating labeled training data is a common problem for supervised learning tasks such as sentiment classification. Recent studies showed that pretraining with unlabeled data via a language model can impr…
ClassificationDecoderGeneral ClassificationLanguage Modeling+3Large-Scale Aspect-Based Sentiment Analysis with Reasoning-Infused LLMs
We introduce Arctic-ABSA, a collection of powerful models for real-life aspect-based sentiment analysis (ABSA). Our models are tailored to commercial needs, trained on a large corpus of public data alongside carefully ge…
Sentiment Analysis