paper-with-me

홈 › Papers

Sentiment Analysis of Lithuanian Online Reviews Using Large Language Models

2024-07-29 · Brigita Vileikytė, Mantas Lukoševičius, Lukas Stankevičius

Sentiment analysis is a widely researched area within Natural Language Processing (NLP), attracting significant interest due to the advent of automated solutions. Despite this, the task remains challenging because of the inherent complexity of languages and the subjective nature of sentiments. It is even more challenging for less-studied and less-resourced languages such as Lithuanian. Our review of existing Lithuanian NLP research reveals that traditional machine learning methods and classification algorithms have limited effectiveness for the task. In this work, we address sentiment analysis of Lithuanian five-star-based online reviews from multiple domains that we collect and clean. We apply transformer models to this task for the first time, exploring the capabilities of pre-trained multilingual Large Language Models (LLMs), specifically focusing on fine-tuning BERT and T5 models. Given the inherent difficulty of the task, the fine-tuned models perform quite well, especially when the sentiments themselves are less ambiguous: 80.74% and 89.61% testing recognition accuracy of the most popular one- and five-star reviews respectively. They significantly outperform current commercial state-of-the-art general-purpose LLM GPT-4. We openly share our fine-tuned LLMs online.

📄 PDF Abstract BibTeX arXiv:2407.19914

Code (0)

등록된 구현이 없습니다.

Tasks

Sentiment Analysis

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Inverse Square Root Schedule Inverse Square Root is a learning rate schedule 1 / $\sqrt{\max\left(n, k\right)}$ where $n$ is the current training iteration and $k$ is the number of warm-up steps. This…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
WordPiece 설명 없음

Similar Papers 제목 키워드 기반

NLP Infrastructure for the Lithuanian Language

2016-05-01 · LREC 2016 5 · Daiva Vitkut{\.e}-Ad{\v{z}}gauskien{\.e}, Andrius Utka, Darius Amilevi{\v{c}}ius, Tomas Krilavi{\v{c}}ius

The Information System for Syntactic and Semantic Analysis of the Lithuanian language (lith. Lietuvi{\k{u}} kalbos sintaksin{\.e}s ir semantin{\.e}s analiz{\.e}s informacin{\.e} sistema, LKSSAIS) is the first infrastruct…

Managementnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1

An Ensemble of Humour, Sarcasm, and Hate Speechfor Sentiment Classification in Online Reviews

2019-11-01 · WS 2019 11 · Rohan Badlani, Nishit Asnani, Manan Rai

Due to the nature of online user reviews, sentiment analysis on such data requires a deep semantic understanding of the text. Many online reviews are sarcastic, humorous, or hateful. Signals from such language nuances ma…

General ClassificationSentiment AnalysisSentiment Classification

Sentiment Analysis Of Shopee Product Reviews Using Distilbert

2025-11-27 · Zahri Aksa Dautd, Aviv Yuniar Rahman arxiv

The rapid growth of digital commerce has led to the accumulation of a massive number of consumer reviews on online platforms. Shopee, as one of the largest e-commerce platforms in Southeast Asia, receives millions of pro…

Sentiment Analysis

Sentiment Analysis on Customer Responses

2020-07-05 · Antony Samuels, John Mcgonical

Sentiment analysis is one of the fastest spreading research areas in computer science, making it challenging to keep track of all the activities in the area. We present a customer feedback reviews on product, where we ut…

Opinion MiningSentiment Analysis

Unifying Topic, Sentiment & Preference in an HDP-Based Rating Regression Model for Online Reviews

2018-12-19 · Zheng Chen, Yong Zhang, Yue Shang, Xiaohua Hu

This paper proposes a new HDP based online review rating regression model named Topic-Sentiment-Preference Regression Analysis (TSPRA). TSPRA combines topics (i.e. product aspects), word sentiment and user preference as …

ClusteringCollaborative FilteringOnline Review Ratingregression+1