Fine-Tuning BERT for Sentiment Analysis of Vietnamese Reviews

2020-11-20 · Quoc Thai Nguyen, Thoai Linh Nguyen, Ngoc Hoang Luong, Quoc Hung Ngo

Sentiment analysis is an important task in the field ofNature Language Processing (NLP), in which users' feedbackdata on a specific issue are evaluated and analyzed. Manydeep learning models have been proposed to tackle this task, including the recently-introduced Bidirectional Encoder Rep-resentations from Transformers (BERT) model. In this paper,we experiment with two BERT fine-tuning methods for thesentiment analysis task on datasets of Vietnamese reviews: 1) a method that uses only the [CLS] token as the input for anattached feed-forward neural network, and 2) another methodin which all BERT output vectors are used as the input forclassification. Experimental results on two datasets show thatmodels using BERT slightly outperform other models usingGloVe and FastText. Also, regarding the datasets employed inthis study, our proposed BERT fine-tuning method produces amodel with better performance than the original BERT fine-tuning method.

📄 PDF Abstract BibTeX arXiv:2011.10426

Code (1)

thoailinh/Sentiment-Analysis-using-BERT 공식 구현

Tasks

Sentiment Analysis

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

WordPiece 설명 없음

Multi-Head Attention 설명 없음

Weight Decay 설명 없음

Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

Residual Connection 설명 없음

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Expanding Vietnamese SentiWordNet to Improve Performance of Vietnamese Sentiment Analysis Models

2025-01-15 · Hong-Viet Tran, Van-Tan Bui, Lam-Quan Tran

Sentiment analysis is one of the most crucial tasks in Natural Language Processing (NLP), involving the training of machine learning models to classify text based on the polarity of opinions. Pre-trained Language Models …

Sentiment Analysis Sentiment Classification Vietnamese Sentiment Analysis

ViSoBERT: A Pre-Trained Language Model for Vietnamese Social Media Text Processing

2023-10-17 · Quoc-Nam Nguyen, Thang Chau Phan, Duc-Vu Nguyen, Kiet Van Nguyen

English and Chinese, known as resource-rich languages, have witnessed the strong development of transformer-based language models for natural language processing tasks. Although Vietnam has approximately 100M people spea…

Language Modeling Language Modelling Vietnamese Hate Speech Detection Vietnamese Language Models+2

Span Detection for Aspect-Based Sentiment Analysis in Vietnamese

2021-10-15 · Kim Thi-Thanh Nguyen, Sieu Khai Huynh, Luong Luc Phan, Phuc Huynh Pham 외

Aspect-based sentiment analysis plays an essential role in natural language processing and artificial intelligence. Recently, researchers only focused on aspect detection and sentiment classification but ignoring the sub…

Aspect-Based Sentiment Analysis Aspect-Based Sentiment Analysis (ABSA)Emotion Recognition Opinion Mining+3

New Benchmark Dataset and Fine-Grained Cross-Modal Fusion Framework for Vietnamese Multimodal Aspect-Category Sentiment Analysis

2024-05-01 · Quy Hoang Nguyen, Minh-Van Truong Nguyen, Kiet Van Nguyen

The emergence of multimodal data on social media platforms presents new opportunities to better understand user sentiments toward a given aspect. However, existing multimodal datasets for Aspect-Category Sentiment Analys…

Aspect Category Sentiment Analysis Multimodal Sentiment Analysis Sentiment Analysis Vietnamese Datasets+3

Investigating Monolingual and Multilingual BERTModels for Vietnamese Aspect Category Detection

2021-03-17 · Dang Van Thin, Lac Si Le, Vu Xuan Hoang, Ngan Luu-Thuy Nguyen

Aspect category detection (ACD) is one of the challenging tasks in the Aspect-based sentiment Analysis problem. The purpose of this task is to identify the aspect categories mentioned in user-generated reviews from a set…

Aspect-Based Sentiment Analysis Aspect-Based Sentiment Analysis (ABSA)Aspect Category Detection Sentiment Analysis