paper-with-me

Papers

A hybrid transformer and attention based recurrent neural network for robust and interpretable sentiment analysis of tweets

2024-03-30 · Md Abrar Jahin, Md Sakib Hossain Shovon, M. F. Mridha, Md Rashedul Islam, Yutaka Watanobe

Sentiment analysis is crucial for understanding public opinion and consumer behavior. Existing models face challenges with linguistic diversity, generalizability, and explainability. We propose TRABSA, a hybrid framework integrating transformer-based architectures, attention mechanisms, and BiLSTM networks to address this. Leveraging RoBERTa-trained on 124M tweets, we bridge gaps in sentiment analysis benchmarks, ensuring state-of-the-art accuracy. Augmenting datasets with tweets from 32 countries and US states, we compare six word-embedding techniques and three lexicon-based labeling techniques, selecting the best for optimal sentiment analysis. TRABSA outperforms traditional ML and deep learning models with 94% accuracy and significant precision, recall, and F1-score gains. Evaluation across diverse datasets demonstrates consistent superiority and generalizability. SHAP and LIME analyses enhance interpretability, improving confidence in predictions. Our study facilitates pandemic resource management, aiding resource planning, policy formation, and vaccination tactics.

📄 PDF Abstract BibTeX arXiv:2404.00297

Code (1)

abrar2652/nlp-roberta-bilstm-attention 공식 구현 tf

Tasks

DiversityManagementSentiment Analysis

Methods 이 논문이 사용한 방법론

Tanh Activation 설명 없음
Sigmoid Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
BiLSTM A Bidirectional LSTM, or biLSTM, is a sequence processing model that consists of two LSTMs: one taking the input in a forward direction, and the other in a backwards…
SHAP 설명 없음
LIME LIME, or Local Interpretable Model-Agnostic Explanations, is an algorithm that can explain the predictions of any classifier or regressor in a faithful way, by…

Similar Papers 제목 키워드 기반

BERT-Based Combination of Convolutional and Recurrent Neural Network for Indonesian Sentiment Analysis

2022-11-10 · Hendri Murfi, Syamsyuriani, Theresia Gowandi, Gianinna Ardaneswari 외

Sentiment analysis is the computational study of opinions and emotions ex-pressed in text. Deep learning is a model that is currently producing state-of-the-art in various application domains, including sentiment analysi…

Deep LearningSentenceSentiment Analysis

Dynamic Adaptive Attention and Supervised Contrastive Learning: A Novel Hybrid Framework for Text Sentiment Classification

2026-04-12 · Qingyang Li arxiv

The exponential growth of user-generated movie reviews on digital platforms has made accurate text sentiment classification a cornerstone task in natural language processing. Traditional models, including standard BERT a…

Contrastive LearningText Classification

Transformer-Encoder-GRU (T-E-GRU) for Chinese Sentiment Analysis on Chinese Comment Text

2021-08-01 · Binlong Zhang, Wei Zhou

Chinese sentiment analysis (CSA) has always been one of the challenges in natural language processing due to its complexity and uncertainty. Transformer has succeeded in capturing semantic features, but it uses position …

Chinese Sentiment AnalysisPositionSentenceSentence segmentation+1

IKNet: Interpretable Stock Price Prediction via Keyword-Guided Integration of News and Technical Indicators

2025-10-09 · Jinwoong Kim, Sangjin Park arxiv

The increasing influence of unstructured external information, such as news articles, on stock prices has attracted growing attention in financial markets. Despite recent advances, most existing newsbased forecasting mod…

Stock Price Prediction

Retrieval-Aware Distillation for Transformer-SSM Hybrids

2026-02-11 · Aviv Bick, Eric P. Xing, Albert Gu arxiv

State-space models (SSMs) offer efficient sequence modeling but lag behind Transformers on benchmarks that require in-context retrieval. Prior work links this gap to a small set of attention heads, termed Gather-and-Aggr…