Aspect-Based Sentiment Analysis using Local Context Focus Mechanism with DeBERTa
Text sentiment analysis, also known as opinion mining, is research on the calculation of people's views, evaluations, attitude and emotions expressed by entities. Text sentiment analysis can be divided into text-level sentiment analysis, sen-tence-level sentiment analysis and aspect-level sentiment analysis. Aspect-Based Sentiment Analysis (ABSA) is a fine-grained task in the field of sentiment analysis, which aims to predict the polarity of aspects. The research of pre-training neural model has significantly improved the performance of many natural language processing tasks. In recent years, pre training model (PTM) has been applied in ABSA. Therefore, there has been a question, which is whether PTMs contain sufficient syntactic information for ABSA. In this paper, we explored the recent DeBERTa model (Decoding-enhanced BERT with disentangled attention) to solve Aspect-Based Sentiment Analysis problem. DeBERTa is a kind of neural language model based on transformer, which uses self-supervised learning to pre-train on a large number of original text corpora. Based on the Local Context Focus (LCF) mechanism, by integrating DeBERTa model, we purpose a multi-task learning model for aspect-based sentiment analysis. The experiments result on the most commonly used the laptop and restaurant datasets of SemEval-2014 and the ACL twitter dataset show that LCF mechanism with DeBERTa has significant improvement.
Code (0)
등록된 구현이 없습니다.
Tasks
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Language ModellingMulti-Task LearningOpinion MiningSelf-Supervised LearningSentiment AnalysisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Combining dynamic local context focus and dependency cluster attention for aspect-level sentiment classification
Aspect-level sentiment classification (ASC), as a subtask of Aspect-based sentiment analysis (ABSA), aims to analyze the sentiment polarity of different aspect terms in a sentence. Although the existing methods have been…
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)SentenceSentiment Analysis+1Aspect Based Sentiment Analysis using Sentiment Flow with Local and Non-local Neighbor Information
Aspect-level analysis of sentiments contained in a review text is important to reveal a detailed picture of consumer opinions. While a plethora of methods have been traditionally employed for this task, majority focus ha…
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)PredictionSentiment Analysis+1Exploring ChatGPT-based Augmentation Strategies for Contrastive Aspect-based Sentiment Analysis
Aspect-based sentiment analysis (ABSA) involves identifying sentiment towards specific aspect terms in a sentence and allows us to uncover nuanced perspectives and attitudes on particular aspects of a product, service, o…
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Contrastive LearningData Augmentation+6Geo-located Aspect Based Sentiment Analysis (ABSA) for Crowdsourced Evaluation of Urban Environments
Sentiment analysis methods are rapidly being adopted by the field of Urban Design and Planning, for the crowdsourced evaluation of urban environments. However, most models used within this domain are able to identify pos…
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Sentiment AnalysisSentiment Classification+1AdaptiSent: Context-Aware Adaptive Attention for Multimodal Aspect-Based Sentiment Analysis
We introduce AdaptiSent, a new framework for Multimodal Aspect-Based Sentiment Analysis (MABSA) that uses adaptive cross-modal attention mechanisms to improve sentiment classification and aspect term extraction from both…
Aspect-Based Sentiment AnalysisSentiment AnalysisSentiment ClassificationTerm Extraction