Adversarial Training for Aspect-Based Sentiment Analysis with BERT
Aspect-Based Sentiment Analysis (ABSA) deals with the extraction of sentiments and their targets. Collecting labeled data for this task in order to help neural networks generalize better can be laborious and time-consuming. As an alternative, similar data to the real-world examples can be produced artificially through an adversarial process which is carried out in the embedding space. Although these examples are not real sentences, they have been shown to act as a regularization method which can make neural networks more robust. In this work, we apply adversarial training, which was put forward by Goodfellow et al. (2014), to the post-trained BERT (BERT-PT) language model proposed by Xu et al. (2019) on the two major tasks of Aspect Extraction and Aspect Sentiment Classification in sentiment analysis. After improving the results of post-trained BERT by an ablation study, we propose a novel architecture called BERT Adversarial Training (BAT) to utilize adversarial training in ABSA. The proposed model outperforms post-trained BERT in both tasks. To the best of our knowledge, this is the first study on the application of adversarial training in ABSA.
Code (4)
Tasks
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Aspect ExtractionLanguage ModelingLanguage ModellingSentiment AnalysisSentiment ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Aspect-Based Sentiment Analysis using Local Context Focus Mechanism with DeBERTa
Text sentiment analysis, also known as opinion mining, is research on the calculation of people's views, evaluations, attitude and emotions expressed by entities. Text sentiment analysis can be divided into text-level se…
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Language ModellingMulti-Task Learning+3Improving BERT Performance for Aspect-Based Sentiment Analysis
Aspect-Based Sentiment Analysis (ABSA) studies the consumer opinion on the market products. It involves examining the type of sentiments as well as sentiment targets expressed in product reviews. Analyzing the language u…
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Aspect ExtractionSentiment Analysis+1BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis
Question-answering plays an important role in e-commerce as it allows potential customers to actively seek crucial information about products or services to help their purchase decision making. Inspired by the recent suc…
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Aspect ExtractionReading Comprehension+1A sentiment analysis model for car review texts based on adversarial training and whole word mask BERT
In the field of car evaluation, more and more netizens choose to express their opinions on the Internet platform, and these comments will affect the decision-making of buyers and the trend of car word-of-mouth. As an imp…
Decision MakingSentiment AnalysisHome Appliance Review Research Via Adversarial Reptile
For manufacturers of home appliances, the Studying discussion of products on social media can help manufacturers improve their products. Opinions provided through online reviews can immediately reflect whether the produc…
Aspect Category Sentiment ClassificationMeta-Learningnamed-entity-recognitionNamed Entity Recognition+4