paper-with-me

홈 › Papers

Adversarial Training for Aspect-Based Sentiment Analysis with BERT

2020-01-30 · Akbar Karimi, Leonardo Rossi, Andrea Prati

Aspect-Based Sentiment Analysis (ABSA) deals with the extraction of sentiments and their targets. Collecting labeled data for this task in order to help neural networks generalize better can be laborious and time-consuming. As an alternative, similar data to the real-world examples can be produced artificially through an adversarial process which is carried out in the embedding space. Although these examples are not real sentences, they have been shown to act as a regularization method which can make neural networks more robust. In this work, we apply adversarial training, which was put forward by Goodfellow et al. (2014), to the post-trained BERT (BERT-PT) language model proposed by Xu et al. (2019) on the two major tasks of Aspect Extraction and Aspect Sentiment Classification in sentiment analysis. After improving the results of post-trained BERT by an ablation study, we propose a novel architecture called BERT Adversarial Training (BAT) to utilize adversarial training in ABSA. The proposed model outperforms post-trained BERT in both tasks. To the best of our knowledge, this is the first study on the application of adversarial training in ABSA.

📄 PDF Abstract BibTeX arXiv:2001.11316

Code (4)

IMPLabUniPr/Adversarial-Training-for-ABSA 공식 구현 pytorch
IMPLabUniPr/BERT-for-ABSA pytorch
akkarimi/Adversarial-Training-for-ABSA pytorch
leanhkhoi/AE_BERT_CROSS_SENTENCES pytorch

Tasks

Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Aspect ExtractionLanguage ModelingLanguage ModellingSentiment AnalysisSentiment Classification

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Aspect-Based Sentiment Analysis using Local Context Focus Mechanism with DeBERTa

2022-07-06 · Tianyu Zhao, Junping Du, Zhe Xue, Ang Li 외

Text sentiment analysis, also known as opinion mining, is research on the calculation of people's views, evaluations, attitude and emotions expressed by entities. Text sentiment analysis can be divided into text-level se…

Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Language ModellingMulti-Task Learning+3

Improving BERT Performance for Aspect-Based Sentiment Analysis

2020-10-22 · ICNLSP 2021 11 · Akbar Karimi, Leonardo Rossi, Andrea Prati

Aspect-Based Sentiment Analysis (ABSA) studies the consumer opinion on the market products. It involves examining the type of sentiments as well as sentiment targets expressed in product reviews. Analyzing the language u…

Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Aspect ExtractionSentiment Analysis+1

BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis

2019-04-03 · NAACL 2019 6 · Hu Xu, Bing Liu, Lei Shu, Philip S. Yu

Question-answering plays an important role in e-commerce as it allows potential customers to actively seek crucial information about products or services to help their purchase decision making. Inspired by the recent suc…

Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Aspect ExtractionReading Comprehension+1

A sentiment analysis model for car review texts based on adversarial training and whole word mask BERT

2022-06-06 · Xingchen Liu, Yawen Li, Yingxia Shao, Ang Li 외

In the field of car evaluation, more and more netizens choose to express their opinions on the Internet platform, and these comments will affect the decision-making of buyers and the trend of car word-of-mouth. As an imp…

Decision MakingSentiment Analysis

Home Appliance Review Research Via Adversarial Reptile

2021-10-01 · ROCLING 2021 10 · Tai-Jung Kan, Chia-Hui Chang, Hsiu-Min Chuang

For manufacturers of home appliances, the Studying discussion of products on social media can help manufacturers improve their products. Opinions provided through online reviews can immediately reflect whether the produc…

Aspect Category Sentiment ClassificationMeta-Learningnamed-entity-recognitionNamed Entity Recognition+4