paper-with-me

홈 › Papers

Aspect-specific Context Modeling for Aspect-based Sentiment Analysis

2022-07-17 · Fang Ma, Chen Zhang, Bo Zhang, Dawei Song

Aspect-based sentiment analysis (ABSA) aims at predicting sentiment polarity (SC) or extracting opinion span (OE) expressed towards a given aspect. Previous work in ABSA mostly relies on rather complicated aspect-specific feature induction. Recently, pretrained language models (PLMs), e.g., BERT, have been used as context modeling layers to simplify the feature induction structures and achieve state-of-the-art performance. However, such PLM-based context modeling can be not that aspect-specific. Therefore, a key question is left under-explored: how the aspect-specific context can be better modeled through PLMs? To answer the question, we attempt to enhance aspect-specific context modeling with PLM in a non-intrusive manner. We propose three aspect-specific input transformations, namely aspect companion, aspect prompt, and aspect marker. Informed by these transformations, non-intrusive aspect-specific PLMs can be achieved to promote the PLM to pay more attention to the aspect-specific context in a sentence. Additionally, we craft an adversarial benchmark for ABSA (advABSA) to see how aspect-specific modeling can impact model robustness. Extensive experimental results on standard and adversarial benchmarks for SC and OE demonstrate the effectiveness and robustness of the proposed method, yielding new state-of-the-art performance on OE and competitive performance on SC.

📄 PDF Abstract BibTeX arXiv:2207.08099

Code (1)

bd-mf/ascm4absa 공식 구현 pytorch

Tasks

Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)SentenceSentiment Analysis

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Weight Decay 설명 없음

Similar Papers 제목 키워드 기반

BiSyn-GAT+: Bi-Syntax Aware Graph Attention Network for Aspect-based Sentiment Analysis

2022-04-06 · Findings (ACL) 2022 5 · Shuo Liang, Wei Wei, Xian-Ling Mao, Fei Wang 외

Aspect-based sentiment analysis (ABSA) is a fine-grained sentiment analysis task that aims to align aspects and corresponding sentiments for aspect-specific sentiment polarity inference. It is challenging because a sente…

Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Graph AttentionSentence+1

Aspect Sentiment Classification with Document-level Sentiment Preference Modeling

2020-07-01 · ACL 2020 6 · Xiao Chen, Changlong Sun, Jingjing Wang, Shoushan Li 외

In the literature, existing studies always consider Aspect Sentiment Classification (ASC) as an independent sentence-level classification problem aspect by aspect, which largely ignore the document-level sentiment prefer…

ClassificationGeneral ClassificationGraph AttentionSentence+2

Modeling Aspect Correlation for Aspect-based Sentiment Analysis via Recurrent Inverse Learning Guidance

2022-10-01 · COLING 2022 10 · Longfeng Li, Haifeng Sun, Qi Qi, Jingyu Wang 외

Aspect-based sentiment analysis (ABSA) aims to distinguish sentiment polarity of every specific aspect in a given sentence. Previous researches have realized the importance of interactive learning with context and aspect…

Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)SentenceSentiment Analysis

Modeling Sentiment Dependencies with Graph Convolutional Networks for Aspect-level Sentiment Classification

2019-06-11 · Pinlong Zhaoa, Linlin Houb, Ou Wua

Aspect-level sentiment classification aims to distinguish the sentiment polarities over one or more aspect terms in a sentence. Existing approaches mostly model different aspects in one sentence independently, which igno…

Aspect-Based Sentiment Analysis (ABSA)ClassificationGeneral ClassificationSentence+2

Earlier Attention? Aspect-Aware LSTM for Aspect-Based Sentiment Analysis

2019-05-19 · Bowen Xing, Lejian Liao, Dandan song, Jingang Wang 외

Aspect-based sentiment analysis (ABSA) aims to predict fine-grained sentiments of comments with respect to given aspect terms or categories. In previous ABSA methods, the importance of aspect has been realized and verifi…

Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Sentiment Analysis