Utilizing BERT Intermediate Layers for Aspect Based Sentiment Analysis and Natural Language Inference
Aspect based sentiment analysis aims to identify the sentimental tendency towards a given aspect in text. Fine-tuning of pretrained BERT performs excellent on this task and achieves state-of-the-art performances. Existing BERT-based works only utilize the last output layer of BERT and ignore the semantic knowledge in the intermediate layers. This paper explores the potential of utilizing BERT intermediate layers to enhance the performance of fine-tuning of BERT. To the best of our knowledge, no existing work has been done on this research. To show the generality, we also apply this approach to a natural language inference task. Experimental results demonstrate the effectiveness and generality of the proposed approach.
Code (1)
Tasks
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Natural Language InferenceSentiment AnalysisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
BERT4GCN: Using BERT Intermediate Layers to Augment GCN for Aspect-based Sentiment Classification
Graph-based Aspect-based Sentiment Classification (ABSC) approaches have yielded state-of-the-art results, expecially when equipped with contextual word embedding from pre-training language models (PLMs). However, they i…
Sentiment AnalysisSentiment ClassificationUtilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary Sentence
Aspect-based sentiment analysis (ABSA), which aims to identify fine-grained opinion polarity towards a specific aspect, is a challenging subtask of sentiment analysis (SA). In this paper, we construct an auxiliary senten…
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)General ClassificationNatural Language Inference+4SAMBERT: Improve Aspect Sentiment Triplet Extraction by Segmenting the Attention Maps of BERT
Aspect Sentiment Triplet Extraction (ASTE) performs fine-grained sentiment analysis in a unified way through extracting sentiment triplets comprised of aspect terms, opinion spans, and their sentiment relations in senten…
Aspect Sentiment Triplet ExtractionSemantic SegmentationSentiment AnalysisTripletUndivided Attention: Are Intermediate Layers Necessary for BERT?
In recent times, BERT-based models have been extremely successful in solving a variety of natural language processing (NLP) tasks such as reading comprehension, natural language inference, sentiment analysis, etc. All BE…
Natural Language InferenceReading ComprehensionSentiment AnalysisIncorporating Dynamic Semantics into Pre-Trained Language Model for Aspect-based Sentiment Analysis
Aspect-based sentiment analysis (ABSA) predicts sentiment polarity towards a specific aspect in the given sentence. While pre-trained language models such as BERT have achieved great success, incorporating dynamic semant…
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Language ModelingLanguage Modelling+2