SGPT: Semantic Graphs based Pre-training for Aspect-based Sentiment Analysis
Previous studies show effective of pre-trained language models for sentiment analysis. However, most of these studies ignore the importance of sentimental information for pre-trained models.Therefore, we fully investigate the sentimental information for pre-trained models and enhance pre-trained language models with semantic graphs for sentiment analysis.In particular, we introduce Semantic Graphs based Pre-training(SGPT) using semantic graphs to obtain synonym knowledge for aspect-sentiment pairs and similar aspect/sentiment terms.We then optimize the pre-trained language model with the semantic graphs.Empirical studies on several downstream tasks show that proposed model outperforms strong pre-trained baselines. The results also show the effectiveness of proposed semantic graphs for pre-trained model.
Code (0)
등록된 구현이 없습니다.
Tasks
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Language ModelingLanguage ModellingSentiment AnalysisSimilar Papers 제목 키워드 기반
A Graph is Worth $K$ Words: Euclideanizing Graph using Pure Transformer
Can we model Non-Euclidean graphs as pure language or even Euclidean vectors while retaining their inherent information? The Non-Euclidean property have posed a long term challenge in graph modeling. Despite recent graph…
DecoderGraph ClassificationGraph GenerationGraph Representation Learning+1Inducing Target-Specific Latent Structures for Aspect Sentiment Classification
Aspect-level sentiment analysis aims to recognize the sentiment polarity of an aspect or a target in a comment. Recently, graph convolutional networks based on linguistic dependency trees have been studied for this task.…
ClassificationDependency ParsingGeneral ClassificationSentiment Analysis+1An Empirical Analysis of Fine-Tuning Large Language Models on Bioinformatics Literature: PRSGPT and BioStarsGPT
Large language models (LLMs) often lack specialized knowledge for complex bioinformatics applications. We present a reproducible pipeline for fine-tuning LLMs on specialized bioinformatics data, demonstrated through two …
parameter-efficient fine-tuningNatural Language InferenceSGPT: GPT Sentence Embeddings for Semantic Search
Decoder transformers have continued increasing in scale reaching hundreds of billions of parameters. Due to their scale the same decoder sets state-of-the-art results on various language tasks via prompting or fine-tunin…
Argument RetrievalBiomedical Information RetrievalCitation PredictionDecoder+11Target-oriented Sentiment Classification with Sequential Cross-modal Semantic Graph
Multi-modal aspect-based sentiment classification (MABSC) is task of classifying the sentiment of a target entity mentioned in a sentence and an image. However, previous methods failed to account for the fine-grained sem…
DecoderImage CaptioningSentenceSentiment Analysis+1