Integrating Transformers and Knowledge Graphs for Twitter Stance Detection
Stance detection (SD) entails classifying the sentiment of a text towards a given target, and is a relevant sub-task for opinion mining and social media analysis. Recent works have explored knowledge infusion supplementing the linguistic competence and latent knowledge of large pre-trained language models with structured knowledge graphs (KGs), yet few works have applied such methods to the SD task. In this work, we first perform stance-relevant knowledge probing on Transformers-based pre-trained models in a zero-shot setting, showing these models’ latent real-world knowledge about SD targets and their sensitivity to context. We then train and evaluate new knowledge-enriched stance detection models on two Twitter stance datasets, achieving state-of-the-art performance on both.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge GraphsKnowledge ProbingOpinion MiningStance DetectionWorld KnowledgeSimilar Papers 제목 키워드 기반
Learning Stance Embeddings from Signed Social Graphs
A key challenge in social network analysis is understanding the position, or stance, of people in the graph on a large set of topics. While past work has modeled (dis)agreement in social networks using signed graphs, the…
MisinformationStance DetectionTransformers as Graph-to-Graph Models
We argue that Transformers are essentially graph-to-graph models, with sequences just being a special case. Attention weights are functionally equivalent to graph edges. Our Graph-to-Graph Transformer architecture makes …
Grounding Dialogue Systems via Knowledge Graph Aware Decoding with Pre-trained Transformers
Generating knowledge grounded responses in both goal and non-goal oriented dialogue systems is an important research challenge. Knowledge Graphs (KG) can be viewed as an abstraction of the real world, which can potential…
Dialogue GenerationGoal-Oriented Dialogue SystemsKnowledge GraphsResponse GenerationExtensible Multi-Granularity Fusion Network for Aspect-based Sentiment Analysis
Aspect-based Sentiment Analysis (ABSA) evaluates sentiment expressions within a text to comprehend sentiment information. Previous studies integrated external knowledge, such as knowledge graphs, to enhance the semantic …
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Knowledge GraphsSentiment Analysis+1Enhancing Graph Transformers with Hierarchical Distance Structural Encoding
Graph transformers need strong inductive biases to derive meaningful attention scores. Yet, current methods often fall short in capturing longer ranges, hierarchical structures, or community structures, which are common …
Graph ClassificationGraph RegressionNode Classification