Generating Zero-shot Abstractive Explanations for Rumour Verification
The task of rumour verification in social media concerns assessing the veracity of a claim on the basis of conversation threads that result from it. While previous work has focused on predicting a veracity label, here we reformulate the task to generate model-centric free-text explanations of a rumour's veracity. The approach is model agnostic in that it generalises to any model. Here we propose a novel GNN-based rumour verification model. We follow a zero-shot approach by first applying post-hoc explainability methods to score the most important posts within a thread and then we use these posts to generate informative explanations using opinion-guided summarisation. To evaluate the informativeness of the explanatory summaries, we exploit the few-shot learning capabilities of a large language model (LLM). Our experiments show that LLMs can have similar agreement to humans in evaluating summaries. Importantly, we show explanatory abstractive summaries are more informative and better reflect the predicted rumour veracity than just using the highest ranking posts in the thread.
Code (1)
Tasks
Few-Shot LearningInformativenessLanguage ModelingLanguage ModellingLarge Language ModelSimilar Papers 제목 키워드 기반
Rumour Detection via Zero-shot Cross-lingual Transfer Learning
Most rumour detection models for social media are designed for one specific language (mostly English). There are over 40 languages on Twitter and most languages lack annotated resources to build rumour detection models. …
Cross-Lingual TransferPretrained Multilingual Language ModelsRumour DetectionTransfer Learning+1Model-Agnostic and Diverse Explanations for Streaming Rumour Graphs
The propagation of rumours on social media poses an important threat to societies, so that various techniques for rumour detection have been proposed recently. Yet, existing work focuses on \emph{what} entities constitut…
Graph Representation LearningRepresentation LearningRumour DetectionContrastive Token-level Explanations for Graph-based Rumour Detection
The widespread use of social media has accelerated the dissemination of information, but it has also facilitated the spread of harmful rumours, which can disrupt economies, influence political outcomes, and exacerbate pu…
Graph Neural NetworkRumour DetectionSummarize-then-Answer: Generating Concise Explanations for Multi-hop Reading Comprehension
How can we generate concise explanations for multi-hop Reading Comprehension (RC)? The current strategies of identifying supporting sentences can be seen as an extractive question-focused summarization of the input text.…
2kMulti-Hop Reading ComprehensionReading ComprehensionAssessing LLMs for Zero-shot Abstractive Summarization Through the Lens of Relevance Paraphrasing
Large Language Models (LLMs) have achieved state-of-the-art performance at zero-shot generation of abstractive summaries for given articles. However, little is known about the robustness of such a process of zero-shot su…
Abstractive Text SummarizationArticles