paper-with-me

Papers

Generating Zero-shot Abstractive Explanations for Rumour Verification

2024-01-23 · Iman Munire Bilal, Preslav Nakov, Rob Procter, Maria Liakata

The task of rumour verification in social media concerns assessing the veracity of a claim on the basis of conversation threads that result from it. While previous work has focused on predicting a veracity label, here we reformulate the task to generate model-centric free-text explanations of a rumour's veracity. The approach is model agnostic in that it generalises to any model. Here we propose a novel GNN-based rumour verification model. We follow a zero-shot approach by first applying post-hoc explainability methods to score the most important posts within a thread and then we use these posts to generate informative explanations using opinion-guided summarisation. To evaluate the informativeness of the explanatory summaries, we exploit the few-shot learning capabilities of a large language model (LLM). Our experiments show that LLMs can have similar agreement to humans in evaluating summaries. Importantly, we show explanatory abstractive summaries are more informative and better reflect the predicted rumour veracity than just using the highest ranking posts in the thread.

📄 PDF Abstract BibTeX arXiv:2401.12713

Code (1)

bilaliman/rv_explainability 공식 구현 pytorch

Tasks

Few-Shot LearningInformativenessLanguage ModelingLanguage ModellingLarge Language Model

Similar Papers 제목 키워드 기반

Rumour Detection via Zero-shot Cross-lingual Transfer Learning

2021-09-27 · Lin Tian, Xiuzhen Zhang, Jey Han Lau

Most rumour detection models for social media are designed for one specific language (mostly English). There are over 40 languages on Twitter and most languages lack annotated resources to build rumour detection models. …

Cross-Lingual TransferPretrained Multilingual Language ModelsRumour DetectionTransfer Learning+1

Model-Agnostic and Diverse Explanations for Streaming Rumour Graphs

2022-07-17 · Thanh Tam Nguyen, Thanh Cong Phan, Minh Hieu Nguyen, Matthias Weidlich 외

The propagation of rumours on social media poses an important threat to societies, so that various techniques for rumour detection have been proposed recently. Yet, existing work focuses on \emph{what} entities constitut…

Graph Representation LearningRepresentation LearningRumour Detection

Contrastive Token-level Explanations for Graph-based Rumour Detection

2025-02-05 · Daniel Wai Kit Chin, Roy Ka-Wei Lee

The widespread use of social media has accelerated the dissemination of information, but it has also facilitated the spread of harmful rumours, which can disrupt economies, influence political outcomes, and exacerbate pu…

Graph Neural NetworkRumour Detection

Summarize-then-Answer: Generating Concise Explanations for Multi-hop Reading Comprehension

2021-09-14 · EMNLP 2021 11 · Naoya Inoue, Harsh Trivedi, Steven Sinha, Niranjan Balasubramanian 외

How can we generate concise explanations for multi-hop Reading Comprehension (RC)? The current strategies of identifying supporting sentences can be seen as an extractive question-focused summarization of the input text.…

2kMulti-Hop Reading ComprehensionReading Comprehension

Assessing LLMs for Zero-shot Abstractive Summarization Through the Lens of Relevance Paraphrasing

2024-06-06 · Hadi Askari, Anshuman Chhabra, Muhao Chen, Prasant Mohapatra

Large Language Models (LLMs) have achieved state-of-the-art performance at zero-shot generation of abstractive summaries for given articles. However, little is known about the robustness of such a process of zero-shot su…

Abstractive Text SummarizationArticles