Multi-modal Stance Detection: New Datasets and Model
Stance detection is a challenging task that aims to identify public opinion from social media platforms with respect to specific targets. Previous work on stance detection largely focused on pure texts. In this paper, we study multi-modal stance detection for tweets consisting of texts and images, which are prevalent in today's fast-growing social media platforms where people often post multi-modal messages. To this end, we create five new multi-modal stance detection datasets of different domains based on Twitter, in which each example consists of a text and an image. In addition, we propose a simple yet effective Targeted Multi-modal Prompt Tuning framework (TMPT), where target information is leveraged to learn multi-modal stance features from textual and visual modalities. Experimental results on our five benchmark datasets show that the proposed TMPT achieves state-of-the-art performance in multi-modal stance detection.
Code (1)
Tasks
modelStance DetectionSimilar Papers 제목 키워드 기반
Multimodal Multi-turn Conversation Stance Detection: A Challenge Dataset and Effective Model
Stance detection, which aims to identify public opinion towards specific targets using social media data, is an important yet challenging task. With the proliferation of diverse multimodal social media content including …
Language ModelingLanguage ModellingLarge Language ModelMultimodal Large Language Model+1MM-StanceDet: Retrieval-Augmented Multi-modal Multi-agent Stance Detection
Multimodal Stance Detection (MSD) is crucial for understanding public discourse, yet effectively fusing text and image, especially with conflicting signals, remains challenging. Existing methods often face difficulties w…
Stance DetectionMultiClimate: Multimodal Stance Detection on Climate Change Videos
Climate change (CC) has attracted increasing attention in NLP in recent years. However, detecting the stance on CC in multimodal data is understudied and remains challenging due to a lack of reliable datasets. To improve…
Stance DetectionLarge Language Models Meet Stance Detection: A Survey of Tasks, Methods, Applications, Challenges and Future Directions
Stance detection is essential for understanding subjective content across various platforms such as social media, news articles, and online reviews. Recent advances in Large Language Models (LLMs) have revolutionized sta…
ArticlesDomain GeneralizationMisinformationStance DetectionMultimodal Hate Detection Using Dual-Stream Graph Neural Networks
Hateful videos present serious risks to online safety and real-world well-being, necessitating effective detection methods. Although multimodal classification approaches integrating information from several modalities ou…
Video ClassificationGraph Neural Network