PIXELMOD: Improving Soft Moderation of Visual Misleading Information on Twitter
Images are a powerful and immediate vehicle to carry misleading or outright false messages, yet identifying image-based misinformation at scale poses unique challenges. In this paper, we present PIXELMOD, a system that leverages perceptual hashes, vector databases, and optical character recognition (OCR) to efficiently identify images that are candidates to receive soft moderation labels on Twitter. We show that PIXELMOD outperforms existing image similarity approaches when applied to soft moderation, with negligible performance overhead. We then test PIXELMOD on a dataset of tweets surrounding the 2020 US Presidential Election, and find that it is able to identify visually misleading images that are candidates for soft moderation with 0.99% false detection and 2.06% false negatives.
Code (1)
Tasks
MisinformationOptical Character RecognitionOptical Character Recognition (OCR)Similar Papers 제목 키워드 기반
Community Moderation and the New Epistemology of Fact Checking on Social Media
Social media platforms have traditionally relied on internal moderation teams and partnerships with independent fact-checking organizations to identify and flag misleading content. Recently, however, platforms including …
Fact CheckingMisinformationValidating Multimedia Content Moderation Software via Semantic Fusion
The exponential growth of social media platforms, such as Facebook and TikTok, has revolutionized communication and content publication in human society. Users on these platforms can publish multimedia content that deliv…
Sentencesoftware testingEnabling Contextual Soft Moderation on Social Media through Contrastive Textual Deviation
Automated soft moderation systems are unable to ascertain if a post supports or refutes a false claim, resulting in a large number of contextual false positives. This limits their effectiveness, for example undermining t…
Stance DetectionContent Moderation by LLM: From Accuracy to Legitimacy
One trending application of LLM (large language model) is to use it for content moderation in online platforms. Most current studies on this application have focused on the metric of accuracy -- the extent to which LLMs …
Large Language ModelCARO: Chain-of-Analogy Reasoning Optimization for Robust Content Moderation
Current large language models (LLMs), even those explicitly trained for reasoning, often struggle with ambiguous content moderation cases due to misleading "decision shortcuts" embedded in context. Inspired by cognitive …