Large Language Models for Multi-label Propaganda Detection
The spread of propaganda through the internet has increased drastically over the past years. Lately, propaganda detection has started gaining importance because of the negative impact it has on society. In this work, we describe our approach for the WANLP 2022 shared task which handles the task of propaganda detection in a multi-label setting. The task demands the model to label the given text as having one or more types of propaganda techniques. There are a total of 21 propaganda techniques to be detected. We show that an ensemble of five models performs the best on the task, scoring a micro-F1 score of 59.73%. We also conduct comprehensive ablations and propose various future directions for this work.
Code (0)
등록된 구현이 없습니다.
Tasks
Propaganda detectionSimilar Papers 제목 키워드 기반
Large Language Models for Propaganda Detection
The prevalence of propaganda in our digital society poses a challenge to societal harmony and the dissemination of truth. Detecting propaganda through NLP in text is challenging due to subtle manipulation techniques and …
ArticlesMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONPrompt Engineering+1Can GPT-4 Identify Propaganda? Annotation and Detection of Propaganda Spans in News Articles
The use of propaganda has spiked on mainstream and social media, aiming to manipulate or mislead users. While efforts to automatically detect propaganda techniques in textual, visual, or multimodal content have increased…
8kArticlesPropaganda detectionHQP: A Human-Annotated Dataset for Detecting Online Propaganda
Online propaganda poses a severe threat to the integrity of societies. However, existing datasets for detecting online propaganda have a key limitation: they were annotated using weak labels that can be noisy and even in…
Few-Shot LearningPropaganda detectionUAIC1860 at SemEval-2020 Task 11: Detection of Propaganda Techniques in News Articles
The {``}Detection of Propaganda Techniques in News Articles{''} task at the SemEval 2020 competition focuses on detecting and classifying propaganda, pervasive in news article. In this paper, we present a system able to …
ArticlesSentenceHybrid Annotation for Propaganda Detection: Integrating LLM Pre-Annotations with Human Intelligence
Propaganda detection on social media remains challenging due to task complexity and limited high-quality labeled data. This paper introduces a novel framework that combines human expertise with Large Language Model (LLM)…
Knowledge Distillation