Which side are you on? Insider-Outsider classification in conspiracy-theoretic social media
Social media is a breeding ground for threat narratives and related conspiracy theories. In these, an outside group threatens the integrity of an inside group, leading to the emergence of sharply defined group identities: Insiders -- agents with whom the authors identify and Outsiders -- agents who threaten the insiders. Inferring the members of these groups constitutes a challenging new NLP task: (i) Information is distributed over many poorly-constructed posts; (ii) Threats and threat agents are highly contextual, with the same post potentially having multiple agents assigned to membership in either group; (iii) An agent's identity is often implicit and transitive; and (iv) Phrases used to imply Outsider status often do not follow common negative sentiment patterns. To address these challenges, we define a novel Insider-Outsider classification task. Because we are not aware of any appropriate existing datasets or attendant models, we introduce a labeled dataset (CT5K) and design a model (NP2IO) to address this task. NP2IO leverages pretrained language modeling to classify Insiders and Outsiders. NP2IO is shown to be robust, generalizing to noun phrases not seen during training, and exceeding the performance of non-trivial baseline models by $20\%$.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
InsideOut: Measuring and Mitigating Insider-Outsider Bias in Interview Script Generation
Advancements in Large language models (LLMs) have enabled a variety of downstream applications like story and interview script generation. However, recent research raised concerns about culture-related fairness issues in…
Partisan affect and political outsiders
We examine the effects of introducing a political outsider to the nomination process leading to an election. To this end, we develop a sequential game where politicians -- insiders and outsiders -- make a platform offer …
Toward the Automatic Retrieval and Annotation of Outsider Art images: A Preliminary Statement
The aim of this position paper is to establish an initial approach to the automatic classification of digital images about the Outsider Art style of painting. Specifically, we explore whether is it possible to classify n…
General ClassificationRetrievalTowards the Ontologization of the Outsider Art Domain: Position Paper
The purpose of this paper is to present a prospective and interdisciplinary research project seeking to ontologize knowledge of the domain of Outsider Art, that is, the art created outside the boundaries of official cult…
BIG-bench Machine LearningCultural Vocal Bursts Intensity PredictionPositionAnomaly Detection for Scenario-based Insider Activities using CGAN Augmented Data
Insider threats are the cyber attacks from within the trusted entities of an organization. Lack of real-world data and issue of data imbalance leave insider threat analysis an understudied research area. To mitigate the …
Anomaly DetectionGeneral ClassificationGenerative Adversarial NetworkMulti-class Anomaly Detection+1