An Expert Annotated Dataset for the Detection of Online Misogyny
Online misogyny is a pernicious social problem that risks making online platforms toxic and unwelcoming to women. We present a new hierarchical taxonomy for online misogyny, as well as an expert labelled dataset to enable automatic classification of misogynistic content. The dataset consists of 6567 labels for Reddit posts and comments. As previous research has found untrained crowdsourced annotators struggle with identifying misogyny, we hired and trained annotators and provided them with robust annotation guidelines. We report baseline classification performance on the binary classification task, achieving accuracy of 0.93 and F1 of 0.43. The codebook and datasets are made freely available for future researchers.
Code (1)
Tasks
Binary ClassificationClassificationSimilar Papers 제목 키워드 기반
BiaSWE: An Expert Annotated Dataset for Misogyny Detection in Swedish
In this study, we introduce the process for creating BiaSWE, an expert-annotated dataset tailored for misogyny detection in the Swedish language. To address the cultural and linguistic specificity of misogyny in Swedish,…
Bias DetectionSpecificitySubtle Misogyny Detection and Mitigation: An Expert-Annotated Dataset
Using novel approaches to dataset development, the Biasly dataset captures the nuance and subtlety of misogyny in ways that are unique within the literature. Built in collaboration with multi-disciplinary experts and ann…
Bias DetectionText GenerationAnnotating Online Misogyny
Online misogyny, a category of online abusive language, has serious and harmful social consequences. Automatic detection of misogynistic language online, while imperative, poses complicated challenges to both data gather…
Abusive LanguageHate Speech DetectionMisogyny classification of German newspaper forum comments
This paper presents work on detecting misogyny in the comments of a large Austrian German language newspaper forum. We describe the creation of a corpus of 6600 comments which were annotated with 5 levels of misogyny. Th…
ClassificationPejorativITy: Disambiguating Pejorative Epithets to Improve Misogyny Detection in Italian Tweets
Misogyny is often expressed through figurative language. Some neutral words can assume a negative connotation when functioning as pejorative epithets. Disambiguating the meaning of such terms might help the detection of …
SentenceWord EmbeddingsWord Sense Disambiguation