A multitask learning framework for leveraging subjectivity of annotators to identify misogyny
Identifying misogyny using artificial intelligence is a form of combating online toxicity against women. However, the subjective nature of interpreting misogyny poses a significant challenge to model the phenomenon. In this paper, we propose a multitask learning approach that leverages the subjectivity of this task to enhance the performance of the misogyny identification systems. We incorporated diverse perspectives from annotators in our model design, considering gender and age across six profile groups, and conducted extensive experiments and error analysis using two language models to validate our four alternative designs of the multitask learning technique to identify misogynistic content in English tweets. The results demonstrate that incorporating various viewpoints enhances the language models' ability to interpret different forms of misogyny. This research advances content moderation and highlights the importance of embracing diverse perspectives to build effective online moderation systems.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Modeling subjectivity (by Mimicking Annotator Annotation) in toxic comment identification across diverse communities
The prevalence and impact of toxic discussions online have made content moderation crucial.Automated systems can play a vital role in identifying toxicity, and reducing the reliance on human moderation.Nevertheless, iden…
Language ModelingLanguage ModellingLarge Language ModelPolarity and Subjectivity Detection with Multitask Learning and BERT Embedding
Multitask learning often helps improve the performance of related tasks as these often have inter-dependence on each other and perform better when solved in a joint framework. In this paper, we present a deep multitask l…
Will Annotators Disagree? Identifying Subjectivity in Value-Laden Arguments
Aggregating multiple annotations into a single ground truth label may hide valuable insights into annotator disagreement, particularly in tasks where subjectivity plays a crucial role. In this work, we explore methods fo…
Value predictionA Multi-Label Dataset of French Fake News: Human and Machine Insights
We present a corpus of 100 documents, OBSINFOX, selected from 17 sources of French press considered unreliable by expert agencies, annotated using 11 labels by 8 annotators. By collecting more labels than usual, by more …
Creation of the Estonian Subjectivity Dataset: Assessing the Degree of Subjectivity on a Scale
This article presents the creation of an Estonian-language dataset for document-level subjectivity, analyzes the resulting annotations, and reports an initial experiment of automatic subjectivity analysis using a large l…
Subjectivity Analysis