Improving Generalization of Hate Speech Detection Systems to Novel Target Groups via Domain Adaptation
Despite recent advances in machine learning based hate speech detection, classifiers still struggle with generalizing knowledge to out-of-domain data samples. In this paper, we investigate the generalization capabilities of deep learning models to different target groups of hate speech under clean experimental settings. Furthermore, we assess the efficacy of three different strategies of unsupervised domain adaptation to improve these capabilities. Given the diversity of hate and its rapid dynamics in the online world (e.g. the evolution of new target groups like virologists during the COVID-19 pandemic), robustly detecting hate aimed at newly identified target groups is a highly relevant research question. We show that naively trained models suffer from a target group specific bias, which can be reduced via domain adaptation. We were able to achieve a relative improvement of the F1-score between 5.8% and 10.7% for out-of-domain target groups of hate speech compared to baseline approaches by utilizing domain adaptation.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityDomain AdaptationHate Speech DetectionUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Improving Cross-Domain Hate Speech Generalizability with Emotion Knowledge
Reliable automatic hate speech (HS) detection systems must adapt to the in-flow of diverse new data to curtail hate speech. However, hate speech detection systems commonly lack generalizability in identifying hate speech…
Hate Speech DetectionAnalyzing the Real Vulnerability of Hate Speech Detection Systems against Targeted Intentional Noise
Hate speech detection systems have been shown to be vulnerable against obfuscation attacks, where a potential hater tries to circumvent detection by deliberately introducing noise in their posts. In previous work, noise …
Hate Speech DetectionAddressing the Challenges of Cross-Lingual Hate Speech Detection
The goal of hate speech detection is to filter negative online content aiming at certain groups of people. Due to the easy accessibility of social media platforms it is crucial to protect everyone which requires building…
Cross-Lingual TransferCross-Lingual Word EmbeddingsHate Speech DetectionTransfer Learning+1PEACE: Cross-Platform Hate Speech Detection- A Causality-guided Framework
Hate speech detection refers to the task of detecting hateful content that aims at denigrating an individual or a group based on their religion, gender, sexual orientation, or other characteristics. Due to the different …
Hate Speech DetectionHate Speech Detection in Limited Data Contexts using Synthetic Data Generation
A growing body of work has focused on text classification methods for detecting the increasing amount of hate speech posted online. This progress has been limited to only a select number of highly-resourced languages cau…
Data AugmentationHate Speech DetectionSynthetic Data Generationtext-classification+1