Detection of Abusive Language: the Problem of Biased Datasets
We discuss the impact of data bias on abusive language detection. We show that classification scores on popular datasets reported in previous work are much lower under realistic settings in which this bias is reduced. Such biases are most notably observed on datasets that are created by focused sampling instead of random sampling. Datasets with a higher proportion of implicit abuse are more affected than datasets with a lower proportion.
Code (0)
등록된 구현이 없습니다.
Tasks
Abusive LanguageSimilar Papers 제목 키워드 기반
Reducing Gender Bias in Abusive Language Detection
Abusive language detection models tend to have a problem of being biased toward identity words of a certain group of people because of imbalanced training datasets. For example, "You are a good woman" was considered "sex…
Abusive LanguageData AugmentationWord EmbeddingsInvestigating Sampling Bias in Abusive Language Detection
Abusive language detection is becoming increasingly important, but we still understand little about the biases in our datasets for abusive language detection, and how these biases affect the quality of abusive language d…
Abusive LanguageIdentifying Implicitly Abusive Remarks about Identity Groups using a Linguistically Informed Approach
We address the task of distinguishing implicitly abusive sentences on identity groups (“Muslims contaminate our planet”) from other group-related negative polar sentences (“Muslims despise terrorism”). Implicitly abusive…
Abusive LanguageAbusive Language Detection in Heterogeneous Contexts: Dataset Collection and the Role of Supervised Attention
Abusive language is a massive problem in online social platforms. Existing abusive language detection techniques are particularly ill-suited to comments containing heterogeneous abusive language patterns, i.e., both abus…
Abusive LanguageMulti-Task LearningImplicitly Abusive Language -- What does it actually look like and why are we not getting there?
Abusive language detection is an emerging field in natural language processing which has received a large amount of attention recently. Still the success of automatic detection is limited. Particularly, the detection of …
Abusive LanguagePosition