Modeling Users and Online Communities for Abuse Detection: A Position on Ethics and Explainability
Abuse on the Internet is an important societal problem of our time. Millions of Internet users face harassment, racism, personal attacks, and other types of abuse across various platforms. The psychological effects of abuse on individuals can be profound and lasting. Consequently, over the past few years, there has been a substantial research effort towards automated abusive language detection in the field of NLP. In this position paper, we discuss the role that modeling of users and online communities plays in abuse detection. Specifically, we review and analyze the state of the art methods that leverage user or community information to enhance the understanding and detection of abusive language. We then explore the ethical challenges of incorporating user and community information, laying out considerations to guide future research. Finally, we address the topic of explainability in abusive language detection, proposing properties that an explainable method should aim to exhibit. We describe how user and community information can facilitate the realization of these properties and discuss the effective operationalization of explainability in view of the properties.
Code (0)
등록된 구현이 없습니다.
Tasks
Abuse DetectionAbusive LanguageEthicsPositionSimilar Papers 제목 키워드 기반
Abusive Language Detection with Graph Convolutional Networks
Abuse on the Internet represents a significant societal problem of our time. Previous research on automated abusive language detection in Twitter has shown that community-based profiling of users is a promising technique…
Abuse DetectionA Unified Taxonomy of Harmful Content
The ability to recognize harmful content within online communities has come into focus for researchers, engineers and policy makers seeking to protect users from abuse. While the number of datasets aiming to capture form…
``Are you kidding me?'': Detecting Unpalatable Questions on Reddit
Abusive language in online discourse negatively affects a large number of social media users. Many computational methods have been proposed to address this issue of online abuse. The existing work, however, tends to focu…
Abusive LanguageJoint Modelling of Emotion and Abusive Language Detection
The rise of online communication platforms has been accompanied by some undesirable effects, such as the proliferation of aggressive and abusive behaviour online. Aiming to tackle this problem, the natural language proce…
Abuse DetectionAbusive LanguageMulti-Task LearningAbuseAnalyzer: Abuse Detection, Severity and Target Prediction for Gab Posts
While extensive popularity of online social media platforms has made information dissemination faster, it has also resulted in widespread online abuse of different types like hate speech, offensive language, sexist and r…
Abuse Detectionseverity prediction