Challenges for Toxic Comment Classification: An In-Depth Error Analysis

2018-09-20 · WS 2018 10 · Betty van Aken, Julian Risch, Ralf Krestel, Alexander Löser

Toxic comment classification has become an active research field with many recently proposed approaches. However, while these approaches address some of the task's challenges others still remain unsolved and directions for further research are needed. To this end, we compare different deep learning and shallow approaches on a new, large comment dataset and propose an ensemble that outperforms all individual models. Further, we validate our findings on a second dataset. The results of the ensemble enable us to perform an extensive error analysis, which reveals open challenges for state-of-the-art methods and directions towards pending future research. These challenges include missing paradigmatic context and inconsistent dataset labels.

📄 PDF Abstract BibTeX arXiv:1809.07572

Code (0)

등록된 구현이 없습니다.

Tasks

Classification General Classification Toxic Comment Classification

Overview of the GermEval 2021 Shared Task on the Identification of Toxic, Engaging, and Fact-Claiming Comments

2021-09-01 · GermEval 2021 9 · Julian Risch, Anke Stoll, Lena Wilms, Michael Wiegand

We present the GermEval 2021 shared task on the identification of toxic, engaging, and fact-claiming comments. This shared task comprises three binary classification subtasks with the goal to identify: toxic comments, en…

Binary Classification Fact Checking

Toxic Language Detection in Social Media for Brazilian Portuguese: New Dataset and Multilingual Analysis

2020-10-09 · Asian Chapter of the Association for Computational Linguistics 2020 · João A. Leite, Diego F. Silva, Kalina Bontcheva, Carolina Scarton

Hate speech and toxic comments are a common concern of social media platform users. Although these comments are, fortunately, the minority in these platforms, they are still capable of causing harm. Therefore, identifyin…

Hate Speech Detection Multi-Label Classification MUlTI-LABEL-ClASSIFICATION Text Classification

Interpretable Multi Labeled Bengali Toxic Comments Classification using Deep Learning

2023-04-08 · Tanveer Ahmed Belal, G. M. Shahariar, Md. Hasanul Kabir

This paper presents a deep learning-based pipeline for categorizing Bengali toxic comments, in which at first a binary classification model is used to determine whether a comment is toxic or not, and then a multi-label c…

Binary Classification Classification Deep Learning Feature Importance

IRCologne at GermEval 2021: Toxicity Classification

2021-09-01 · GermEval 2021 9 · Fabian Haak, Björn Engelmann

In this paper, we describe the TH Köln’s submission for the Shared Task on the Identification of Toxic Comments at GermEval 2021. Toxicity is a severe and latent problem in comments in online discussions. Complex languag…

Classification Language Modeling Language Modelling Toxic Comment Classification

SS-BERT: Mitigating Identity Terms Bias in Toxic Comment Classification by Utilising the Notion of "Subjectivity" and "Identity Terms"

2021-09-06 · Zhixue Zhao, Ziqi Zhang, Frank Hopfgartner

Toxic comment classification models are often found biased toward identity terms which are terms characterizing a specific group of people such as "Muslim" and "black". Such bias is commonly reflected in false-positive p…

Toxic Comment Classification