paper-with-me

홈 › Papers

Exploring Hate Speech Detection with HateXplain and BERT

2022-08-09 · Arvind Subramaniam, Aryan Mehra, Sayani Kundu

Hate Speech takes many forms to target communities with derogatory comments, and takes humanity a step back in societal progress. HateXplain is a recently published and first dataset to use annotated spans in the form of rationales, along with speech classification categories and targeted communities to make the classification more humanlike, explainable, accurate and less biased. We tune BERT to perform this task in the form of rationales and class prediction, and compare our performance on different metrics spanning across accuracy, explainability and bias. Our novelty is threefold. Firstly, we experiment with the amalgamated rationale class loss with different importance values. Secondly, we experiment extensively with the ground truth attention values for the rationales. With the introduction of conservative and lenient attentions, we compare performance of the model on HateXplain and test our hypothesis. Thirdly, in order to improve the unintended bias in our models, we use masking of the target community words and note the improvement in bias and explainability metrics. Overall, we are successful in achieving model explanability, bias removal and several incremental improvements on the original BERT implementation.

📄 PDF Abstract BibTeX arXiv:2208.04489

Code (1)

sayani-kundu/11711-HateXplain 공식 구현 pytorch

Tasks

Hate Speech Detection

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Test 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
WordPiece 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Similar Papers 제목 키워드 기반

HateXplain: A Benchmark Dataset for Explainable Hate Speech Detection

2020-12-18 · Binny Mathew, Punyajoy Saha, Seid Muhie Yimam, Chris Biemann 외

Hate speech is a challenging issue plaguing the online social media. While better models for hate speech detection are continuously being developed, there is little research on the bias and interpretability aspects of ha…

Hate Speech DetectionText Classification

Generative AI for Hate Speech Detection: Evaluation and Findings

2023-11-16 · Sagi Pendzel, Tomer Wullach, Amir Adler, Einat Minkov

Automatic hate speech detection using deep neural models is hampered by the scarcity of labeled datasets, leading to poor generalization. To mitigate this problem, generative AI has been utilized to generate large amount…

Hate Speech DetectionText Generation

Bi-Attention HateXplain : Taking into account the sequential aspect of data during explainability in a multi-task context

2026-01-19 · Ghislain Dorian Tchuente Mondjo arxiv

Technological advances in the Internet and online social networks have brought many benefits to humanity. At the same time, this growth has led to an increase in hate speech, the main global threat. To improve the reliab…

Hate Speech DetectionMulti-Task Learning

Majority Vote Silences Minority Values: Annotator Disagreement at the Hate/Offensive Boundary in HateXplain

2026-06-27 · Joshua Muhumuza, Joab Ezra Agaba, Mercy Amiyo arxiv

Hate speech annotation pipelines routinely collapse annotator disagreement into majority vote labels before training. We show that this aggregation is not neutral: 42.6% of all annotator disagreement in HateXplain concen…

Few-shot Hate Speech Detection Based on the MindSpore Framework

2025-04-22 · Zhenkai Qin, Dongze Wu, Yuxin Liu, Guifang Yang

The proliferation of hate speech on social media poses a significant threat to online communities, requiring effective detection systems. While deep learning models have shown promise, their performance often deteriorate…

Data AugmentationHate Speech Detection