Cross-lingual Hate Speech Detection using Transformer Models

2021-11-01 · Teodor Tiţa, Arkaitz Zubiaga

Hate speech detection within a cross-lingual setting represents a paramount area of interest for all medium and large-scale online platforms. Failing to properly address this issue on a global scale has already led over time to morally questionable real-life events, human deaths, and the perpetuation of hate itself. This paper illustrates the capabilities of fine-tuned altered multi-lingual Transformer models (mBERT, XLM-RoBERTa) regarding this crucial social data science task with cross-lingual training from English to French, vice-versa and each language on its own, including sections about iterative improvement and comparative error analysis.

📄 PDF Abstract BibTeX arXiv:2111.00981

Code (0)

등록된 구현이 없습니다.

Tasks

Hate Speech Detection

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Residual Connection 설명 없음

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Cross-lingual Zero- and Few-shot Hate Speech Detection Utilising Frozen Transformer Language Models and AXEL

2020-04-13 · Lukas Stappen, Fabian Brunn, Björn Schuller

Detecting hate speech, especially in low-resource languages, is a non-trivial challenge. To tackle this, we developed a tailored architecture based on frozen, pre-trained Transformers to examine cross-lingual zero-shot a…

Few-Shot Learning General Classification Hate Speech Detection

Multilingual HateCheck: Functional Tests for Multilingual Hate Speech Detection Models

2022-06-20 · NAACL (WOAH) 2022 7 · Paul Röttger, Haitham Seelawi, Debora Nozza, Zeerak Talat 외

Hate speech detection models are typically evaluated on held-out test sets. However, this risks painting an incomplete and potentially misleading picture of model performance because of increasingly well-documented syste…

Diagnostic Hate Speech Detection

Code-Mixed Telugu-English Hate Speech Detection

2025-02-15 · Santhosh Kakarla, Gautama Shastry Bulusu Venkata

Hate speech detection in low-resource languages like Telugu is a growing challenge in NLP. This study investigates transformer-based models, including TeluguHateBERT, HateBERT, DeBERTa, Muril, IndicBERT, Roberta, and Hin…

Hate Speech Detection Multilingual NLP Translation

Leveraging Multilingual Transformers for Hate Speech Detection

2021-01-08 · Sayar Ghosh Roy, Ujwal Narayan, Tathagata Raha, Zubair Abid 외

Detecting and classifying instances of hate in social media text has been a problem of interest in Natural Language Processing in the recent years. Our work leverages state of the art Transformer language models to ident…

feature selection General Classification Hate Speech Detection

Highly Generalizable Models for Multilingual Hate Speech Detection

2022-01-27 · Neha Deshpande, Nicholas Farris, Vidhur Kumar

Hate speech detection has become an important research topic within the past decade. More private corporations are needing to regulate user generated content on different platforms across the globe. In this paper, we int…