Automatic Textual Normalization for Hate Speech Detection
Social media data is a valuable resource for research, yet it contains a wide range of non-standard words (NSW). These irregularities hinder the effective operation of NLP tools. Current state-of-the-art methods for the Vietnamese language address this issue as a problem of lexical normalization, involving the creation of manual rules or the implementation of multi-staged deep learning frameworks, which necessitate extensive efforts to craft intricate rules. In contrast, our approach is straightforward, employing solely a sequence-to-sequence (Seq2Seq) model. In this research, we provide a dataset for textual normalization, comprising 2,181 human-annotated comments with an inter-annotator agreement of 0.9014. By leveraging the Seq2Seq model for textual normalization, our results reveal that the accuracy achieved falls slightly short of 70%. Nevertheless, textual normalization enhances the accuracy of the Hate Speech Detection (HSD) task by approximately 2%, demonstrating its potential to improve the performance of complex NLP tasks. Our dataset is accessible for research purposes.
Code (1)
Tasks
Hate Speech DetectionLexical NormalizationVietnamese Hate Speech DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Assessing the impact of contextual information in hate speech detection
In recent years, hate speech has gained great relevance in social networks and other virtual media because of its intensity and its relationship with violent acts against members of protected groups. Due to the great amo…
Hate Speech DetectionTowards Automatic Online Hate Speech Intervention Generation using Pretrained Language Model
Social media harbours substantial toxic and hateful conversations today. Curbing them has emerged as a critical challenge for governments and organizations globally. Prior research has primarily concentrated on the detec…
Dialogue GenerationLanguage ModelingLanguage ModellingText GenerationDeepHate: Hate Speech Detection via Multi-Faceted Text Representations
Online hate speech is an important issue that breaks the cohesiveness of online social communities and even raises public safety concerns in our societies. Motivated by this rising issue, researchers have developed many …
Hate Speech DetectionWord EmbeddingsL-HSAB: A Levantine Twitter Dataset for Hate Speech and Abusive Language
Hate speech and abusive language have become a common phenomenon on Arabic social media. Automatic hate speech and abusive detection systems can facilitate the prohibition of toxic textual contents. The complexity, infor…
Abusive LanguageHate Speech DetectionSurfacing contextual hate speech words within social media
Social media platforms have recently seen an increase in the occurrence of hate speech discourse which has led to calls for improved detection methods. Most of these rely on annotated data, keywords, and a classification…
Community DetectionGeneral ClassificationHate Speech Detection