paper-with-me

홈 › Papers

Hate Speech Detection in Roman Urdu

2021-08-05 · Moin Khan, Khurram Shahzad, Kamran Malik

Hate speech is a specific type of controversial content that is widely legislated as a crime that must be identified and blocked. However, due to the sheer volume and velocity of the Twitter data stream, hate speech detection cannot be performed manually. To address this issue, several studies have been conducted for hate speech detection in European languages, whereas little attention has been paid to low-resource South Asian languages, making the social media vulnerable for millions of users. In particular, to the best of our knowledge, no study has been conducted for hate speech detection in Roman Urdu text, which is widely used in the sub-continent. In this study, we have scrapped more than 90,000 tweets and manually parsed them to identify 5,000 Roman Urdu tweets. Subsequently, we have employed an iterative approach to develop guidelines and used them for generating the Hate Speech Roman Urdu 2020 corpus. The tweets in the this corpus are classified at three levels: Neutral-Hostile, Simple-Complex, and Offensive-Hate speech. As another contribution, we have used five supervised learning techniques, including a deep learning technique, to evaluate and compare their effectiveness for hate speech detection. The results show that Logistic Regression outperformed all other techniques, including deep learning techniques for the two levels of classification, by achieved an F1 score of 0.906 for distinguishing between Neutral-Hostile tweets, and 0.756 for distinguishing between Offensive-Hate speech tweets.

📄 PDF Abstract BibTeX arXiv:2108.02830

Code (0)

등록된 구현이 없습니다.

Tasks

Hate Speech Detection

Methods 이 논문이 사용한 방법론

Logistic Regression Logistic Regression, despite its name, is a linear model for classification rather than regression. Logistic regression is also known in the literature as logit regression,…

Similar Papers 제목 키워드 기반

Exploring Data Augmentation Strategies for Hate Speech Detection in Roman Urdu

2022-06-01 · LREC 2022 6 · Ubaid Azam, Hammad Rizwan, Asim Karim

In an era where social media platform users are growing rapidly, there has been a marked increase in hateful content being generated; to combat this, automatic hate speech detection systems are a necessity. For this purp…

Data AugmentationHate Speech Detection

Hate-Speech and Offensive Language Detection in Roman Urdu

2020-11-01 · EMNLP 2020 11 · Hammad Rizwan, Muhammad Haroon Shakeel, Asim Karim

The task of automatic hate-speech and offensive language detection in social media content is of utmost importance due to its implications in unprejudiced society concerning race, gender, or religion. Existing research i…

Transfer Learning

'Ghaib in Translation' aka Unseen Harm: Measuring Cross-Script Safety Inconsistency with 'Missed-in-Urdu' Scores in LLM Hate Speech Detection

2026-08-25 · Fawzia Zehra, Kara-Isitt, Sonal Khosla, Stephen Swift arxiv

Urdu, the world's tenth most spoken language with 246 million speakers, remains almost entirely absent from mainstream LLM safety evaluation and nine years of WOAH proceedings. To investigate whether this absence has mea…

Hate Speech Detection

Multilingual Hate Speech Detection in Social Media Using Translation-Based Approaches with Large Language Models

2025-06-09 · Muhammad Usman, Muhammad Ahmad, M. Shahiki Tash, Irina Gelbukh 외

Social media platforms are critical spaces for public discourse, shaping opinions and community dynamics, yet their widespread use has amplified harmful content, particularly hate speech, threatening online safety and in…

Hate Speech Detection

Hate Speech and Offensive Language Detection in Bengali

2022-10-07 · Mithun Das, Somnath Banerjee, Punyajoy Saha, Animesh Mukherjee

Social media often serves as a breeding ground for various hateful and offensive content. Identifying such content on social media is crucial due to its impact on the race, gender, or religion in an unprejudiced society.…

Hate Speech Detection