paper-with-me

홈 › Papers

Assessing the Level of Toxicity Against Distinct Groups in Bangla Social Media Comments: A Comprehensive Investigation

2024-09-25 · Mukaffi Bin Moin, Pronay Debnath, Usafa Akther Rifa, Rijeet Bin Anis

Social media platforms have a vital role in the modern world, serving as conduits for communication, the exchange of ideas, and the establishment of networks. However, the misuse of these platforms through toxic comments, which can range from offensive remarks to hate speech, is a concerning issue. This study focuses on identifying toxic comments in the Bengali language targeting three specific groups: transgender people, indigenous people, and migrant people, from multiple social media sources. The study delves into the intricate process of identifying and categorizing toxic language while considering the varying degrees of toxicity: high, medium, and low. The methodology involves creating a dataset, manual annotation, and employing pre-trained transformer models like Bangla-BERT, bangla-bert-base, distil-BERT, and Bert-base-multilingual-cased for classification. Diverse assessment metrics such as accuracy, recall, precision, and F1-score are employed to evaluate the model's effectiveness. The experimental findings reveal that Bangla-BERT surpasses alternative models, achieving an F1-score of 0.8903. This research exposes the complexity of toxicity in Bangla social media dialogues, revealing its differing impacts on diverse demographic groups.

📄 PDF Abstract BibTeX arXiv:2409.17130

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Towards Inclusive Toxic Content Moderation: Addressing Vulnerabilities to Adversarial Attacks in Toxicity Classifiers Tackling LLM-generated Content

2025-09-16 · Shaz Furniturewala, Arkaitz Zubiaga arxiv

The volume of machine-generated content online has grown dramatically due to the widespread use of Large Language Models (LLMs), leading to new challenges for content moderation systems. Conventional content moderation c…

Same Same, But Different: Conditional Multi-Task Learning for Demographic-Specific Toxicity Detection

2023-02-14 · Soumyajit Gupta, Sooyong Lee, Maria De-Arteaga, Matthew Lease

Algorithmic bias often arises as a result of differential subgroup validity, in which predictive relationships vary across groups. For example, in toxic language detection, comments targeting different demographic groups…

Multi-Task Learning

Centering the Margins: Outlier-Based Identification of Harmed Populations in Toxicity Detection

2023-05-24 · Vyoma Raman, Eve Fleisig, Dan Klein

The impact of AI models on marginalized communities has traditionally been measured by identifying performance differences between specified demographic subgroups. Though this approach aims to center vulnerable groups, i…

Outlier Detection

CONDA: a CONtextual Dual-Annotated dataset for in-game toxicity understanding and detection

2021-06-11 · Findings (ACL) 2021 8 · Henry Weld, Guanghao Huang, Jean Lee, Tongshu Zhang 외

Traditional toxicity detection models have focused on the single utterance level without deeper understanding of context. We introduce CONDA, a new dataset for in-game toxic language detection enabling joint intent class…

Dota 2intent-classificationIntent ClassificationIntent Classification and Slot Filling+3

Improving and Assessing the Fidelity of Large Language Models Alignment to Online Communities

2024-08-18 · Minh Duc Chu, Zihao He, Rebecca Dorn, Kristina Lerman

Large language models (LLMs) have shown promise in representing individuals and communities, offering new ways to study complex social dynamics. However, effectively aligning LLMs with specific human groups and systemati…

Models Alignment