paper-with-me

Papers

Classification Benchmarks for Under-resourced Bengali Language based on Multichannel Convolutional-LSTM Network

2020-04-11 · Md. Rezaul Karim, Bharathi Raja Chakravarthi, John P. McCrae, Michael Cochez

Exponential growths of social media and micro-blogging sites not only provide platforms for empowering freedom of expressions and individual voices but also enables people to express anti-social behaviour like online harassment, cyberbullying, and hate speech. Numerous works have been proposed to utilize these data for social and anti-social behaviours analysis, document characterization, and sentiment analysis by predicting the contexts mostly for highly resourced languages such as English. However, there are languages that are under-resources, e.g., South Asian languages like Bengali, Tamil, Assamese, Telugu that lack of computational resources for the NLP tasks. In this paper, we provide several classification benchmarks for Bengali, an under-resourced language. We prepared three datasets of expressing hate, commonly used topics, and opinions for hate speech detection, document classification, and sentiment analysis, respectively. We built the largest Bengali word embedding models to date based on 250 million articles, which we call BengFastText. We perform three different experiments, covering document classification, sentiment analysis, and hate speech detection. We incorporate word embeddings into a Multichannel Convolutional-LSTM (MConv-LSTM) network for predicting different types of hate speech, document classification, and sentiment analysis. Experiments demonstrate that BengFastText can capture the semantics of words from respective contexts correctly. Evaluations against several baseline embedding models, e.g., Word2Vec and GloVe yield up to 92.30%, 82.25%, and 90.45% F1-scores in case of document classification, sentiment analysis, and hate speech detection, respectively during 5-fold cross-validation tests.

📄 PDF Abstract BibTeX arXiv:2004.07807

Code (1)

rezacsedu/BengFastText 공식 구현

Tasks

ArticlesClassificationDocument ClassificationGeneral ClassificationHate Speech DetectionSentiment AnalysisWord Embeddings

Methods 이 논문이 사용한 방법론

GloVe GloVe Embeddings are a type of word embedding that encode the co-occurrence probability ratio between two words as vector differences. GloVe uses a weighted least squares…

Similar Papers 제목 키워드 기반

BenLLMEval: A Comprehensive Evaluation into the Potentials and Pitfalls of Large Language Models on Bengali NLP

2023-09-22 · Mohsinul Kabir, Mohammed Saidul Islam, Md Tahmid Rahman Laskar, Mir Tafseer Nayeem 외

Large Language Models (LLMs) have emerged as one of the most important breakthroughs in NLP for their impressive skills in language generation and other language-specific tasks. Though LLMs have been evaluated in various…

Abstractive Text SummarizationNatural Language InferenceQuestion AnsweringSentiment Analysis+5

BengaliFig: A Low-Resource Challenge for Figurative and Culturally Grounded Reasoning in Bengali

2025-11-25 · Abdullah Al Sefat arxiv

Large language models excel on broad multilingual benchmarks but remain to be evaluated extensively in figurative and culturally grounded reasoning, especially in low-resource contexts. We present BengaliFig, a compact y…

DeepHateExplainer: Explainable Hate Speech Detection in Under-resourced Bengali Language

2020-12-28 · Md. Rezaul Karim, Sumon Kanti Dey, Tanhim Islam, Sagor Sarker 외

The exponential growths of social media and micro-blogging sites not only provide platforms for empowering freedom of expressions and individual voices, but also enables people to express anti-social behaviour like onlin…

Hate Speech DetectionWord Embeddings

Prompting with Sign Parameters for Low-resource Sign Language Instruction Generation

2025-08-22 · Md Tariquzzaman, Md Farhan Ishmam, Saiyma Sittul Muna, Md Kamrul Hasan 외 arxiv

Sign Language (SL) enables two-way communication for the deaf and hard-of-hearing community, yet many sign languages remain under-resourced in the AI space. Sign Language Instruction Generation (SLIG) produces step-by-st…

Adapting Word Embeddings to New Languages with Morphological and Phonological Subword Representations

2018-08-28 · EMNLP 2018 10 · Aditi Chaudhary, Chunting Zhou, Lori Levin, Graham Neubig 외

Much work in Natural Language Processing (NLP) has been for resource-rich languages, making generalization to new, less-resourced languages challenging. We present two approaches for improving generalization to low-resou…

AvgMachine Translationnamed-entity-recognitionNamed Entity Recognition+5