paper-with-me

홈 › Papers

Zero-Shot Multi-Label Classification of Bangla Documents: Large Decoders Vs. Classic Encoders

2025-03-04 · Souvika Sarkar, Md. Najib Hasan, Santu Karmaker

Bangla, a language spoken by over 300 million native speakers and ranked as the sixth most spoken language worldwide, presents unique challenges in natural language processing (NLP) due to its complex morphological characteristics and limited resources. While recent Large Decoder Based models (LLMs), such as GPT, LLaMA, and DeepSeek, have demonstrated excellent performance across many NLP tasks, their effectiveness in Bangla remains largely unexplored. In this paper, we establish the first benchmark comparing decoder-based LLMs with classic encoder-based models for Zero-Shot Multi-Label Classification (Zero-Shot-MLC) task in Bangla. Our evaluation of 32 state-of-the-art models reveals that, existing so-called powerful encoders and decoders still struggle to achieve high accuracy on the Bangla Zero-Shot-MLC task, suggesting a need for more research and resources for Bangla NLP.

📄 PDF Abstract BibTeX arXiv:2503.02993

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Weight Decay 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…

Similar Papers 제목 키워드 기반

BanTH: A Multi-label Hate Speech Detection Dataset for Transliterated Bangla

2024-10-17 · Fabiha Haider, Fariha Tanjim Shifat, Md Farhan Ishmam, Deeparghya Dutta Barua 외

The proliferation of transliterated texts in digital spaces has emphasized the need for detecting and classifying hate speech in languages beyond English, particularly in low-resource languages. As online discourse can p…

ClassificationHate Speech DetectionMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+1

Pipeline Enabling Zero-shot Classification for Bangla Handwritten Grapheme

2023-12-01 · Proceedings of the First Workshop on Bangla Language Processing (BLP-2023) 2023 12 · Linsheng Guo, Md Habibur Sifat, Tashin Ahmed

This research investigates Zero-Shot Learning (ZSL), and proposes CycleGAN-based image synthesis and accurate label mapping to build a strong association between labels and graphemes. The objective is to enhance model ac…

Bangla Text DetectionClassificationGrapheme DetectionHandwritten Text Recognition+7

Addressing Data Scarcity in Bangla Fake News Detection: An LLM-Based Dataset Augmentation Approach

2026-05-02 · Ahmed Alfey Sani, Kazi Akib Zaoad, Shefayat E Shams Adib, Md Abdul Muqtadir 외 arxiv

The growing spread of misinformation in digital media highlights the need for reliable fake news detection systems, yet progress in under-resourced languages such as Bangla is limited by small and imbalanced datasets. Th…

Fake News DetectionNews Classification

MixSarc: A Bangla-English Code-Mixed Corpus for Implicit Meaning Identification

2026-02-25 · Kazi Samin Yasar Alam, Md Tanbir Chowdhury, Tamim Ahmed, Ajwad Abrar 외 arxiv

Bangla-English code-mixing is widespread across South Asian social media, yet resources for implicit meaning identification in this setting remain scarce. Existing sentiment and sarcasm models largely focus on monolingua…

Humor Detection

BanglaSentNet: An Explainable Hybrid Deep Learning Framework for Multi-Aspect Sentiment Analysis with Cross-Domain Transfer Learning

2025-11-28 · Ariful Islam, Md Rifat Hossen, Tanvir Mahmud arxiv

Multi-aspect sentiment analysis of Bangla e-commerce reviews remains challenging due to limited annotated datasets, morphological complexity, code-mixing phenomena, and domain shift issues, affecting 300 million Bangla-s…

Domain GeneralizationSentiment AnalysisTransfer LearningFew-Shot Learning