paper-with-me

Papers

Text classification dataset and analysis for Uzbek language

2023-02-28 · Elmurod Kuriyozov, Ulugbek Salaev, Sanatbek Matlatipov, Gayrat Matlatipov

Text classification is an important task in Natural Language Processing (NLP), where the goal is to categorize text data into predefined classes. In this study, we analyse the dataset creation steps and evaluation techniques of multi-label news categorisation task as part of text classification. We first present a newly obtained dataset for Uzbek text classification, which was collected from 10 different news and press websites and covers 15 categories of news, press and law texts. We also present a comprehensive evaluation of different models, ranging from traditional bag-of-words models to deep learning architectures, on this newly created dataset. Our experiments show that the Recurrent Neural Network (RNN) and Convolutional Neural Network (CNN) based models outperform the rule-based models. The best performance is achieved by the BERTbek model, which is a transformer-based BERT model trained on the Uzbek corpus. Our findings provide a good baseline for further research in Uzbek text classification.

📄 PDF Abstract BibTeX arXiv:2302.14494

Code (1)

elmurod1202/textclassification 공식 구현 tf

Tasks

Classificationtext-classificationText Classification

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Weight Decay 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
WordPiece 설명 없음

Similar Papers 제목 키워드 기반

Uzbek affix finite state machine for stemming

2022-05-20 · Maksud Sharipov, Ulugbek Salaev

This work presents a morphological analyzer for the Uzbek language using a finite state machine. The proposed methodology is a morphologic analysis of Uzbek words by using an affix striping to find a root and without inc…

Morphological Analysis

UzbekTagger: The rule-based POS tagger for Uzbek language

2023-01-30 · Maksud Sharipov, Elmurod Kuriyozov, Ollabergan Yuldashev, Ogabek Sobirov

This research paper presents a part-of-speech (POS) annotated dataset and tagger tool for the low-resource Uzbek language. The dataset includes 12 tags, which were used to develop a rule-based POS-tagger tool. The corpus…

Language ModelingLanguage ModellingMachine TranslationPOS+6

Accuracy of the Uzbek stop words detection: a case study on "School corpus"

2022-09-15 · Khabibulla Madatov, Shukurla Bekchanov, Jernej Vičič

Stop words are very important for information retrieval and text analysis investigation tasks of natural language processing. Current work presents a method to evaluate the quality of a list of stop words aimed at automa…

Information RetrievalRetrievalSentence

BBPOS: BERT-based Part-of-Speech Tagging for Uzbek

2025-01-17 · Latofat Bobojonova, Arofat Akhundjanova, Phil Ostheimer, Sophie Fellenz

This paper advances NLP research for the low-resource Uzbek language by evaluating two previously untested monolingual Uzbek BERT models on the part-of-speech (POS) tagging task and introducing the first publicly availab…

Part-Of-Speech TaggingPOSPOS TaggingSensitivity

Development of a rule-based lemmatization algorithm through Finite State Machine for Uzbek language

2022-10-28 · Maksud Sharipov, Ogabek Sobirov

Lemmatization is one of the core concepts in natural language processing, thus creating a lemmatization tool is an important task. This paper discusses the construction of a lemmatization algorithm for the Uzbek language…

LEMMALemmatization