paper-with-me

홈 › Papers

Tuning Traditional Language Processing Approaches for Pashto Text Classification

2023-05-04 · Jawid Ahmad Baktash, Mursal Dawodi, Mohammad Zarif Joya, Nematullah Hassanzada

Today text classification becomes critical task for concerned individuals for numerous purposes. Hence, several researches have been conducted to develop automatic text classification for national and international languages. However, the need for an automatic text categorization system for local languages is felt. The main aim of this study is to establish a Pashto automatic text classification system. In order to pursue this work, we built a Pashto corpus which is a collection of Pashto documents due to the unavailability of public datasets of Pashto text documents. Besides, this study compares several models containing both statistical and neural network machine learning techniques including Multilayer Perceptron (MLP), Support Vector Machine (SVM), K Nearest Neighbor (KNN), decision tree, gaussian na\"ive Bayes, multinomial na\"ive Bayes, random forest, and logistic regression to discover the most effective approach. Moreover, this investigation evaluates two different feature extraction methods including unigram, and Time Frequency Inverse Document Frequency (IFIDF). Subsequently, this research obtained average testing accuracy rate 94% using MLP classification algorithm and TFIDF feature extraction method in this context.

📄 PDF Abstract BibTeX arXiv:2305.03737

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationText Categorizationtext-classificationText Classification

Methods 이 논문이 사용한 방법론

Logistic Regression Logistic Regression, despite its name, is a linear model for classification rather than regression. Logistic regression is also known in the literature as logit regression,…

Similar Papers 제목 키워드 기반

Fine-tuning Whisper for Pashto ASR: strategies and scale

2026-04-07 · Hanif Rahman arxiv

Pashto is absent from Whisper's pre-training corpus despite being one of CommonVoice's largest language collections, leaving off-the-shelf models unusable: all Whisper sizes output Arabic, Dari, or Urdu script on Pashto …

Enhancing NER Performance in Low-Resource Pakistani Languages using Cross-Lingual Data Augmentation

2025-04-07 · Toqeer Ehsan, Thamar Solorio

Named Entity Recognition (NER), a fundamental task in Natural Language Processing (NLP), has shown significant advancements for high-resource languages. However, due to a lack of annotated datasets and limited representa…

Data AugmentationFew-Shot Learningnamed-entity-recognitionNamed Entity Recognition+2

Pashto Common Voice: Building the First Open Speech Corpus for a 60-Million-Speaker Low-Resource Language

2026-03-27 · Hanif Rahman, Shafeeq ur Rehman arxiv

We present the Pashto Common Voice corpus -- the first large-scale, openly licensed speech resource for Pashto, a language with over 60 million native speakers largely absent from open speech technology. Through a commun…

PsOCR: Benchmarking Large Multimodal Models for Optical Character Recognition in Low-resource Pashto Language

2025-05-15 · Ijazul Haq, Yingjie Zhang, Irfan Ali Khan

This paper evaluates the performance of Large Multimodal Models (LMMs) on Optical Character Recognition (OCR) in the low-resource Pashto language. Natural Language Processing (NLP) in Pashto faces several challenges due …

BenchmarkingOptical Character RecognitionOptical Character Recognition (OCR)

Development of a New Image-to-text Conversion System for Pashto, Farsi and Traditional Chinese

2020-05-08 · Marek Rychlik, Dwight Nwaigwe, Yan Han, Dylan Murphy

We report upon the results of a research and prototype building project \emph{Worldly~OCR} dedicated to developing new, more accurate image-to-text conversion software for several languages and writing systems. These inc…

Image to textOptical Character Recognition (OCR)Retrieval