paper-with-me

Papers

Topic Modeling in Marathi

2025-02-04 · Sanket Shinde, Raviraj Joshi

While topic modeling in English has become a prevalent and well-explored area, venturing into topic modeling for Indic languages remains relatively rare. The limited availability of resources, diverse linguistic structures, and unique challenges posed by Indic languages contribute to the scarcity of research and applications in this domain. Despite the growing interest in natural language processing and machine learning, there exists a noticeable gap in the comprehensive exploration of topic modeling methodologies tailored specifically for languages such as Hindi, Marathi, Tamil, and others. In this paper, we examine several topic modeling approaches applied to the Marathi language. Specifically, we compare various BERT and non-BERT approaches, including multilingual and monolingual BERT models, using topic coherence and topic diversity as evaluation metrics. Our analysis provides insights into the performance of these approaches for Marathi language topic modeling. The key finding of the paper is that BERTopic, when combined with BERT models trained on Indic languages, outperforms LDA in terms of topic modeling performance.

📄 PDF Abstract BibTeX arXiv:2502.02100

Code (0)

등록된 구현이 없습니다.

Tasks

Diversity

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Weight Decay 설명 없음
WordPiece 설명 없음

Similar Papers 제목 키워드 기반

L3Cube-MahaNews: News-based Short Text and Long Document Classification Datasets in Marathi

2024-04-28 · Saloni Mittal, Vidula Magdum, Omkar Dhekane, Sharayu Hiwarkhedkar 외

The availability of text or topic classification datasets in the low-resource Marathi language is limited, typically consisting of fewer than 4 target labels, with some achieving nearly perfect accuracy. In this work, we…

ArticlesDocument Classificationtext-classificationText Classification+1

L3Cube-MahaNLP: Marathi Natural Language Processing Datasets, Models, and Library

2022-05-29 · Raviraj Joshi

Despite being the third most popular language in India, the Marathi language lacks useful NLP resources. Moreover, popular NLP libraries do not have support for the Marathi language. With L3Cube-MahaNLP, we aim to build …

Hate Speech DetectionLanguage ModelingLanguage Modellingnamed-entity-recognition+3

On Importance of Pruning and Distillation for Efficient Low Resource NLP

2024-09-21 · Aishwarya Mirashi, Purva Lingayat, Srushti Sonavane, Tejas Padhiyar 외

The rise of large transformer models has revolutionized Natural Language Processing, leading to significant advances in tasks like text classification. However, this progress demands substantial computational resources, …

Document ClassificationGPUKnowledge Distillationtext-classification+1

L3Cube-MahaCorpus and MahaBERT: Marathi Monolingual Corpus, Marathi BERT Language Models, and Resources

2022-02-02 · WILDRE (LREC) 2022 6 · Raviraj Joshi

We present L3Cube-MahaCorpus a Marathi monolingual data set scraped from different internet sources. We expand the existing Marathi monolingual corpus with 24.8M sentences and 289M tokens. We further present, MahaBERT, M…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+4

English-Marathi Neural Machine Translation for LoResMT 2021

2021-08-01 · MTSummit 2021 8 · Vandan Mujadia, Dipti Misra Sharma

In this paper, we (team - oneNLP-IIITH) describe our Neural Machine Translation approaches for English-Marathi (both direction) for LoResMT-20211 . We experimented with transformer based Neural Machine Translation and ex…

Machine TranslationMORPHPOSTranslation