paper-with-me

홈 › Papers

Experimental Evaluation of Deep Learning models for Marathi Text Classification

2021-01-13 · Atharva Kulkarni, Meet Mandhane, Manali Likhitkar, Gayatri Kshirsagar, Jayashree Jagdale, Raviraj Joshi

The Marathi language is one of the prominent languages used in India. It is predominantly spoken by the people of Maharashtra. Over the past decade, the usage of language on online platforms has tremendously increased. However, research on Natural Language Processing (NLP) approaches for Marathi text has not received much attention. Marathi is a morphologically rich language and uses a variant of the Devanagari script in the written form. This works aims to provide a comprehensive overview of available resources and models for Marathi text classification. We evaluate CNN, LSTM, ULMFiT, and BERT based models on two publicly available Marathi text classification datasets and present a comparative analysis. The pre-trained Marathi fast text word embeddings by Facebook and IndicNLP are used in conjunction with word-based models. We show that basic single layer models based on CNN and LSTM coupled with FastText embeddings perform on par with the BERT based models on the available datasets. We hope our paper aids focused research and experiments in the area of Marathi NLP.

📄 PDF Abstract BibTeX arXiv:2101.04899

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationDeep LearningGeneral Classificationtext-classificationText ClassificationWord Embeddings

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Weight Tying Weight Tying improves the performance of language models by tying (sharing) the weights of the embedding and softmax layers. This…
Activation Regularization Activation Regularization (AR), or $L\_{2}$ activation regularization, is regularization performed on activations as opposed to weights. It is usually used in conjunction with…
Embedding Dropout Embedding Dropout is equivalent to performing dropout on the embedding matrix at a word level, where the dropout is broadcast…
DropConnect DropConnect generalizes Dropout by randomly dropping the weights rather than the activations with probability $1-p$. DropConnect…
Temporal Activation Regularization 설명 없음
Variational Dropout Variational Dropout is a regularization technique based on dropout, but uses a variational inference grounded approach. In…
AWD-LSTM ASGD Weight-Dropped LSTM, or AWD-LSTM, is a type of recurrent neural network that employs DropConnect for regularization,…

Similar Papers 제목 키워드 기반

Mono vs Multilingual BERT for Hate Speech Detection and Text Classification: A Case Study in Marathi

2022-04-19 · Abhishek Velankar, Hrushikesh Patil, Raviraj Joshi

Transformers are the most eminent architectures used for a vast range of Natural Language Processing tasks. These models are pre-trained over a large text corpus and are meant to serve state-of-the-art results over tasks…

ArticlesClassificationHate Speech DetectionSentence+5

Curating Stopwords in Marathi: A TF-IDF Approach for Improved Text Analysis and Information Retrieval

2024-06-16 · Rohan Chavan, Gaurav Patil, Vishal Madle, Raviraj Joshi

Stopwords are commonly used words in a language that are often considered to be of little value in determining the meaning or significance of a document. These words occur frequently in most texts and don't provide much …

Information RetrievalRetrievalSentiment Analysistext-classification+1

L3Cube-MahaCorpus and MahaBERT: Marathi Monolingual Corpus, Marathi BERT Language Models, and Resources

2022-02-02 · WILDRE (LREC) 2022 6 · Raviraj Joshi

We present L3Cube-MahaCorpus a Marathi monolingual data set scraped from different internet sources. We expand the existing Marathi monolingual corpus with 24.8M sentences and 289M tokens. We further present, MahaBERT, M…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+4

L3Cube-MahaNews: News-based Short Text and Long Document Classification Datasets in Marathi

2024-04-28 · Saloni Mittal, Vidula Magdum, Omkar Dhekane, Sharayu Hiwarkhedkar 외

The availability of text or topic classification datasets in the low-resource Marathi language is limited, typically consisting of fewer than 4 target labels, with some achieving nearly perfect accuracy. In this work, we…

ArticlesDocument Classificationtext-classificationText Classification+1

Mono vs Multilingual BERT: A Case Study in Hindi and Marathi Named Entity Recognition

2022-03-24 · Onkar Litake, Maithili Sabane, Parth Patil, Aparna Ranade 외

Named entity recognition (NER) is the process of recognising and classifying important information (entities) in text. Proper nouns, such as a person's name, an organization's name, or a location's name, are examples of …

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER