paper-with-me

Papers

Question answering using deep learning in low resource Indian language Marathi

2023-09-27 · Dhiraj Amin, Sharvari Govilkar, Sagar Kulkarni

Precise answers are extracted from a text for a given input question in a question answering system. Marathi question answering system is created in recent studies by using ontology, rule base and machine learning based approaches. Recently transformer models and transfer learning approaches are used to solve question answering challenges. In this paper we investigate different transformer models for creating a reading comprehension-based Marathi question answering system. We have experimented on different pretrained Marathi language multilingual and monolingual models like Multilingual Representations for Indian Languages (MuRIL), MahaBERT, Indic Bidirectional Encoder Representations from Transformers (IndicBERT) and fine-tuned it on a Marathi reading comprehension-based data set. We got the best accuracy in a MuRIL multilingual model with an EM score of 0.64 and F1 score of 0.74 by fine tuning the model on the Marathi dataset.

📄 PDF Abstract BibTeX arXiv:2309.15779

Code (0)

등록된 구현이 없습니다.

Tasks

Question AnsweringReading ComprehensionTransfer Learning

Methods 이 논문이 사용한 방법론

BASE 설명 없음

Similar Papers 제목 키워드 기반

Breaking Language Barriers: A Question Answering Dataset for Hindi and Marathi

2023-08-19 · Maithili Sabane, Onkar Litake, Aman Chadha

The recent advances in deep-learning have led to the development of highly sophisticated systems with an unquenchable appetite for data. On the other hand, building good deep-learning models for low-resource languages re…

Question Answering

MahaSQuAD: Bridging Linguistic Divides in Marathi Question-Answering

2024-04-20 · Ruturaj Ghatage, Aditya Kulkarni, Rajlaxmi Patil, Sharvi Endait 외

Question-answering systems have revolutionized information retrieval, but linguistic and cultural boundaries limit their widespread accessibility. This research endeavors to bridge the gap of the absence of efficient QnA…

Information RetrievalQuestion AnsweringTranslation

Multitask Finetuning for Improving Neural Machine Translation in Indian Languages

2021-12-03 · Shaily Desai, Atharva Kshirsagar, Manisha Marathe

Transformer based language models have led to impressive results across all domains in Natural Language Processing. Pretraining these models on language modeling tasks and finetuning them on downstream tasks such as Text…

Causal Language ModelingLanguage ModelingLanguage ModellingMachine Translation+4

BharatBBQ: A Multilingual Bias Benchmark for Question Answering in the Indian Context

2025-08-09 · Aditya Tomar, Nihar Ranjan Sahoo, Pushpak Bhattacharyya arxiv

Evaluating social biases in language models (LMs) is crucial for ensuring fairness and minimizing the reinforcement of harmful stereotypes in AI systems. Existing benchmarks, such as the Bias Benchmark for Question Answe…

Question Answering

"A Passage to India": Pre-trained Word Embeddings for Indian Languages

2021-12-27 · Kumar Saurav, Kumar Saunack, Diptesh Kanojia, Pushpak Bhattacharyya

Dense word vectors or 'word embeddings' which encode semantic properties of words, have now become integral to NLP tasks like Machine Translation (MT), Question Answering (QA), Word Sense Disambiguation (WSD), and Inform…

Information RetrievalMachine TranslationNERQuestion Answering+3