Question answering using deep learning in low resource Indian language Marathi
Precise answers are extracted from a text for a given input question in a question answering system. Marathi question answering system is created in recent studies by using ontology, rule base and machine learning based approaches. Recently transformer models and transfer learning approaches are used to solve question answering challenges. In this paper we investigate different transformer models for creating a reading comprehension-based Marathi question answering system. We have experimented on different pretrained Marathi language multilingual and monolingual models like Multilingual Representations for Indian Languages (MuRIL), MahaBERT, Indic Bidirectional Encoder Representations from Transformers (IndicBERT) and fine-tuned it on a Marathi reading comprehension-based data set. We got the best accuracy in a MuRIL multilingual model with an EM score of 0.64 and F1 score of 0.74 by fine tuning the model on the Marathi dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Question AnsweringReading ComprehensionTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Breaking Language Barriers: A Question Answering Dataset for Hindi and Marathi
The recent advances in deep-learning have led to the development of highly sophisticated systems with an unquenchable appetite for data. On the other hand, building good deep-learning models for low-resource languages re…
Question AnsweringMahaSQuAD: Bridging Linguistic Divides in Marathi Question-Answering
Question-answering systems have revolutionized information retrieval, but linguistic and cultural boundaries limit their widespread accessibility. This research endeavors to bridge the gap of the absence of efficient QnA…
Information RetrievalQuestion AnsweringTranslationMultitask Finetuning for Improving Neural Machine Translation in Indian Languages
Transformer based language models have led to impressive results across all domains in Natural Language Processing. Pretraining these models on language modeling tasks and finetuning them on downstream tasks such as Text…
Causal Language ModelingLanguage ModelingLanguage ModellingMachine Translation+4BharatBBQ: A Multilingual Bias Benchmark for Question Answering in the Indian Context
Evaluating social biases in language models (LMs) is crucial for ensuring fairness and minimizing the reinforcement of harmful stereotypes in AI systems. Existing benchmarks, such as the Bias Benchmark for Question Answe…
Question Answering"A Passage to India": Pre-trained Word Embeddings for Indian Languages
Dense word vectors or 'word embeddings' which encode semantic properties of words, have now become integral to NLP tasks like Machine Translation (MT), Question Answering (QA), Word Sense Disambiguation (WSD), and Inform…
Information RetrievalMachine TranslationNERQuestion Answering+3