paper-with-me

Papers

Summarizing Indian Languages using Multilingual Transformers based Models

2023-03-29 · Dhaval Taunk, Vasudeva Varma

With the advent of multilingual models like mBART, mT5, IndicBART etc., summarization in low resource Indian languages is getting a lot of attention now a days. But still the number of datasets is low in number. In this work, we (Team HakunaMatata) study how these multilingual models perform on the datasets which have Indian languages as source and target text while performing summarization. We experimented with IndicBART and mT5 models to perform the experiments and report the ROUGE-1, ROUGE-2, ROUGE-3 and ROUGE-4 scores as a performance metric.

📄 PDF Abstract BibTeX arXiv:2303.16657

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Adafactor Adafactor is a stochastic optimization method based on Adam that reduces memory usage while retaining the empirical benefits of…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…

Similar Papers 제목 키워드 기반

MILDSum: A Novel Benchmark Dataset for Multilingual Summarization of Indian Legal Case Judgments

2023-10-28 · Debtanu Datta, Shubham Soni, Rajdeep Mukherjee, Saptarshi Ghosh

Automatic summarization of legal case judgments is a practically important problem that has attracted substantial research efforts in many countries. In the context of the Indian judiciary, there is an additional complex…

Indic-TunedLens: Interpreting Multilingual Models in Indian Languages

2026-01-29 · Mihir Panchal, Deeksha Varshney, Mamta, Asif Ekbal arxiv

Multilingual large language models (LLMs) are increasingly deployed in linguistically diverse regions like India, yet most interpretability tools remain tailored to English. Prior work reveals that LLMs often operate in …

DuDe: Dual-Decoder Multilingual ASR for Indian Languages using Common Label Set

2022-10-30 · Arunkumar A, Mudit Batra, Umesh S

In a multilingual country like India, multilingual Automatic Speech Recognition (ASR) systems have much scope. Multilingual ASR systems exhibit many advantages like scalability, maintainability, and improved performance …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Decoderspeech-recognition+2

Efficient Multilingual Text Classification for Indian Languages

2021-09-01 · RANLP 2021 9 · Salil Aggarwal, Sourav Kumar, Radhika Mamidi

India is one of the richest language hubs on the earth and is very diverse and multilingual. But apart from a few Indian languages, most of them are still considered to be resource poor. Since most of the NLP techniques …

ClassificationMultilingual text classificationtext-classificationText Classification+1

Indic-Transformers: An Analysis of Transformer Language Models for Indian Languages

2020-11-04 · Kushal Jain, Adwait Deshpande, Kumar Shridhar, Felix Laumann 외

Language models based on the Transformer architecture have achieved state-of-the-art performance on a wide range of NLP tasks such as text classification, question-answering, and token classification. However, this perfo…

ClassificationGeneral ClassificationLanguage ModelingLanguage Modelling+5