paper-with-me

홈 › Papers

Enhancing Low Resource NER Using Assisting Language And Transfer Learning

2023-06-10 · Maithili Sabane, Aparna Ranade, Onkar Litake, Parth Patil, Raviraj Joshi, Dipali Kadam

Named Entity Recognition (NER) is a fundamental task in NLP that is used to locate the key information in text and is primarily applied in conversational and search systems. In commercial applications, NER or comparable slot-filling methods have been widely deployed for popular languages. NER is used in applications such as human resources, customer service, search engines, content classification, and academia. In this paper, we draw focus on identifying name entities for low-resource Indian languages that are closely related, like Hindi and Marathi. We use various adaptations of BERT such as baseBERT, AlBERT, and RoBERTa to train a supervised NER model. We also compare multilingual models with monolingual models and establish a baseline. In this work, we show the assisting capabilities of the Hindi and Marathi languages for the NER task. We show that models trained using multiple languages perform better than a single language. However, we also observe that blind mixing of all datasets doesn't necessarily provide improvements and data selection methods may be required.

📄 PDF Abstract BibTeX arXiv:2306.06477

Code (0)

등록된 구현이 없습니다.

Tasks

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERslot-fillingSlot FillingTransfer Learning

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Focus 설명 없음

Similar Papers 제목 키워드 기반

Addressing word-order Divergence in Multilingual Neural Machine Translation for extremely Low Resource Languages

2018-11-01 · NAACL 2019 6 · Rudra Murthy V, Anoop Kunchukuttan, Pushpak Bhattacharyya

Transfer learning approaches for Neural Machine Translation (NMT) train a NMT model on the assisting-target language pair (parent model) which is later fine-tuned for the source-target language pair of interest (child mo…

Machine TranslationNMTSentenceTransfer Learning+1

Neural Machine Translation in Low-Resource Setting: a Case Study in English-Marathi Pair

2021-08-01 · MTSummit 2021 8 · Aakash Banerjee, Aditya Jain, Shivam Mhaskar, Sourabh Dattatray Deoghare 외

In this paper and we explore different techniques of overcoming the challenges of low-resource in Neural Machine Translation (NMT) and specifically focusing on the case of English-Marathi NMT. NMT systems require a large…

Machine TranslationNMTTransfer LearningTranslation

CUTE: A Multilingual Dataset for Enhancing Cross-Lingual Knowledge Transfer in Low-Resource Languages

2025-09-21 · Wenhao Zhuang, Yuan Sun arxiv

Large Language Models (LLMs) demonstrate exceptional zero-shot capabilities in various NLP tasks, significantly enhancing user experience and efficiency. However, this advantage is primarily limited to resource-rich lang…

Cross-Lingual TransferMachine Translation

Assisting Language Learners: Automated Trans-Lingual Definition Generation via Contrastive Prompt Learning

2023-06-09 · Hengyuan Zhang, Dawei Li, Yanran Li, Chenming Shang 외

The standard definition generation task requires to automatically produce mono-lingual definitions (e.g., English definitions for English words), but ignores that the generated definitions may also consist of unfamiliar …

Machine TranslationPrompt Learning

BayLing 2: A Multilingual Large Language Model with Efficient Language Alignment

2024-11-25 · Shaolei Zhang, Kehao Zhang, Qingkai Fang, Shoutao Guo 외

Large language models (LLMs), with their powerful generative capabilities and vast knowledge, empower various tasks in everyday life. However, these abilities are primarily concentrated in high-resource languages, leavin…

Language ModelingLanguage ModellingLarge Language ModelTransfer Learning