paper-with-me

Papers

AsNER -- Annotated Dataset and Baseline for Assamese Named Entity recognition

2022-07-07 · Dhrubajyoti Pathak, Sukumar Nandi, Priyankoo Sarmah

We present the AsNER, a named entity annotation dataset for low resource Assamese language with a baseline Assamese NER model. The dataset contains about 99k tokens comprised of text from the speech of the Prime Minister of India and Assamese play. It also contains person names, location names and addresses. The proposed NER dataset is likely to be a significant resource for deep neural based Assamese language processing. We benchmark the dataset by training NER models and evaluating using state-of-the-art architectures for supervised named entity recognition (NER) such as Fasttext, BERT, XLM-R, FLAIR, MuRIL etc. We implement several baseline approaches with state-of-the-art sequence tagging Bi-LSTM-CRF architecture. The highest F1-score among all baselines achieves an accuracy of 80.69% when using MuRIL as a word embedding method. The annotated dataset and the top performing model are made publicly available.

📄 PDF Abstract BibTeX arXiv:2207.03422

Code (0)

등록된 구현이 없습니다.

Tasks

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERXLM-R

Methods 이 논문이 사용한 방법론

Attention 설명 없음
XLM-R XLM-R
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Weight Decay 설명 없음

Similar Papers 제목 키워드 기반

AsNER - Annotated Dataset and Baseline for Assamese Named Entity recognition

2022-06-01 · LREC 2022 6 · Dhrubajyoti Pathak, Sukumar Nandi, Priyankoo Sarmah

We present the AsNER, a named entity annotation dataset for low resource Assamese language with a baseline Assamese NER model. The dataset contains about 99k tokens comprised of text from the speech of the Prime Minister…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1

A Survey of Named Entity Recognition in Assamese and other Indian Languages

2014-07-09 · Gitimoni Talukdar, Pranjal Protim Borah, Arup Baruah

Named Entity Recognition is always important when dealing with major Natural Language Processing tasks such as information extraction, question-answering, machine translation, document summarization etc so in this paper …

Document SummarizationMachine Translationnamed-entity-recognitionNamed Entity Recognition+3

Development of Assamese Rule based Stemmer using WordNet

2019-07-01 · GWC 2019 7 · Jumi Sarmah, Shikhar Kumar Sarma, Anup Kumar Barman

Stemming is a technique that reduces any inflected word to its root form. Assamese is a morphologically rich, scheduled Indian language. There are various forms of suffixes applied to a word in various contexts. Such inf…

Enhancing Assamese NLP Capabilities: Introducing a Centralized Dataset Repository

2024-10-15 · S. Tamang, D. J. Bora

This paper introduces a centralized, open-source dataset repository designed to advance NLP and NMT for Assamese, a low-resource language. The repository, available at GitHub, supports various tasks like sentiment analys…

DiversityMachine Translationnamed-entity-recognitionNamed Entity Recognition+4

Image Caption Generation Framework for Assamese News using Attention Mechanism

2021-12-01 · ICON 2021 12 · Ringki Das, Thoudam Doren Singh

Automatic caption generation is an artificial intelligence problem that falls at the intersection of computer vision and natural language processing. Although significant works have been reported in image captioning, the…

Caption GenerationDecoderImage Captioning