paper-with-me

Papers

Transformer-based Model for Word Level Language Identification in Code-mixed Kannada-English Texts

2022-11-26 · Atnafu Lambebo Tonja, Mesay Gemeda Yigezu, Olga Kolesnikova, Moein Shahiki Tash, Grigori Sidorov, Alexander Gelbuk

Using code-mixed data in natural language processing (NLP) research currently gets a lot of attention. Language identification of social media code-mixed text has been an interesting problem of study in recent years due to the advancement and influences of social media in communication. This paper presents the Instituto Polit\'ecnico Nacional, Centro de Investigaci\'on en Computaci\'on (CIC) team's system description paper for the CoLI-Kanglish shared task at ICON2022. In this paper, we propose the use of a Transformer based model for word-level language identification in code-mixed Kannada English texts. The proposed model on the CoLI-Kenglish dataset achieves a weighted F1-score of 0.84 and a macro F1-score of 0.61.

📄 PDF Abstract BibTeX arXiv:2211.14459

Code (0)

등록된 구현이 없습니다.

Tasks

Language Identification

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Adam 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Position-Wise Feed-Forward Layer 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Word-level Language Identification Using Subword Embeddings for Code-mixed Bangla-English Social Media Data

2022-06-01 · DCLRL (LREC) 2022 6 · Aparna Dutta

This paper reports work on building a word-level language identification (LID) model for code-mixed Bangla-English social media data using subword embeddings, with an ultimate goal of using this LID module as the first s…

Language IdentificationPOS

Combining ResNet and Transformer for Chinese Grammatical Error Diagnosis

2020-10-01 · Shaolei Wang, Baoxin Wang, Jiefu Gong, Zhongyuan Wang 외

Grammatical error diagnosis is an important task in natural language processing. This paper introduces our system at NLPTEA-2020 Task: Chinese Grammatical Error Diagnosis (CGED). CGED aims to diagnose four types of gramm…

Position

Subword-Level Language Identification for Intra-Word Code-Switching

2019-04-03 · NAACL 2019 6 · Manuel Mager, Özlem Çetinoğlu, Katharina Kann

Language identification for code-switching (CS), the phenomenon of alternating between two or more languages in conversations, has traditionally been approached under the assumption of a single language per token. Howeve…

Language Identification

Hierarchical Character-Word Models for Language Identification

2016-08-10 · WS 2016 11 · Aaron Jaech, George Mulcaire, Shobhit Hathi, Mari Ostendorf 외

Social media messages' brevity and unconventional spelling pose a challenge to language identification. We introduce a hierarchical model that learns character and contextualized word-level representations for language i…

Language Identification

Transliteration for Low-Resource Code-Switching Texts: Building an Automatic Cyrillic-to-Latin Converter for Tatar

2021-06-01 · NAACL (CALCS) 2021 6 · Chihiro Taguchi, Yusuke Sakai, Taro Watanabe

We introduce a Cyrillic-to-Latin transliterator for the Tatar language based on subword-level language identification. The transliteration is a challenging task due to the following two reasons. First, because modern Tat…

Language IdentificationTransliteration