Classification of Code-Mixed Text Using Capsule Networks
A major challenge in analysing social me-dia data belonging to languages that use non-English script is its code-mixed nature. Recentresearch has presented state-of-the-art contex-tual embedding models (both monolingual s.a.BERT and multilingual s.a.XLM-R) as apromising approach. In this paper, we showthat the performance of such embedding mod-els depends on multiple factors, such as thelevel of code-mixing in the dataset, and thesize of the training dataset. We empiricallyshow that a newly introduced Capsule+biGRUclassifier could outperform a classifier built onthe English-BERT as well as XLM-R just witha training dataset of about 6500 samples forthe Sinhala-English code-mixed data.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationXLM-RMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Investigating Capsule Networks with Dynamic Routing for Text Classification
In this study, we explore capsule networks with dynamic routing for text classification. We propose three strategies to stabilize the dynamic routing process to alleviate the disturbance of some noise capsules which may …
ClassificationGeneral ClassificationMulti-Label Text ClassificationSentiment Analysis+2Hierarchical Multi-label Classification of Text with Capsule Networks
Capsule networks have been shown to demonstrate good performance on structured data in the area of visual inference. In this paper we apply and compare simple shallow capsule networks for hierarchical multi-label text cl…
AttributeClassificationGeneral ClassificationHierarchical Multi-label Classification+6Text Classification using Capsules
This paper presents an empirical exploration of the use of capsule networks for text classification. While it has been shown that capsule networks are effective for image classification, their validity in the domain of t…
ClassificationGeneral Classificationimage-classificationImage Classification+2Dual-State Capsule Networks for Text Classification
Text classification systems based on contextual embeddings are not viable options for many of the low resource languages. On the other hand, recently introduced capsule networks have shown performance in par with these t…
ClassificationLanguage ModelingLanguage ModellingSentence+2Transfer Capsule Network for Aspect Level Sentiment Classification
Aspect-level sentiment classification aims to determine the sentiment polarity of a sentence towards an aspect. Due to the high cost in annotation, the lack of aspect-level labeled data becomes a major obstacle in this a…
ClassificationGeneral ClassificationSentenceSentiment Analysis+2